Duckietown Challenges Home Challenges Submissions

Evaluator 4873

ID4873
evaluatornogpu-prod-05
ownerI don't have one πŸ˜€
machinenogpu-prod_b1178707883f
processnogpu-prod-05_b1178707883f
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success43 53902
# timeout1 58144
# failed8 54321
# error
# aborted3 57166
# host-error43 54011
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
581449358Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-05----No reset possible
581259377Jerome LabonteΒ πŸ‡¨πŸ‡¦real-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:17:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8972007506071495
survival_time_median21.775000000000176
deviation-center-line_median0.7745675628933324
in-drivable-lane_median9.800000000000114


other stats
agent_compute-ego0_max0.013541884060147443
agent_compute-ego0_mean0.01274619172964846
agent_compute-ego0_median0.012514173388343867
agent_compute-ego0_min0.012414536081758656
complete-iteration_max0.2062635630892034
complete-iteration_mean0.18717518341599448
complete-iteration_median0.18599883419616145
complete-iteration_min0.17043950218245152
deviation-center-line_max1.8290084791172143
deviation-center-line_mean0.9555829572269894
deviation-center-line_min0.4441882240040786
deviation-heading_max11.359476052666103
deviation-heading_mean5.312862543117937
deviation-heading_median4.081091766506485
deviation-heading_min1.7297905867926744
driven_any_max10.556065977065236
driven_any_mean5.361567452647126
driven_any_median4.07414080213777
driven_any_min2.7419222292477254
driven_lanedir_consec_max4.277788981374242
driven_lanedir_consec_mean2.390288307970417
driven_lanedir_consec_min1.4889627492931288
driven_lanedir_max4.277788981374242
driven_lanedir_mean2.7287825303049944
driven_lanedir_median2.4007920922079027
driven_lanedir_min1.8357569554299311
get_duckie_state_max1.528578733623673e-06
get_duckie_state_mean1.4051622760674756e-06
get_duckie_state_median1.409057227121948e-06
get_duckie_state_min1.273955916402334e-06
get_robot_state_max0.0038314252769222463
get_robot_state_mean0.0037081873834827416
get_robot_state_median0.0037252925201917385
get_robot_state_min0.0035507392166252423
get_state_dump_max0.0047445905969498
get_state_dump_mean0.0046795687154200915
get_state_dump_median0.004681398110494965
get_state_dump_min0.004610888043740638
get_ui_image_max0.03497652541425891
get_ui_image_mean0.03095919625309602
get_ui_image_median0.03104410090815904
get_ui_image_min0.026772057781807093
in-drivable-lane_max33.74999999999941
in-drivable-lane_mean14.299999999999924
in-drivable-lane_min3.850000000000051
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.7419222292477254, "get_ui_image": 0.02964699217613707, "step_physics": 0.1077374813404489, "survival_time": 11.700000000000031, "driven_lanedir": 1.8357569554299311, "get_state_dump": 0.0047445905969498, "get_robot_state": 0.003721048476848197, "sim_render-ego0": 0.00389036219170753, "get_duckie_state": 1.4122496259973403e-06, "in-drivable-lane": 3.850000000000051, "deviation-heading": 1.7297905867926744, "agent_compute-ego0": 0.012527121888830308, "complete-iteration": 0.17647607580144353, "set_robot_commands": 0.0022198514735445062, "deviation-center-line": 0.4441882240040786, "driven_lanedir_consec": 1.8357569554299311, "sim_compute_sim_state": 0.009901054869306848, "sim_compute_performance-ego0": 0.0020033572582488363}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.648106318853695, "get_ui_image": 0.03497652541425891, "step_physics": 0.1326390818545693, "survival_time": 19.900000000000148, "driven_lanedir": 2.8429396386314374, "get_state_dump": 0.004610888043740638, "get_robot_state": 0.0035507392166252423, "sim_render-ego0": 0.00375141535785264, "get_duckie_state": 1.273955916402334e-06, "in-drivable-lane": 5.350000000000051, "deviation-heading": 5.097169757650423, "agent_compute-ego0": 0.012414536081758656, "complete-iteration": 0.2062635630892034, "set_robot_commands": 0.0021566974190542275, "deviation-center-line": 0.9749501418493534, "driven_lanedir_consec": 1.4889627492931288, "sim_compute_sim_state": 0.010177354764818848, "sim_compute_performance-ego0": 0.0019047296136841735}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.500175285421846, "get_ui_image": 0.03244120964018101, "step_physics": 0.120539352360657, "survival_time": 23.6500000000002, "driven_lanedir": 1.958644545784368, "get_state_dump": 0.004661221544450848, "get_robot_state": 0.00372953656353528, "sim_render-ego0": 0.004003709378624767, "get_duckie_state": 1.4058648282465553e-06, "in-drivable-lane": 14.250000000000178, "deviation-heading": 3.0650137753625466, "agent_compute-ego0": 0.013541884060147443, "complete-iteration": 0.19552159259087928, "set_robot_commands": 0.002258712732339207, "deviation-center-line": 0.5741849839373115, "driven_lanedir_consec": 1.958644545784368, "sim_compute_sim_state": 0.012222712553000148, "sim_compute_performance-ego0": 0.002036181180286005}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.556065977065236, "get_ui_image": 0.026772057781807093, "step_physics": 0.10752817812212104, "survival_time": 59.99999999999873, "driven_lanedir": 4.277788981374242, "get_state_dump": 0.004701574676539082, "get_robot_state": 0.0038314252769222463, "sim_render-ego0": 0.003977181413191542, "get_duckie_state": 1.528578733623673e-06, "in-drivable-lane": 33.74999999999941, "deviation-heading": 11.359476052666103, "agent_compute-ego0": 0.01250122488785743, "complete-iteration": 0.17043950218245152, "set_robot_commands": 0.0023268291495622544, "deviation-center-line": 1.8290084791172143, "driven_lanedir_consec": 4.277788981374242, "sim_compute_sim_state": 0.006626869022201043, "sim_compute_performance-ego0": 0.0020836090465866457}}
set_robot_commands_max0.0023268291495622544
set_robot_commands_mean0.002240522693625049
set_robot_commands_median0.002239282102941857
set_robot_commands_min0.0021566974190542275
sim_compute_performance-ego0_max0.0020836090465866457
sim_compute_performance-ego0_mean0.002006969274701415
sim_compute_performance-ego0_median0.0020197692192674204
sim_compute_performance-ego0_min0.0019047296136841735
sim_compute_sim_state_max0.012222712553000148
sim_compute_sim_state_mean0.00973199780233172
sim_compute_sim_state_median0.010039204817062847
sim_compute_sim_state_min0.006626869022201043
sim_render-ego0_max0.004003709378624767
sim_render-ego0_mean0.00390566708534412
sim_render-ego0_median0.0039337718024495365
sim_render-ego0_min0.00375141535785264
simulation-passed1
step_physics_max0.1326390818545693
step_physics_mean0.11711102341944908
step_physics_median0.11413841685055295
step_physics_min0.10752817812212104
survival_time_max59.99999999999873
survival_time_mean28.81249999999978
survival_time_min11.700000000000031
No reset possible
580949773Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:20:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.913789482584096
survival_time_median33.29999999999985
deviation-center-line_median1.4912580271636855
in-drivable-lane_median10.374999999999805


other stats
agent_compute-ego0_max0.013251147408416306
agent_compute-ego0_mean0.012783300671361504
agent_compute-ego0_median0.012984758586474791
agent_compute-ego0_min0.011912538104080128
complete-iteration_max0.2121521015151355
complete-iteration_mean0.18638844353039064
complete-iteration_median0.1920856791963668
complete-iteration_min0.14923031421369343
deviation-center-line_max3.963151915813852
deviation-center-line_mean1.7892477084273772
deviation-center-line_min0.21132286356828517
deviation-heading_max15.254750154127091
deviation-heading_mean6.957119279677021
deviation-heading_median5.688246031166676
deviation-heading_min1.1972349022476385
driven_any_max11.673213923415116
driven_any_mean6.356113445044835
driven_any_median6.31210935391538
driven_any_min1.127021148933461
driven_lanedir_consec_max7.788623570943837
driven_lanedir_consec_mean4.076930192262729
driven_lanedir_consec_min0.691518232938886
driven_lanedir_max8.598545367848502
driven_lanedir_mean4.387692496980321
driven_lanedir_median4.123748370258033
driven_lanedir_min0.7047278795567202
get_duckie_state_max1.6592996089219005e-06
get_duckie_state_mean1.450414600732182e-06
get_duckie_state_median1.4474695495212163e-06
get_duckie_state_min1.2474196949643953e-06
get_robot_state_max0.0039382733111818806
get_robot_state_mean0.0037518116608435655
get_robot_state_median0.003781873402258732
get_robot_state_min0.003505226527674917
get_state_dump_max0.0051732982089946365
get_state_dump_mean0.0048120196033399594
get_state_dump_median0.004828740275220188
get_state_dump_min0.0044172996539248235
get_ui_image_max0.03586222428664081
get_ui_image_mean0.030712879340806357
get_ui_image_median0.030933585372742777
get_ui_image_min0.025122122331099075
in-drivable-lane_max11.949999999999886
in-drivable-lane_mean8.78749999999987
in-drivable-lane_min2.4499999999999913
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.748125873172773, "get_ui_image": 0.02943424314390624, "step_physics": 0.11384147796047828, "survival_time": 45.74999999999954, "driven_lanedir": 6.459979239936998, "get_state_dump": 0.0051732982089946365, "get_robot_state": 0.0039382733111818806, "sim_render-ego0": 0.004132360089814298, "get_duckie_state": 1.6592996089219005e-06, "in-drivable-lane": 9.949999999999497, "deviation-heading": 8.442692011160682, "agent_compute-ego0": 0.013189338180175515, "complete-iteration": 0.1848282402779858, "set_robot_commands": 0.0023266092658563472, "deviation-center-line": 2.304682763693643, "driven_lanedir_consec": 6.040061464589125, "sim_compute_sim_state": 0.010489050217591, "sim_compute_performance-ego0": 0.0022025699178204266}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.673213923415116, "get_ui_image": 0.03586222428664081, "step_physics": 0.13155968481059077, "survival_time": 59.99999999999873, "driven_lanedir": 8.598545367848502, "get_state_dump": 0.004705483470729349, "get_robot_state": 0.0037965984963854583, "sim_render-ego0": 0.004043579300079219, "get_duckie_state": 1.376316410417263e-06, "in-drivable-lane": 11.949999999999886, "deviation-heading": 15.254750154127091, "agent_compute-ego0": 0.012780178992774067, "complete-iteration": 0.2121521015151355, "set_robot_commands": 0.0022875690936645203, "deviation-center-line": 3.963151915813852, "driven_lanedir_consec": 7.788623570943837, "sim_compute_sim_state": 0.014901603489096816, "sim_compute_performance-ego0": 0.002123927990661672}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.127021148933461, "get_ui_image": 0.03243292760157931, "step_physics": 0.12801700916843137, "survival_time": 6.849999999999984, "driven_lanedir": 0.7047278795567202, "get_state_dump": 0.004951997079711029, "get_robot_state": 0.0037671483081320057, "sim_render-ego0": 0.00402459890946098, "get_duckie_state": 1.51862268862517e-06, "in-drivable-lane": 2.4499999999999913, "deviation-heading": 1.1972349022476385, "agent_compute-ego0": 0.013251147408416306, "complete-iteration": 0.19934311811474784, "set_robot_commands": 0.00226460677990015, "deviation-center-line": 0.21132286356828517, "driven_lanedir_consec": 0.691518232938886, "sim_compute_sim_state": 0.00846691926320394, "sim_compute_performance-ego0": 0.0020679926526719246}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.876092834657988, "get_ui_image": 0.025122122331099075, "step_physics": 0.09056407983223216, "survival_time": 20.85000000000016, "driven_lanedir": 1.787517500579067, "get_state_dump": 0.0044172996539248235, "get_robot_state": 0.003505226527674917, "sim_render-ego0": 0.0036287821080696063, "get_duckie_state": 1.2474196949643953e-06, "in-drivable-lane": 10.80000000000011, "deviation-heading": 2.93380005117267, "agent_compute-ego0": 0.011912538104080128, "complete-iteration": 0.14923031421369343, "set_robot_commands": 0.0020640033283872467, "deviation-center-line": 0.6778332906337281, "driven_lanedir_consec": 1.787517500579067, "sim_compute_sim_state": 0.006110462275418368, "sim_compute_performance-ego0": 0.0018274384822571676}}
set_robot_commands_max0.0023266092658563472
set_robot_commands_mean0.002235697116952066
set_robot_commands_median0.0022760879367823353
set_robot_commands_min0.0020640033283872467
sim_compute_performance-ego0_max0.0022025699178204266
sim_compute_performance-ego0_mean0.0020554822608527977
sim_compute_performance-ego0_median0.0020959603216667982
sim_compute_performance-ego0_min0.0018274384822571676
sim_compute_sim_state_max0.014901603489096816
sim_compute_sim_state_mean0.00999200881132753
sim_compute_sim_state_median0.009477984740397467
sim_compute_sim_state_min0.006110462275418368
sim_render-ego0_max0.004132360089814298
sim_render-ego0_mean0.0039573301018560264
sim_render-ego0_median0.0040340891047701
sim_render-ego0_min0.0036287821080696063
simulation-passed1
step_physics_max0.13155968481059077
step_physics_mean0.11599556294293314
step_physics_median0.12092924356445482
step_physics_min0.09056407983223216
survival_time_max59.99999999999873
survival_time_mean33.362499999999606
survival_time_min6.849999999999984
No reset possible
5807610024Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:35:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.55503414638892
survival_time_median59.99999999999873
deviation-center-line_median2.8256491526745053
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.033835293351363184
agent_compute-ego0_mean0.01859453903646096
agent_compute-ego0_median0.01385355571426023
agent_compute-ego0_min0.01283575136596019
complete-iteration_max0.202226436505409
complete-iteration_mean0.1875199303837442
complete-iteration_median0.18765178072164695
complete-iteration_min0.17254972358627382
deviation-center-line_max3.111147326389904
deviation-center-line_mean2.6631365318254088
deviation-center-line_min1.89010049556272
deviation-heading_max11.514063800596308
deviation-heading_mean9.404961827921149
deviation-heading_median9.179278250147576
deviation-heading_min7.747227010793133
driven_any_max5.885867648486069
driven_any_mean5.74266038972747
driven_any_median5.702937568316041
driven_any_min5.678898773791725
driven_lanedir_consec_max5.605326598802633
driven_lanedir_consec_mean5.1221077888966215
driven_lanedir_consec_min3.77303626400601
driven_lanedir_max5.6406419840958595
driven_lanedir_mean5.589009218919084
driven_lanedir_median5.5844843534100965
driven_lanedir_min5.54642618476028
get_duckie_state_max1.528975767060978e-06
get_duckie_state_mean1.410957577822111e-06
get_duckie_state_median1.3862422463498842e-06
get_duckie_state_min1.3423700515276985e-06
get_robot_state_max0.0039155233114784105
get_robot_state_mean0.0038197755714340273
get_robot_state_median0.003852136426920895
get_robot_state_min0.003659306120415909
get_state_dump_max0.004831887204680812
get_state_dump_mean0.004705198698496441
get_state_dump_median0.004703557759300061
get_state_dump_min0.004581792070704833
get_ui_image_max0.03794056172176364
get_ui_image_mean0.03229305875192177
get_ui_image_median0.0323467644724024
get_ui_image_min0.026538144341118623
in-drivable-lane_max1.299999999999926
in-drivable-lane_mean0.3249999999999815
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.885867648486069, "get_ui_image": 0.03020059953224252, "step_physics": 0.1083049393017822, "survival_time": 59.99999999999873, "driven_lanedir": 5.6406419840958595, "get_state_dump": 0.004831887204680812, "get_robot_state": 0.003860949874420547, "sim_render-ego0": 0.004074048440124867, "get_duckie_state": 1.528975767060978e-06, "in-drivable-lane": 1.299999999999926, "deviation-heading": 7.778051441593689, "agent_compute-ego0": 0.01283575136596019, "complete-iteration": 0.17984703716687814, "set_robot_commands": 0.002330458233695939, "deviation-center-line": 3.111147326389904, "driven_lanedir_consec": 3.77303626400601, "sim_compute_sim_state": 0.0111816548785004, "sim_compute_performance-ego0": 0.002136438315754429}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.717451433443168, "get_ui_image": 0.03794056172176364, "step_physics": 0.1202759302029701, "survival_time": 59.99999999999873, "driven_lanedir": 5.56364210801756, "get_state_dump": 0.004673894299357062, "get_robot_state": 0.0038433229794212426, "sim_render-ego0": 0.004106662354798837, "get_duckie_state": 1.382867462132793e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.514063800596308, "agent_compute-ego0": 0.014608107041955292, "complete-iteration": 0.202226436505409, "set_robot_commands": 0.002343436462694561, "deviation-center-line": 2.8654404757923, "driven_lanedir_consec": 5.56364210801756, "sim_compute_sim_state": 0.012178510154514488, "sim_compute_performance-ego0": 0.0021658426121212264}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.6884237031889135, "get_ui_image": 0.03449292941256229, "step_physics": 0.11709475378311246, "survival_time": 59.99999999999873, "driven_lanedir": 5.54642618476028, "get_state_dump": 0.004733221219243059, "get_robot_state": 0.0039155233114784105, "sim_render-ego0": 0.004075649675977518, "get_duckie_state": 1.3896170305669754e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.580505058701462, "agent_compute-ego0": 0.013099004386565171, "complete-iteration": 0.19545652427641577, "set_robot_commands": 0.0023957422432752573, "deviation-center-line": 2.785857829556711, "driven_lanedir_consec": 5.54642618476028, "sim_compute_sim_state": 0.013361007347392798, "sim_compute_performance-ego0": 0.002198932966919962}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.678898773791725, "get_ui_image": 0.026538144341118623, "step_physics": 0.08949197539679712, "survival_time": 59.99999999999873, "driven_lanedir": 5.605326598802633, "get_state_dump": 0.004581792070704833, "get_robot_state": 0.003659306120415909, "sim_render-ego0": 0.003843010712622802, "get_duckie_state": 1.3423700515276985e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.747227010793133, "agent_compute-ego0": 0.033835293351363184, "complete-iteration": 0.17254972358627382, "set_robot_commands": 0.002284642560198146, "deviation-center-line": 1.89010049556272, "driven_lanedir_consec": 5.605326598802633, "sim_compute_sim_state": 0.0062401604394333055, "sim_compute_performance-ego0": 0.0019915179348706604}}
set_robot_commands_max0.0023957422432752573
set_robot_commands_mean0.002338569874965976
set_robot_commands_median0.0023369473481952502
set_robot_commands_min0.002284642560198146
sim_compute_performance-ego0_max0.002198932966919962
sim_compute_performance-ego0_mean0.0021231829574165696
sim_compute_performance-ego0_median0.0021511404639378276
sim_compute_performance-ego0_min0.0019915179348706604
sim_compute_sim_state_max0.013361007347392798
sim_compute_sim_state_mean0.010740333204960248
sim_compute_sim_state_median0.011680082516507444
sim_compute_sim_state_min0.0062401604394333055
sim_render-ego0_max0.004106662354798837
sim_render-ego0_mean0.004024842795881006
sim_render-ego0_median0.0040748490580511925
sim_render-ego0_min0.003843010712622802
simulation-passed1
step_physics_max0.1202759302029701
step_physics_mean0.10879189967116548
step_physics_median0.11269984654244732
step_physics_min0.08949197539679712
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5806810016Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:11:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8482990762410116
survival_time_median13.100000000000051
deviation-center-line_median0.6968217326731536
in-drivable-lane_median3.900000000000039


other stats
agent_compute-ego0_max0.01424500766922446
agent_compute-ego0_mean0.013533099224986193
agent_compute-ego0_median0.013444881448261274
agent_compute-ego0_min0.01299762633419776
complete-iteration_max0.21525094801919503
complete-iteration_mean0.1859118574657013
complete-iteration_median0.1848002538961523
complete-iteration_min0.1587959740513055
deviation-center-line_max1.2445784787190737
deviation-center-line_mean0.7830871075021391
deviation-center-line_min0.49412648594317543
deviation-heading_max3.180982837958647
deviation-heading_mean2.251835733817977
deviation-heading_median2.1955523323891635
deviation-heading_min1.435255432534933
driven_any_max6.429532560833502
driven_any_mean3.2915744047998414
driven_any_median2.3597306356331695
driven_any_min2.017303787099523
driven_lanedir_consec_max3.388531522123639
driven_lanedir_consec_mean2.098856784279107
driven_lanedir_consec_min1.310297462510765
driven_lanedir_max3.388531522123639
driven_lanedir_mean2.098856784279107
driven_lanedir_median1.8482990762410116
driven_lanedir_min1.310297462510765
get_duckie_state_max1.6268561868106617e-06
get_duckie_state_mean1.4986702533588471e-06
get_duckie_state_median1.4764993924254912e-06
get_duckie_state_min1.414826041773746e-06
get_robot_state_max0.00408981161959031
get_robot_state_mean0.003915114355230249
get_robot_state_median0.003896732383336597
get_robot_state_min0.0037771810346574927
get_state_dump_max0.005212554861517514
get_state_dump_mean0.0049445201993108655
get_state_dump_median0.004903946042984955
get_state_dump_min0.004757633849756041
get_ui_image_max0.03950251194468716
get_ui_image_mean0.03252761169621009
get_ui_image_median0.03192678240436122
get_ui_image_min0.02675437003143074
in-drivable-lane_max15.800000000000086
in-drivable-lane_mean6.437500000000049
in-drivable-lane_min2.1500000000000306
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4086555204676063, "get_ui_image": 0.028817972140525703, "step_physics": 0.09895550492984144, "survival_time": 13.350000000000056, "driven_lanedir": 2.094631315061007, "get_state_dump": 0.004757633849756041, "get_robot_state": 0.0037771810346574927, "sim_render-ego0": 0.004049948791959392, "get_duckie_state": 1.5132462800438724e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 1.4938227927302643, "agent_compute-ego0": 0.01315002121142487, "complete-iteration": 0.1677362322807312, "set_robot_commands": 0.002406719015605414, "deviation-center-line": 0.49412648594317543, "driven_lanedir_consec": 2.094631315061007, "sim_compute_sim_state": 0.009647423651681015, "sim_compute_performance-ego0": 0.0020827295175239223}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.017303787099523, "get_ui_image": 0.03950251194468716, "step_physics": 0.13289525529794527, "survival_time": 11.350000000000026, "driven_lanedir": 1.310297462510765, "get_state_dump": 0.004955669244130452, "get_robot_state": 0.003912014919414855, "sim_render-ego0": 0.00416724723682069, "get_duckie_state": 1.414826041773746e-06, "in-drivable-lane": 3.650000000000019, "deviation-heading": 2.897281872048062, "agent_compute-ego0": 0.013739741685097678, "complete-iteration": 0.21525094801919503, "set_robot_commands": 0.0024281551963404604, "deviation-center-line": 0.7305329803166314, "driven_lanedir_consec": 1.310297462510765, "sim_compute_sim_state": 0.011259404190799646, "sim_compute_performance-ego0": 0.002297024977834601}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.429532560833502, "get_ui_image": 0.03503559266819673, "step_physics": 0.11964639600585487, "survival_time": 33.95000000000021, "driven_lanedir": 3.388531522123639, "get_state_dump": 0.005212554861517514, "get_robot_state": 0.00408981161959031, "sim_render-ego0": 0.004399153064278996, "get_duckie_state": 1.6268561868106617e-06, "in-drivable-lane": 15.800000000000086, "deviation-heading": 3.180982837958647, "agent_compute-ego0": 0.01424500766922446, "complete-iteration": 0.20186427551157335, "set_robot_commands": 0.00247802874621223, "deviation-center-line": 1.2445784787190737, "driven_lanedir_consec": 3.388531522123639, "sim_compute_sim_state": 0.01431884905871223, "sim_compute_performance-ego0": 0.0023301941507002885}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.3108057507987327, "get_ui_image": 0.02675437003143074, "step_physics": 0.09605284162270006, "survival_time": 12.850000000000048, "driven_lanedir": 1.601966837421016, "get_state_dump": 0.004852222841839457, "get_robot_state": 0.0038814498472583385, "sim_render-ego0": 0.004010413044182829, "get_duckie_state": 1.43975250480711e-06, "in-drivable-lane": 4.150000000000059, "deviation-heading": 1.435255432534933, "agent_compute-ego0": 0.01299762633419776, "complete-iteration": 0.1587959740513055, "set_robot_commands": 0.00233789931896121, "deviation-center-line": 0.6631104850296758, "driven_lanedir_consec": 1.601966837421016, "sim_compute_sim_state": 0.0057821837506553, "sim_compute_performance-ego0": 0.002034995907036833}}
set_robot_commands_max0.00247802874621223
set_robot_commands_mean0.0024127005692798284
set_robot_commands_median0.002417437105972937
set_robot_commands_min0.00233789931896121
sim_compute_performance-ego0_max0.0023301941507002885
sim_compute_performance-ego0_mean0.0021862361382739117
sim_compute_performance-ego0_median0.0021898772476792614
sim_compute_performance-ego0_min0.002034995907036833
sim_compute_sim_state_max0.01431884905871223
sim_compute_sim_state_mean0.010251965162962048
sim_compute_sim_state_median0.010453413921240332
sim_compute_sim_state_min0.0057821837506553
sim_render-ego0_max0.004399153064278996
sim_render-ego0_mean0.004156690534310476
sim_render-ego0_median0.004108598014390041
sim_render-ego0_min0.004010413044182829
simulation-passed1
step_physics_max0.13289525529794527
step_physics_mean0.11188749946408542
step_physics_median0.10930095046784816
step_physics_min0.09605284162270006
survival_time_max33.95000000000021
survival_time_mean17.875000000000085
survival_time_min11.350000000000026
No reset possible
5805010029Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:34:36
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5802412733Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:39:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median19.62958274932697
survival_time_median59.99999999999873
deviation-center-line_median3.0916218604430927
in-drivable-lane_median2.87499999999997


other stats
agent_compute-ego0_max0.07257189560095337
agent_compute-ego0_mean0.0662534122880014
agent_compute-ego0_median0.06688451203578488
agent_compute-ego0_min0.05867272947948243
complete-iteration_max0.32851516031066985
complete-iteration_mean0.2976717227599589
complete-iteration_median0.303945203010089
complete-iteration_min0.25428132470898784
deviation-center-line_max3.792604305568017
deviation-center-line_mean2.961396822964318
deviation-center-line_min1.8697392654030711
deviation-heading_max21.99675276335745
deviation-heading_mean15.914784775848442
deviation-heading_median16.01272598886082
deviation-heading_min9.636934362314683
driven_any_max25.62987910445423
driven_any_mean20.93750206974576
driven_any_median22.526332183628934
driven_any_min13.06746480727092
driven_lanedir_consec_max24.41584980658088
driven_lanedir_consec_mean18.84259768490229
driven_lanedir_consec_min11.695375434374345
driven_lanedir_max24.41584980658088
driven_lanedir_mean18.84259768490229
driven_lanedir_median19.62958274932697
driven_lanedir_min11.695375434374345
get_duckie_state_max1.409468702432218e-06
get_duckie_state_mean1.3188273638349782e-06
get_duckie_state_median1.3134858689637704e-06
get_duckie_state_min1.2388690149801545e-06
get_robot_state_max0.003917640690799557
get_robot_state_mean0.00368337096157632
get_robot_state_median0.003653238853943735
get_robot_state_min0.0035093654476182528
get_state_dump_max0.004880932546674361
get_state_dump_mean0.004647393310218547
get_state_dump_median0.0046063647679147075
get_state_dump_min0.004495911158370413
get_ui_image_max0.03442069533266295
get_ui_image_mean0.03078072287282817
get_ui_image_median0.03143187142575493
get_ui_image_min0.025838453307139884
in-drivable-lane_max4.849999999999924
in-drivable-lane_mean2.8874999999999584
in-drivable-lane_min0.9499999999999708
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 25.62987910445423, "get_ui_image": 0.02860034494773236, "step_physics": 0.15834772477638315, "survival_time": 59.99999999999873, "driven_lanedir": 24.41584980658088, "get_state_dump": 0.004633822707113477, "get_robot_state": 0.0037223314067704, "sim_render-ego0": 0.003914651823083527, "get_duckie_state": 1.356266221833368e-06, "in-drivable-lane": 0.9499999999999708, "deviation-heading": 14.033480631704906, "agent_compute-ego0": 0.07257189560095337, "complete-iteration": 0.2857247609877765, "set_robot_commands": 0.00220701339143599, "deviation-center-line": 2.758319269124944, "driven_lanedir_consec": 24.41584980658088, "sim_compute_sim_state": 0.009622928601915296, "sim_compute_performance-ego0": 0.0020155070921860567}, "LF-norm-zigzag-000-ego0": {"driven_any": 13.06746480727092, "get_ui_image": 0.0342633979037775, "step_physics": 0.19496603835903184, "survival_time": 34.1000000000002, "driven_lanedir": 11.695375434374345, "get_state_dump": 0.004495911158370413, "get_robot_state": 0.0035093654476182528, "sim_render-ego0": 0.0037743825339991736, "get_duckie_state": 1.2388690149801545e-06, "in-drivable-lane": 2.150000000000026, "deviation-heading": 9.636934362314683, "agent_compute-ego0": 0.07025057295580035, "complete-iteration": 0.32851516031066985, "set_robot_commands": 0.002137715086929969, "deviation-center-line": 1.8697392654030711, "driven_lanedir_consec": 11.695375434374345, "sim_compute_sim_state": 0.01311462480536666, "sim_compute_performance-ego0": 0.001921210421650162}, "LF-norm-techtrack-000-ego0": {"driven_any": 23.37824113285069, "get_ui_image": 0.03442069533266295, "step_physics": 0.1979134547323311, "survival_time": 59.99999999999873, "driven_lanedir": 20.579645448293338, "get_state_dump": 0.004880932546674361, "get_robot_state": 0.003917640690799557, "sim_render-ego0": 0.004100891076754174, "get_duckie_state": 1.409468702432218e-06, "in-drivable-lane": 4.849999999999924, "deviation-heading": 17.99197134601673, "agent_compute-ego0": 0.05867272947948243, "complete-iteration": 0.32216564503240147, "set_robot_commands": 0.002421864859766011, "deviation-center-line": 3.424924451761241, "driven_lanedir_consec": 20.579645448293338, "sim_compute_sim_state": 0.013576508163909533, "sim_compute_performance-ego0": 0.002163473116567391}, "LF-norm-small_loop-000-ego0": {"driven_any": 21.674423234407183, "get_ui_image": 0.025838453307139884, "step_physics": 0.14281101885882147, "survival_time": 59.99999999999873, "driven_lanedir": 18.67952005036061, "get_state_dump": 0.0045789068287159385, "get_robot_state": 0.0035841463011170704, "sim_render-ego0": 0.0037440352396206694, "get_duckie_state": 1.2707055160941728e-06, "in-drivable-lane": 3.5999999999999135, "deviation-heading": 21.99675276335745, "agent_compute-ego0": 0.06351845111576941, "complete-iteration": 0.25428132470898784, "set_robot_commands": 0.0021448020236279745, "deviation-center-line": 3.792604305568017, "driven_lanedir_consec": 18.67952005036061, "sim_compute_sim_state": 0.006064076308505323, "sim_compute_performance-ego0": 0.0019122293648572888}}
set_robot_commands_max0.002421864859766011
set_robot_commands_mean0.002227848840439986
set_robot_commands_median0.002175907707531982
set_robot_commands_min0.002137715086929969
sim_compute_performance-ego0_max0.002163473116567391
sim_compute_performance-ego0_mean0.0020031049988152244
sim_compute_performance-ego0_median0.0019683587569181093
sim_compute_performance-ego0_min0.0019122293648572888
sim_compute_sim_state_max0.013576508163909533
sim_compute_sim_state_mean0.0105945344699242
sim_compute_sim_state_median0.011368776703640978
sim_compute_sim_state_min0.006064076308505323
sim_render-ego0_max0.004100891076754174
sim_render-ego0_mean0.0038834901683643865
sim_render-ego0_median0.00384451717854135
sim_render-ego0_min0.0037440352396206694
simulation-passed1
step_physics_max0.1979134547323311
step_physics_mean0.1735095591816419
step_physics_median0.17665688156770748
step_physics_min0.14281101885882147
survival_time_max59.99999999999873
survival_time_mean53.524999999999096
survival_time_min34.1000000000002
No reset possible
5801110069Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
β”‚ output: ''
β”‚  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5799710043Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:34:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.242030236318744
survival_time_median59.99999999999873
deviation-center-line_median3.328501548809466
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012704303322187768
agent_compute-ego0_mean0.012417041739258144
agent_compute-ego0_median0.012501171586118472
agent_compute-ego0_min0.011961520462607862
complete-iteration_max0.19813003389166356
complete-iteration_mean0.17395965518006476
complete-iteration_median0.1758334530481788
complete-iteration_min0.14604168073223792
deviation-center-line_max3.572765580944597
deviation-center-line_mean3.133123031097965
deviation-center-line_min2.3027234458283306
deviation-heading_max13.515118416908352
deviation-heading_mean11.750752520274425
deviation-heading_median12.216096436533896
deviation-heading_min9.055698791121545
driven_any_max9.104800730878678
driven_any_mean8.564186309398314
driven_any_median8.41801436194637
driven_any_min8.315915782821843
driven_lanedir_consec_max8.88045021803387
driven_lanedir_consec_mean8.352218073955218
driven_lanedir_consec_min8.044361605149513
driven_lanedir_max8.88045021803387
driven_lanedir_mean8.352218073955218
driven_lanedir_median8.242030236318744
driven_lanedir_min8.044361605149513
get_duckie_state_max1.5115062958195644e-06
get_duckie_state_mean1.3922970062687832e-06
get_duckie_state_median1.3816763618208784e-06
get_duckie_state_min1.2943290056138114e-06
get_robot_state_max0.003801189592537733
get_robot_state_mean0.0036529407314614985
get_robot_state_median0.003673492621422608
get_robot_state_min0.003463588090463046
get_state_dump_max0.004711540017298715
get_state_dump_mean0.00462690296022223
get_state_dump_median0.0046813696449146385
get_state_dump_min0.004433332533760929
get_ui_image_max0.03498936612639796
get_ui_image_mean0.029715276826529777
get_ui_image_median0.02963339170746561
get_ui_image_min0.024604957764789923
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.104800730878678, "get_ui_image": 0.027843234938050587, "step_physics": 0.09676108709679952, "survival_time": 59.99999999999873, "driven_lanedir": 8.88045021803387, "get_state_dump": 0.0046791712707722815, "get_robot_state": 0.003801189592537733, "sim_render-ego0": 0.003895204529774179, "get_duckie_state": 1.5115062958195644e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.503336781899469, "agent_compute-ego0": 0.012476414268360249, "complete-iteration": 0.16316616148079166, "set_robot_commands": 0.002316933686687587, "deviation-center-line": 3.1303533885192203, "driven_lanedir_consec": 8.88045021803387, "sim_compute_sim_state": 0.00926865090140693, "sim_compute_performance-ego0": 0.002039158771079744}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.421565511049087, "get_ui_image": 0.03498936612639796, "step_physics": 0.1216895324205181, "survival_time": 59.99999999999873, "driven_lanedir": 8.182626366414437, "get_state_dump": 0.0046835680190569955, "get_robot_state": 0.003647573186793395, "sim_render-ego0": 0.0038911410910600825, "get_duckie_state": 1.429121857578808e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.928856091168326, "agent_compute-ego0": 0.012704303322187768, "complete-iteration": 0.19813003389166356, "set_robot_commands": 0.0022108701742459694, "deviation-center-line": 3.572765580944597, "driven_lanedir_consec": 8.182626366414437, "sim_compute_sim_state": 0.012230641438899488, "sim_compute_performance-ego0": 0.0019953685636623615}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.315915782821843, "get_ui_image": 0.031423548476880635, "step_physics": 0.1148848736117424, "survival_time": 59.99999999999873, "driven_lanedir": 8.044361605149513, "get_state_dump": 0.004711540017298715, "get_robot_state": 0.003699412056051821, "sim_render-ego0": 0.003910574885232562, "get_duckie_state": 1.3342308660629488e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.515118416908352, "agent_compute-ego0": 0.012525928903876693, "complete-iteration": 0.18850074461556593, "set_robot_commands": 0.00222494004668046, "deviation-center-line": 3.526649709099712, "driven_lanedir_consec": 8.044361605149513, "sim_compute_sim_state": 0.013011697329251991, "sim_compute_performance-ego0": 0.002018771699624296}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.41446321284365, "get_ui_image": 0.024604957764789923, "step_physics": 0.08803914647416013, "survival_time": 59.99999999999873, "driven_lanedir": 8.301434106223049, "get_state_dump": 0.004433332533760929, "get_robot_state": 0.003463588090463046, "sim_render-ego0": 0.003671040443655454, "get_duckie_state": 1.2943290056138114e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.055698791121545, "agent_compute-ego0": 0.011961520462607862, "complete-iteration": 0.14604168073223792, "set_robot_commands": 0.002098839646275097, "deviation-center-line": 2.3027234458283306, "driven_lanedir_consec": 8.301434106223049, "sim_compute_sim_state": 0.005851752156520466, "sim_compute_performance-ego0": 0.0018382481393170891}}
set_robot_commands_max0.002316933686687587
set_robot_commands_mean0.0022128958884722783
set_robot_commands_median0.002217905110463215
set_robot_commands_min0.002098839646275097
sim_compute_performance-ego0_max0.002039158771079744
sim_compute_performance-ego0_mean0.0019728867934208725
sim_compute_performance-ego0_median0.0020070701316433287
sim_compute_performance-ego0_min0.0018382481393170891
sim_compute_sim_state_max0.013011697329251991
sim_compute_sim_state_mean0.010090685456519718
sim_compute_sim_state_median0.010749646170153207
sim_compute_sim_state_min0.005851752156520466
sim_render-ego0_max0.003910574885232562
sim_render-ego0_mean0.003841990237430569
sim_render-ego0_median0.003893172810417131
sim_render-ego0_min0.003671040443655454
simulation-passed1
step_physics_max0.1216895324205181
step_physics_mean0.10534365990080503
step_physics_median0.10582298035427096
step_physics_min0.08803914647416013
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5798410068Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:20:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1853877389016536
survival_time_median28.37500000000027
deviation-center-line_median0.9479021681798012
in-drivable-lane_median16.30000000000023


other stats
agent_compute-ego0_max0.012709634975322242
agent_compute-ego0_mean0.012553340676534836
agent_compute-ego0_median0.012579343291226276
agent_compute-ego0_min0.012345041148364544
complete-iteration_max0.2003873297311727
complete-iteration_mean0.17867654458418136
complete-iteration_median0.1779444539048271
complete-iteration_min0.15842994079589845
deviation-center-line_max2.5682446744825045
deviation-center-line_mean1.2256298466487263
deviation-center-line_min0.43847037575279824
deviation-heading_max9.222079800311093
deviation-heading_mean5.3976769283101085
deviation-heading_median5.263697041984537
deviation-heading_min1.8412338289602672
driven_any_max11.869761967352671
driven_any_mean6.144201207767406
driven_any_median4.6803931670622525
driven_any_min3.34625652959245
driven_lanedir_consec_max7.488111073094863
driven_lanedir_consec_mean3.3323121707325827
driven_lanedir_consec_min1.4703621320321614
driven_lanedir_max7.488111073094863
driven_lanedir_mean3.690583672791681
driven_lanedir_median2.620612769877822
driven_lanedir_min2.032998078316217
get_duckie_state_max1.98822021484375e-06
get_duckie_state_mean1.9157335526310864e-06
get_duckie_state_median1.9130631557946065e-06
get_duckie_state_min1.848587684091382e-06
get_robot_state_max0.003649729872424834
get_robot_state_mean0.00355722465277208
get_robot_state_median0.003552706650391366
get_robot_state_min0.0034737554378807545
get_state_dump_max0.004516249393841111
get_state_dump_mean0.004452223448168546
get_state_dump_median0.0044441058964405245
get_state_dump_min0.0044044326059520245
get_ui_image_max0.03481195910463055
get_ui_image_mean0.02952893264143382
get_ui_image_median0.029145379573630975
get_ui_image_min0.025013012313842772
in-drivable-lane_max19.49999999999939
in-drivable-lane_mean13.887499999999976
in-drivable-lane_min3.450000000000049
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.23848494370177, "get_ui_image": 0.02624793816357851, "step_physics": 0.10107841016724706, "survival_time": 25.550000000000228, "driven_lanedir": 2.032998078316217, "get_state_dump": 0.0044044326059520245, "get_robot_state": 0.0034737554378807545, "sim_render-ego0": 0.0036856303922832017, "get_duckie_state": 1.9222497940063477e-06, "in-drivable-lane": 15.700000000000225, "deviation-heading": 1.8412338289602672, "agent_compute-ego0": 0.012345041148364544, "complete-iteration": 0.16522268624976277, "set_robot_commands": 0.0020842207595705986, "deviation-center-line": 0.43847037575279824, "driven_lanedir_consec": 2.032998078316217, "sim_compute_sim_state": 0.00993794109672308, "sim_compute_performance-ego0": 0.001880856230854988}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.34625652959245, "get_ui_image": 0.03481195910463055, "step_physics": 0.12708548955547, "survival_time": 20.550000000000157, "driven_lanedir": 2.764343960216995, "get_state_dump": 0.004408697480136908, "get_robot_state": 0.003490555054933122, "sim_render-ego0": 0.003749455641774298, "get_duckie_state": 1.9038765175828655e-06, "in-drivable-lane": 3.450000000000049, "deviation-heading": 5.42874168624876, "agent_compute-ego0": 0.012709634975322242, "complete-iteration": 0.2003873297311727, "set_robot_commands": 0.0020994983830498262, "deviation-center-line": 1.0394719035491116, "driven_lanedir_consec": 1.4703621320321614, "sim_compute_sim_state": 0.01004847508032345, "sim_compute_performance-ego0": 0.001897212371085454}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.869761967352671, "get_ui_image": 0.03204282098368344, "step_physics": 0.1166467746032664, "survival_time": 59.99999999999873, "driven_lanedir": 7.488111073094863, "get_state_dump": 0.004516249393841111, "get_robot_state": 0.003649729872424834, "sim_render-ego0": 0.00384410851007695, "get_duckie_state": 1.848587684091382e-06, "in-drivable-lane": 19.49999999999939, "deviation-heading": 9.222079800311093, "agent_compute-ego0": 0.012678680173761144, "complete-iteration": 0.1906662215598914, "set_robot_commands": 0.0021697609351139877, "deviation-center-line": 2.5682446744825045, "driven_lanedir_consec": 7.488111073094863, "sim_compute_sim_state": 0.01305133972834985, "sim_compute_performance-ego0": 0.0019788892938135865}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.122301390422734, "get_ui_image": 0.025013012313842772, "step_physics": 0.09840705451965331, "survival_time": 31.20000000000031, "driven_lanedir": 2.4768815795386487, "get_state_dump": 0.004479514312744141, "get_robot_state": 0.003614858245849609, "sim_render-ego0": 0.003757556915283203, "get_duckie_state": 1.98822021484375e-06, "in-drivable-lane": 16.90000000000024, "deviation-heading": 5.098652397720315, "agent_compute-ego0": 0.012480006408691404, "complete-iteration": 0.15842994079589845, "set_robot_commands": 0.0021527679443359374, "deviation-center-line": 0.8563324328104909, "driven_lanedir_consec": 2.33777739948709, "sim_compute_sim_state": 0.006494916534423828, "sim_compute_performance-ego0": 0.001945505142211914}}
set_robot_commands_max0.0021697609351139877
set_robot_commands_mean0.0021265620055175875
set_robot_commands_median0.002126133163692882
set_robot_commands_min0.0020842207595705986
sim_compute_performance-ego0_max0.0019788892938135865
sim_compute_performance-ego0_mean0.0019256157594914856
sim_compute_performance-ego0_median0.001921358756648684
sim_compute_performance-ego0_min0.001880856230854988
sim_compute_sim_state_max0.01305133972834985
sim_compute_sim_state_mean0.009883168109955051
sim_compute_sim_state_median0.009993208088523263
sim_compute_sim_state_min0.006494916534423828
sim_render-ego0_max0.00384410851007695
sim_render-ego0_mean0.0037591878648544127
sim_render-ego0_median0.0037535062785287506
sim_render-ego0_min0.0036856303922832017
simulation-passed1
step_physics_max0.12708548955547
step_physics_mean0.1108044322114092
step_physics_median0.10886259238525672
step_physics_min0.09840705451965331
survival_time_max59.99999999999873
survival_time_mean34.324999999999854
survival_time_min20.550000000000157
No reset possible
5797310715Philippe ReddyΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:20:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0496506340927196
survival_time_median39.024999999999494
deviation-center-line_median1.0373930524519226
in-drivable-lane_median6.900000000000078


other stats
agent_compute-ego0_max0.014267106850941976
agent_compute-ego0_mean0.01311972223779585
agent_compute-ego0_median0.01295402121908315
agent_compute-ego0_min0.01230373966207512
complete-iteration_max0.22325423470249883
complete-iteration_mean0.1866380736051036
complete-iteration_median0.18732763351405268
complete-iteration_min0.14864279268981018
deviation-center-line_max1.8226876853055205
deviation-center-line_mean1.0292811521056566
deviation-center-line_min0.21965081821326063
deviation-heading_max8.51745398616589
deviation-heading_mean5.791193370045617
deviation-heading_median6.297084648342445
deviation-heading_min2.053150197331689
driven_any_max4.169089614552141
driven_any_mean2.4439093588789778
driven_any_median2.6526802276441974
driven_any_min0.3011873656753747
driven_lanedir_consec_max4.088496190488968
driven_lanedir_consec_mean1.5828790543750415
driven_lanedir_consec_min0.14371875882575935
driven_lanedir_max4.088496190488968
driven_lanedir_mean1.5828790543750415
driven_lanedir_median1.0496506340927196
driven_lanedir_min0.14371875882575935
get_duckie_state_max1.4110026330808233e-06
get_duckie_state_mean1.326565135009773e-06
get_duckie_state_median1.3056187249282854e-06
get_duckie_state_min1.2840204571016985e-06
get_robot_state_max0.0038318660729512585
get_robot_state_mean0.0037202739655061647
get_robot_state_median0.003704413590115204
get_robot_state_min0.003640402608842992
get_state_dump_max0.00477413839558709
get_state_dump_mean0.004677758186697327
get_state_dump_median0.0046877390182499335
get_state_dump_min0.004561416314702348
get_ui_image_max0.0374468344229239
get_ui_image_mean0.031080828336584022
get_ui_image_median0.0304744172183912
get_ui_image_min0.025927644486629795
in-drivable-lane_max30.84999999999882
in-drivable-lane_mean11.162499999999744
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.3284362504136038, "get_ui_image": 0.02781511717174777, "step_physics": 0.11012903849283856, "survival_time": 20.05000000000015, "driven_lanedir": 0.4668298300774145, "get_state_dump": 0.004713578010672953, "get_robot_state": 0.003640402608842992, "sim_render-ego0": 0.003852675803265168, "get_duckie_state": 1.2840204571016985e-06, "in-drivable-lane": 11.500000000000163, "deviation-heading": 4.424111096065408, "agent_compute-ego0": 0.012589787369343772, "complete-iteration": 0.1757530062945921, "set_robot_commands": 0.002169748443869216, "deviation-center-line": 0.9382400249030508, "driven_lanedir_consec": 0.4668298300774145, "sim_compute_sim_state": 0.008832947531742836, "sim_compute_performance-ego0": 0.0019296508523362192}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3011873656753747, "get_ui_image": 0.0374468344229239, "step_physics": 0.14391553622704964, "survival_time": 5.349999999999989, "driven_lanedir": 0.14371875882575935, "get_state_dump": 0.004661900025826914, "get_robot_state": 0.0037145989912527578, "sim_render-ego0": 0.004176903654027868, "get_duckie_state": 1.3157173439308448e-06, "in-drivable-lane": 2.299999999999992, "deviation-heading": 2.053150197331689, "agent_compute-ego0": 0.014267106850941976, "complete-iteration": 0.22325423470249883, "set_robot_commands": 0.002226575657173439, "deviation-center-line": 0.21965081821326063, "driven_lanedir_consec": 0.14371875882575935, "sim_compute_sim_state": 0.010715912889551234, "sim_compute_performance-ego0": 0.002044220765431722}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.976924204874791, "get_ui_image": 0.033133717265034626, "step_physics": 0.12379434640606758, "survival_time": 57.99999999999884, "driven_lanedir": 1.6324714381080248, "get_state_dump": 0.00477413839558709, "get_robot_state": 0.0038318660729512585, "sim_render-ego0": 0.004075229835345969, "get_duckie_state": 1.4110026330808233e-06, "in-drivable-lane": 30.84999999999882, "deviation-heading": 8.170058200619483, "agent_compute-ego0": 0.013318255068822529, "complete-iteration": 0.19890226073351325, "set_robot_commands": 0.002284135005270788, "deviation-center-line": 1.1365460800007945, "driven_lanedir_consec": 1.6324714381080248, "sim_compute_sim_state": 0.01151498425735881, "sim_compute_performance-ego0": 0.002086140388666197}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.169089614552141, "get_ui_image": 0.025927644486629795, "step_physics": 0.08788192698997224, "survival_time": 59.99999999999873, "driven_lanedir": 4.088496190488968, "get_state_dump": 0.004561416314702348, "get_robot_state": 0.0036942281889776503, "sim_render-ego0": 0.003875246452947739, "get_duckie_state": 1.295520105925726e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.51745398616589, "agent_compute-ego0": 0.01230373966207512, "complete-iteration": 0.14864279268981018, "set_robot_commands": 0.0022450642820004123, "deviation-center-line": 1.8226876853055205, "driven_lanedir_consec": 4.088496190488968, "sim_compute_sim_state": 0.006065701961914367, "sim_compute_performance-ego0": 0.002007210482963416}}
set_robot_commands_max0.002284135005270788
set_robot_commands_mean0.0022313808470784636
set_robot_commands_median0.0022358199695869255
set_robot_commands_min0.002169748443869216
sim_compute_performance-ego0_max0.002086140388666197
sim_compute_performance-ego0_mean0.0020168056223493886
sim_compute_performance-ego0_median0.002025715624197569
sim_compute_performance-ego0_min0.0019296508523362192
sim_compute_sim_state_max0.01151498425735881
sim_compute_sim_state_mean0.009282386660141813
sim_compute_sim_state_median0.009774430210647035
sim_compute_sim_state_min0.006065701961914367
sim_render-ego0_max0.004176903654027868
sim_render-ego0_mean0.003995013936396686
sim_render-ego0_median0.003975238144146854
sim_render-ego0_min0.003852675803265168
simulation-passed1
step_physics_max0.14391553622704964
step_physics_mean0.116430212028982
step_physics_median0.11696169244945306
step_physics_min0.08788192698997224
survival_time_max59.99999999999873
survival_time_mean35.849999999999426
survival_time_min5.349999999999989
No reset possible
5795010729Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:26:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6310628193934242
survival_time_median52.499999999999154
deviation-center-line_median0.7692126830696944
in-drivable-lane_median39.77499999999944


other stats
agent_compute-ego0_max0.013170539732459638
agent_compute-ego0_mean0.012850062106404332
agent_compute-ego0_median0.012784700422337196
agent_compute-ego0_min0.0126603078484833
complete-iteration_max0.18750030351399585
complete-iteration_mean0.1688614240201739
complete-iteration_median0.17114308538491674
complete-iteration_min0.14565922179686636
deviation-center-line_max0.9662478845783546
deviation-center-line_mean0.6863773832678711
deviation-center-line_min0.2408362823537412
deviation-heading_max5.144185253913149
deviation-heading_mean3.367150767504099
deviation-heading_median3.494710288566497
deviation-heading_min1.334997238970252
driven_any_max10.389928536194413
driven_any_mean7.79336822067876
driven_any_median7.9057759907725424
driven_any_min4.971992364975545
driven_lanedir_consec_max3.107505223548492
driven_lanedir_consec_mean1.800451981808154
driven_lanedir_consec_min0.8321770648972763
driven_lanedir_max3.107505223548492
driven_lanedir_mean1.806410070259164
driven_lanedir_median1.6429789962954442
driven_lanedir_min0.8321770648972763
get_duckie_state_max1.304554489423644e-06
get_duckie_state_mean1.209802661711478e-06
get_duckie_state_median1.1889496189172936e-06
get_duckie_state_min1.1567569195876808e-06
get_robot_state_max0.003618224233174495
get_robot_state_mean0.0035700712757276414
get_robot_state_median0.0035673491067433733
get_robot_state_min0.0035273626562493227
get_state_dump_max0.004565226780323024
get_state_dump_mean0.004508550319453243
get_state_dump_median0.004516700057212639
get_state_dump_min0.0044355743830646705
get_ui_image_max0.03479757028467515
get_ui_image_mean0.029686597119260843
get_ui_image_median0.029453690362846813
get_ui_image_min0.0250414374666746
in-drivable-lane_max55.44999999999878
in-drivable-lane_mean39.44999999999945
in-drivable-lane_min22.800000000000132
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.389928536194413, "get_ui_image": 0.027115792854937985, "step_physics": 0.09135991667430664, "survival_time": 59.99999999999873, "driven_lanedir": 3.107505223548492, "get_state_dump": 0.004492226687200262, "get_robot_state": 0.003564924522800112, "sim_render-ego0": 0.00381789398034546, "get_duckie_state": 1.1567569195876808e-06, "in-drivable-lane": 45.34999999999903, "deviation-heading": 2.8387318588960806, "agent_compute-ego0": 0.0126603078484833, "complete-iteration": 0.15605505400156597, "set_robot_commands": 0.002139322763676449, "deviation-center-line": 0.7151493156797586, "driven_lanedir_consec": 3.107505223548492, "sim_compute_sim_state": 0.008861883792353113, "sim_compute_performance-ego0": 0.001963116743483214}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.477082202098927, "get_ui_image": 0.03479757028467515, "step_physics": 0.11279653523791248, "survival_time": 44.99999999999958, "driven_lanedir": 1.4163636823083916, "get_state_dump": 0.004565226780323024, "get_robot_state": 0.0035273626562493227, "sim_render-ego0": 0.0038597999217110657, "get_duckie_state": 1.304554489423644e-06, "in-drivable-lane": 34.199999999999854, "deviation-heading": 5.144185253913149, "agent_compute-ego0": 0.012833503189679654, "complete-iteration": 0.18750030351399585, "set_robot_commands": 0.0021465356553699013, "deviation-center-line": 0.82327605045963, "driven_lanedir_consec": 1.4163636823083916, "sim_compute_sim_state": 0.010960357964501928, "sim_compute_performance-ego0": 0.0019342063137482064}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.971992364975545, "get_ui_image": 0.031791587870755644, "step_physics": 0.11505588353109016, "survival_time": 34.700000000000166, "driven_lanedir": 1.8695943102824968, "get_state_dump": 0.0045411734272250166, "get_robot_state": 0.003618224233174495, "sim_render-ego0": 0.003878701505043524, "get_duckie_state": 1.21816456746712e-06, "in-drivable-lane": 22.800000000000132, "deviation-heading": 4.150688718236913, "agent_compute-ego0": 0.013170539732459638, "complete-iteration": 0.1862311167682675, "set_robot_commands": 0.0022097244537133964, "deviation-center-line": 0.9662478845783546, "driven_lanedir_consec": 1.8457619564784569, "sim_compute_sim_state": 0.009941477398220584, "sim_compute_performance-ego0": 0.001943313475135419}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.334469779446158, "get_ui_image": 0.0250414374666746, "step_physics": 0.0860201839999692, "survival_time": 59.99999999999873, "driven_lanedir": 0.8321770648972763, "get_state_dump": 0.0044355743830646705, "get_robot_state": 0.0035697736906866347, "sim_render-ego0": 0.003840519129286996, "get_duckie_state": 1.1597346703674671e-06, "in-drivable-lane": 55.44999999999878, "deviation-heading": 1.334997238970252, "agent_compute-ego0": 0.012735897654994738, "complete-iteration": 0.14565922179686636, "set_robot_commands": 0.0021285540257564295, "deviation-center-line": 0.2408362823537412, "driven_lanedir_consec": 0.8321770648972763, "sim_compute_sim_state": 0.005855453699256458, "sim_compute_performance-ego0": 0.0019548248986618207}}
set_robot_commands_max0.0022097244537133964
set_robot_commands_mean0.002156034224629044
set_robot_commands_median0.002142929209523175
set_robot_commands_min0.0021285540257564295
sim_compute_performance-ego0_max0.001963116743483214
sim_compute_performance-ego0_mean0.0019488653577571648
sim_compute_performance-ego0_median0.0019490691868986195
sim_compute_performance-ego0_min0.0019342063137482064
sim_compute_sim_state_max0.010960357964501928
sim_compute_sim_state_mean0.00890479321358302
sim_compute_sim_state_median0.009401680595286848
sim_compute_sim_state_min0.005855453699256458
sim_render-ego0_max0.003878701505043524
sim_render-ego0_mean0.003849228634096761
sim_render-ego0_median0.0038501595254990303
sim_render-ego0_min0.00381789398034546
simulation-passed1
step_physics_max0.11505588353109016
step_physics_mean0.10130812986081962
step_physics_median0.10207822595610956
step_physics_min0.0860201839999692
survival_time_max59.99999999999873
survival_time_mean49.9249999999993
survival_time_min34.700000000000166
No reset possible
5793210741Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:31:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.146528044560585
survival_time_median59.57499999999875
deviation-center-line_median1.618253243420972
in-drivable-lane_median20.27499999999947


other stats
agent_compute-ego0_max0.013644280779073877
agent_compute-ego0_mean0.012808812282571013
agent_compute-ego0_median0.012838155964445656
agent_compute-ego0_min0.011914656422318865
complete-iteration_max0.19714576120082783
complete-iteration_mean0.17341455940088857
complete-iteration_median0.172003919462564
complete-iteration_min0.15250463747759843
deviation-center-line_max4.213239185206288
deviation-center-line_mean2.083029240789481
deviation-center-line_min0.8823712911096916
deviation-heading_max9.596110881821058
deviation-heading_mean7.151963572722082
deviation-heading_median6.974961184766506
deviation-heading_min5.061821039534257
driven_any_max8.33812047996604
driven_any_mean7.717914123735296
driven_any_median8.229780635764554
driven_any_min6.073974743446038
driven_lanedir_consec_max8.174625731189682
driven_lanedir_consec_mean4.362958843213194
driven_lanedir_consec_min0.984153552541926
driven_lanedir_max8.174625731189682
driven_lanedir_mean4.404268087567544
driven_lanedir_median4.146528044560585
driven_lanedir_min1.1493905299593266
get_duckie_state_max1.3111008180154336e-06
get_duckie_state_mean1.253089226637333e-06
get_duckie_state_median1.2598422895573318e-06
get_duckie_state_min1.181571509419234e-06
get_robot_state_max0.003747928350990162
get_robot_state_mean0.0036494212499292447
get_robot_state_median0.003630438854518536
get_robot_state_min0.003588878939689744
get_state_dump_max0.0047210823189309
get_state_dump_mean0.004628402531359727
get_state_dump_median0.004645594530205686
get_state_dump_min0.004501338746096636
get_ui_image_max0.03638127681913225
get_ui_image_mean0.030420697872916968
get_ui_image_median0.0296851400055245
get_ui_image_min0.025931234661486623
in-drivable-lane_max48.2999999999989
in-drivable-lane_mean22.21249999999946
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.121517449242523, "get_ui_image": 0.02729976861863523, "step_physics": 0.09502544838028984, "survival_time": 59.149999999998776, "driven_lanedir": 6.354581694675197, "get_state_dump": 0.004501338746096636, "get_robot_state": 0.003658932407160063, "sim_render-ego0": 0.003840282358027793, "get_duckie_state": 1.3111008180154336e-06, "in-drivable-lane": 11.999999999999318, "deviation-heading": 6.441884028345425, "agent_compute-ego0": 0.01223327118802715, "complete-iteration": 0.16009276883827672, "set_robot_commands": 0.0021928544785525346, "deviation-center-line": 2.1837375998848354, "driven_lanedir_consec": 6.354581694675197, "sim_compute_sim_state": 0.00925862225326332, "sim_compute_performance-ego0": 0.0019980584447448317}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.33812047996604, "get_ui_image": 0.03638127681913225, "step_physics": 0.11691949270250002, "survival_time": 59.99999999999873, "driven_lanedir": 1.1493905299593266, "get_state_dump": 0.004708910663360164, "get_robot_state": 0.003747928350990162, "sim_render-ego0": 0.004088468099017624, "get_duckie_state": 1.3094162762313955e-06, "in-drivable-lane": 48.2999999999989, "deviation-heading": 7.508038341187587, "agent_compute-ego0": 0.013644280779073877, "complete-iteration": 0.19714576120082783, "set_robot_commands": 0.002265409664944943, "deviation-center-line": 0.8823712911096916, "driven_lanedir_consec": 0.984153552541926, "sim_compute_sim_state": 0.013198173611884708, "sim_compute_performance-ego0": 0.002097830387277468}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.073974743446038, "get_ui_image": 0.03207051139241377, "step_physics": 0.11177479873323656, "survival_time": 44.549999999999606, "driven_lanedir": 1.9384743944459732, "get_state_dump": 0.004582278397051208, "get_robot_state": 0.003601945301877009, "sim_render-ego0": 0.0039170788008001355, "get_duckie_state": 1.210268302883268e-06, "in-drivable-lane": 28.54999999999962, "deviation-heading": 5.061821039534257, "agent_compute-ego0": 0.01344304074086416, "complete-iteration": 0.18391507008685123, "set_robot_commands": 0.002175296101334918, "deviation-center-line": 1.0527688869571084, "driven_lanedir_consec": 1.9384743944459732, "sim_compute_sim_state": 0.010284549719549617, "sim_compute_performance-ego0": 0.0019787280014277576}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.338043822286584, "get_ui_image": 0.025931234661486623, "step_physics": 0.09233505739756766, "survival_time": 59.99999999999873, "driven_lanedir": 8.174625731189682, "get_state_dump": 0.0047210823189309, "get_robot_state": 0.003588878939689744, "sim_render-ego0": 0.003797413208998808, "get_duckie_state": 1.181571509419234e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.596110881821058, "agent_compute-ego0": 0.011914656422318865, "complete-iteration": 0.15250463747759843, "set_robot_commands": 0.0021625363161720704, "deviation-center-line": 4.213239185206288, "driven_lanedir_consec": 8.174625731189682, "sim_compute_sim_state": 0.006054548300076881, "sim_compute_performance-ego0": 0.0019117888562585987}}
set_robot_commands_max0.002265409664944943
set_robot_commands_mean0.0021990241402511167
set_robot_commands_median0.0021840752899437263
set_robot_commands_min0.0021625363161720704
sim_compute_performance-ego0_max0.002097830387277468
sim_compute_performance-ego0_mean0.001996601422427164
sim_compute_performance-ego0_median0.001988393223086295
sim_compute_performance-ego0_min0.0019117888562585987
sim_compute_sim_state_max0.013198173611884708
sim_compute_sim_state_mean0.00969897347119363
sim_compute_sim_state_median0.009771585986406466
sim_compute_sim_state_min0.006054548300076881
sim_render-ego0_max0.004088468099017624
sim_render-ego0_mean0.00391081061671109
sim_render-ego0_median0.003878680579413965
sim_render-ego0_min0.003797413208998808
simulation-passed1
step_physics_max0.11691949270250002
step_physics_mean0.10401369930339852
step_physics_median0.1034001235567632
step_physics_min0.09233505739756766
survival_time_max59.99999999999873
survival_time_mean55.92499999999896
survival_time_min44.549999999999606
No reset possible
5793010745Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:03:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 42 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5790910764Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:27:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8787674186536376
survival_time_median56.29999999999894
deviation-center-line_median0.5710117373348239
in-drivable-lane_median20.549999999999542


other stats
agent_compute-ego0_max0.014245647310871004
agent_compute-ego0_mean0.013551317386675742
agent_compute-ego0_median0.01365569557596394
agent_compute-ego0_min0.01264823108390408
complete-iteration_max0.22446646087471095
complete-iteration_mean0.18760104241842832
complete-iteration_median0.1832835852509787
complete-iteration_min0.15937053829704495
deviation-center-line_max3.5238447791556533
deviation-center-line_mean1.212633015587132
deviation-center-line_min0.18466380852322736
deviation-heading_max11.412223748003852
deviation-heading_mean4.316130197163874
deviation-heading_median2.054584362044066
deviation-heading_min1.7431283165635116
driven_any_max8.645379713833398
driven_any_mean5.742640001004149
driven_any_median7.007191358305102
driven_any_min0.310797573572996
driven_lanedir_consec_max7.512537493606136
driven_lanedir_consec_mean2.8565055184489925
driven_lanedir_consec_min0.15594974288255958
driven_lanedir_max7.512537493606136
driven_lanedir_mean2.8565055184489925
driven_lanedir_median1.8787674186536376
driven_lanedir_min0.15594974288255958
get_duckie_state_max2.5876654276343606e-06
get_duckie_state_mean2.264516767246473e-06
get_duckie_state_median2.266454065360797e-06
get_duckie_state_min1.937493510629939e-06
get_robot_state_max0.004131636615039503
get_robot_state_mean0.003944298078583912
get_robot_state_median0.003973119661869555
get_robot_state_min0.0036993163755570336
get_state_dump_max0.005072044194687614
get_state_dump_mean0.004918844532653896
get_state_dump_median0.004941581801401279
get_state_dump_min0.004720170333125411
get_ui_image_max0.03530509444488876
get_ui_image_mean0.030972880503235017
get_ui_image_median0.030802959546236845
get_ui_image_min0.0269805084755776
in-drivable-lane_max47.14999999999869
in-drivable-lane_mean22.06249999999945
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.645379713833398, "get_ui_image": 0.029006453179796967, "step_physics": 0.09828134897249526, "survival_time": 59.99999999999873, "driven_lanedir": 1.9959805042009735, "get_state_dump": 0.005072044194687614, "get_robot_state": 0.004072141488525492, "sim_render-ego0": 0.004303351727056067, "get_duckie_state": 2.5876654276343606e-06, "in-drivable-lane": 47.14999999999869, "deviation-heading": 1.7431283165635116, "agent_compute-ego0": 0.013512044425411684, "complete-iteration": 0.16882449641612846, "set_robot_commands": 0.0024503121070321853, "deviation-center-line": 0.5319523575591518, "driven_lanedir_consec": 1.9959805042009735, "sim_compute_sim_state": 0.00971330472769884, "sim_compute_performance-ego0": 0.002306659453913731}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.310797573572996, "get_ui_image": 0.03530509444488876, "step_physics": 0.14864879366995273, "survival_time": 4.299999999999993, "driven_lanedir": 0.15594974288255958, "get_state_dump": 0.004895561042873339, "get_robot_state": 0.0036993163755570336, "sim_render-ego0": 0.003918560071923267, "get_duckie_state": 1.937493510629939e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.7963314762420797, "agent_compute-ego0": 0.013799346726516197, "complete-iteration": 0.22446646087471095, "set_robot_commands": 0.0022157773204233453, "deviation-center-line": 0.18466380852322736, "driven_lanedir_consec": 0.15594974288255958, "sim_compute_sim_state": 0.009975181228813084, "sim_compute_performance-ego0": 0.001924920356136629}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.3240384048350355, "get_ui_image": 0.03259946591267672, "step_physics": 0.1201225644842512, "survival_time": 52.59999999999915, "driven_lanedir": 1.761554333106301, "get_state_dump": 0.00498760255992922, "get_robot_state": 0.004131636615039503, "sim_render-ego0": 0.004373796079007082, "get_duckie_state": 2.4935458800052308e-06, "in-drivable-lane": 39.5999999999991, "deviation-heading": 2.3128372478460526, "agent_compute-ego0": 0.014245647310871004, "complete-iteration": 0.197742674085829, "set_robot_commands": 0.0024784052813494645, "deviation-center-line": 0.610071117110496, "driven_lanedir_consec": 1.761554333106301, "sim_compute_sim_state": 0.012351566796515627, "sim_compute_performance-ego0": 0.0023467943765725393}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.690344311775169, "get_ui_image": 0.0269805084755776, "step_physics": 0.09636253659473074, "survival_time": 59.99999999999873, "driven_lanedir": 7.512537493606136, "get_state_dump": 0.004720170333125411, "get_robot_state": 0.003874097835213616, "sim_render-ego0": 0.003981211302580186, "get_duckie_state": 2.039362250716363e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.412223748003852, "agent_compute-ego0": 0.01264823108390408, "complete-iteration": 0.15937053829704495, "set_robot_commands": 0.0022390345351880636, "deviation-center-line": 3.5238447791556533, "driven_lanedir_consec": 7.512537493606136, "sim_compute_sim_state": 0.006406088256518311, "sim_compute_performance-ego0": 0.0020720103102659405}}
set_robot_commands_max0.0024784052813494645
set_robot_commands_mean0.002345882310998265
set_robot_commands_median0.0023446733211101244
set_robot_commands_min0.0022157773204233453
sim_compute_performance-ego0_max0.0023467943765725393
sim_compute_performance-ego0_mean0.00216259612422221
sim_compute_performance-ego0_median0.002189334882089835
sim_compute_performance-ego0_min0.001924920356136629
sim_compute_sim_state_max0.012351566796515627
sim_compute_sim_state_mean0.009611535252386469
sim_compute_sim_state_median0.009844242978255962
sim_compute_sim_state_min0.006406088256518311
sim_render-ego0_max0.004373796079007082
sim_render-ego0_mean0.004144229795141651
sim_render-ego0_median0.004142281514818127
sim_render-ego0_min0.003918560071923267
simulation-passed1
step_physics_max0.14864879366995273
step_physics_mean0.11585381093035747
step_physics_median0.10920195672837324
step_physics_min0.09636253659473074
survival_time_max59.99999999999873
survival_time_mean44.22499999999915
survival_time_min4.299999999999993
No reset possible
5790010773Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6338095706111017
survival_time_median9.725000000000003
deviation-center-line_median0.22050651620797648
in-drivable-lane_median5.55000000000001


other stats
agent_compute-ego0_max0.014823551386431918
agent_compute-ego0_mean0.013998047466313382
agent_compute-ego0_median0.01386720073316262
agent_compute-ego0_min0.01343423701249636
complete-iteration_max0.22291233891346415
complete-iteration_mean0.2044736601349773
complete-iteration_median0.21173112135055497
complete-iteration_min0.17152005892533523
deviation-center-line_max0.8957590843027463
deviation-center-line_mean0.3736617014310152
deviation-center-line_min0.15787468900536164
deviation-heading_max3.424705295527488
deviation-heading_mean1.6163491305641433
deviation-heading_median1.1261697114482103
deviation-heading_min0.7883518038326649
driven_any_max4.971994536963439
driven_any_mean2.299425536008408
driven_any_median1.45502298868832
driven_any_min1.3156616296935535
driven_lanedir_consec_max3.6089819706579616
driven_lanedir_consec_mean1.370298753161813
driven_lanedir_consec_min0.6045939007670871
driven_lanedir_max3.6089819706579616
driven_lanedir_mean1.370298753161813
driven_lanedir_median0.6338095706111017
driven_lanedir_min0.6045939007670871
get_duckie_state_max1.713226401740736e-06
get_duckie_state_mean1.5920560136390997e-06
get_duckie_state_median1.5973419279092963e-06
get_duckie_state_min1.4603137969970703e-06
get_robot_state_max0.004226768480743047
get_robot_state_mean0.004067579942203098
get_robot_state_median0.004079623629889187
get_robot_state_min0.003884304028290969
get_state_dump_max0.005389815471211418
get_state_dump_mean0.005153041143384851
get_state_dump_median0.005121528052087409
get_state_dump_min0.004979292998153172
get_ui_image_max0.03844171427608876
get_ui_image_mean0.03388315837583148
get_ui_image_median0.03448031316739055
get_ui_image_min0.028130292892456055
in-drivable-lane_max7.950000000000113
in-drivable-lane_mean5.937500000000032
in-drivable-lane_min4.6999999999999975
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.971994536963439, "get_ui_image": 0.03294540500479503, "step_physics": 0.12353297699929898, "survival_time": 29.500000000000284, "driven_lanedir": 3.6089819706579616, "get_state_dump": 0.005259279067141151, "get_robot_state": 0.004226768480743047, "sim_render-ego0": 0.004426026303957763, "get_duckie_state": 1.7052374515436628e-06, "in-drivable-lane": 7.950000000000113, "deviation-heading": 3.424705295527488, "agent_compute-ego0": 0.013895599975198658, "complete-iteration": 0.20154127292019863, "set_robot_commands": 0.002595187443767102, "deviation-center-line": 0.8957590843027463, "driven_lanedir_consec": 3.6089819706579616, "sim_compute_sim_state": 0.012103499898248922, "sim_compute_performance-ego0": 0.002451338743800439}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3156616296935535, "get_ui_image": 0.03844171427608876, "step_physics": 0.14139541213432055, "survival_time": 8.84999999999999, "driven_lanedir": 0.6045939007670871, "get_state_dump": 0.004979292998153172, "get_robot_state": 0.003954911499880673, "sim_render-ego0": 0.004137311088904905, "get_duckie_state": 1.4894464042749298e-06, "in-drivable-lane": 4.6999999999999975, "deviation-heading": 1.454861010320607, "agent_compute-ego0": 0.013838801491126583, "complete-iteration": 0.2219209697809112, "set_robot_commands": 0.00239260946766714, "deviation-center-line": 0.23162397888800423, "driven_lanedir_consec": 0.6045939007670871, "sim_compute_sim_state": 0.01055965530738402, "sim_compute_performance-ego0": 0.002127275038301275}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3469488393296147, "get_ui_image": 0.03601522132998607, "step_physics": 0.1426710860976756, "survival_time": 9.099999999999994, "driven_lanedir": 0.6312617777836231, "get_state_dump": 0.005389815471211418, "get_robot_state": 0.004204335759897701, "sim_render-ego0": 0.004608313242594401, "get_duckie_state": 1.713226401740736e-06, "in-drivable-lane": 4.900000000000001, "deviation-heading": 0.7883518038326649, "agent_compute-ego0": 0.014823551386431918, "complete-iteration": 0.22291233891346415, "set_robot_commands": 0.0025979000362542156, "deviation-center-line": 0.15787468900536164, "driven_lanedir_consec": 0.6312617777836231, "sim_compute_sim_state": 0.010033163216596091, "sim_compute_performance-ego0": 0.002458810806274414}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.563097138047025, "get_ui_image": 0.028130292892456055, "step_physics": 0.1070349055987138, "survival_time": 10.350000000000012, "driven_lanedir": 0.6363573634385802, "get_state_dump": 0.004983777037033668, "get_robot_state": 0.003884304028290969, "sim_render-ego0": 0.003979145334317134, "get_duckie_state": 1.4603137969970703e-06, "in-drivable-lane": 6.200000000000019, "deviation-heading": 0.7974784125758138, "agent_compute-ego0": 0.01343423701249636, "complete-iteration": 0.17152005892533523, "set_robot_commands": 0.002300613201581515, "deviation-center-line": 0.2093890535279487, "driven_lanedir_consec": 0.6363573634385802, "sim_compute_sim_state": 0.005631924821780278, "sim_compute_performance-ego0": 0.0020508021116256714}}
set_robot_commands_max0.0025979000362542156
set_robot_commands_mean0.0024715775373174934
set_robot_commands_median0.002493898455717121
set_robot_commands_min0.002300613201581515
sim_compute_performance-ego0_max0.002458810806274414
sim_compute_performance-ego0_mean0.00227205667500045
sim_compute_performance-ego0_median0.002289306891050857
sim_compute_performance-ego0_min0.0020508021116256714
sim_compute_sim_state_max0.012103499898248922
sim_compute_sim_state_mean0.009582060811002328
sim_compute_sim_state_median0.010296409261990056
sim_compute_sim_state_min0.005631924821780278
sim_render-ego0_max0.004608313242594401
sim_render-ego0_mean0.0042876989924435505
sim_render-ego0_median0.004281668696431334
sim_render-ego0_min0.003979145334317134
simulation-passed1
step_physics_max0.1426710860976756
step_physics_mean0.12865859520750222
step_physics_median0.13246419456680977
step_physics_min0.1070349055987138
survival_time_max29.500000000000284
survival_time_mean14.45000000000007
survival_time_min8.84999999999999
No reset possible
5789710774Γ‰tienne BoucherΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:05:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6663804571375769
survival_time_median5.574999999999989
deviation-center-line_median0.09462247218232148
in-drivable-lane_median3.1499999999999906


other stats
agent_compute-ego0_max0.015247725477122297
agent_compute-ego0_mean0.014626401196628192
agent_compute-ego0_median0.014859926817512328
agent_compute-ego0_min0.013538025674365815
complete-iteration_max0.30131909721776057
complete-iteration_mean0.23803616678080733
complete-iteration_median0.22406659067795215
complete-iteration_min0.2026923885495644
deviation-center-line_max0.2520155509936589
deviation-center-line_mean0.1254571374152907
deviation-center-line_min0.06056805430286088
deviation-heading_max0.9941962522274204
deviation-heading_mean0.5812439192042895
deviation-heading_median0.4760551869987488
deviation-heading_min0.37866905059224054
driven_any_max1.8378657258535975
driven_any_mean1.4011081692025886
driven_any_median1.5758083522463853
driven_any_min0.6149502464639867
driven_lanedir_consec_max0.6914890612579228
driven_lanedir_consec_mean0.5537420070562915
driven_lanedir_consec_min0.1907180526920893
driven_lanedir_max0.6914890612579228
driven_lanedir_mean0.5537420070562915
driven_lanedir_median0.6663804571375769
driven_lanedir_min0.1907180526920893
get_duckie_state_max2.916413124161537e-06
get_duckie_state_mean2.797264750643334e-06
get_duckie_state_median2.8401584417093095e-06
get_duckie_state_min2.5923289949931797e-06
get_robot_state_max0.004650714104635674
get_robot_state_mean0.004569164156326126
get_robot_state_median0.004590951731748649
get_robot_state_min0.004444039057171534
get_state_dump_max0.005753366570723684
get_state_dump_mean0.005605099103371743
get_state_dump_median0.005674438185294754
get_state_dump_min0.005318153472173782
get_ui_image_max0.04140249888102213
get_ui_image_mean0.03519239559996675
get_ui_image_median0.0341850622391804
get_ui_image_min0.03099695904048409
in-drivable-lane_max3.949999999999986
in-drivable-lane_mean3.0124999999999913
in-drivable-lane_min1.7999999999999978
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.8203826980140383, "get_ui_image": 0.03168583294701955, "step_physics": 0.14118124000609866, "survival_time": 6.249999999999986, "driven_lanedir": 0.6914890612579228, "get_state_dump": 0.005318153472173782, "get_robot_state": 0.004444039057171534, "sim_render-ego0": 0.0044286175379677425, "get_duckie_state": 2.5923289949931797e-06, "in-drivable-lane": 3.7499999999999902, "deviation-heading": 0.9941962522274204, "agent_compute-ego0": 0.013538025674365815, "complete-iteration": 0.21600682016402956, "set_robot_commands": 0.002634377706618536, "deviation-center-line": 0.2520155509936589, "driven_lanedir_consec": 0.6914890612579228, "sim_compute_sim_state": 0.01013285583919949, "sim_compute_performance-ego0": 0.0025250003451392764}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6149502464639867, "get_ui_image": 0.04140249888102213, "step_physics": 0.21210352579752603, "survival_time": 2.799999999999998, "driven_lanedir": 0.1907180526920893, "get_state_dump": 0.005753366570723684, "get_robot_state": 0.004650714104635674, "sim_render-ego0": 0.004864998031080815, "get_duckie_state": 2.8568401671292488e-06, "in-drivable-lane": 1.7999999999999978, "deviation-heading": 0.5522525733248023, "agent_compute-ego0": 0.015118155563086794, "complete-iteration": 0.30131909721776057, "set_robot_commands": 0.0027614350904498182, "deviation-center-line": 0.06056805430286088, "driven_lanedir_consec": 0.1907180526920893, "sim_compute_sim_state": 0.0119274331812273, "sim_compute_performance-ego0": 0.002604045365986071}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.331234006478732, "get_ui_image": 0.03668429153134124, "step_physics": 0.14935220612419975, "survival_time": 4.899999999999991, "driven_lanedir": 0.6584254974592502, "get_state_dump": 0.005615617289687648, "get_robot_state": 0.004647214003283568, "sim_render-ego0": 0.004898670947912968, "get_duckie_state": 2.916413124161537e-06, "in-drivable-lane": 2.549999999999991, "deviation-heading": 0.3998578006726953, "agent_compute-ego0": 0.015247725477122297, "complete-iteration": 0.2321263611918748, "set_robot_commands": 0.0028579596317175665, "deviation-center-line": 0.09097473650040876, "driven_lanedir_consec": 0.6584254974592502, "sim_compute_sim_state": 0.010027870987400864, "sim_compute_performance-ego0": 0.0026655317556978477}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8378657258535975, "get_ui_image": 0.03099695904048409, "step_physics": 0.13064940144696574, "survival_time": 6.299999999999986, "driven_lanedir": 0.6743354168159035, "get_state_dump": 0.005733259080901859, "get_robot_state": 0.004534689460213729, "sim_render-ego0": 0.004596909200112651, "get_duckie_state": 2.82347671628937e-06, "in-drivable-lane": 3.949999999999986, "deviation-heading": 0.37866905059224054, "agent_compute-ego0": 0.014601698071937862, "complete-iteration": 0.2026923885495644, "set_robot_commands": 0.0026505387674166463, "deviation-center-line": 0.0982702078642342, "driven_lanedir_consec": 0.6743354168159035, "sim_compute_sim_state": 0.006294693533829817, "sim_compute_performance-ego0": 0.0025079400520625077}}
set_robot_commands_max0.0028579596317175665
set_robot_commands_mean0.0027260777990506416
set_robot_commands_median0.002705986928933232
set_robot_commands_min0.002634377706618536
sim_compute_performance-ego0_max0.0026655317556978477
sim_compute_performance-ego0_mean0.0025756293797214256
sim_compute_performance-ego0_median0.0025645228555626737
sim_compute_performance-ego0_min0.0025079400520625077
sim_compute_sim_state_max0.0119274331812273
sim_compute_sim_state_mean0.009595713385414368
sim_compute_sim_state_median0.010080363413300176
sim_compute_sim_state_min0.006294693533829817
sim_render-ego0_max0.004898670947912968
sim_render-ego0_mean0.004697298929268544
sim_render-ego0_median0.004730953615596733
sim_render-ego0_min0.0044286175379677425
simulation-passed1
step_physics_max0.21210352579752603
step_physics_mean0.15832159334369755
step_physics_median0.1452667230651492
step_physics_min0.13064940144696574
survival_time_max6.299999999999986
survival_time_mean5.06249999999999
survival_time_min2.799999999999998
No reset possible
5788410787Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0744461885396674
survival_time_median9.675000000000011
deviation-center-line_median0.31660123524661254
in-drivable-lane_median2.7749999999999906


other stats
agent_compute-ego0_max0.015153127865199624
agent_compute-ego0_mean0.014179058780637088
agent_compute-ego0_median0.014195278875660114
agent_compute-ego0_min0.013172549506028494
complete-iteration_max0.252741776406765
complete-iteration_mean0.22205365227360344
complete-iteration_median0.22229141540770983
complete-iteration_min0.1908900018722292
deviation-center-line_max0.4780627307862399
deviation-center-line_mean0.31534463263753293
deviation-center-line_min0.1501133292706666
deviation-heading_max2.919562880347429
deviation-heading_mean1.398119935210166
deviation-heading_median1.057034957674582
deviation-heading_min0.5588469451440707
driven_any_max5.515090109833034
driven_any_mean2.4756759012132674
driven_any_median1.8049607415497664
driven_any_min0.7776920119205045
driven_lanedir_consec_max2.030530045319814
driven_lanedir_consec_mean1.13782328422652
driven_lanedir_consec_min0.3718707145069311
driven_lanedir_max2.030530045319814
driven_lanedir_mean1.13782328422652
driven_lanedir_median1.0744461885396674
driven_lanedir_min0.3718707145069311
get_duckie_state_max1.873288835797991e-06
get_duckie_state_mean1.7144680696516597e-06
get_duckie_state_median1.768343640069892e-06
get_duckie_state_min1.447896162668864e-06
get_robot_state_max0.0045494284943072465
get_robot_state_mean0.004180925709097566
get_robot_state_median0.004221573877743422
get_robot_state_min0.003731126586596171
get_state_dump_max0.005665773892924733
get_state_dump_mean0.005161037200065024
get_state_dump_median0.005211681559165678
get_state_dump_min0.004555011789004008
get_ui_image_max0.03614851335684458
get_ui_image_mean0.0329874682428697
get_ui_image_median0.03323163258740723
get_ui_image_min0.02933809443981978
in-drivable-lane_max19.050000000000225
in-drivable-lane_mean6.75000000000006
in-drivable-lane_min2.400000000000034
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.412976579679835, "get_ui_image": 0.030715683149913, "step_physics": 0.11572354275082784, "survival_time": 12.550000000000043, "driven_lanedir": 2.030530045319814, "get_state_dump": 0.005167522127666171, "get_robot_state": 0.004216873456561376, "sim_render-ego0": 0.0044863659238058426, "get_duckie_state": 1.873288835797991e-06, "in-drivable-lane": 2.400000000000034, "deviation-heading": 1.1400821959508882, "agent_compute-ego0": 0.01446013128946698, "complete-iteration": 0.1908900018722292, "set_robot_commands": 0.0025636638913835797, "deviation-center-line": 0.42623072605024465, "driven_lanedir_consec": 2.030530045319814, "sim_compute_sim_state": 0.011014995120820544, "sim_compute_performance-ego0": 0.002428498533036974}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7776920119205045, "get_ui_image": 0.03614851335684458, "step_physics": 0.17599409818649292, "survival_time": 4.749999999999991, "driven_lanedir": 0.3718707145069311, "get_state_dump": 0.004555011789004008, "get_robot_state": 0.003731126586596171, "sim_render-ego0": 0.004158973693847656, "get_duckie_state": 1.447896162668864e-06, "in-drivable-lane": 2.449999999999992, "deviation-heading": 0.9739877193982758, "agent_compute-ego0": 0.013172549506028494, "complete-iteration": 0.252741776406765, "set_robot_commands": 0.0023185014724731445, "deviation-center-line": 0.20697174444298044, "driven_lanedir_consec": 0.3718707145069311, "sim_compute_sim_state": 0.010447760423024496, "sim_compute_performance-ego0": 0.002118729054927826}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1969449034196975, "get_ui_image": 0.035747582024901456, "step_physics": 0.16436152214551494, "survival_time": 6.799999999999984, "driven_lanedir": 0.6609152669046544, "get_state_dump": 0.005665773892924733, "get_robot_state": 0.0045494284943072465, "sim_render-ego0": 0.004803328618516017, "get_duckie_state": 1.870802719227589e-06, "in-drivable-lane": 3.099999999999989, "deviation-heading": 0.5588469451440707, "agent_compute-ego0": 0.015153127865199624, "complete-iteration": 0.2461495034015962, "set_robot_commands": 0.0028008144267284087, "deviation-center-line": 0.1501133292706666, "driven_lanedir_consec": 0.6609152669046544, "sim_compute_sim_state": 0.010382265940199803, "sim_compute_performance-ego0": 0.002568615614062678}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.515090109833034, "get_ui_image": 0.02933809443981978, "step_physics": 0.12913323666927587, "survival_time": 27.350000000000257, "driven_lanedir": 1.4879771101746804, "get_state_dump": 0.005255840990665185, "get_robot_state": 0.00422627429892547, "sim_render-ego0": 0.004323187535696656, "get_duckie_state": 1.6658845609121949e-06, "in-drivable-lane": 19.050000000000225, "deviation-heading": 2.919562880347429, "agent_compute-ego0": 0.01393042646185325, "complete-iteration": 0.1984333274138235, "set_robot_commands": 0.0025426114562654145, "deviation-center-line": 0.4780627307862399, "driven_lanedir_consec": 1.4879771101746804, "sim_compute_sim_state": 0.007259420669861954, "sim_compute_performance-ego0": 0.002319623954104681}}
set_robot_commands_max0.0028008144267284087
set_robot_commands_mean0.002556397811712637
set_robot_commands_median0.002553137673824497
set_robot_commands_min0.0023185014724731445
sim_compute_performance-ego0_max0.002568615614062678
sim_compute_performance-ego0_mean0.0023588667890330397
sim_compute_performance-ego0_median0.0023740612435708274
sim_compute_performance-ego0_min0.002118729054927826
sim_compute_sim_state_max0.011014995120820544
sim_compute_sim_state_mean0.0097761105384767
sim_compute_sim_state_median0.01041501318161215
sim_compute_sim_state_min0.007259420669861954
sim_render-ego0_max0.004803328618516017
sim_render-ego0_mean0.004442963942966543
sim_render-ego0_median0.00440477672975125
sim_render-ego0_min0.004158973693847656
simulation-passed1
step_physics_max0.17599409818649292
step_physics_mean0.1463030999380279
step_physics_median0.1467473794073954
step_physics_min0.11572354275082784
survival_time_max27.350000000000257
survival_time_mean12.862500000000068
survival_time_min4.749999999999991
No reset possible
5787310786Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:03:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 47 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5782310808Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:27:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.92910114398751
survival_time_median47.44999999999944
deviation-center-line_median1.9358883105341431
in-drivable-lane_median30.099999999999508


other stats
agent_compute-ego0_max0.069582200286412
agent_compute-ego0_mean0.05319735460403464
agent_compute-ego0_median0.0495077754738817
agent_compute-ego0_min0.04419166718196313
complete-iteration_max0.3317192568637357
complete-iteration_mean0.2667150914132575
complete-iteration_median0.2564173924024066
complete-iteration_min0.2223063239844812
deviation-center-line_max3.0378607070080044
deviation-center-line_mean1.7767238720910066
deviation-center-line_min0.197258160287736
deviation-heading_max13.455047646817384
deviation-heading_mean5.898720959102295
deviation-heading_median4.000218891847344
deviation-heading_min2.139398405897107
driven_any_max4.169097013550336
driven_any_mean2.7444028892358823
driven_any_median3.2658930436657267
driven_any_min0.2767284560617391
driven_lanedir_consec_max1.3295270706644549
driven_lanedir_consec_mean0.8261568256699507
driven_lanedir_consec_min0.11689794404032794
driven_lanedir_max1.3295270706644549
driven_lanedir_mean0.8375481434312201
driven_lanedir_median0.9518837795100488
driven_lanedir_min0.11689794404032794
get_duckie_state_max2.502214790570854e-06
get_duckie_state_mean2.0883903112726585e-06
get_duckie_state_median2.07473131275627e-06
get_duckie_state_min1.70188382900724e-06
get_robot_state_max0.004817245030167079
get_robot_state_mean0.004505625615095998
get_robot_state_median0.004554213307954668
get_robot_state_min0.0040968308143075755
get_state_dump_max0.006076701796881043
get_state_dump_mean0.005570431160626936
get_state_dump_median0.005477642175453056
get_state_dump_min0.005249738494720586
get_ui_image_max0.04135490880154147
get_ui_image_mean0.033949516965180435
get_ui_image_median0.03280351909345253
get_ui_image_min0.02883612087227522
in-drivable-lane_max40.19999999999904
in-drivable-lane_mean25.649999999999512
in-drivable-lane_min2.199999999999992
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.36617684295212, "get_ui_image": 0.03173739886249766, "step_physics": 0.16434393045046128, "survival_time": 34.900000000000155, "driven_lanedir": 0.6611176176908357, "get_state_dump": 0.005565449233048293, "get_robot_state": 0.004565466797573543, "sim_render-ego0": 0.004550577062735059, "get_duckie_state": 2.2252400716145835e-06, "in-drivable-lane": 23.90000000000009, "deviation-heading": 4.564177154054568, "agent_compute-ego0": 0.04788196751999753, "complete-iteration": 0.2752892292279201, "set_robot_commands": 0.0026239455172602883, "deviation-center-line": 1.3016958974203483, "driven_lanedir_consec": 0.6611176176908357, "sim_compute_sim_state": 0.011367585696546476, "sim_compute_performance-ego0": 0.002522775884691056}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2767284560617391, "get_ui_image": 0.04135490880154147, "step_physics": 0.1867290747047651, "survival_time": 4.99999999999999, "driven_lanedir": 0.11689794404032794, "get_state_dump": 0.006076701796881043, "get_robot_state": 0.004817245030167079, "sim_render-ego0": 0.005045225124547977, "get_duckie_state": 2.502214790570854e-06, "in-drivable-lane": 2.199999999999992, "deviation-heading": 2.139398405897107, "agent_compute-ego0": 0.069582200286412, "complete-iteration": 0.3317192568637357, "set_robot_commands": 0.0027539494014022373, "deviation-center-line": 0.197258160287736, "driven_lanedir_consec": 0.11689794404032794, "sim_compute_sim_state": 0.012640327510267202, "sim_compute_performance-ego0": 0.002585366220757513}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.1656092443793336, "get_ui_image": 0.0338696393244074, "step_physics": 0.12228384879506896, "survival_time": 59.99999999999873, "driven_lanedir": 1.2426499413292618, "get_state_dump": 0.005249738494720586, "get_robot_state": 0.0040968308143075755, "sim_render-ego0": 0.004388449293290645, "get_duckie_state": 1.70188382900724e-06, "in-drivable-lane": 36.29999999999893, "deviation-heading": 13.455047646817384, "agent_compute-ego0": 0.05113358342776588, "complete-iteration": 0.23754555557689305, "set_robot_commands": 0.002491833466872089, "deviation-center-line": 2.570080723647938, "driven_lanedir_consec": 1.1970846702841844, "sim_compute_sim_state": 0.011623124298108408, "sim_compute_performance-ego0": 0.002291570595162398}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.169097013550336, "get_ui_image": 0.02883612087227522, "step_physics": 0.1220631849557335, "survival_time": 59.99999999999873, "driven_lanedir": 1.3295270706644549, "get_state_dump": 0.00538983511785782, "get_robot_state": 0.004542959818335794, "sim_render-ego0": 0.004581250517096349, "get_duckie_state": 1.9242225538979563e-06, "in-drivable-lane": 40.19999999999904, "deviation-heading": 3.436260629640119, "agent_compute-ego0": 0.04419166718196313, "complete-iteration": 0.2223063239844812, "set_robot_commands": 0.0027634031468882947, "deviation-center-line": 3.0378607070080044, "driven_lanedir_consec": 1.3295270706644549, "sim_compute_sim_state": 0.007303386802578052, "sim_compute_performance-ego0": 0.0025065395853898606}}
set_robot_commands_max0.0027634031468882947
set_robot_commands_mean0.002658282883105727
set_robot_commands_median0.002688947459331263
set_robot_commands_min0.002491833466872089
sim_compute_performance-ego0_max0.002585366220757513
sim_compute_performance-ego0_mean0.0024765630715002066
sim_compute_performance-ego0_median0.002514657735040458
sim_compute_performance-ego0_min0.002291570595162398
sim_compute_sim_state_max0.012640327510267202
sim_compute_sim_state_mean0.010733606076875036
sim_compute_sim_state_median0.011495354997327442
sim_compute_sim_state_min0.007303386802578052
sim_render-ego0_max0.005045225124547977
sim_render-ego0_mean0.004641375499417507
sim_render-ego0_median0.004565913789915704
sim_render-ego0_min0.004388449293290645
simulation-passed1
step_physics_max0.1867290747047651
step_physics_mean0.14885500972650725
step_physics_median0.14331388962276512
step_physics_min0.1220631849557335
survival_time_max59.99999999999873
survival_time_mean39.9749999999994
survival_time_min4.99999999999999
No reset possible
5780110822Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:11:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8832013061269521
survival_time_median14.550000000000072
deviation-center-line_median0.4180461814781279
in-drivable-lane_median6.400000000000057


other stats
agent_compute-ego0_max0.01382883403192684
agent_compute-ego0_mean0.013611776135759496
agent_compute-ego0_median0.013543548342656291
agent_compute-ego0_min0.013531173825798548
complete-iteration_max0.24226639464094832
complete-iteration_mean0.2062892651628504
complete-iteration_median0.20432678915369068
complete-iteration_min0.1742370877030719
deviation-center-line_max0.707972776860522
deviation-center-line_mean0.44611000572653825
deviation-center-line_min0.24037488308937535
deviation-heading_max3.824759195048034
deviation-heading_mean2.346122896975631
deviation-heading_median2.195055222859297
deviation-heading_min1.1696219471358953
driven_any_max4.786768821575945
driven_any_mean2.7031109987486723
driven_any_median2.3346937904772505
driven_any_min1.3562875924642428
driven_lanedir_consec_max1.9692624513834756
driven_lanedir_consec_mean1.0751361585961738
driven_lanedir_consec_min0.5648795707473155
driven_lanedir_max1.9692624513834756
driven_lanedir_mean1.0751361585961738
driven_lanedir_median0.8832013061269521
driven_lanedir_min0.5648795707473155
get_duckie_state_max1.7996970306142877e-06
get_duckie_state_mean1.610281649903922e-06
get_duckie_state_median1.6097356136372963e-06
get_duckie_state_min1.4219583417268075e-06
get_robot_state_max0.004233545873964262
get_robot_state_mean0.0040334685110219376
get_robot_state_median0.004065754954640288
get_robot_state_min0.003768818260842909
get_state_dump_max0.005267427238400953
get_state_dump_mean0.005069613103371611
get_state_dump_median0.005139772696729987
get_state_dump_min0.004731479781625517
get_ui_image_max0.037965882791055214
get_ui_image_mean0.03235151985109661
get_ui_image_median0.03230550688948129
get_ui_image_min0.02682918283436865
in-drivable-lane_max21.000000000000227
in-drivable-lane_mean9.737500000000084
in-drivable-lane_min5.150000000000002
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.9524321273781373, "get_ui_image": 0.031512778881844394, "step_physics": 0.12853542457326958, "survival_time": 18.00000000000012, "driven_lanedir": 1.9692624513834756, "get_state_dump": 0.005267427238400953, "get_robot_state": 0.004233545873964262, "sim_render-ego0": 0.00434439070006817, "get_duckie_state": 1.7996970306142877e-06, "in-drivable-lane": 5.900000000000084, "deviation-heading": 2.7864835845046407, "agent_compute-ego0": 0.013555517487248555, "complete-iteration": 0.20388675198330444, "set_robot_commands": 0.00253165527724163, "deviation-center-line": 0.707972776860522, "driven_lanedir_consec": 1.9692624513834756, "sim_compute_sim_state": 0.011417237675421124, "sim_compute_performance-ego0": 0.0023776137597673157}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3562875924642428, "get_ui_image": 0.037965882791055214, "step_physics": 0.16165283821724558, "survival_time": 9.199999999999996, "driven_lanedir": 0.5648795707473155, "get_state_dump": 0.005080663835680162, "get_robot_state": 0.004071176374280775, "sim_render-ego0": 0.004180623389579154, "get_duckie_state": 1.5593863822318412e-06, "in-drivable-lane": 5.150000000000002, "deviation-heading": 1.6036268612139537, "agent_compute-ego0": 0.01353157919806403, "complete-iteration": 0.24226639464094832, "set_robot_commands": 0.0024206883198506124, "deviation-center-line": 0.24561547182865356, "driven_lanedir_consec": 0.5648795707473155, "sim_compute_sim_state": 0.011025534449396909, "sim_compute_performance-ego0": 0.0022328930932122306}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.786768821575945, "get_ui_image": 0.033098234897118196, "step_physics": 0.12811498617844477, "survival_time": 29.60000000000029, "driven_lanedir": 1.1486747123560836, "get_state_dump": 0.005198881557779811, "get_robot_state": 0.0040603335349998024, "sim_render-ego0": 0.004241245794055032, "get_duckie_state": 1.6600848450427514e-06, "in-drivable-lane": 21.000000000000227, "deviation-heading": 3.824759195048034, "agent_compute-ego0": 0.01382883403192684, "complete-iteration": 0.20476682632407692, "set_robot_commands": 0.00246735688606764, "deviation-center-line": 0.5904768911276022, "driven_lanedir_consec": 1.1486747123560836, "sim_compute_sim_state": 0.01137794290384997, "sim_compute_performance-ego0": 0.0022625613574434895}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.716955453576364, "get_ui_image": 0.02682918283436865, "step_physics": 0.11153718601962376, "survival_time": 11.100000000000025, "driven_lanedir": 0.6177278998978206, "get_state_dump": 0.004731479781625517, "get_robot_state": 0.003768818260842909, "sim_render-ego0": 0.003975325101159613, "get_duckie_state": 1.4219583417268075e-06, "in-drivable-lane": 6.90000000000003, "deviation-heading": 1.1696219471358953, "agent_compute-ego0": 0.013531173825798548, "complete-iteration": 0.1742370877030719, "set_robot_commands": 0.0022735050440903736, "deviation-center-line": 0.24037488308937535, "driven_lanedir_consec": 0.6177278998978206, "sim_compute_sim_state": 0.005507347295102517, "sim_compute_performance-ego0": 0.001989302613810039}}
set_robot_commands_max0.00253165527724163
set_robot_commands_mean0.002423301381812564
set_robot_commands_median0.002444022602959126
set_robot_commands_min0.0022735050440903736
sim_compute_performance-ego0_max0.0023776137597673157
sim_compute_performance-ego0_mean0.002215592706058269
sim_compute_performance-ego0_median0.00224772722532786
sim_compute_performance-ego0_min0.001989302613810039
sim_compute_sim_state_max0.011417237675421124
sim_compute_sim_state_mean0.009832015580942629
sim_compute_sim_state_median0.01120173867662344
sim_compute_sim_state_min0.005507347295102517
sim_render-ego0_max0.00434439070006817
sim_render-ego0_mean0.0041853962462154925
sim_render-ego0_median0.004210934591817093
sim_render-ego0_min0.003975325101159613
simulation-passed1
step_physics_max0.16165283821724558
step_physics_mean0.13246010874714592
step_physics_median0.12832520537585718
step_physics_min0.11153718601962376
survival_time_max29.60000000000029
survival_time_mean16.975000000000108
survival_time_min9.199999999999996
No reset possible
5779210824Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:03:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 26 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778910826Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 15 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5775510845Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:24:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9822733594580506
survival_time_median43.27499999999968
deviation-center-line_median2.4258123623316887
in-drivable-lane_median10.750000000000028


other stats
agent_compute-ego0_max0.013322260099298811
agent_compute-ego0_mean0.013178068655248915
agent_compute-ego0_median0.013314056888798297
agent_compute-ego0_min0.012761900744100257
complete-iteration_max0.2018884899812773
complete-iteration_mean0.1833300554557124
complete-iteration_median0.18989447467996784
complete-iteration_min0.1516427824816366
deviation-center-line_max4.311888101664969
deviation-center-line_mean2.318492000437954
deviation-center-line_min0.1104551754234702
deviation-heading_max25.846860590459347
deviation-heading_mean11.911763227347285
deviation-heading_median10.64063765474694
deviation-heading_min0.5189170094359201
driven_any_max10.604857682975751
driven_any_mean7.264252007354024
driven_any_median8.040195301752151
driven_any_min2.3717597429360406
driven_lanedir_consec_max6.321211202761411
driven_lanedir_consec_mean3.1709536675829524
driven_lanedir_consec_min0.3980567486542965
driven_lanedir_max8.6709855395823
driven_lanedir_mean4.660992624329323
driven_lanedir_median4.787464104540346
driven_lanedir_min0.3980567486542965
get_duckie_state_max2.3798838413452265e-06
get_duckie_state_mean2.190007432511961e-06
get_duckie_state_median2.2049536578667036e-06
get_duckie_state_min1.9702385729692115e-06
get_robot_state_max0.0038711796788608328
get_robot_state_mean0.003743041527829295
get_robot_state_median0.00380203742520534
get_robot_state_min0.003496911582045668
get_state_dump_max0.004883158557555255
get_state_dump_mean0.004717159566042407
get_state_dump_median0.004705844330386082
get_state_dump_min0.004573791045842208
get_ui_image_max0.03589257868402308
get_ui_image_mean0.03140006068110728
get_ui_image_median0.031953154767260836
get_ui_image_min0.025801354505884364
in-drivable-lane_max19.099999999999564
in-drivable-lane_mean12.262499999999832
in-drivable-lane_min8.449999999999704
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.620883319226352, "get_ui_image": 0.03009974711081561, "step_physics": 0.1135126373347114, "survival_time": 33.95000000000021, "driven_lanedir": 4.288456080728078, "get_state_dump": 0.004883158557555255, "get_robot_state": 0.0038711796788608328, "sim_render-ego0": 0.0040662039728725655, "get_duckie_state": 2.2982849794275622e-06, "in-drivable-lane": 11.350000000000012, "deviation-heading": 8.295097059432605, "agent_compute-ego0": 0.013322260099298811, "complete-iteration": 0.1836319429032943, "set_robot_commands": 0.002320184427149156, "deviation-center-line": 1.5010077214212898, "driven_lanedir_consec": 3.0546170885325608, "sim_compute_sim_state": 0.009330289153491747, "sim_compute_performance-ego0": 0.0021336800911847284}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.45950728427795, "get_ui_image": 0.03589257868402308, "step_physics": 0.12309731551749224, "survival_time": 59.99999999999873, "driven_lanedir": 5.286472128352615, "get_state_dump": 0.004678784163170909, "get_robot_state": 0.0037550554982232216, "sim_render-ego0": 0.004065694658087255, "get_duckie_state": 2.1116223363058453e-06, "in-drivable-lane": 19.099999999999564, "deviation-heading": 25.846860590459347, "agent_compute-ego0": 0.013306525029508796, "complete-iteration": 0.2018884899812773, "set_robot_commands": 0.002284623304076437, "deviation-center-line": 4.311888101664969, "driven_lanedir_consec": 2.9099296303835405, "sim_compute_sim_state": 0.01263632345556915, "sim_compute_performance-ego0": 0.002084975635677849}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.604857682975751, "get_ui_image": 0.033806562423706055, "step_physics": 0.11855469922847332, "survival_time": 52.59999999999915, "driven_lanedir": 8.6709855395823, "get_state_dump": 0.004732904497601255, "get_robot_state": 0.0038490193521874584, "sim_render-ego0": 0.004109172286697489, "get_duckie_state": 2.3798838413452265e-06, "in-drivable-lane": 8.449999999999704, "deviation-heading": 12.986178250061272, "agent_compute-ego0": 0.013321588748087795, "complete-iteration": 0.1961570064566414, "set_robot_commands": 0.002359605129854179, "deviation-center-line": 3.350617003242087, "driven_lanedir_consec": 6.321211202761411, "sim_compute_sim_state": 0.013159850836932262, "sim_compute_performance-ego0": 0.0021717118175394287}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.3717597429360406, "get_ui_image": 0.025801354505884364, "step_physics": 0.09224088454809716, "survival_time": 12.650000000000045, "driven_lanedir": 0.3980567486542965, "get_state_dump": 0.004573791045842208, "get_robot_state": 0.003496911582045668, "sim_render-ego0": 0.003804025687570647, "get_duckie_state": 1.9702385729692115e-06, "in-drivable-lane": 10.150000000000045, "deviation-heading": 0.5189170094359201, "agent_compute-ego0": 0.012761900744100257, "complete-iteration": 0.1516427824816366, "set_robot_commands": 0.002160536022636834, "deviation-center-line": 0.1104551754234702, "driven_lanedir_consec": 0.3980567486542965, "sim_compute_sim_state": 0.004861902064225805, "sim_compute_performance-ego0": 0.001861188355393297}}
set_robot_commands_max0.002359605129854179
set_robot_commands_mean0.0022812372209291515
set_robot_commands_median0.0023024038656127965
set_robot_commands_min0.002160536022636834
sim_compute_performance-ego0_max0.0021717118175394287
sim_compute_performance-ego0_mean0.002062888974948826
sim_compute_performance-ego0_median0.0021093278634312885
sim_compute_performance-ego0_min0.001861188355393297
sim_compute_sim_state_max0.013159850836932262
sim_compute_sim_state_mean0.009997091377554742
sim_compute_sim_state_median0.01098330630453045
sim_compute_sim_state_min0.004861902064225805
sim_render-ego0_max0.004109172286697489
sim_render-ego0_mean0.004011274151306989
sim_render-ego0_median0.0040659493154799106
sim_render-ego0_min0.003804025687570647
simulation-passed1
step_physics_max0.12309731551749224
step_physics_mean0.11185138415719352
step_physics_median0.11603366828159235
step_physics_min0.09224088454809716
survival_time_max59.99999999999873
survival_time_mean39.79999999999953
survival_time_min12.650000000000045
No reset possible
5771110871Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:37:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.249573610097244
survival_time_median59.99999999999873
deviation-center-line_median2.6606984484913014
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01260004015786761
agent_compute-ego0_mean0.012441133529717084
agent_compute-ego0_median0.01242448179846898
agent_compute-ego0_min0.012315530364062764
complete-iteration_max0.2050133497887706
complete-iteration_mean0.18543431150426873
complete-iteration_median0.1867761741966927
complete-iteration_min0.16317154783491886
deviation-center-line_max3.591399827684051
deviation-center-line_mean2.7476631751071032
deviation-center-line_min2.07785597576176
deviation-heading_max14.179445030158252
deviation-heading_mean11.776287882282292
deviation-heading_median11.71594976546766
deviation-heading_min9.4938069680356
driven_any_max9.348929321145132
driven_any_mean8.659293298934465
driven_any_median8.487362873873916
driven_any_min8.3135181268449
driven_lanedir_consec_max9.126528062506155
driven_lanedir_consec_mean8.347923458442699
driven_lanedir_consec_min7.766018551070156
driven_lanedir_max9.126528062506155
driven_lanedir_mean8.347923458442699
driven_lanedir_median8.249573610097244
driven_lanedir_min7.766018551070156
get_duckie_state_max1.5807886306292608e-06
get_duckie_state_mean1.4234145019175508e-06
get_duckie_state_median1.4175086295376413e-06
get_duckie_state_min1.27785211796566e-06
get_robot_state_max0.0038860404024910274
get_robot_state_mean0.0037633367224001665
get_robot_state_median0.003742288391754887
get_robot_state_min0.0036827297035998646
get_state_dump_max0.004794163668185448
get_state_dump_mean0.004674412328734386
get_state_dump_median0.004657603322615929
get_state_dump_min0.004588279001520238
get_ui_image_max0.03606908883182929
get_ui_image_mean0.030903404648357585
get_ui_image_median0.030651289854915217
get_ui_image_min0.02624195005177062
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean0.4874999999999982
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.348929321145132, "get_ui_image": 0.029135884889258036, "step_physics": 0.1104937639959051, "survival_time": 59.99999999999873, "driven_lanedir": 9.126528062506155, "get_state_dump": 0.004794163668185448, "get_robot_state": 0.0038860404024910274, "sim_render-ego0": 0.004122155989139503, "get_duckie_state": 1.5807886306292608e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.55688916957674, "agent_compute-ego0": 0.01260004015786761, "complete-iteration": 0.17924450061204134, "set_robot_commands": 0.0023873142159848686, "deviation-center-line": 2.2898861528993133, "driven_lanedir_consec": 9.126528062506155, "sim_compute_sim_state": 0.009563428178417197, "sim_compute_performance-ego0": 0.002167571692740689}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.3135181268449, "get_ui_image": 0.03606908883182929, "step_physics": 0.12680186498770607, "survival_time": 59.99999999999873, "driven_lanedir": 7.766018551070156, "get_state_dump": 0.004659940559202984, "get_robot_state": 0.0037770029110872775, "sim_render-ego0": 0.004000322110051418, "get_duckie_state": 1.4134390368052664e-06, "in-drivable-lane": 1.949999999999993, "deviation-heading": 14.179445030158252, "agent_compute-ego0": 0.012496035660831855, "complete-iteration": 0.2050133497887706, "set_robot_commands": 0.002290458107471069, "deviation-center-line": 3.591399827684051, "driven_lanedir_consec": 7.766018551070156, "sim_compute_sim_state": 0.01275516767287433, "sim_compute_performance-ego0": 0.00207783816557542}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.461474157415841, "get_ui_image": 0.0321666948205724, "step_physics": 0.11984564402419064, "survival_time": 59.99999999999873, "driven_lanedir": 8.142880880866176, "get_state_dump": 0.004588279001520238, "get_robot_state": 0.0036827297035998646, "sim_render-ego0": 0.0038906195876401823, "get_duckie_state": 1.27785211796566e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.875010361358582, "agent_compute-ego0": 0.012352927936106102, "complete-iteration": 0.1943078477813441, "set_robot_commands": 0.002236199120895551, "deviation-center-line": 3.0315107440832896, "driven_lanedir_consec": 8.142880880866176, "sim_compute_sim_state": 0.013408375024597016, "sim_compute_performance-ego0": 0.0020526402399601486}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.513251590331993, "get_ui_image": 0.02624195005177062, "step_physics": 0.10197179641056615, "survival_time": 59.99999999999873, "driven_lanedir": 8.35626633932831, "get_state_dump": 0.004655266086028875, "get_robot_state": 0.003707573872422497, "sim_render-ego0": 0.003873914008732144, "get_duckie_state": 1.421578222270016e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.4938069680356, "agent_compute-ego0": 0.012315530364062764, "complete-iteration": 0.16317154783491886, "set_robot_commands": 0.002210595625624073, "deviation-center-line": 2.07785597576176, "driven_lanedir_consec": 8.35626633932831, "sim_compute_sim_state": 0.006145959492031482, "sim_compute_performance-ego0": 0.0019636829131648107}}
set_robot_commands_max0.0023873142159848686
set_robot_commands_mean0.0022811417674938905
set_robot_commands_median0.00226332861418331
set_robot_commands_min0.002210595625624073
sim_compute_performance-ego0_max0.002167571692740689
sim_compute_performance-ego0_mean0.002065433252860267
sim_compute_performance-ego0_median0.0020652392027677843
sim_compute_performance-ego0_min0.0019636829131648107
sim_compute_sim_state_max0.013408375024597016
sim_compute_sim_state_mean0.010468232591980006
sim_compute_sim_state_median0.011159297925645763
sim_compute_sim_state_min0.006145959492031482
sim_render-ego0_max0.004122155989139503
sim_render-ego0_mean0.003971752923890812
sim_render-ego0_median0.0039454708488458005
sim_render-ego0_min0.003873914008732144
simulation-passed1
step_physics_max0.12680186498770607
step_physics_mean0.114778267354592
step_physics_median0.11516970401004788
step_physics_min0.10197179641056615
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5764110895Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:37:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.481459128084911
survival_time_median59.99999999999873
deviation-center-line_median3.613434860112113
in-drivable-lane_median2.6999999999999416


other stats
agent_compute-ego0_max0.03401698220480888
agent_compute-ego0_mean0.02735005350136737
agent_compute-ego0_median0.03154116824306517
agent_compute-ego0_min0.01230089531453027
complete-iteration_max0.2149756190977327
complete-iteration_mean0.19425565604861827
complete-iteration_median0.18819427152755952
complete-iteration_min0.1856584620416214
deviation-center-line_max4.088115249709699
deviation-center-line_mean3.535603253058478
deviation-center-line_min2.8274280422999856
deviation-heading_max21.838025979270647
deviation-heading_mean16.41282705061161
deviation-heading_median14.832797890623352
deviation-heading_min14.1476864419291
driven_any_max9.123528623852382
driven_any_mean8.35987372977891
driven_any_median8.18807964869811
driven_any_min7.93980699786704
driven_lanedir_consec_max6.035106405709536
driven_lanedir_consec_mean5.480875370141737
driven_lanedir_consec_min4.925476818687587
driven_lanedir_max8.384232509340046
driven_lanedir_mean7.556622911388473
driven_lanedir_median7.612618293743502
driven_lanedir_min6.61702254872684
get_duckie_state_max1.6258519257633613e-06
get_duckie_state_mean1.3832148663904346e-06
get_duckie_state_median1.3096147929500485e-06
get_duckie_state_min1.2877779538982811e-06
get_robot_state_max0.004011095016822529
get_robot_state_mean0.003813544131635527
get_robot_state_median0.0037750266771530926
get_robot_state_min0.0036930281554133967
get_state_dump_max0.004906292064898616
get_state_dump_mean0.004757133302442438
get_state_dump_median0.004729004327105444
get_state_dump_min0.004664232490660249
get_ui_image_max0.03590759071680429
get_ui_image_mean0.03136101377496712
get_ui_image_median0.031141278646470705
get_ui_image_min0.02725390709012275
in-drivable-lane_max6.649999999999903
in-drivable-lane_mean3.2499999999999325
in-drivable-lane_min0.949999999999946
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.93980699786704, "get_ui_image": 0.02836257075389954, "step_physics": 0.10426470461137884, "survival_time": 59.99999999999873, "driven_lanedir": 6.61702254872684, "get_state_dump": 0.004727358424991096, "get_robot_state": 0.0037553997262133646, "sim_render-ego0": 0.003966481163539458, "get_duckie_state": 1.3199376623199742e-06, "in-drivable-lane": 6.649999999999903, "deviation-heading": 21.838025979270647, "agent_compute-ego0": 0.02952754031013787, "complete-iteration": 0.18952014761900127, "set_robot_commands": 0.0023298918654976243, "deviation-center-line": 3.3572149219052085, "driven_lanedir_consec": 4.925476818687587, "sim_compute_sim_state": 0.010443623119548, "sim_compute_performance-ego0": 0.0020494556347595266}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.297966905909885, "get_ui_image": 0.03590759071680429, "step_physics": 0.1159480620581939, "survival_time": 59.99999999999873, "driven_lanedir": 7.863651010168645, "get_state_dump": 0.004664232490660249, "get_robot_state": 0.0036930281554133967, "sim_render-ego0": 0.003928867605306227, "get_duckie_state": 1.299291923580122e-06, "in-drivable-lane": 0.949999999999946, "deviation-heading": 14.487781375100017, "agent_compute-ego0": 0.03401698220480888, "complete-iteration": 0.2149756190977327, "set_robot_commands": 0.002254185728189054, "deviation-center-line": 4.088115249709699, "driven_lanedir_consec": 6.035106405709536, "sim_compute_sim_state": 0.012450466942132064, "sim_compute_performance-ego0": 0.0020198827976985936}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.123528623852382, "get_ui_image": 0.033919986539041866, "step_physics": 0.11011394672250868, "survival_time": 59.99999999999873, "driven_lanedir": 8.384232509340046, "get_state_dump": 0.004730650229219791, "get_robot_state": 0.0037946536280928206, "sim_render-ego0": 0.003999790879312304, "get_duckie_state": 1.2877779538982811e-06, "in-drivable-lane": 3.149999999999861, "deviation-heading": 14.1476864419291, "agent_compute-ego0": 0.01230089531453027, "complete-iteration": 0.1856584620416214, "set_robot_commands": 0.0023065657540225267, "deviation-center-line": 2.8274280422999856, "driven_lanedir_consec": 5.9899017597874735, "sim_compute_sim_state": 0.012338098538706047, "sim_compute_performance-ego0": 0.0020640057191364373}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.078192391486335, "get_ui_image": 0.02725390709012275, "step_physics": 0.1016766230927022, "survival_time": 59.99999999999873, "driven_lanedir": 7.361585577318359, "get_state_dump": 0.004906292064898616, "get_robot_state": 0.004011095016822529, "sim_render-ego0": 0.00413031462924268, "get_duckie_state": 1.6258519257633613e-06, "in-drivable-lane": 2.250000000000022, "deviation-heading": 15.177814406146688, "agent_compute-ego0": 0.03355479617599246, "complete-iteration": 0.1868683954361178, "set_robot_commands": 0.002346898792784577, "deviation-center-line": 3.869654798319017, "driven_lanedir_consec": 4.973016496382349, "sim_compute_sim_state": 0.006704065225999818, "sim_compute_performance-ego0": 0.0021795150540849747}}
set_robot_commands_max0.002346898792784577
set_robot_commands_mean0.0023093855351234453
set_robot_commands_median0.0023182288097600753
set_robot_commands_min0.002254185728189054
sim_compute_performance-ego0_max0.0021795150540849747
sim_compute_performance-ego0_mean0.002078214801419883
sim_compute_performance-ego0_median0.0020567306769479817
sim_compute_performance-ego0_min0.0020198827976985936
sim_compute_sim_state_max0.012450466942132064
sim_compute_sim_state_mean0.010484063456596485
sim_compute_sim_state_median0.011390860829127023
sim_compute_sim_state_min0.006704065225999818
sim_render-ego0_max0.00413031462924268
sim_render-ego0_mean0.004006363569350167
sim_render-ego0_median0.003983136021425881
sim_render-ego0_min0.003928867605306227
simulation-passed1
step_physics_max0.1159480620581939
step_physics_mean0.1080008341211959
step_physics_median0.10718932566694377
step_physics_min0.1016766230927022
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5763510933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-050:01:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5763211428Frank (Chude) QianΒ πŸ‡¨πŸ‡¦template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-erroryesnogpu-prod-050:00:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5763111428Frank (Chude) QianΒ πŸ‡¨πŸ‡¦template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-erroryesnogpu-prod-050:01:01
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5762811426Frank (Chude) QianΒ πŸ‡¨πŸ‡¦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-050:02:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5755710895Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:35:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.298410770684075
survival_time_median59.99999999999873
deviation-center-line_median3.687785585558592
in-drivable-lane_median2.1749999999999674


other stats
agent_compute-ego0_max0.034119451373542574
agent_compute-ego0_mean0.018647664939235583
agent_compute-ego0_median0.013993759834200616
agent_compute-ego0_min0.012483688714998548
complete-iteration_max0.2018321801184814
complete-iteration_mean0.18208953954099516
complete-iteration_median0.1765993533781625
complete-iteration_min0.1733272712891743
deviation-center-line_max3.9469112854637087
deviation-center-line_mean3.615005689057872
deviation-center-line_min3.1375402996505946
deviation-heading_max21.314512246821984
deviation-heading_mean17.587840956833222
deviation-heading_median16.92951858718211
deviation-heading_min15.177814406146688
driven_any_max8.905854678173014
driven_any_mean8.340726051467724
driven_any_median8.231002148168542
driven_any_min7.995045231360794
driven_lanedir_consec_max6.264209788480745
driven_lanedir_consec_mean5.458511956557811
driven_lanedir_consec_min4.973016496382349
driven_lanedir_max8.353254704992285
driven_lanedir_mean7.551368908584037
driven_lanedir_median7.4031035102379406
driven_lanedir_min7.046013908867984
get_duckie_state_max1.6314103938856291e-06
get_duckie_state_mean1.4172108544596627e-06
get_duckie_state_median1.3958703072045267e-06
get_duckie_state_min1.2456924095439672e-06
get_robot_state_max0.0038959148225935175
get_robot_state_mean0.0037650316085148417
get_robot_state_median0.003732849715849839
get_robot_state_min0.00369851217976617
get_state_dump_max0.004755903540999566
get_state_dump_mean0.004674068646665219
get_state_dump_median0.004683230838410364
get_state_dump_min0.004573909368840582
get_ui_image_max0.03604909958787802
get_ui_image_mean0.03089964697501939
get_ui_image_median0.030405183715883837
get_ui_image_min0.026739120880431875
in-drivable-lane_max4.249999999999904
in-drivable-lane_mean2.5374999999999535
in-drivable-lane_min1.549999999999975
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.38381190485075, "get_ui_image": 0.029018664737228153, "step_physics": 0.10453221442598187, "survival_time": 59.99999999999873, "driven_lanedir": 7.444621443157522, "get_state_dump": 0.004755903540999566, "get_robot_state": 0.0038959148225935175, "sim_render-ego0": 0.004024858776476858, "get_duckie_state": 1.6314103938856291e-06, "in-drivable-lane": 4.249999999999904, "deviation-heading": 18.27782981956926, "agent_compute-ego0": 0.012871118310488433, "complete-iteration": 0.1733272712891743, "set_robot_commands": 0.0023830075942904228, "deviation-center-line": 3.5059163727981666, "driven_lanedir_consec": 5.603397512725244, "sim_compute_sim_state": 0.009594422990733835, "sim_compute_performance-ego0": 0.0021530229979808088}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.995045231360794, "get_ui_image": 0.03604909958787802, "step_physics": 0.12247247759448202, "survival_time": 59.99999999999873, "driven_lanedir": 7.046013908867984, "get_state_dump": 0.004710606194654174, "get_robot_state": 0.0037330999461737, "sim_render-ego0": 0.003939989504468729, "get_duckie_state": 1.4588993653766718e-06, "in-drivable-lane": 2.0999999999999126, "deviation-heading": 21.314512246821984, "agent_compute-ego0": 0.015116401357912798, "complete-iteration": 0.2018321801184814, "set_robot_commands": 0.002219490762753451, "deviation-center-line": 3.9469112854637087, "driven_lanedir_consec": 4.993424028642906, "sim_compute_sim_state": 0.01144554116743788, "sim_compute_performance-ego0": 0.002050819841650106}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.905854678173014, "get_ui_image": 0.03179170269453952, "step_physics": 0.10478091696517652, "survival_time": 59.99999999999873, "driven_lanedir": 8.353254704992285, "get_state_dump": 0.004573909368840582, "get_robot_state": 0.0037325994855259776, "sim_render-ego0": 0.0038757961457416873, "get_duckie_state": 1.2456924095439672e-06, "in-drivable-lane": 1.549999999999975, "deviation-heading": 15.58120735479496, "agent_compute-ego0": 0.012483688714998548, "complete-iteration": 0.17640341390280995, "set_robot_commands": 0.002228423022509217, "deviation-center-line": 3.1375402996505946, "driven_lanedir_consec": 6.264209788480745, "sim_compute_sim_state": 0.010796272784446698, "sim_compute_performance-ego0": 0.0020549243733249635}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.078192391486335, "get_ui_image": 0.026739120880431875, "step_physics": 0.09316928341029387, "survival_time": 59.99999999999873, "driven_lanedir": 7.361585577318359, "get_state_dump": 0.004655855482166554, "get_robot_state": 0.00369851217976617, "sim_render-ego0": 0.003891149230245547, "get_duckie_state": 1.332841249032382e-06, "in-drivable-lane": 2.250000000000022, "deviation-heading": 15.177814406146688, "agent_compute-ego0": 0.034119451373542574, "complete-iteration": 0.176795292853515, "set_robot_commands": 0.0022739242455246645, "deviation-center-line": 3.869654798319017, "driven_lanedir_consec": 4.973016496382349, "sim_compute_sim_state": 0.006191909561347802, "sim_compute_performance-ego0": 0.0019650268713500875}}
set_robot_commands_max0.0023830075942904228
set_robot_commands_mean0.002276211406269439
set_robot_commands_median0.002251173634016941
set_robot_commands_min0.002219490762753451
sim_compute_performance-ego0_max0.0021530229979808088
sim_compute_performance-ego0_mean0.0020559485210764916
sim_compute_performance-ego0_median0.002052872107487535
sim_compute_performance-ego0_min0.0019650268713500875
sim_compute_sim_state_max0.01144554116743788
sim_compute_sim_state_mean0.009507036625991555
sim_compute_sim_state_median0.010195347887590267
sim_compute_sim_state_min0.006191909561347802
sim_render-ego0_max0.004024858776476858
sim_render-ego0_mean0.003932948414233205
sim_render-ego0_median0.0039155693673571385
sim_render-ego0_min0.0038757961457416873
simulation-passed1
step_physics_max0.12247247759448202
step_physics_mean0.10623872309898358
step_physics_median0.1046565656955792
step_physics_min0.09316928341029387
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5747110921Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:28:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.430088405858089
survival_time_median52.69999999999914
deviation-center-line_median1.6437650328764644
in-drivable-lane_median15.89999999999996


other stats
agent_compute-ego0_max0.013070810527701652
agent_compute-ego0_mean0.01270863168273037
agent_compute-ego0_median0.012650482721785494
agent_compute-ego0_min0.01246275075964884
complete-iteration_max0.19114729871300504
complete-iteration_mean0.16962793137362084
complete-iteration_median0.1678542641391783
complete-iteration_min0.1516558985031217
deviation-center-line_max3.197874728569768
deviation-center-line_mean1.8009660967363952
deviation-center-line_min0.7184595926228845
deviation-heading_max10.454902975997198
deviation-heading_mean6.297602240793408
deviation-heading_median5.507935023553026
deviation-heading_min3.7196359400703782
driven_any_max8.159955183935427
driven_any_mean6.202651814083791
driven_any_median6.561808119039175
driven_any_min3.527035834321385
driven_lanedir_consec_max7.720484180945858
driven_lanedir_consec_mean4.0810024242809195
driven_lanedir_consec_min1.7433487044616407
driven_lanedir_max7.720484180945858
driven_lanedir_mean4.403894035185548
driven_lanedir_median3.974081519255373
driven_lanedir_min1.9469289212855905
get_duckie_state_max1.3489581735554371e-06
get_duckie_state_mean1.2884164583251976e-06
get_duckie_state_median1.3064385254516094e-06
get_duckie_state_min1.1918306088421342e-06
get_robot_state_max0.003733859220308367
get_robot_state_mean0.003630824436911832
get_robot_state_median0.003608015990350494
get_robot_state_min0.0035734065466379744
get_state_dump_max0.004690378332221279
get_state_dump_mean0.00458501927715947
get_state_dump_median0.0045662422561327885
get_state_dump_min0.004517214264151024
get_ui_image_max0.035592518551811496
get_ui_image_mean0.030102944567085867
get_ui_image_median0.02937409712289719
get_ui_image_min0.026071065470737585
in-drivable-lane_max30.34999999999965
in-drivable-lane_mean15.537499999999891
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.159955183935427, "get_ui_image": 0.0276401283143462, "step_physics": 0.0956350972908522, "survival_time": 59.99999999999873, "driven_lanedir": 5.901184336129749, "get_state_dump": 0.004590730285962158, "get_robot_state": 0.0035734065466379744, "sim_render-ego0": 0.003790797440832997, "get_duckie_state": 1.3117984768552249e-06, "in-drivable-lane": 20.24999999999976, "deviation-heading": 6.52253261807103, "agent_compute-ego0": 0.01256346623168996, "complete-iteration": 0.1606641335848666, "set_robot_commands": 0.002124953726546949, "deviation-center-line": 2.118635245915689, "driven_lanedir_consec": 4.813198109335181, "sim_compute_sim_state": 0.008760127298639378, "sim_compute_performance-ego0": 0.001905251303679937}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.527035834321385, "get_ui_image": 0.035592518551811496, "step_physics": 0.11401626036013192, "survival_time": 28.60000000000027, "driven_lanedir": 2.046978702380997, "get_state_dump": 0.004690378332221279, "get_robot_state": 0.003733859220308367, "sim_render-ego0": 0.003994467370797203, "get_duckie_state": 1.3489581735554371e-06, "in-drivable-lane": 11.550000000000164, "deviation-heading": 4.493337429035022, "agent_compute-ego0": 0.013070810527701652, "complete-iteration": 0.19114729871300504, "set_robot_commands": 0.0022637128413867786, "deviation-center-line": 1.1688948198372398, "driven_lanedir_consec": 2.046978702380997, "sim_compute_sim_state": 0.011642550090636677, "sim_compute_performance-ego0": 0.0020575560824409207}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.250230700302927, "get_ui_image": 0.031108065931448187, "step_physics": 0.10515764103208568, "survival_time": 45.39999999999956, "driven_lanedir": 1.9469289212855905, "get_state_dump": 0.004517214264151024, "get_robot_state": 0.003593349614159109, "sim_render-ego0": 0.0038948935119494615, "get_duckie_state": 1.1918306088421342e-06, "in-drivable-lane": 30.34999999999965, "deviation-heading": 3.7196359400703782, "agent_compute-ego0": 0.012737499211881028, "complete-iteration": 0.17504439469349004, "set_robot_commands": 0.002189216309516999, "deviation-center-line": 0.7184595926228845, "driven_lanedir_consec": 1.7433487044616407, "sim_compute_sim_state": 0.009812736144029137, "sim_compute_performance-ego0": 0.0019555629545574796}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.873385537775423, "get_ui_image": 0.026071065470737585, "step_physics": 0.09070157905502382, "survival_time": 59.99999999999873, "driven_lanedir": 7.720484180945858, "get_state_dump": 0.004541754226303418, "get_robot_state": 0.003622682366541879, "sim_render-ego0": 0.003829046649599353, "get_duckie_state": 1.301078574047994e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.454902975997198, "agent_compute-ego0": 0.01246275075964884, "complete-iteration": 0.1516558985031217, "set_robot_commands": 0.0021692704003021977, "deviation-center-line": 3.197874728569768, "driven_lanedir_consec": 7.720484180945858, "sim_compute_sim_state": 0.006224893114151903, "sim_compute_performance-ego0": 0.0019528127332015595}}
set_robot_commands_max0.0022637128413867786
set_robot_commands_mean0.0021867883194382313
set_robot_commands_median0.002179243354909598
set_robot_commands_min0.002124953726546949
sim_compute_performance-ego0_max0.0020575560824409207
sim_compute_performance-ego0_mean0.0019677957684699743
sim_compute_performance-ego0_median0.0019541878438795197
sim_compute_performance-ego0_min0.001905251303679937
sim_compute_sim_state_max0.011642550090636677
sim_compute_sim_state_mean0.009110076661864272
sim_compute_sim_state_median0.009286431721334256
sim_compute_sim_state_min0.006224893114151903
sim_render-ego0_max0.003994467370797203
sim_render-ego0_mean0.003877301243294754
sim_render-ego0_median0.0038619700807744073
sim_render-ego0_min0.003790797440832997
simulation-passed1
step_physics_max0.11401626036013192
step_physics_mean0.1013776444345234
step_physics_median0.10039636916146892
step_physics_min0.09070157905502382
survival_time_max59.99999999999873
survival_time_mean48.49999999999932
survival_time_min28.60000000000027
No reset possible
5738210949Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:13:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30471847681286446
survival_time_median11.125000000000025
deviation-center-line_median0.160248487573028
in-drivable-lane_median7.725000000000014


other stats
agent_compute-ego0_max0.01415858625039008
agent_compute-ego0_mean0.013270980712382006
agent_compute-ego0_median0.013233371822414923
agent_compute-ego0_min0.012458592954308095
complete-iteration_max0.24521001027180597
complete-iteration_mean0.1961112073182371
complete-iteration_median0.18581753435676873
complete-iteration_min0.16759975028760504
deviation-center-line_max0.5823133726004968
deviation-center-line_mean0.2461328624980724
deviation-center-line_min0.08172110224573696
deviation-heading_max1.6820624186184727
deviation-heading_mean0.9830718789916414
deviation-heading_median0.7885095824199059
deviation-heading_min0.6732059325082812
driven_any_max6.354206759086923
driven_any_mean2.7248033933415092
driven_any_median2.1142212513543295
driven_any_min0.3165643115704541
driven_lanedir_consec_max0.775757098732152
driven_lanedir_consec_mean0.3885999883487825
driven_lanedir_consec_min0.16920590103724908
driven_lanedir_max0.775757098732152
driven_lanedir_mean0.3885999883487825
driven_lanedir_median0.30471847681286446
driven_lanedir_min0.16920590103724908
get_duckie_state_max1.795320625764778e-06
get_duckie_state_mean1.61197508761618e-06
get_duckie_state_median1.58658579698161e-06
get_duckie_state_min1.4794081307367224e-06
get_robot_state_max0.004017174149166041
get_robot_state_mean0.003858713972830499
get_robot_state_median0.003841403267580233
get_robot_state_min0.003734875206995492
get_state_dump_max0.004928845479871207
get_state_dump_mean0.004711625098953374
get_state_dump_median0.004694923840112258
get_state_dump_min0.0045278072357177734
get_ui_image_max0.03343026913129366
get_ui_image_mean0.030080071668128937
get_ui_image_median0.030688391990358874
get_ui_image_min0.025513233560504337
in-drivable-lane_max29.70000000000031
in-drivable-lane_mean11.587500000000082
in-drivable-lane_min1.1999999999999984
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.381535149022292, "get_ui_image": 0.028347002933303035, "step_physics": 0.10882294417385116, "survival_time": 12.40000000000004, "driven_lanedir": 0.775757098732152, "get_state_dump": 0.0047830769335888475, "get_robot_state": 0.003940794841352716, "sim_render-ego0": 0.004078602695082086, "get_duckie_state": 1.795320625764778e-06, "in-drivable-lane": 7.90000000000002, "deviation-heading": 1.6820624186184727, "agent_compute-ego0": 0.012890639554065874, "complete-iteration": 0.17763957058090762, "set_robot_commands": 0.002335038051069022, "deviation-center-line": 0.5823133726004968, "driven_lanedir_consec": 0.775757098732152, "sim_compute_sim_state": 0.010121612663728644, "sim_compute_performance-ego0": 0.0022189799082805834}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3165643115704541, "get_ui_image": 0.03343026913129366, "step_physics": 0.1723498243551988, "survival_time": 2.549999999999999, "driven_lanedir": 0.16920590103724908, "get_state_dump": 0.0045278072357177734, "get_robot_state": 0.0037420116938077486, "sim_render-ego0": 0.0038449764251708984, "get_duckie_state": 1.5680606548602764e-06, "in-drivable-lane": 1.1999999999999984, "deviation-heading": 0.7898034122739294, "agent_compute-ego0": 0.013576104090763971, "complete-iteration": 0.24521001027180597, "set_robot_commands": 0.002072453498840332, "deviation-center-line": 0.08172110224573696, "driven_lanedir_consec": 0.16920590103724908, "sim_compute_sim_state": 0.009402233820695143, "sim_compute_performance-ego0": 0.002170154681572547}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.354206759086923, "get_ui_image": 0.03302978104741471, "step_physics": 0.11581313515315944, "survival_time": 31.40000000000031, "driven_lanedir": 0.23710660468353817, "get_state_dump": 0.004928845479871207, "get_robot_state": 0.004017174149166041, "sim_render-ego0": 0.004335781349097223, "get_duckie_state": 1.4794081307367224e-06, "in-drivable-lane": 29.70000000000031, "deviation-heading": 0.6732059325082812, "agent_compute-ego0": 0.01415858625039008, "complete-iteration": 0.19399549813262987, "set_robot_commands": 0.00247852222339527, "deviation-center-line": 0.0973933783068658, "driven_lanedir_consec": 0.23710660468353817, "sim_compute_sim_state": 0.012901142026358454, "sim_compute_performance-ego0": 0.002235721139346852}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8469073536863672, "get_ui_image": 0.025513233560504337, "step_physics": 0.10775945523772576, "survival_time": 9.850000000000003, "driven_lanedir": 0.37233034894219075, "get_state_dump": 0.004606770746635668, "get_robot_state": 0.003734875206995492, "sim_render-ego0": 0.003846105903086036, "get_duckie_state": 1.6051109391029436e-06, "in-drivable-lane": 7.550000000000007, "deviation-heading": 0.7872157525658824, "agent_compute-ego0": 0.012458592954308095, "complete-iteration": 0.16759975028760504, "set_robot_commands": 0.0022220418910787565, "deviation-center-line": 0.22310359683919023, "driven_lanedir_consec": 0.37233034894219075, "sim_compute_sim_state": 0.0053501779382879085, "sim_compute_performance-ego0": 0.002013255851437347}}
set_robot_commands_max0.00247852222339527
set_robot_commands_mean0.002277013916095845
set_robot_commands_median0.0022785399710738893
set_robot_commands_min0.002072453498840332
sim_compute_performance-ego0_max0.002235721139346852
sim_compute_performance-ego0_mean0.002159527895159333
sim_compute_performance-ego0_median0.0021945672949265655
sim_compute_performance-ego0_min0.002013255851437347
sim_compute_sim_state_max0.012901142026358454
sim_compute_sim_state_mean0.009443791612267535
sim_compute_sim_state_median0.009761923242211897
sim_compute_sim_state_min0.0053501779382879085
sim_render-ego0_max0.004335781349097223
sim_render-ego0_mean0.004026366593109061
sim_render-ego0_median0.003962354299084061
sim_render-ego0_min0.0038449764251708984
simulation-passed1
step_physics_max0.1723498243551988
step_physics_mean0.12618633972998378
step_physics_median0.11231803966350529
step_physics_min0.10775945523772576
survival_time_max31.40000000000031
survival_time_mean14.05000000000009
survival_time_min2.549999999999999
No reset possible
5727310976Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:23:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.302820859581086
survival_time_median47.224999999999454
deviation-center-line_median1.0487257714340297
in-drivable-lane_median13.124999999999904


other stats
agent_compute-ego0_max0.04749931358709568
agent_compute-ego0_mean0.03534994385308542
agent_compute-ego0_median0.04044668221648144
agent_compute-ego0_min0.0130070973922831
complete-iteration_max0.281881480682187
complete-iteration_mean0.20845151304399215
complete-iteration_median0.18937359264505396
complete-iteration_min0.17317738620367376
deviation-center-line_max3.246030421108714
deviation-center-line_mean1.3713633530980447
deviation-center-line_min0.1419714484154058
deviation-heading_max10.496498068342415
deviation-heading_mean5.211054483226013
deviation-heading_median4.23991417737282
deviation-heading_min1.8678915098159936
driven_any_max7.901235160203281
driven_any_mean5.16109145771384
driven_any_median6.233779279668539
driven_any_min0.27557211131500264
driven_lanedir_consec_max7.742623706023055
driven_lanedir_consec_mean3.612314248682575
driven_lanedir_consec_min0.10099156954507382
driven_lanedir_max7.742623706023055
driven_lanedir_mean3.612314248682575
driven_lanedir_median3.302820859581086
driven_lanedir_min0.10099156954507382
get_duckie_state_max1.436326561904535e-06
get_duckie_state_mean1.3761181439925078e-06
get_duckie_state_median1.3735086257168037e-06
get_duckie_state_min1.3211287626318888e-06
get_robot_state_max0.003913414187547638
get_robot_state_mean0.003738820516012307
get_robot_state_median0.0037352683118202054
get_robot_state_min0.0035713312528611817
get_state_dump_max0.004857092368893507
get_state_dump_mean0.004762658089696319
get_state_dump_median0.00481940456136174
get_state_dump_min0.00455473086716829
get_ui_image_max0.03696184332777814
get_ui_image_mean0.030670607298650197
get_ui_image_median0.03007148302926041
get_ui_image_min0.02557761980830184
in-drivable-lane_max24.69999999999984
in-drivable-lane_mean12.737499999999914
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.685491552389861, "get_ui_image": 0.028322862301123516, "step_physics": 0.10047319733337157, "survival_time": 49.39999999999933, "driven_lanedir": 3.943205750989212, "get_state_dump": 0.0047828266425369, "get_robot_state": 0.003774059554081715, "sim_render-ego0": 0.003941099371297776, "get_duckie_state": 1.360118931537933e-06, "in-drivable-lane": 24.69999999999984, "deviation-heading": 3.5850704738333836, "agent_compute-ego0": 0.04306648112645164, "complete-iteration": 0.19947533636411352, "set_robot_commands": 0.002249991086182628, "deviation-center-line": 0.9620800311623972, "driven_lanedir_consec": 3.943205750989212, "sim_compute_sim_state": 0.010701830153277235, "sim_compute_performance-ego0": 0.0020727660465529765}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.27557211131500264, "get_ui_image": 0.03696184332777814, "step_physics": 0.1699300393825624, "survival_time": 4.049999999999994, "driven_lanedir": 0.10099156954507382, "get_state_dump": 0.004857092368893507, "get_robot_state": 0.003913414187547638, "sim_render-ego0": 0.003973263065989424, "get_duckie_state": 1.436326561904535e-06, "in-drivable-lane": 1.699999999999994, "deviation-heading": 1.8678915098159936, "agent_compute-ego0": 0.04749931358709568, "complete-iteration": 0.281881480682187, "set_robot_commands": 0.002311625131746618, "deviation-center-line": 0.1419714484154058, "driven_lanedir_consec": 0.10099156954507382, "sim_compute_sim_state": 0.01034189142831942, "sim_compute_performance-ego0": 0.002001919397493688}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.782067006947217, "get_ui_image": 0.0318201037573973, "step_physics": 0.10634949889257056, "survival_time": 45.04999999999958, "driven_lanedir": 2.6624359681729604, "get_state_dump": 0.004855982480186581, "get_robot_state": 0.003696477069558696, "sim_render-ego0": 0.003986260843382707, "get_duckie_state": 1.3868983198956746e-06, "in-drivable-lane": 24.549999999999816, "deviation-heading": 4.894757880912257, "agent_compute-ego0": 0.0130070973922831, "complete-iteration": 0.1792718489259944, "set_robot_commands": 0.0021787191970385365, "deviation-center-line": 1.1353715117056622, "driven_lanedir_consec": 2.6624359681729604, "sim_compute_sim_state": 0.01125935281723936, "sim_compute_performance-ego0": 0.002026530432859704}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.901235160203281, "get_ui_image": 0.02557761980830184, "step_physics": 0.0876319076893828, "survival_time": 59.99999999999873, "driven_lanedir": 7.742623706023055, "get_state_dump": 0.00455473086716829, "get_robot_state": 0.0035713312528611817, "sim_render-ego0": 0.003769425329419595, "get_duckie_state": 1.3211287626318888e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.496498068342415, "agent_compute-ego0": 0.03782688330651124, "complete-iteration": 0.17317738620367376, "set_robot_commands": 0.0021574894256337694, "deviation-center-line": 3.246030421108714, "driven_lanedir_consec": 7.742623706023055, "sim_compute_sim_state": 0.006104819085774672, "sim_compute_performance-ego0": 0.001895059852377759}}
set_robot_commands_max0.002311625131746618
set_robot_commands_mean0.002224456210150388
set_robot_commands_median0.002214355141610582
set_robot_commands_min0.0021574894256337694
sim_compute_performance-ego0_max0.0020727660465529765
sim_compute_performance-ego0_mean0.001999068932321032
sim_compute_performance-ego0_median0.002014224915176696
sim_compute_performance-ego0_min0.001895059852377759
sim_compute_sim_state_max0.01125935281723936
sim_compute_sim_state_mean0.00960197337115267
sim_compute_sim_state_median0.010521860790798329
sim_compute_sim_state_min0.006104819085774672
sim_render-ego0_max0.003986260843382707
sim_render-ego0_mean0.0039175121525223755
sim_render-ego0_median0.0039571812186436
sim_render-ego0_min0.003769425329419595
simulation-passed1
step_physics_max0.1699300393825624
step_physics_mean0.11609616082447184
step_physics_median0.10341134811297104
step_physics_min0.0876319076893828
survival_time_max59.99999999999873
survival_time_mean39.62499999999941
survival_time_min4.049999999999994
No reset possible
5720410993Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:19:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47455237605697903
survival_time_median34.39999999999976
deviation-center-line_median0.4868136590496472
in-drivable-lane_median26.399999999999793


other stats
agent_compute-ego0_max0.01492246585105782
agent_compute-ego0_mean0.013933802469170968
agent_compute-ego0_median0.013865723056977386
agent_compute-ego0_min0.013081297911671275
complete-iteration_max0.26333156628395193
complete-iteration_mean0.20151755369486005
complete-iteration_median0.19076971981315757
complete-iteration_min0.16119920886917313
deviation-center-line_max0.7566404041353975
deviation-center-line_mean0.4602275382254283
deviation-center-line_min0.110642430667021
deviation-heading_max5.921885719099268
deviation-heading_mean2.8189090697265193
deviation-heading_median2.24459065242056
deviation-heading_min0.8645692549656893
driven_any_max7.754968308041258
driven_any_mean4.119108354807921
driven_any_median4.208042952411533
driven_any_min0.3053792063673569
driven_lanedir_consec_max0.7084083756610966
driven_lanedir_consec_mean0.4516590258808518
driven_lanedir_consec_min0.14912297574835254
driven_lanedir_max0.7084083756610966
driven_lanedir_mean0.4516590258808518
driven_lanedir_median0.47455237605697903
driven_lanedir_min0.14912297574835254
get_duckie_state_max2.1743060942005337e-06
get_duckie_state_mean1.9002254185805728e-06
get_duckie_state_median1.8965250323813187e-06
get_duckie_state_min1.633545515359119e-06
get_robot_state_max0.004826015500879999
get_robot_state_mean0.004403888369830017
get_robot_state_median0.004316181433189973
get_robot_state_min0.004157175112060123
get_state_dump_max0.007945188835485657
get_state_dump_mean0.0059105698481742575
get_state_dump_median0.005319807109526975
get_state_dump_min0.005057476338157422
get_ui_image_max0.03911566022616714
get_ui_image_mean0.03184810712286849
get_ui_image_median0.031109490025003537
get_ui_image_min0.02605778821529974
in-drivable-lane_max54.74999999999886
in-drivable-lane_mean27.262499999999612
in-drivable-lane_min1.4999999999999951
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4014659991964993, "get_ui_image": 0.029374266503160433, "step_physics": 0.11193335918417, "survival_time": 20.00000000000015, "driven_lanedir": 0.628660500063338, "get_state_dump": 0.005394223919533137, "get_robot_state": 0.004403724337456529, "sim_render-ego0": 0.004467870826435802, "get_duckie_state": 2.1743060942005337e-06, "in-drivable-lane": 12.85000000000008, "deviation-heading": 3.3587542365363516, "agent_compute-ego0": 0.01392768683873507, "complete-iteration": 0.1858250708354084, "set_robot_commands": 0.002583802192288444, "deviation-center-line": 0.7088452739204668, "driven_lanedir_consec": 0.628660500063338, "sim_compute_sim_state": 0.01112128671565258, "sim_compute_performance-ego0": 0.0024981587902268864}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3053792063673569, "get_ui_image": 0.03911566022616714, "step_physics": 0.17399968673933797, "survival_time": 3.2999999999999963, "driven_lanedir": 0.14912297574835254, "get_state_dump": 0.007945188835485657, "get_robot_state": 0.004826015500879999, "sim_render-ego0": 0.005420275588533772, "get_duckie_state": 2.031895651746152e-06, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 1.1304270683047686, "agent_compute-ego0": 0.01492246585105782, "complete-iteration": 0.26333156628395193, "set_robot_commands": 0.0026349665513679165, "deviation-center-line": 0.110642430667021, "driven_lanedir_consec": 0.14912297574835254, "sim_compute_sim_state": 0.011628951599348836, "sim_compute_performance-ego0": 0.0027290280185528655}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.014619905626566, "get_ui_image": 0.032844713546846635, "step_physics": 0.11635124597969172, "survival_time": 48.799999999999365, "driven_lanedir": 0.7084083756610966, "get_state_dump": 0.005245390299520814, "get_robot_state": 0.004228638528923417, "sim_render-ego0": 0.004371118399113447, "get_duckie_state": 1.633545515359119e-06, "in-drivable-lane": 39.949999999999505, "deviation-heading": 5.921885719099268, "agent_compute-ego0": 0.013803759275219702, "complete-iteration": 0.19571436879090667, "set_robot_commands": 0.002479919757667315, "deviation-center-line": 0.7566404041353975, "driven_lanedir_consec": 0.7084083756610966, "sim_compute_sim_state": 0.013932925285800087, "sim_compute_performance-ego0": 0.002349531638341648}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.754968308041258, "get_ui_image": 0.02605778821529974, "step_physics": 0.09740108236063076, "survival_time": 57.599999999998865, "driven_lanedir": 0.3204442520506201, "get_state_dump": 0.005057476338157422, "get_robot_state": 0.004157175112060123, "sim_render-ego0": 0.0042274556569399675, "get_duckie_state": 1.7611544130164857e-06, "in-drivable-lane": 54.74999999999886, "deviation-heading": 0.8645692549656893, "agent_compute-ego0": 0.013081297911671275, "complete-iteration": 0.16119920886917313, "set_robot_commands": 0.00245016590988543, "deviation-center-line": 0.2647820441788277, "driven_lanedir_consec": 0.3204442520506201, "sim_compute_sim_state": 0.006350192833443052, "sim_compute_performance-ego0": 0.002309648864494648}}
set_robot_commands_max0.0026349665513679165
set_robot_commands_mean0.002537213602802276
set_robot_commands_median0.002531860974977879
set_robot_commands_min0.00245016590988543
sim_compute_performance-ego0_max0.0027290280185528655
sim_compute_performance-ego0_mean0.0024715918279040123
sim_compute_performance-ego0_median0.0024238452142842674
sim_compute_performance-ego0_min0.002309648864494648
sim_compute_sim_state_max0.013932925285800087
sim_compute_sim_state_mean0.010758339108561138
sim_compute_sim_state_median0.011375119157500708
sim_compute_sim_state_min0.006350192833443052
sim_render-ego0_max0.005420275588533772
sim_render-ego0_mean0.004621680117755747
sim_render-ego0_median0.004419494612774625
sim_render-ego0_min0.0042274556569399675
simulation-passed1
step_physics_max0.17399968673933797
step_physics_mean0.1249213435659576
step_physics_median0.11414230258193088
step_physics_min0.09740108236063076
survival_time_max57.599999999998865
survival_time_mean32.42499999999959
survival_time_min3.2999999999999963
No reset possible
5717811010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-050:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5716611012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-050:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5714311313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-050:03:08
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5706611027Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:12:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9883385417824316
survival_time_median10.775000000000018
deviation-center-line_median0.5111401776627957
in-drivable-lane_median3.650000000000018


other stats
agent_compute-ego0_max0.01243579103833153
agent_compute-ego0_mean0.012344616275158218
agent_compute-ego0_median0.012368541994935138
agent_compute-ego0_min0.012205590072431062
complete-iteration_max0.21770119436697108
complete-iteration_mean0.18223783141866343
complete-iteration_median0.17308206969036494
complete-iteration_min0.1650859919269528
deviation-center-line_max0.8876839246575131
deviation-center-line_mean0.5449589249181186
deviation-center-line_min0.2698714196893697
deviation-heading_max4.1475200144817554
deviation-heading_mean3.066778623475636
deviation-heading_median2.7730663243487315
deviation-heading_min2.573461830723328
driven_any_max5.96295103556042
driven_any_mean2.503152826690662
driven_any_median1.4746056416258813
driven_any_min1.1004489879504684
driven_lanedir_consec_max3.976632096572041
driven_lanedir_consec_mean1.652815864803963
driven_lanedir_consec_min0.6579542790789477
driven_lanedir_max3.976632096572041
driven_lanedir_mean1.6710678790903732
driven_lanedir_median1.005676032492036
driven_lanedir_min0.6962873548053796
get_duckie_state_max1.7633760608912666e-06
get_duckie_state_mean1.6557274216034188e-06
get_duckie_state_median1.669098012770505e-06
get_duckie_state_min1.521337599981399e-06
get_robot_state_max0.0036313625925405014
get_robot_state_mean0.0035190510406201527
get_robot_state_median0.003497270846035327
get_robot_state_min0.0034502998778694555
get_state_dump_max0.004619628334966834
get_state_dump_mean0.0044827871587961535
get_state_dump_median0.004481860255439947
get_state_dump_min0.004347799789337884
get_ui_image_max0.03550329991584815
get_ui_image_mean0.02964652284738073
get_ui_image_median0.02857174573834976
get_ui_image_min0.025939299996975248
in-drivable-lane_max13.149999999999764
in-drivable-lane_mean5.1999999999999496
in-drivable-lane_min0.34999999999999876
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.96295103556042, "get_ui_image": 0.027063446923306114, "step_physics": 0.10082037386141324, "survival_time": 37.94999999999998, "driven_lanedir": 3.976632096572041, "get_state_dump": 0.004410773829409951, "get_robot_state": 0.0034502998778694555, "sim_render-ego0": 0.0037159784844047142, "get_duckie_state": 1.6428922352037932e-06, "in-drivable-lane": 13.149999999999764, "deviation-heading": 4.1475200144817554, "agent_compute-ego0": 0.012205590072431062, "complete-iteration": 0.1659830419640792, "set_robot_commands": 0.002083641918081986, "deviation-center-line": 0.8876839246575131, "driven_lanedir_consec": 3.976632096572041, "sim_compute_sim_state": 0.010272230913764552, "sim_compute_performance-ego0": 0.001882064656207436}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4059174337421136, "get_ui_image": 0.03550329991584815, "step_physics": 0.1433412844432149, "survival_time": 10.300000000000011, "driven_lanedir": 1.276869680734677, "get_state_dump": 0.004619628334966834, "get_robot_state": 0.0036313625925405014, "sim_render-ego0": 0.003832988692942449, "get_duckie_state": 1.7633760608912666e-06, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 2.7939554761849945, "agent_compute-ego0": 0.012361516123232634, "complete-iteration": 0.21770119436697108, "set_robot_commands": 0.0021882402724114017, "deviation-center-line": 0.7518187617989259, "driven_lanedir_consec": 1.276869680734677, "sim_compute_sim_state": 0.010160825102801484, "sim_compute_performance-ego0": 0.001978587413179702}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1004489879504684, "get_ui_image": 0.030080044553393408, "step_physics": 0.11423299142292569, "survival_time": 8.349999999999984, "driven_lanedir": 0.7344823842493948, "get_state_dump": 0.004347799789337884, "get_robot_state": 0.0034545574869428363, "sim_render-ego0": 0.003652708871023996, "get_duckie_state": 1.521337599981399e-06, "in-drivable-lane": 2.049999999999998, "deviation-heading": 2.573461830723328, "agent_compute-ego0": 0.01243579103833153, "complete-iteration": 0.18018109741665067, "set_robot_commands": 0.002108931541442871, "deviation-center-line": 0.2698714196893697, "driven_lanedir_consec": 0.6998074028301864, "sim_compute_sim_state": 0.007962645519347418, "sim_compute_performance-ego0": 0.0018284647237686883}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.543293849509649, "get_ui_image": 0.025939299996975248, "step_physics": 0.10570815601180084, "survival_time": 11.250000000000025, "driven_lanedir": 0.6962873548053796, "get_state_dump": 0.0045529466814699425, "get_robot_state": 0.0035399842051278174, "sim_render-ego0": 0.003758922087407745, "get_duckie_state": 1.6953037903372166e-06, "in-drivable-lane": 5.250000000000038, "deviation-heading": 2.7521771725124684, "agent_compute-ego0": 0.012375567866637644, "complete-iteration": 0.1650859919269528, "set_robot_commands": 0.002097275404803521, "deviation-center-line": 0.2704615935266656, "driven_lanedir_consec": 0.6579542790789477, "sim_compute_sim_state": 0.005172135555638676, "sim_compute_performance-ego0": 0.0018630607993201872}}
set_robot_commands_max0.0021882402724114017
set_robot_commands_mean0.002119522284184945
set_robot_commands_median0.0021031034731231963
set_robot_commands_min0.002083641918081986
sim_compute_performance-ego0_max0.001978587413179702
sim_compute_performance-ego0_mean0.0018880443981190032
sim_compute_performance-ego0_median0.0018725627277638116
sim_compute_performance-ego0_min0.0018284647237686883
sim_compute_sim_state_max0.010272230913764552
sim_compute_sim_state_mean0.008391959272888033
sim_compute_sim_state_median0.009061735311074452
sim_compute_sim_state_min0.005172135555638676
sim_render-ego0_max0.003832988692942449
sim_render-ego0_mean0.003740149533944726
sim_render-ego0_median0.00373745028590623
sim_render-ego0_min0.003652708871023996
simulation-passed1
step_physics_max0.1433412844432149
step_physics_mean0.11602570143483867
step_physics_median0.10997057371736328
step_physics_min0.10082037386141324
survival_time_max37.94999999999998
survival_time_mean16.962500000000002
survival_time_min8.349999999999984
No reset possible
5705011312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-050:00:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5704411312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-050:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5691611063Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:26:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.453749296734931
survival_time_median59.99999999999873
deviation-center-line_median2.2075246511936193
in-drivable-lane_median0.8749999999999969


other stats
agent_compute-ego0_max0.050954935502032846
agent_compute-ego0_mean0.03329440821045433
agent_compute-ego0_median0.034909085469083126
agent_compute-ego0_min0.01240452640161824
complete-iteration_max0.2546714568624691
complete-iteration_mean0.19519375006598208
complete-iteration_median0.1809510693363504
complete-iteration_min0.16420140472875844
deviation-center-line_max3.584617806947178
deviation-center-line_mean2.0522220525173873
deviation-center-line_min0.209221100735132
deviation-heading_max10.219905270203473
deviation-heading_mean5.5506060428729755
deviation-heading_median5.014049204941297
deviation-heading_min1.9544204914058343
driven_any_max8.56423364768081
driven_any_mean5.95466481821238
driven_any_median7.468486233663512
driven_any_min0.31745315784168354
driven_lanedir_consec_max7.737696646151443
driven_lanedir_consec_mean4.701734892324243
driven_lanedir_consec_min0.1617443296756682
driven_lanedir_max7.737696646151443
driven_lanedir_mean4.701734892324243
driven_lanedir_median5.453749296734931
driven_lanedir_min0.1617443296756682
get_duckie_state_max2.020900195881687e-06
get_duckie_state_mean1.8733293494140424e-06
get_duckie_state_median1.859757288036785e-06
get_duckie_state_min1.7529026257009133e-06
get_robot_state_max0.0036470753068630142
get_robot_state_mean0.0035759602652002988
get_robot_state_median0.0035939365491180113
get_robot_state_min0.0034688926557021574
get_state_dump_max0.004838263760200647
get_state_dump_mean0.00461338371745906
get_state_dump_median0.0046047716590934375
get_state_dump_min0.0044057277914487155
get_ui_image_max0.035160371235438755
get_ui_image_mean0.02959652447992604
get_ui_image_median0.029287072343691305
get_ui_image_min0.024651581996882787
in-drivable-lane_max32.249999999998465
in-drivable-lane_mean8.499999999999615
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.56423364768081, "get_ui_image": 0.02723454754120305, "step_physics": 0.09221600811249211, "survival_time": 59.99999999999873, "driven_lanedir": 3.906120523743237, "get_state_dump": 0.004838263760200647, "get_robot_state": 0.0036470753068630142, "sim_render-ego0": 0.0038882479084024423, "get_duckie_state": 2.020900195881687e-06, "in-drivable-lane": 32.249999999998465, "deviation-heading": 3.683947392584219, "agent_compute-ego0": 0.03429979428363581, "complete-iteration": 0.1809131638592824, "set_robot_commands": 0.002206712440090513, "deviation-center-line": 1.4679765315982098, "driven_lanedir_consec": 3.906120523743237, "sim_compute_sim_state": 0.010451512769497405, "sim_compute_performance-ego0": 0.002040322277567766}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.31745315784168354, "get_ui_image": 0.035160371235438755, "step_physics": 0.14170413601155185, "survival_time": 4.849999999999991, "driven_lanedir": 0.1617443296756682, "get_state_dump": 0.004650295997152523, "get_robot_state": 0.003569002054175552, "sim_render-ego0": 0.0039607432423805706, "get_duckie_state": 1.921945688675861e-06, "in-drivable-lane": 1.7499999999999938, "deviation-heading": 1.9544204914058343, "agent_compute-ego0": 0.050954935502032846, "complete-iteration": 0.2546714568624691, "set_robot_commands": 0.002274771125949159, "deviation-center-line": 0.209221100735132, "driven_lanedir_consec": 0.1617443296756682, "sim_compute_sim_state": 0.010337077841466789, "sim_compute_performance-ego0": 0.0019711839909456216}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.1425366046590755, "get_ui_image": 0.03133959714617956, "step_physics": 0.10843020513790236, "survival_time": 59.99999999999873, "driven_lanedir": 7.001378069726625, "get_state_dump": 0.004559247321034352, "get_robot_state": 0.003618871044060471, "sim_render-ego0": 0.003790327551759947, "get_duckie_state": 1.797568887397709e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.219905270203473, "agent_compute-ego0": 0.01240452640161824, "complete-iteration": 0.1809889748134184, "set_robot_commands": 0.002139188367857921, "deviation-center-line": 3.584617806947178, "driven_lanedir_consec": 7.001378069726625, "sim_compute_sim_state": 0.012695694644683406, "sim_compute_performance-ego0": 0.00192855299759864}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.794435862667949, "get_ui_image": 0.024651581996882787, "step_physics": 0.08271420408942916, "survival_time": 59.99999999999873, "driven_lanedir": 7.737696646151443, "get_state_dump": 0.0044057277914487155, "get_robot_state": 0.0034688926557021574, "sim_render-ego0": 0.0036395261130861, "get_duckie_state": 1.7529026257009133e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.344151017298375, "agent_compute-ego0": 0.03551837665453045, "complete-iteration": 0.16420140472875844, "set_robot_commands": 0.002093036208522012, "deviation-center-line": 2.947072770789029, "driven_lanedir_consec": 7.737696646151443, "sim_compute_sim_state": 0.005806733130614625, "sim_compute_performance-ego0": 0.0018217089174192812}}
set_robot_commands_max0.002274771125949159
set_robot_commands_mean0.002178427035604901
set_robot_commands_median0.002172950403974217
set_robot_commands_min0.002093036208522012
sim_compute_performance-ego0_max0.002040322277567766
sim_compute_performance-ego0_mean0.0019404420458828272
sim_compute_performance-ego0_median0.0019498684942721308
sim_compute_performance-ego0_min0.0018217089174192812
sim_compute_sim_state_max0.012695694644683406
sim_compute_sim_state_mean0.009822754596565555
sim_compute_sim_state_median0.010394295305482096
sim_compute_sim_state_min0.005806733130614625
sim_render-ego0_max0.0039607432423805706
sim_render-ego0_mean0.003819711203907265
sim_render-ego0_median0.0038392877300811945
sim_render-ego0_min0.0036395261130861
simulation-passed1
step_physics_max0.14170413601155185
step_physics_mean0.10626613833784386
step_physics_median0.10032310662519724
step_physics_min0.08271420408942916
survival_time_max59.99999999999873
survival_time_mean46.21249999999905
survival_time_min4.849999999999991
No reset possible
5686811278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:06:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5684111282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5682211284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||