Duckietown Challenges Home Challenges Submissions

Evaluator 4870

ID4870
evaluatornogpu-prod-04
ownerI don't have one πŸ˜€
machinenogpu-prod_24fc4146baed
processnogpu-prod-04_24fc4146baed
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success38 53926
# timeout1 58143
# failed11 54861
# error
# aborted4 57325
# host-error42 54012
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
581439358Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-04----No reset possible
581339370Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47469644768734554
survival_time_median5.799999999999987
deviation-center-line_median0.1652944732306097
in-drivable-lane_median3.424999999999989


other stats
agent_compute-ego0_max0.013929233638518447
agent_compute-ego0_mean0.013482589711991656
agent_compute-ego0_median0.013438177912618704
agent_compute-ego0_min0.01312476938421076
complete-iteration_max0.21577674730689125
complete-iteration_mean0.1884568155393294
complete-iteration_median0.18384809397798285
complete-iteration_min0.17035432689446062
deviation-center-line_max0.207379547721231
deviation-center-line_mean0.1575691113149522
deviation-center-line_min0.09230795107735856
deviation-heading_max1.6028043324994483
deviation-heading_mean0.9725201313494434
deviation-heading_median0.9222809147569432
deviation-heading_min0.4427143633844387
driven_any_max2.742138185962727
driven_any_mean1.6170509091491772
driven_any_median1.3305380001207268
driven_any_min1.064989450392528
driven_lanedir_consec_max0.6308086958038511
driven_lanedir_consec_mean0.476292081256212
driven_lanedir_consec_min0.3249667338463058
driven_lanedir_max0.6308086958038511
driven_lanedir_mean0.476292081256212
driven_lanedir_median0.47469644768734554
driven_lanedir_min0.3249667338463058
get_duckie_state_max1.761538923279313e-06
get_duckie_state_mean1.5813230378039133e-06
get_duckie_state_median1.6039490380379695e-06
get_duckie_state_min1.3558551518604009e-06
get_robot_state_max0.00417266482800509
get_robot_state_mean0.004040811001403214
get_robot_state_median0.004068176296610712
get_robot_state_min0.003854226584386344
get_state_dump_max0.004951384215228325
get_state_dump_mean0.0048236910191800705
get_state_dump_median0.0047988467558510006
get_state_dump_min0.004745686349789958
get_ui_image_max0.03786613666905766
get_ui_image_mean0.031690097252564664
get_ui_image_median0.031004896537111575
get_ui_image_min0.026884459266977863
in-drivable-lane_max8.850000000000005
in-drivable-lane_mean4.462499999999994
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.742138185962727, "get_ui_image": 0.02953570151547773, "step_physics": 0.1039569880984245, "survival_time": 10.85000000000002, "driven_lanedir": 0.3249667338463058, "get_state_dump": 0.004838078393848664, "get_robot_state": 0.004107439189875891, "sim_render-ego0": 0.004225470604152855, "get_duckie_state": 1.6929906442624712e-06, "in-drivable-lane": 8.850000000000005, "deviation-heading": 1.3647347330347204, "agent_compute-ego0": 0.013929233638518447, "complete-iteration": 0.1759549116869585, "set_robot_commands": 0.002380143611802967, "deviation-center-line": 0.207379547721231, "driven_lanedir_consec": 0.3249667338463058, "sim_compute_sim_state": 0.010610989474375313, "sim_compute_performance-ego0": 0.0022596339566991965}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746330422663896, "get_ui_image": 0.03786613666905766, "step_physics": 0.13532072252931848, "survival_time": 5.599999999999988, "driven_lanedir": 0.3485414367201807, "get_state_dump": 0.004951384215228325, "get_robot_state": 0.00417266482800509, "sim_render-ego0": 0.004282873288720055, "get_duckie_state": 1.5149074318134678e-06, "in-drivable-lane": 3.3999999999999906, "deviation-heading": 1.6028043324994483, "agent_compute-ego0": 0.013520044563090907, "complete-iteration": 0.21577674730689125, "set_robot_commands": 0.002461960885377057, "deviation-center-line": 0.17269441294522414, "driven_lanedir_consec": 0.3485414367201807, "sim_compute_sim_state": 0.010839331466539773, "sim_compute_performance-ego0": 0.002250380220666396}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064989450392528, "get_ui_image": 0.032474091558745415, "step_physics": 0.12090047923001376, "survival_time": 4.899999999999991, "driven_lanedir": 0.6308086958038511, "get_state_dump": 0.004759615117853338, "get_robot_state": 0.003854226584386344, "sim_render-ego0": 0.003896467613451408, "get_duckie_state": 1.3558551518604009e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.4798270964791663, "agent_compute-ego0": 0.01312476938421076, "complete-iteration": 0.1917412762690072, "set_robot_commands": 0.002252776213366576, "deviation-center-line": 0.09230795107735856, "driven_lanedir_consec": 0.6308086958038511, "sim_compute_sim_state": 0.00828960206773546, "sim_compute_performance-ego0": 0.0020935583596277717}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3864429579750637, "get_ui_image": 0.026884459266977863, "step_physics": 0.10643724567634016, "survival_time": 5.999999999999987, "driven_lanedir": 0.6008514586545104, "get_state_dump": 0.004745686349789958, "get_robot_state": 0.0040289134033455335, "sim_render-ego0": 0.004215147869646056, "get_duckie_state": 1.761538923279313e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.4427143633844387, "agent_compute-ego0": 0.0133563112621465, "complete-iteration": 0.17035432689446062, "set_robot_commands": 0.002531156067020637, "deviation-center-line": 0.15789453351599525, "driven_lanedir_consec": 0.6008514586545104, "sim_compute_sim_state": 0.005741956805394701, "sim_compute_performance-ego0": 0.0022964181978840474}}
set_robot_commands_max0.002531156067020637
set_robot_commands_mean0.0024065091943918093
set_robot_commands_median0.002421052248590012
set_robot_commands_min0.002252776213366576
sim_compute_performance-ego0_max0.0022964181978840474
sim_compute_performance-ego0_mean0.002224997683719353
sim_compute_performance-ego0_median0.002255007088682796
sim_compute_performance-ego0_min0.0020935583596277717
sim_compute_sim_state_max0.010839331466539773
sim_compute_sim_state_mean0.008870469953511312
sim_compute_sim_state_median0.009450295771055389
sim_compute_sim_state_min0.005741956805394701
sim_render-ego0_max0.004282873288720055
sim_render-ego0_mean0.004154989843992593
sim_render-ego0_median0.004220309236899455
sim_render-ego0_min0.003896467613451408
simulation-passed1
step_physics_max0.13532072252931848
step_physics_mean0.11665385888352424
step_physics_median0.11366886245317696
step_physics_min0.1039569880984245
survival_time_max10.85000000000002
survival_time_mean6.837499999999996
survival_time_min4.899999999999991
No reset possible
581279378Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6623705970796556
survival_time_median11.375000000000028
deviation-center-line_median0.10975204729996828
in-drivable-lane_median8.725000000000028


other stats
agent_compute-ego0_max0.013547622368310802
agent_compute-ego0_mean0.012736831140274471
agent_compute-ego0_median0.012701287685762674
agent_compute-ego0_min0.011997126821261733
complete-iteration_max0.2438538323587446
complete-iteration_mean0.1947453227883219
complete-iteration_median0.18574612979216
complete-iteration_min0.16363519921022304
deviation-center-line_max0.6641603488159539
deviation-center-line_mean0.24321272180514408
deviation-center-line_min0.0891864438046858
deviation-heading_max3.1430435112181
deviation-heading_mean1.3746753650795092
deviation-heading_median0.9385619497226724
deviation-heading_min0.4785340496545919
driven_any_max5.802025681192019
driven_any_mean2.755334109502341
driven_any_median2.4581491321316946
driven_any_min0.30301249255395574
driven_lanedir_consec_max2.469969700839292
driven_lanedir_consec_mean0.9840834930089776
driven_lanedir_consec_min0.14162307703730592
driven_lanedir_max2.469969700839292
driven_lanedir_mean0.9840834930089776
driven_lanedir_median0.6623705970796556
driven_lanedir_min0.14162307703730592
get_duckie_state_max1.496427199419807e-06
get_duckie_state_mean1.3823738765402522e-06
get_duckie_state_median1.3813443568089755e-06
get_duckie_state_min1.2703795931232508e-06
get_robot_state_max0.003828114333468447
get_robot_state_mean0.003695343844383945
get_robot_state_median0.003738359805152982
get_robot_state_min0.003476541433761369
get_state_dump_max0.0048833599489325015
get_state_dump_mean0.004751952026290589
get_state_dump_median0.004773300743395397
get_state_dump_min0.00457784666943906
get_ui_image_max0.035202218525445285
get_ui_image_mean0.03172843017129203
get_ui_image_median0.03209231843686861
get_ui_image_min0.02752686528598561
in-drivable-lane_max19.35000000000027
in-drivable-lane_mean9.51250000000008
in-drivable-lane_min1.2499999999999956
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.802025681192019, "get_ui_image": 0.02990160198087413, "step_physics": 0.11027141463873052, "survival_time": 30.6500000000003, "driven_lanedir": 2.469969700839292, "get_state_dump": 0.004768101322534418, "get_robot_state": 0.003727507513586783, "sim_render-ego0": 0.0038871629230362585, "get_duckie_state": 1.4110962808714628e-06, "in-drivable-lane": 19.35000000000027, "deviation-heading": 3.1430435112181, "agent_compute-ego0": 0.01263742726478204, "complete-iteration": 0.18055462254763427, "set_robot_commands": 0.0021987803984154317, "deviation-center-line": 0.6641603488159539, "driven_lanedir_consec": 2.469969700839292, "sim_compute_sim_state": 0.011073162967296688, "sim_compute_performance-ego0": 0.0019991894886625707}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30301249255395574, "get_ui_image": 0.035202218525445285, "step_physics": 0.1711278210824995, "survival_time": 3.2999999999999963, "driven_lanedir": 0.14162307703730592, "get_state_dump": 0.00457784666943906, "get_robot_state": 0.003476541433761369, "sim_render-ego0": 0.003680303915223079, "get_duckie_state": 1.2703795931232508e-06, "in-drivable-lane": 1.2499999999999956, "deviation-heading": 1.374839785306067, "agent_compute-ego0": 0.011997126821261733, "complete-iteration": 0.2438538323587446, "set_robot_commands": 0.0023797981774629053, "deviation-center-line": 0.1232734842843482, "driven_lanedir_consec": 0.14162307703730592, "sim_compute_sim_state": 0.009431266072970715, "sim_compute_performance-ego0": 0.001892189481365147}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1277185440341935, "get_ui_image": 0.0342830348928631, "step_physics": 0.11543289211153568, "survival_time": 14.300000000000068, "driven_lanedir": 0.6503029435266947, "get_state_dump": 0.0048833599489325015, "get_robot_state": 0.003828114333468447, "sim_render-ego0": 0.004134198929790005, "get_duckie_state": 1.3515924327464884e-06, "in-drivable-lane": 11.75000000000007, "deviation-heading": 0.4785340496545919, "agent_compute-ego0": 0.013547622368310802, "complete-iteration": 0.19093763703668573, "set_robot_commands": 0.0023325810449048618, "deviation-center-line": 0.0891864438046858, "driven_lanedir_consec": 0.6503029435266947, "sim_compute_sim_state": 0.010357840966679908, "sim_compute_performance-ego0": 0.0020442997537008147}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7885797202291958, "get_ui_image": 0.02752686528598561, "step_physics": 0.10129949625800638, "survival_time": 8.449999999999985, "driven_lanedir": 0.6744382506326165, "get_state_dump": 0.0047785001642563765, "get_robot_state": 0.003749212096719181, "sim_render-ego0": 0.0039778414894552794, "get_duckie_state": 1.496427199419807e-06, "in-drivable-lane": 5.699999999999987, "deviation-heading": 0.5022841141392779, "agent_compute-ego0": 0.012765148106743307, "complete-iteration": 0.16363519921022304, "set_robot_commands": 0.0022326567593742817, "deviation-center-line": 0.0962306103155884, "driven_lanedir_consec": 0.6744382506326165, "sim_compute_sim_state": 0.005227971076965332, "sim_compute_performance-ego0": 0.0019869565963745116}}
set_robot_commands_max0.0023797981774629053
set_robot_commands_mean0.0022859540950393702
set_robot_commands_median0.0022826189021395715
set_robot_commands_min0.0021987803984154317
sim_compute_performance-ego0_max0.0020442997537008147
sim_compute_performance-ego0_mean0.001980658830025761
sim_compute_performance-ego0_median0.001993073042518542
sim_compute_performance-ego0_min0.001892189481365147
sim_compute_sim_state_max0.011073162967296688
sim_compute_sim_state_mean0.00902256027097816
sim_compute_sim_state_median0.009894553519825312
sim_compute_sim_state_min0.005227971076965332
sim_render-ego0_max0.004134198929790005
sim_render-ego0_mean0.003919876814376156
sim_render-ego0_median0.003932502206245769
sim_render-ego0_min0.003680303915223079
simulation-passed1
step_physics_max0.1711278210824995
step_physics_mean0.124532906022693
step_physics_median0.1128521533751331
step_physics_min0.10129949625800638
survival_time_max30.6500000000003
survival_time_mean14.17500000000009
survival_time_min3.2999999999999963
No reset possible
581099767Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:10:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2712783490256283
survival_time_median17.30000000000011
deviation-center-line_median0.42191879049541425
in-drivable-lane_median8.025000000000079


other stats
agent_compute-ego0_max0.013838293406884994
agent_compute-ego0_mean0.01309805295634138
agent_compute-ego0_median0.013042035803806496
agent_compute-ego0_min0.012469846810867538
complete-iteration_max0.23498291300054183
complete-iteration_mean0.18439641467548865
complete-iteration_median0.17607795419493183
complete-iteration_min0.1504468373115489
deviation-center-line_max0.6549921350077571
deviation-center-line_mean0.39873954043080995
deviation-center-line_min0.09612844572465432
deviation-heading_max1.859185760462389
deviation-heading_mean1.4928504933713271
deviation-heading_median1.6363716528486554
deviation-heading_min0.8394729073256088
driven_any_max5.695801127140479
driven_any_mean3.09835816256981
driven_any_median3.176629810936378
driven_any_min0.3443719012660041
driven_lanedir_consec_max2.104746183293615
driven_lanedir_consec_mean1.2085544498615264
driven_lanedir_consec_min0.18691491810123395
driven_lanedir_max2.104746183293615
driven_lanedir_mean1.2085544498615264
driven_lanedir_median1.2712783490256283
driven_lanedir_min0.18691491810123395
get_duckie_state_max1.6728477298933575e-06
get_duckie_state_mean1.498678975692519e-06
get_duckie_state_median1.487506170028682e-06
get_duckie_state_min1.346855832819353e-06
get_robot_state_max0.003969677177393381
get_robot_state_mean0.0036876566398835
get_robot_state_median0.003648571821025936
get_robot_state_min0.003483805740088747
get_state_dump_max0.005123572730122598
get_state_dump_mean0.004881977359264327
get_state_dump_median0.004844380100218572
get_state_dump_min0.004715576506497567
get_ui_image_max0.03518470964933697
get_ui_image_mean0.02998022478093837
get_ui_image_median0.02987432547519757
get_ui_image_min0.024987538524021375
in-drivable-lane_max23.000000000000288
in-drivable-lane_mean10.08750000000011
in-drivable-lane_min1.2999999999999974
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.408649699612232, "get_ui_image": 0.027045452772681392, "step_physics": 0.09711141194870222, "survival_time": 13.350000000000056, "driven_lanedir": 2.104746183293615, "get_state_dump": 0.004910485957985494, "get_robot_state": 0.0036563312829430423, "sim_render-ego0": 0.0038371753336778327, "get_duckie_state": 1.5559481151068388e-06, "in-drivable-lane": 2.10000000000003, "deviation-heading": 1.438393754110767, "agent_compute-ego0": 0.012469846810867538, "complete-iteration": 0.16272960492034458, "set_robot_commands": 0.002314236626696231, "deviation-center-line": 0.6549921350077571, "driven_lanedir_consec": 2.104746183293615, "sim_compute_sim_state": 0.00933289883741692, "sim_compute_performance-ego0": 0.0019590071777799236}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3443719012660041, "get_ui_image": 0.03518470964933697, "step_physics": 0.16115621516579076, "survival_time": 2.799999999999998, "driven_lanedir": 0.18691491810123395, "get_state_dump": 0.004715576506497567, "get_robot_state": 0.003483805740088747, "sim_render-ego0": 0.0038674003199527136, "get_duckie_state": 1.346855832819353e-06, "in-drivable-lane": 1.2999999999999974, "deviation-heading": 0.8394729073256088, "agent_compute-ego0": 0.013213120008769789, "complete-iteration": 0.23498291300054183, "set_robot_commands": 0.0021597251557467275, "deviation-center-line": 0.09612844572465432, "driven_lanedir_consec": 0.18691491810123395, "sim_compute_sim_state": 0.009158590383696976, "sim_compute_performance-ego0": 0.001952066756131356}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.944609922260524, "get_ui_image": 0.03270319817771374, "step_physics": 0.11354683318608244, "survival_time": 21.250000000000167, "driven_lanedir": 1.285797324686113, "get_state_dump": 0.005123572730122598, "get_robot_state": 0.003969677177393381, "sim_render-ego0": 0.004176484027378996, "get_duckie_state": 1.6728477298933575e-06, "in-drivable-lane": 13.950000000000127, "deviation-heading": 1.834349551586544, "agent_compute-ego0": 0.013838293406884994, "complete-iteration": 0.1894263034695191, "set_robot_commands": 0.0023466874736015786, "deviation-center-line": 0.4540747670668327, "driven_lanedir_consec": 1.285797324686113, "sim_compute_sim_state": 0.011409101911553754, "sim_compute_performance-ego0": 0.002208549092073396}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.695801127140479, "get_ui_image": 0.024987538524021375, "step_physics": 0.08961858220447767, "survival_time": 30.150000000000293, "driven_lanedir": 1.256759373365144, "get_state_dump": 0.004778274242451649, "get_robot_state": 0.00364081235910883, "sim_render-ego0": 0.0038809503940557015, "get_duckie_state": 1.419064224950525e-06, "in-drivable-lane": 23.000000000000288, "deviation-heading": 1.859185760462389, "agent_compute-ego0": 0.012870951598843204, "complete-iteration": 0.1504468373115489, "set_robot_commands": 0.002161859281805177, "deviation-center-line": 0.38976281392399575, "driven_lanedir_consec": 1.256759373365144, "sim_compute_sim_state": 0.006422827970113186, "sim_compute_performance-ego0": 0.0019885498956339247}}
set_robot_commands_max0.0023466874736015786
set_robot_commands_mean0.0022456271344624286
set_robot_commands_median0.002238047954250704
set_robot_commands_min0.0021597251557467275
sim_compute_performance-ego0_max0.002208549092073396
sim_compute_performance-ego0_mean0.0020270432304046503
sim_compute_performance-ego0_median0.0019737785367069244
sim_compute_performance-ego0_min0.001952066756131356
sim_compute_sim_state_max0.011409101911553754
sim_compute_sim_state_mean0.009080854775695209
sim_compute_sim_state_median0.009245744610556947
sim_compute_sim_state_min0.006422827970113186
sim_render-ego0_max0.004176484027378996
sim_render-ego0_mean0.003940502518766311
sim_render-ego0_median0.003874175357004207
sim_render-ego0_min0.0038371753336778327
simulation-passed1
step_physics_max0.16115621516579076
step_physics_mean0.11535826062626328
step_physics_median0.10532912256739232
step_physics_min0.08961858220447767
survival_time_max30.150000000000293
survival_time_mean16.887500000000127
survival_time_min2.799999999999998
No reset possible
5807910017Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:37:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.299756247287842
survival_time_median59.99999999999873
deviation-center-line_median2.982898319391504
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.03440386171047138
agent_compute-ego0_mean0.02947491496726933
agent_compute-ego0_median0.03419856673771893
agent_compute-ego0_min0.01509866468316808
complete-iteration_max0.2237251055032189
complete-iteration_mean0.20004709098460177
complete-iteration_median0.19759563651311207
complete-iteration_min0.181271985408964
deviation-center-line_max3.36927104175562
deviation-center-line_mean2.995333702438643
deviation-center-line_min2.6462671292159436
deviation-heading_max11.74955811001314
deviation-heading_mean9.624235809864766
deviation-heading_median9.737628411432802
deviation-heading_min7.272128306580327
driven_any_max9.125318196477746
driven_any_mean8.53468801126316
driven_any_median8.444147305647215
driven_any_min8.125139237280466
driven_lanedir_consec_max9.007476361542349
driven_lanedir_consec_mean8.378859518950415
driven_lanedir_consec_min7.908449219683624
driven_lanedir_max9.007476361542349
driven_lanedir_mean8.378859518950415
driven_lanedir_median8.299756247287842
driven_lanedir_min7.908449219683624
get_duckie_state_max1.33760565028004e-06
get_duckie_state_mean1.3036592913904751e-06
get_duckie_state_median1.3037585497498016e-06
get_duckie_state_min1.2695144157822582e-06
get_robot_state_max0.003822992088197173
get_robot_state_mean0.0037672417447727783
get_robot_state_median0.0037858889164475978
get_robot_state_min0.003674197057998746
get_state_dump_max0.004923238246069661
get_state_dump_mean0.004786710159466924
get_state_dump_median0.004772635522631186
get_state_dump_min0.004678331346535663
get_ui_image_max0.03626713308069132
get_ui_image_mean0.031926475744461835
get_ui_image_median0.032285783610474954
get_ui_image_min0.026867202676206108
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.125318196477746, "get_ui_image": 0.030139148284950224, "step_physics": 0.10250952221968092, "survival_time": 59.99999999999873, "driven_lanedir": 9.007476361542349, "get_state_dump": 0.00470952844738861, "get_robot_state": 0.003812738699678775, "sim_render-ego0": 0.004017754657183162, "get_duckie_state": 1.2919468049899825e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.045575853805023, "agent_compute-ego0": 0.0341063639603487, "complete-iteration": 0.19347777970129007, "set_robot_commands": 0.0024067722291970235, "deviation-center-line": 2.655034745314918, "driven_lanedir_consec": 9.007476361542349, "sim_compute_sim_state": 0.009545642271526251, "sim_compute_performance-ego0": 0.0021443422589075755}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.221688787660828, "get_ui_image": 0.03626713308069132, "step_physics": 0.12352093272562528, "survival_time": 59.99999999999873, "driven_lanedir": 8.022212774436001, "get_state_dump": 0.004923238246069661, "get_robot_state": 0.003674197057998746, "sim_render-ego0": 0.0040397673820476545, "get_duckie_state": 1.315570294509621e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.42968096906058, "agent_compute-ego0": 0.03440386171047138, "complete-iteration": 0.2237251055032189, "set_robot_commands": 0.0022658847154526786, "deviation-center-line": 3.36927104175562, "driven_lanedir_consec": 8.022212774436001, "sim_compute_sim_state": 0.01252411585068524, "sim_compute_performance-ego0": 0.002018672838298407}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.125139237280466, "get_ui_image": 0.03443241893599969, "step_physics": 0.12161147763191116, "survival_time": 59.99999999999873, "driven_lanedir": 7.908449219683624, "get_state_dump": 0.004678331346535663, "get_robot_state": 0.003822992088197173, "sim_render-ego0": 0.003996975316691657, "get_duckie_state": 1.2695144157822582e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.74955811001314, "agent_compute-ego0": 0.01509866468316808, "complete-iteration": 0.2017134933249341, "set_robot_commands": 0.0023557909521631755, "deviation-center-line": 3.31076189346809, "driven_lanedir_consec": 7.908449219683624, "sim_compute_sim_state": 0.01351175498803589, "sim_compute_performance-ego0": 0.00211883861754558}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.666605823633603, "get_ui_image": 0.026867202676206108, "step_physics": 0.09687540830918692, "survival_time": 59.99999999999873, "driven_lanedir": 8.577299720139685, "get_state_dump": 0.0048357425978737606, "get_robot_state": 0.00375903913321642, "sim_render-ego0": 0.003986809672562903, "get_duckie_state": 1.33760565028004e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.272128306580327, "agent_compute-ego0": 0.03429076951508915, "complete-iteration": 0.181271985408964, "set_robot_commands": 0.0023082249567570236, "deviation-center-line": 2.6462671292159436, "driven_lanedir_consec": 8.577299720139685, "sim_compute_sim_state": 0.006245224997959565, "sim_compute_performance-ego0": 0.002015383019236899}}
set_robot_commands_max0.0024067722291970235
set_robot_commands_mean0.0023341682133924753
set_robot_commands_median0.0023320079544600996
set_robot_commands_min0.0022658847154526786
sim_compute_performance-ego0_max0.0021443422589075755
sim_compute_performance-ego0_mean0.0020743091834971154
sim_compute_performance-ego0_median0.0020687557279219933
sim_compute_performance-ego0_min0.002015383019236899
sim_compute_sim_state_max0.01351175498803589
sim_compute_sim_state_mean0.010456684527051736
sim_compute_sim_state_median0.011034879061105746
sim_compute_sim_state_min0.006245224997959565
sim_render-ego0_max0.0040397673820476545
sim_render-ego0_mean0.004010326757121344
sim_render-ego0_median0.00400736498693741
sim_render-ego0_min0.003986809672562903
simulation-passed1
step_physics_max0.12352093272562528
step_physics_mean0.11112933522160108
step_physics_median0.11206049992579604
step_physics_min0.09687540830918692
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5807110008Mo KleitΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:21:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6380323556012075
survival_time_median31.249999999999865
deviation-center-line_median0.7644367101069559
in-drivable-lane_median7.650000000000092


other stats
agent_compute-ego0_max0.025231838821868514
agent_compute-ego0_mean0.0164023854359926
agent_compute-ego0_median0.013571373336395971
agent_compute-ego0_min0.013234956249309952
complete-iteration_max0.2099397751935728
complete-iteration_mean0.19183561454195647
complete-iteration_median0.18884951493368657
complete-iteration_min0.17970365310688002
deviation-center-line_max2.251225823745713
deviation-center-line_mean1.0630667586153728
deviation-center-line_min0.4721677905018671
deviation-heading_max12.36656677930582
deviation-heading_mean4.880056438399915
deviation-heading_median2.6161163668798957
deviation-heading_min1.9214262405340508
driven_any_max9.792454470882438
driven_any_mean4.808559492351286
driven_any_median3.841790732748545
driven_any_min1.758202033025614
driven_lanedir_consec_max9.563912881909824
driven_lanedir_consec_mean3.440002328920741
driven_lanedir_consec_min0.9200317225707242
driven_lanedir_max9.563912881909824
driven_lanedir_mean3.440002328920741
driven_lanedir_median1.6380323556012075
driven_lanedir_min0.9200317225707242
get_duckie_state_max1.5739372416109883e-06
get_duckie_state_mean1.5052739301082554e-06
get_duckie_state_median1.5122861377700668e-06
get_duckie_state_min1.422586203281899e-06
get_robot_state_max0.004162583420707454
get_robot_state_mean0.004090866554079404
get_robot_state_median0.004114314786617883
get_robot_state_min0.0039722532223743995
get_state_dump_max0.00524264366672229
get_state_dump_mean0.005191835996760741
get_state_dump_median0.005199266912386371
get_state_dump_min0.005126166495547932
get_ui_image_max0.03796446930830646
get_ui_image_mean0.03310668617651001
get_ui_image_median0.033126058721356606
get_ui_image_min0.028210157955020392
in-drivable-lane_max34.699999999999605
in-drivable-lane_mean12.499999999999948
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.758202033025614, "get_ui_image": 0.031050020968154526, "step_physics": 0.10981343789774296, "survival_time": 18.00000000000012, "driven_lanedir": 0.9200317225707242, "get_state_dump": 0.0051678217679179605, "get_robot_state": 0.004092002509373377, "sim_render-ego0": 0.004237693432625641, "get_duckie_state": 1.422586203281899e-06, "in-drivable-lane": 11.850000000000136, "deviation-heading": 2.2968404859869405, "agent_compute-ego0": 0.01324486798526838, "complete-iteration": 0.1823075828129565, "set_robot_commands": 0.002471747490837964, "deviation-center-line": 0.7000071709911554, "driven_lanedir_consec": 0.9200317225707242, "sim_compute_sim_state": 0.00980776102589108, "sim_compute_performance-ego0": 0.0023236644565233565}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.217469053268691, "get_ui_image": 0.03796446930830646, "step_physics": 0.1291939733894008, "survival_time": 15.650000000000087, "driven_lanedir": 1.8324833141804024, "get_state_dump": 0.005126166495547932, "get_robot_state": 0.0039722532223743995, "sim_render-ego0": 0.0042413412385685426, "get_duckie_state": 1.5178303809682277e-06, "in-drivable-lane": 3.450000000000049, "deviation-heading": 2.935392247772851, "agent_compute-ego0": 0.013234956249309952, "complete-iteration": 0.2099397751935728, "set_robot_commands": 0.002348567270169592, "deviation-center-line": 0.8288662492227564, "driven_lanedir_consec": 1.8324833141804024, "sim_compute_sim_state": 0.011558266961650484, "sim_compute_performance-ego0": 0.0021976695698537646}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.466112412228398, "get_ui_image": 0.035202096474558686, "step_physics": 0.11427173898142462, "survival_time": 44.49999999999961, "driven_lanedir": 1.443581397022013, "get_state_dump": 0.00524264366672229, "get_robot_state": 0.004162583420707454, "sim_render-ego0": 0.00441486880969252, "get_duckie_state": 1.5739372416109883e-06, "in-drivable-lane": 34.699999999999605, "deviation-heading": 1.9214262405340508, "agent_compute-ego0": 0.013897878687523565, "complete-iteration": 0.19539144705441663, "set_robot_commands": 0.002580151948597027, "deviation-center-line": 0.4721677905018671, "driven_lanedir_consec": 1.443581397022013, "sim_compute_sim_state": 0.01313548403824486, "sim_compute_performance-ego0": 0.0023775159576792776}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.792454470882438, "get_ui_image": 0.028210157955020392, "step_physics": 0.10097843085994929, "survival_time": 59.99999999999873, "driven_lanedir": 9.563912881909824, "get_state_dump": 0.0052307120568547815, "get_robot_state": 0.00413662706386239, "sim_render-ego0": 0.004246833421705565, "get_duckie_state": 1.5067418945719063e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.36656677930582, "agent_compute-ego0": 0.025231838821868514, "complete-iteration": 0.17970365310688002, "set_robot_commands": 0.0025500502812673804, "deviation-center-line": 2.251225823745713, "driven_lanedir_consec": 9.563912881909824, "sim_compute_sim_state": 0.00667074975324213, "sim_compute_performance-ego0": 0.0023425290427736}}
set_robot_commands_max0.002580151948597027
set_robot_commands_mean0.002487629247717991
set_robot_commands_median0.0025108988860526723
set_robot_commands_min0.002348567270169592
sim_compute_performance-ego0_max0.0023775159576792776
sim_compute_performance-ego0_mean0.0023103447567075
sim_compute_performance-ego0_median0.0023330967496484785
sim_compute_performance-ego0_min0.0021976695698537646
sim_compute_sim_state_max0.01313548403824486
sim_compute_sim_state_mean0.01029306544475714
sim_compute_sim_state_median0.010683013993770784
sim_compute_sim_state_min0.00667074975324213
sim_render-ego0_max0.00441486880969252
sim_render-ego0_mean0.004285184225648067
sim_render-ego0_median0.004244087330137054
sim_render-ego0_min0.004237693432625641
simulation-passed1
step_physics_max0.1291939733894008
step_physics_mean0.11356439528212942
step_physics_median0.11204258843958378
step_physics_min0.10097843085994929
survival_time_max59.99999999999873
survival_time_mean34.53749999999964
survival_time_min15.650000000000087
No reset possible
5805210026Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:30:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5804010034Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:16:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2890078462803554
survival_time_median23.175000000000196
deviation-center-line_median0.7694935019795095
in-drivable-lane_median9.650000000000135


other stats
agent_compute-ego0_max0.01384641896540196
agent_compute-ego0_mean0.01319590732708322
agent_compute-ego0_median0.013280121413131445
agent_compute-ego0_min0.012376967516668036
complete-iteration_max0.22814370319247249
complete-iteration_mean0.19751572846262344
complete-iteration_median0.1981231684411473
complete-iteration_min0.16567287377572676
deviation-center-line_max1.414404199168249
deviation-center-line_mean0.7650326066978363
deviation-center-line_min0.10673922366407726
deviation-heading_max6.031872421667577
deviation-heading_mean2.934508869090093
deviation-heading_median2.2991521781925175
deviation-heading_min1.1078586983077598
driven_any_max8.303247622330368
driven_any_mean4.062671241931412
driven_any_median3.8184050045471234
driven_any_min0.3106273363010348
driven_lanedir_consec_max3.10238942225407
driven_lanedir_consec_mean1.959539037042335
driven_lanedir_consec_min0.1577510333545593
driven_lanedir_max3.10238942225407
driven_lanedir_mean1.959539037042335
driven_lanedir_median2.2890078462803554
driven_lanedir_min0.1577510333545593
get_duckie_state_max1.6987323760986328e-06
get_duckie_state_mean1.568750312747285e-06
get_duckie_state_median1.550414638039288e-06
get_duckie_state_min1.4754395988119308e-06
get_robot_state_max0.0041669295660814445
get_robot_state_mean0.00391834626973642
get_robot_state_median0.003888410762957157
get_robot_state_min0.0037296339869499207
get_state_dump_max0.005209911408735879
get_state_dump_mean0.004927216850256044
get_state_dump_median0.004905485686637363
get_state_dump_min0.004687984619013574
get_ui_image_max0.03625333488886081
get_ui_image_mean0.03228600072898549
get_ui_image_median0.03292006777911649
get_ui_image_min0.027050532468848185
in-drivable-lane_max38.54999999999949
in-drivable-lane_mean14.79999999999994
in-drivable-lane_min1.349999999999996
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.483845189533792, "get_ui_image": 0.029842420710906696, "step_physics": 0.10613050433875476, "survival_time": 26.50000000000024, "driven_lanedir": 2.013048747448605, "get_state_dump": 0.004971107745125694, "get_robot_state": 0.003976267385392988, "sim_render-ego0": 0.004122911873510328, "get_duckie_state": 1.620887138524747e-06, "in-drivable-lane": 15.850000000000223, "deviation-heading": 1.5889881402121444, "agent_compute-ego0": 0.012836366498986656, "complete-iteration": 0.17766369174878252, "set_robot_commands": 0.0023431984493736944, "deviation-center-line": 0.4940421761596698, "driven_lanedir_consec": 2.013048747448605, "sim_compute_sim_state": 0.011116662267911233, "sim_compute_performance-ego0": 0.002228077297605813}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3106273363010348, "get_ui_image": 0.03599771484732628, "step_physics": 0.15183694660663605, "survival_time": 3.149999999999997, "driven_lanedir": 0.1577510333545593, "get_state_dump": 0.004839863628149033, "get_robot_state": 0.0037296339869499207, "sim_render-ego0": 0.004019558429718018, "get_duckie_state": 1.6987323760986328e-06, "in-drivable-lane": 1.349999999999996, "deviation-heading": 1.1078586983077598, "agent_compute-ego0": 0.01372387632727623, "complete-iteration": 0.22814370319247249, "set_robot_commands": 0.002283763140439987, "deviation-center-line": 0.10673922366407726, "driven_lanedir_consec": 0.1577510333545593, "sim_compute_sim_state": 0.009621977806091309, "sim_compute_performance-ego0": 0.0020012184977531433}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.152964819560455, "get_ui_image": 0.03625333488886081, "step_physics": 0.13807881597298474, "survival_time": 19.850000000000147, "driven_lanedir": 2.5649669451121055, "get_state_dump": 0.005209911408735879, "get_robot_state": 0.0041669295660814445, "sim_render-ego0": 0.0043825186676715484, "get_duckie_state": 1.4754395988119308e-06, "in-drivable-lane": 3.450000000000049, "deviation-heading": 3.0093162161728904, "agent_compute-ego0": 0.01384641896540196, "complete-iteration": 0.2185826451335121, "set_robot_commands": 0.002484038247534977, "deviation-center-line": 1.0449448277993492, "driven_lanedir_consec": 2.5649669451121055, "sim_compute_sim_state": 0.011686657541361289, "sim_compute_performance-ego0": 0.0023731879852524956}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.303247622330368, "get_ui_image": 0.027050532468848185, "step_physics": 0.10306978086746305, "survival_time": 59.99999999999873, "driven_lanedir": 3.10238942225407, "get_state_dump": 0.004687984619013574, "get_robot_state": 0.0038005541405213266, "sim_render-ego0": 0.003932368050606225, "get_duckie_state": 1.4799421375538288e-06, "in-drivable-lane": 38.54999999999949, "deviation-heading": 6.031872421667577, "agent_compute-ego0": 0.012376967516668036, "complete-iteration": 0.16567287377572676, "set_robot_commands": 0.002281398598498647, "deviation-center-line": 1.414404199168249, "driven_lanedir_consec": 3.10238942225407, "sim_compute_sim_state": 0.006365931103568986, "sim_compute_performance-ego0": 0.0020172961248545525}}
set_robot_commands_max0.002484038247534977
set_robot_commands_mean0.0023480996089618265
set_robot_commands_median0.002313480794906841
set_robot_commands_min0.002281398598498647
sim_compute_performance-ego0_max0.0023731879852524956
sim_compute_performance-ego0_mean0.002154944976366501
sim_compute_performance-ego0_median0.0021226867112301828
sim_compute_performance-ego0_min0.0020012184977531433
sim_compute_sim_state_max0.011686657541361289
sim_compute_sim_state_mean0.009697807179733203
sim_compute_sim_state_median0.010369320037001271
sim_compute_sim_state_min0.006365931103568986
sim_render-ego0_max0.0043825186676715484
sim_render-ego0_mean0.00411433925537653
sim_render-ego0_median0.004071235151614173
sim_render-ego0_min0.003932368050606225
simulation-passed1
step_physics_max0.15183694660663605
step_physics_mean0.12477901194645966
step_physics_median0.12210466015586977
step_physics_min0.10306978086746305
survival_time_max59.99999999999873
survival_time_mean27.37499999999978
survival_time_min3.149999999999997
No reset possible
5802310058Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦real-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:26:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7276566033342902
survival_time_median36.32499999999993
deviation-center-line_median0.8462482650207317
in-drivable-lane_median19.84999999999956


other stats
agent_compute-ego0_max0.01410690373829738
agent_compute-ego0_mean0.013377033974802558
agent_compute-ego0_median0.013385355485182285
agent_compute-ego0_min0.012630521190548282
complete-iteration_max0.2227446433407977
complete-iteration_mean0.1969612986498993
complete-iteration_median0.2013089789256946
complete-iteration_min0.1624825934074103
deviation-center-line_max3.049728121184737
deviation-center-line_mean1.3539402131501863
deviation-center-line_min0.6735362013745455
deviation-heading_max12.873643416971245
deviation-heading_mean6.707299171828435
deviation-heading_median5.060377715188015
deviation-heading_min3.834797839966464
driven_any_max9.03027665616199
driven_any_mean5.8295396567515905
driven_any_median5.266483608301326
driven_any_min3.7549147542417223
driven_lanedir_consec_max5.420236513178551
driven_lanedir_consec_mean2.4698976208664867
driven_lanedir_consec_min1.004040763618815
driven_lanedir_max5.420236513178551
driven_lanedir_mean2.4698976208664867
driven_lanedir_median1.7276566033342902
driven_lanedir_min1.004040763618815
get_duckie_state_max2.17059691836025e-06
get_duckie_state_mean2.107243096817547e-06
get_duckie_state_median2.151968522781571e-06
get_duckie_state_min1.9544384233467944e-06
get_robot_state_max0.004043545728301148
get_robot_state_mean0.003839069494646312
get_robot_state_median0.00381666112796737
get_robot_state_min0.003679409994349361
get_state_dump_max0.004878063618402598
get_state_dump_mean0.004736204890811235
get_state_dump_median0.004760092880437279
get_state_dump_min0.00454657018396778
get_ui_image_max0.03856261286707742
get_ui_image_mean0.03252661114474234
get_ui_image_median0.033053034703667376
get_ui_image_min0.025437762304557177
in-drivable-lane_max32.34999999999952
in-drivable-lane_mean21.69999999999971
in-drivable-lane_min14.75000000000021
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.282528832065514, "get_ui_image": 0.03055095313408056, "step_physics": 0.12142356595975082, "survival_time": 26.50000000000024, "driven_lanedir": 1.903189462261989, "get_state_dump": 0.004820076534752567, "get_robot_state": 0.003843855274150152, "sim_render-ego0": 0.004075309875545753, "get_duckie_state": 2.144869213499367e-06, "in-drivable-lane": 14.75000000000021, "deviation-heading": 3.834797839966464, "agent_compute-ego0": 0.013248734555001989, "complete-iteration": 0.19325675174116863, "set_robot_commands": 0.002350910459759096, "deviation-center-line": 0.7833783883966013, "driven_lanedir_consec": 1.903189462261989, "sim_compute_sim_state": 0.010626800989700575, "sim_compute_performance-ego0": 0.0022255103691374064}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.03027665616199, "get_ui_image": 0.03856261286707742, "step_physics": 0.1403978267974599, "survival_time": 59.99999999999873, "driven_lanedir": 5.420236513178551, "get_state_dump": 0.00470010922612199, "get_robot_state": 0.003789466981784589, "sim_render-ego0": 0.0040770597402301064, "get_duckie_state": 2.159067832063775e-06, "in-drivable-lane": 20.899999999998883, "deviation-heading": 12.873643416971245, "agent_compute-ego0": 0.013521976415362584, "complete-iteration": 0.2227446433407977, "set_robot_commands": 0.0022820574754878545, "deviation-center-line": 3.049728121184737, "driven_lanedir_consec": 5.420236513178551, "sim_compute_sim_state": 0.01318679642022202, "sim_compute_performance-ego0": 0.0021325132431932333}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.250438384537137, "get_ui_image": 0.03555511627325419, "step_physics": 0.12992723017497132, "survival_time": 44.5999999999996, "driven_lanedir": 1.5521237444065914, "get_state_dump": 0.004878063618402598, "get_robot_state": 0.004043545728301148, "sim_render-ego0": 0.0042934086661856755, "get_duckie_state": 2.17059691836025e-06, "in-drivable-lane": 32.34999999999952, "deviation-heading": 4.827984245864417, "agent_compute-ego0": 0.01410690373829738, "complete-iteration": 0.2093612061102206, "set_robot_commands": 0.002445726084949455, "deviation-center-line": 0.9091181416448622, "driven_lanedir_consec": 1.5521237444065914, "sim_compute_sim_state": 0.011792822621036885, "sim_compute_performance-ego0": 0.0022229499539228995}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.7549147542417223, "get_ui_image": 0.025437762304557177, "step_physics": 0.10194824853401592, "survival_time": 28.050000000000264, "driven_lanedir": 1.004040763618815, "get_state_dump": 0.00454657018396778, "get_robot_state": 0.003679409994349361, "sim_render-ego0": 0.003778533154959356, "get_duckie_state": 1.9544384233467944e-06, "in-drivable-lane": 18.80000000000024, "deviation-heading": 5.292771184511614, "agent_compute-ego0": 0.012630521190548282, "complete-iteration": 0.1624825934074103, "set_robot_commands": 0.0021108354962169062, "deviation-center-line": 0.6735362013745455, "driven_lanedir_consec": 1.004040763618815, "sim_compute_sim_state": 0.006326475601603552, "sim_compute_performance-ego0": 0.001938209839138696}}
set_robot_commands_max0.002445726084949455
set_robot_commands_mean0.002297382379103328
set_robot_commands_median0.0023164839676234755
set_robot_commands_min0.0021108354962169062
sim_compute_performance-ego0_max0.0022255103691374064
sim_compute_performance-ego0_mean0.0021297958513480588
sim_compute_performance-ego0_median0.0021777315985580664
sim_compute_performance-ego0_min0.001938209839138696
sim_compute_sim_state_max0.01318679642022202
sim_compute_sim_state_mean0.010483223908140755
sim_compute_sim_state_median0.01120981180536873
sim_compute_sim_state_min0.006326475601603552
sim_render-ego0_max0.0042934086661856755
sim_render-ego0_mean0.0040560778592302225
sim_render-ego0_median0.00407618480788793
sim_render-ego0_min0.003778533154959356
simulation-passed1
step_physics_max0.1403978267974599
step_physics_mean0.12342421786654947
step_physics_median0.12567539806736103
step_physics_min0.10194824853401592
survival_time_max59.99999999999873
survival_time_mean39.78749999999971
survival_time_min26.50000000000024
No reset possible
5801210055Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
β”‚ output: ''
β”‚  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5800510066Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:10:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4455353488540887
survival_time_median13.82500000000006
deviation-center-line_median0.6173429301518953
in-drivable-lane_median9.250000000000073


other stats
agent_compute-ego0_max0.014220229566913762
agent_compute-ego0_mean0.013586064493631214
agent_compute-ego0_median0.013589959722299198
agent_compute-ego0_min0.012944108963012697
complete-iteration_max0.2072835131867291
complete-iteration_mean0.1783021999060743
complete-iteration_median0.17700091017309716
complete-iteration_min0.15192346609137358
deviation-center-line_max1.3636699648155766
deviation-center-line_mean0.6788768392521531
deviation-center-line_min0.11715153188924544
deviation-heading_max3.8446683046461767
deviation-heading_mean1.892178123666433
deviation-heading_median1.4258900434299586
deviation-heading_min0.8722641031596373
driven_any_max5.595733024275154
driven_any_mean3.2773226711876777
driven_any_median2.547102323518992
driven_any_min2.419353013437573
driven_lanedir_consec_max2.8724003030027294
driven_lanedir_consec_mean1.6290669728257052
driven_lanedir_consec_min0.7527968905919142
driven_lanedir_max2.8724003030027294
driven_lanedir_mean1.6290669728257052
driven_lanedir_median1.4455353488540887
driven_lanedir_min0.7527968905919142
get_duckie_state_max1.6562385704127554e-06
get_duckie_state_mean1.6175946959407217e-06
get_duckie_state_median1.61105312713205e-06
get_duckie_state_min1.5920339590860308e-06
get_robot_state_max0.004080136481405525
get_robot_state_mean0.003904915974775033
get_robot_state_median0.0039039514072115606
get_robot_state_min0.003731624603271484
get_state_dump_max0.005257190697835981
get_state_dump_mean0.005095067008254203
get_state_dump_median0.005107251138598716
get_state_dump_min0.0049085750579833986
get_ui_image_max0.03692119497142426
get_ui_image_mean0.031216554648597787
get_ui_image_median0.030730359557545633
get_ui_image_min0.026484304507875624
in-drivable-lane_max13.800000000000178
in-drivable-lane_mean8.67500000000009
in-drivable-lane_min2.400000000000034
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.421847298216213, "get_ui_image": 0.027727054595947265, "step_physics": 0.09557202816009522, "survival_time": 12.450000000000042, "driven_lanedir": 2.050863383614045, "get_state_dump": 0.0049085750579833986, "get_robot_state": 0.003731624603271484, "sim_render-ego0": 0.003916891098022461, "get_duckie_state": 1.5964508056640624e-06, "in-drivable-lane": 2.400000000000034, "deviation-heading": 1.4963498577438687, "agent_compute-ego0": 0.012944108963012697, "complete-iteration": 0.1628554286956787, "set_robot_commands": 0.0022708702087402342, "deviation-center-line": 0.6447484817013136, "driven_lanedir_consec": 2.050863383614045, "sim_compute_sim_state": 0.009602757453918457, "sim_compute_performance-ego0": 0.0020836067199707033}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.67235734882177, "get_ui_image": 0.03692119497142426, "step_physics": 0.12590203138246928, "survival_time": 14.550000000000072, "driven_lanedir": 0.8402073140941322, "get_state_dump": 0.005129218918003448, "get_robot_state": 0.003997129936740823, "sim_render-ego0": 0.004227015253615706, "get_duckie_state": 1.6256554486000374e-06, "in-drivable-lane": 9.650000000000084, "deviation-heading": 1.3554302291160487, "agent_compute-ego0": 0.014220229566913762, "complete-iteration": 0.2072835131867291, "set_robot_commands": 0.002276570013124649, "deviation-center-line": 0.5899373786024771, "driven_lanedir_consec": 0.8402073140941322, "sim_compute_sim_state": 0.012355295762623826, "sim_compute_performance-ego0": 0.0021553382481614204}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.595733024275154, "get_ui_image": 0.033733664519144, "step_physics": 0.11190884023803084, "survival_time": 29.25000000000028, "driven_lanedir": 2.8724003030027294, "get_state_dump": 0.005257190697835981, "get_robot_state": 0.004080136481405525, "sim_render-ego0": 0.004270722841646891, "get_duckie_state": 1.5920339590860308e-06, "in-drivable-lane": 13.800000000000178, "deviation-heading": 3.8446683046461767, "agent_compute-ego0": 0.013929437044944372, "complete-iteration": 0.1911463916505156, "set_robot_commands": 0.0024707272597954133, "deviation-center-line": 1.3636699648155766, "driven_lanedir_consec": 2.8724003030027294, "sim_compute_sim_state": 0.013102810944306566, "sim_compute_performance-ego0": 0.002287518042346316}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.419353013437573, "get_ui_image": 0.026484304507875624, "step_physics": 0.08882921186236828, "survival_time": 13.100000000000051, "driven_lanedir": 0.7527968905919142, "get_state_dump": 0.005085283359193983, "get_robot_state": 0.003810772877682298, "sim_render-ego0": 0.004116588672304335, "get_duckie_state": 1.6562385704127554e-06, "in-drivable-lane": 8.850000000000058, "deviation-heading": 0.8722641031596373, "agent_compute-ego0": 0.013250482399654026, "complete-iteration": 0.15192346609137358, "set_robot_commands": 0.00238244433820021, "deviation-center-line": 0.11715153188924544, "driven_lanedir_consec": 0.7527968905919142, "sim_compute_sim_state": 0.005691899092931711, "sim_compute_performance-ego0": 0.0021703524281316837}}
set_robot_commands_max0.0024707272597954133
set_robot_commands_mean0.002350152954965127
set_robot_commands_median0.0023295071756624297
set_robot_commands_min0.0022708702087402342
sim_compute_performance-ego0_max0.002287518042346316
sim_compute_performance-ego0_mean0.0021742038596525306
sim_compute_performance-ego0_median0.002162845338146552
sim_compute_performance-ego0_min0.0020836067199707033
sim_compute_sim_state_max0.013102810944306566
sim_compute_sim_state_mean0.01018819081344514
sim_compute_sim_state_median0.01097902660827114
sim_compute_sim_state_min0.005691899092931711
sim_render-ego0_max0.004270722841646891
sim_render-ego0_mean0.004132804466397348
sim_render-ego0_median0.00417180196296002
sim_render-ego0_min0.003916891098022461
simulation-passed1
step_physics_max0.12590203138246928
step_physics_mean0.1055530279107409
step_physics_median0.10374043419906304
step_physics_min0.08882921186236828
survival_time_max29.25000000000028
survival_time_mean17.337500000000112
survival_time_min12.450000000000042
No reset possible
5799210718Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5798210367Anthony CourchesneΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.488584191979378
survival_time_median3.4999999999999956
deviation-center-line_median0.07758239282468801
in-drivable-lane_median2.199999999999995


other stats
agent_compute-ego0_max0.014069237951504984
agent_compute-ego0_mean0.013246244282017068
agent_compute-ego0_median0.013058639064738718
agent_compute-ego0_min0.012798461047085848
complete-iteration_max0.222345678622906
complete-iteration_mean0.19421490346249803
complete-iteration_median0.19337192336701817
complete-iteration_min0.16777008849304992
deviation-center-line_max0.10346394946911484
deviation-center-line_mean0.07675434555254551
deviation-center-line_min0.048388647091691155
deviation-heading_max0.8140505946962051
deviation-heading_mean0.5034029136252918
deviation-heading_median0.4906844259818857
deviation-heading_min0.2181922078411904
driven_any_max3.0360000000003073
driven_any_mean1.7685013432513497
driven_any_median1.476000406124966
driven_any_min1.0860045607551594
driven_lanedir_consec_max0.6588300859048688
driven_lanedir_consec_mean0.47645748308973895
driven_lanedir_consec_min0.2698314624953311
driven_lanedir_max0.6588300859048688
driven_lanedir_mean0.47645748308973895
driven_lanedir_median0.488584191979378
driven_lanedir_min0.2698314624953311
get_duckie_state_max1.572943353033685e-06
get_duckie_state_mean1.5226268789801591e-06
get_duckie_state_median1.52938286910734e-06
get_duckie_state_min1.4587984246722722e-06
get_robot_state_max0.004080738340105329
get_robot_state_mean0.003962818553527233
get_robot_state_median0.003939042932320715
get_robot_state_min0.003892450009362173
get_state_dump_max0.005180523945735051
get_state_dump_mean0.005018900286925124
get_state_dump_median0.005010823943700298
get_state_dump_min0.00487342931456485
get_ui_image_max0.037823189221895655
get_ui_image_mean0.03217800170267166
get_ui_image_median0.03140979695619097
get_ui_image_min0.02806922367640904
in-drivable-lane_max5.049999999999988
in-drivable-lane_mean2.699999999999994
in-drivable-lane_min1.349999999999997
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0360000000003073, "get_ui_image": 0.03002162289813282, "step_physics": 0.10349120938681006, "survival_time": 6.099999999999986, "driven_lanedir": 0.2698314624953311, "get_state_dump": 0.005069994344943907, "get_robot_state": 0.003929830178981874, "sim_render-ego0": 0.004276176778281607, "get_duckie_state": 1.4925390724244156e-06, "in-drivable-lane": 5.049999999999988, "deviation-heading": 0.7227468353160319, "agent_compute-ego0": 0.013102106931732922, "complete-iteration": 0.17441763528963414, "set_robot_commands": 0.002372478081928036, "deviation-center-line": 0.10346394946911484, "driven_lanedir_consec": 0.2698314624953311, "sim_compute_sim_state": 0.0099093216221507, "sim_compute_performance-ego0": 0.0021439257676039284}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2960007751037872, "get_ui_image": 0.037823189221895655, "step_physics": 0.14428426302396336, "survival_time": 3.1999999999999966, "driven_lanedir": 0.3579515953954717, "get_state_dump": 0.005180523945735051, "get_robot_state": 0.0039482556856595555, "sim_render-ego0": 0.004006440822894757, "get_duckie_state": 1.5662266657902644e-06, "in-drivable-lane": 1.999999999999996, "deviation-heading": 0.8140505946962051, "agent_compute-ego0": 0.013015171197744516, "complete-iteration": 0.222345678622906, "set_robot_commands": 0.0023441608135516827, "deviation-center-line": 0.0833109354260745, "driven_lanedir_consec": 0.3579515953954717, "sim_compute_sim_state": 0.009501108756432166, "sim_compute_performance-ego0": 0.0021382808685302735}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0860045607551594, "get_ui_image": 0.032797971014249125, "step_physics": 0.1407178781800351, "survival_time": 2.8999999999999977, "driven_lanedir": 0.6588300859048688, "get_state_dump": 0.00487342931456485, "get_robot_state": 0.003892450009362173, "sim_render-ego0": 0.003945880017038119, "get_duckie_state": 1.4587984246722722e-06, "in-drivable-lane": 1.349999999999997, "deviation-heading": 0.25862201664773954, "agent_compute-ego0": 0.014069237951504984, "complete-iteration": 0.21232621144440217, "set_robot_commands": 0.002363726244134418, "deviation-center-line": 0.048388647091691155, "driven_lanedir_consec": 0.6588300859048688, "sim_compute_sim_state": 0.007475077095678297, "sim_compute_performance-ego0": 0.0020917674242439915}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6560000371461447, "get_ui_image": 0.02806922367640904, "step_physics": 0.10408093093277572, "survival_time": 3.7999999999999945, "driven_lanedir": 0.6192167885632842, "get_state_dump": 0.004951653542456689, "get_robot_state": 0.004080738340105329, "sim_render-ego0": 0.0040868040803190946, "get_duckie_state": 1.572943353033685e-06, "in-drivable-lane": 2.399999999999994, "deviation-heading": 0.2181922078411904, "agent_compute-ego0": 0.012798461047085848, "complete-iteration": 0.16777008849304992, "set_robot_commands": 0.002327956162489854, "deviation-center-line": 0.07185385022330154, "driven_lanedir_consec": 0.6192167885632842, "sim_compute_sim_state": 0.005139075316391982, "sim_compute_performance-ego0": 0.0021326603827538427}}
set_robot_commands_max0.002372478081928036
set_robot_commands_mean0.0023520803255259975
set_robot_commands_median0.0023539435288430503
set_robot_commands_min0.002327956162489854
sim_compute_performance-ego0_max0.0021439257676039284
sim_compute_performance-ego0_mean0.002126658610783009
sim_compute_performance-ego0_median0.002135470625642058
sim_compute_performance-ego0_min0.0020917674242439915
sim_compute_sim_state_max0.0099093216221507
sim_compute_sim_state_mean0.008006145697663286
sim_compute_sim_state_median0.008488092926055232
sim_compute_sim_state_min0.005139075316391982
sim_render-ego0_max0.004276176778281607
sim_render-ego0_mean0.004078825424633394
sim_render-ego0_median0.004046622451606925
sim_render-ego0_min0.003945880017038119
simulation-passed1
step_physics_max0.14428426302396336
step_physics_mean0.12314357038089604
step_physics_median0.1223994045564054
step_physics_min0.10349120938681006
survival_time_max6.099999999999986
survival_time_mean3.999999999999994
survival_time_min2.8999999999999977
No reset possible
5797210713Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:33:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.2392887893191
survival_time_median59.99999999999873
deviation-center-line_median2.7825752100472743
in-drivable-lane_median10.824999999999402


other stats
agent_compute-ego0_max0.04776349155035344
agent_compute-ego0_mean0.03800628054190671
agent_compute-ego0_median0.045475587956018
agent_compute-ego0_min0.013310454705237404
complete-iteration_max0.22210077361997024
complete-iteration_mean0.19472947488504128
complete-iteration_median0.19545270298017725
complete-iteration_min0.1659117199598403
deviation-center-line_max3.455497143211983
deviation-center-line_mean2.7936325346020956
deviation-center-line_min2.15388257510185
deviation-heading_max12.67285288069053
deviation-heading_mean11.129340983035664
deviation-heading_median11.55851828620512
deviation-heading_min8.727474479041893
driven_any_max12.764952319479535
driven_any_mean9.881996795352563
driven_any_median9.1330747482536
driven_any_min8.49688536542352
driven_lanedir_consec_max11.542754143580126
driven_lanedir_consec_mean8.286814414295405
driven_lanedir_consec_min5.125925934963295
driven_lanedir_max11.542754143580126
driven_lanedir_mean8.286814414295405
driven_lanedir_median8.2392887893191
driven_lanedir_min5.125925934963295
get_duckie_state_max2.0147190450332625e-06
get_duckie_state_mean1.7006363163731126e-06
get_duckie_state_median1.6807417984707568e-06
get_duckie_state_min1.426342623517674e-06
get_robot_state_max0.003789076997349982
get_robot_state_mean0.0034809315288175015
get_robot_state_median0.003482382263768027
get_robot_state_min0.0031698845903839696
get_state_dump_max0.004842027215948264
get_state_dump_mean0.004454377781345919
get_state_dump_median0.004490300479479178
get_state_dump_min0.00399488295047706
get_ui_image_max0.032726406554794626
get_ui_image_mean0.028772161136591895
get_ui_image_median0.03020191216177634
get_ui_image_min0.02195841366802028
in-drivable-lane_max18.14999999999908
in-drivable-lane_mean9.949999999999472
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.764952319479535, "get_ui_image": 0.028007200218854996, "step_physics": 0.0949651017772665, "survival_time": 59.99999999999873, "driven_lanedir": 11.542754143580126, "get_state_dump": 0.004632046180998257, "get_robot_state": 0.003590907780554372, "sim_render-ego0": 0.003804612814834176, "get_duckie_state": 1.754689276168785e-06, "in-drivable-lane": 6.849999999999611, "deviation-heading": 8.727474479041893, "agent_compute-ego0": 0.04776349155035344, "complete-iteration": 0.1960990135119817, "set_robot_commands": 0.0021894252071968227, "deviation-center-line": 2.6001838293764807, "driven_lanedir_consec": 11.542754143580126, "sim_compute_sim_state": 0.009134601494553286, "sim_compute_performance-ego0": 0.001922572482932517}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.663398930938758, "get_ui_image": 0.032726406554794626, "step_physics": 0.11562681912780304, "survival_time": 59.99999999999873, "driven_lanedir": 9.342291985409243, "get_state_dump": 0.004348554777960098, "get_robot_state": 0.003373856746981682, "sim_render-ego0": 0.003568360450166548, "get_duckie_state": 1.6067943207727284e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.67285288069053, "agent_compute-ego0": 0.04652124479549512, "complete-iteration": 0.22210077361997024, "set_robot_commands": 0.002080690255272299, "deviation-center-line": 3.455497143211983, "driven_lanedir_consec": 9.342291985409243, "sim_compute_sim_state": 0.011945244870912424, "sim_compute_performance-ego0": 0.001823505295206367}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.602750565568442, "get_ui_image": 0.03239662410469768, "step_physics": 0.11817542899440288, "survival_time": 50.79999999999925, "driven_lanedir": 5.125925934963295, "get_state_dump": 0.004842027215948264, "get_robot_state": 0.003789076997349982, "sim_render-ego0": 0.0040252407977949085, "get_duckie_state": 2.0147190450332625e-06, "in-drivable-lane": 18.14999999999908, "deviation-heading": 10.489958614517764, "agent_compute-ego0": 0.013310454705237404, "complete-iteration": 0.1948063924483728, "set_robot_commands": 0.002256867691010032, "deviation-center-line": 2.15388257510185, "driven_lanedir_consec": 5.125925934963295, "sim_compute_sim_state": 0.013811642441426054, "sim_compute_performance-ego0": 0.0020989225325682872}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.49688536542352, "get_ui_image": 0.02195841366802028, "step_physics": 0.0798747607015948, "survival_time": 59.99999999999873, "driven_lanedir": 7.136285593228952, "get_state_dump": 0.00399488295047706, "get_robot_state": 0.0031698845903839696, "sim_render-ego0": 0.0033917032014718165, "get_duckie_state": 1.426342623517674e-06, "in-drivable-lane": 14.799999999999194, "deviation-heading": 12.627077957892478, "agent_compute-ego0": 0.044429931116540866, "complete-iteration": 0.1659117199598403, "set_robot_commands": 0.0017988920013275271, "deviation-center-line": 2.964966590718068, "driven_lanedir_consec": 7.136285593228952, "sim_compute_sim_state": 0.005535378047171282, "sim_compute_performance-ego0": 0.0016843071587377544}}
set_robot_commands_max0.002256867691010032
set_robot_commands_mean0.0020814687887016703
set_robot_commands_median0.002135057731234561
set_robot_commands_min0.0017988920013275271
sim_compute_performance-ego0_max0.0020989225325682872
sim_compute_performance-ego0_mean0.0018823268673612312
sim_compute_performance-ego0_median0.001873038889069442
sim_compute_performance-ego0_min0.0016843071587377544
sim_compute_sim_state_max0.013811642441426054
sim_compute_sim_state_mean0.01010671671351576
sim_compute_sim_state_median0.010539923182732856
sim_compute_sim_state_min0.005535378047171282
sim_render-ego0_max0.0040252407977949085
sim_render-ego0_mean0.003697479316066862
sim_render-ego0_median0.003686486632500362
sim_render-ego0_min0.0033917032014718165
simulation-passed1
step_physics_max0.11817542899440288
step_physics_mean0.1021605276502668
step_physics_median0.10529596045253475
step_physics_min0.0798747607015948
survival_time_max59.99999999999873
survival_time_mean57.69999999999886
survival_time_min50.79999999999925
No reset possible
5796910718Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5794610731Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:29:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3761735058975955
survival_time_median52.47499999999915
deviation-center-line_median1.285976708728387
in-drivable-lane_median22.924999999999766


other stats
agent_compute-ego0_max0.013944478481002116
agent_compute-ego0_mean0.01300825079709149
agent_compute-ego0_median0.013079220179869094
agent_compute-ego0_min0.011930084347625656
complete-iteration_max0.1889968135140159
complete-iteration_mean0.17103747985693987
complete-iteration_median0.17718860588388105
complete-iteration_min0.14077589414598146
deviation-center-line_max2.9744434141008624
deviation-center-line_mean1.5549260764748656
deviation-center-line_min0.6733074743418249
deviation-heading_max9.27021363510053
deviation-heading_mean5.520190135616964
deviation-heading_median5.222507991701768
deviation-heading_min2.365530923963788
driven_any_max7.740423151344848
driven_any_mean6.52607792685786
driven_any_median6.576785148572143
driven_any_min5.210318258942302
driven_lanedir_consec_max7.607048835863518
driven_lanedir_consec_mean4.0232405083057765
driven_lanedir_consec_min1.733566185564397
driven_lanedir_max7.607048835863518
driven_lanedir_mean4.0232405083057765
driven_lanedir_median3.3761735058975955
driven_lanedir_min1.733566185564397
get_duckie_state_max1.5819879402791646e-06
get_duckie_state_mean1.4895424170933478e-06
get_duckie_state_median1.5387426773350306e-06
get_duckie_state_min1.298696373424165e-06
get_robot_state_max0.003931456154774562
get_robot_state_mean0.0037136729584138863
get_robot_state_median0.003711976049360165
get_robot_state_min0.003499283580160657
get_state_dump_max0.004962336748166192
get_state_dump_mean0.00474201496607768
get_state_dump_median0.004833025583638626
get_state_dump_min0.004339671948867277
get_ui_image_max0.0350219184420607
get_ui_image_mean0.029729530064628945
get_ui_image_median0.029797783006254117
get_ui_image_min0.024300635803946844
in-drivable-lane_max38.74999999999915
in-drivable-lane_mean21.14999999999967
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.076590421533656, "get_ui_image": 0.02769934705325535, "step_physics": 0.09891067770190703, "survival_time": 53.14999999999912, "driven_lanedir": 4.108080613749809, "get_state_dump": 0.004962336748166192, "get_robot_state": 0.003742260592324393, "sim_render-ego0": 0.00402280621062544, "get_duckie_state": 1.5819879402791646e-06, "in-drivable-lane": 25.349999999999767, "deviation-heading": 4.509982673592041, "agent_compute-ego0": 0.012929483463889672, "complete-iteration": 0.1677327877596805, "set_robot_commands": 0.0022697977553632924, "deviation-center-line": 1.1512879490371533, "driven_lanedir_consec": 4.108080613749809, "sim_compute_sim_state": 0.011007914641746004, "sim_compute_performance-ego0": 0.0020935212759147013}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.210318258942302, "get_ui_image": 0.0350219184420607, "step_physics": 0.11134775357657369, "survival_time": 42.299999999999734, "driven_lanedir": 2.644266398045381, "get_state_dump": 0.004742347926710685, "get_robot_state": 0.003681691506395937, "sim_render-ego0": 0.003930010226991691, "get_duckie_state": 1.51270536492538e-06, "in-drivable-lane": 20.49999999999977, "deviation-heading": 5.935033309811496, "agent_compute-ego0": 0.013228956895848512, "complete-iteration": 0.1889968135140159, "set_robot_commands": 0.002199040393761789, "deviation-center-line": 1.4206654684196214, "driven_lanedir_consec": 2.644266398045381, "sim_compute_sim_state": 0.01272511116307066, "sim_compute_performance-ego0": 0.0020285150940049495}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.07697987561063, "get_ui_image": 0.03189621895925288, "step_physics": 0.11141328595528376, "survival_time": 51.799999999999194, "driven_lanedir": 1.733566185564397, "get_state_dump": 0.004923703240566566, "get_robot_state": 0.003931456154774562, "sim_render-ego0": 0.00420701239355045, "get_duckie_state": 1.5647799897446813e-06, "in-drivable-lane": 38.74999999999915, "deviation-heading": 2.365530923963788, "agent_compute-ego0": 0.013944478481002116, "complete-iteration": 0.1866444240080816, "set_robot_commands": 0.0023291196059812805, "deviation-center-line": 0.6733074743418249, "driven_lanedir_consec": 1.733566185564397, "sim_compute_sim_state": 0.01168902837666849, "sim_compute_performance-ego0": 0.0022127152408905177}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.740423151344848, "get_ui_image": 0.024300635803946844, "step_physics": 0.08328129508711714, "survival_time": 59.99999999999873, "driven_lanedir": 7.607048835863518, "get_state_dump": 0.004339671948867277, "get_robot_state": 0.003499283580160657, "sim_render-ego0": 0.003646410474372248, "get_duckie_state": 1.298696373424165e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.27021363510053, "agent_compute-ego0": 0.011930084347625656, "complete-iteration": 0.14077589414598146, "set_robot_commands": 0.0020675931147592056, "deviation-center-line": 2.9744434141008624, "driven_lanedir_consec": 7.607048835863518, "sim_compute_sim_state": 0.005784097261770282, "sim_compute_performance-ego0": 0.0018471357328111583}}
set_robot_commands_max0.0023291196059812805
set_robot_commands_mean0.002216387717466392
set_robot_commands_median0.0022344190745625407
set_robot_commands_min0.0020675931147592056
sim_compute_performance-ego0_max0.0022127152408905177
sim_compute_performance-ego0_mean0.0020454718359053316
sim_compute_performance-ego0_median0.0020610181849598256
sim_compute_performance-ego0_min0.0018471357328111583
sim_compute_sim_state_max0.01272511116307066
sim_compute_sim_state_mean0.01030153786081386
sim_compute_sim_state_median0.011348471509207248
sim_compute_sim_state_min0.005784097261770282
sim_render-ego0_max0.00420701239355045
sim_render-ego0_mean0.003951559826384957
sim_render-ego0_median0.003976408218808566
sim_render-ego0_min0.003646410474372248
simulation-passed1
step_physics_max0.11141328595528376
step_physics_mean0.1012382530802204
step_physics_median0.10512921563924035
step_physics_min0.08328129508711714
survival_time_max59.99999999999873
survival_time_mean51.81249999999919
survival_time_min42.299999999999734
No reset possible
5793310741Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:21:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.069844448409803
survival_time_median40.77499999999962
deviation-center-line_median1.3321586049224068
in-drivable-lane_median6.600000000000081


other stats
agent_compute-ego0_max0.01398670862591456
agent_compute-ego0_mean0.0131660450229005
agent_compute-ego0_median0.013075080858424931
agent_compute-ego0_min0.012527309748837572
complete-iteration_max0.2654725748395163
complete-iteration_mean0.20035318092129964
complete-iteration_median0.1842551656197065
complete-iteration_min0.1674298176062693
deviation-center-line_max4.261005810816155
deviation-center-line_mean1.7575262151127582
deviation-center-line_min0.10478183979006513
deviation-heading_max9.84094520520859
deviation-heading_mean4.599731587483875
deviation-heading_median3.709101742446872
deviation-heading_min1.139777659833168
driven_any_max8.338044608497098
driven_any_mean4.93143667931345
driven_any_median5.549897845350873
driven_any_min0.2879064180549526
driven_lanedir_consec_max8.020109102326298
driven_lanedir_consec_mean3.5727722948963416
driven_lanedir_consec_min0.13129118043946297
driven_lanedir_max8.020109102326298
driven_lanedir_mean3.5727722948963416
driven_lanedir_median3.069844448409803
driven_lanedir_min0.13129118043946297
get_duckie_state_max1.457002427842882e-06
get_duckie_state_mean1.3574985383178782e-06
get_duckie_state_median1.344756290692368e-06
get_duckie_state_min1.2834791440438954e-06
get_robot_state_max0.00393308032859275
get_robot_state_mean0.003866726665002738
get_robot_state_median0.0038842630237849902
get_robot_state_min0.0037653002838482215
get_state_dump_max0.0051816342368958485
get_state_dump_mean0.004964510454413595
get_state_dump_median0.00492896033604107
get_state_dump_min0.004818486908676396
get_ui_image_max0.03825705770462278
get_ui_image_mean0.0315065962859618
get_ui_image_median0.03033325888810152
get_ui_image_min0.027102809663021397
in-drivable-lane_max23.799999999999756
in-drivable-lane_mean9.499999999999966
in-drivable-lane_min0.9999999999999432
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.576438154149887, "get_ui_image": 0.028303341882785014, "step_physics": 0.1064655524265917, "survival_time": 55.249999999999, "driven_lanedir": 4.220698576020977, "get_state_dump": 0.004818486908676396, "get_robot_state": 0.003873500642897207, "sim_render-ego0": 0.0041002451187878795, "get_duckie_state": 1.3427751620466842e-06, "in-drivable-lane": 23.799999999999756, "deviation-heading": 4.824539780969563, "agent_compute-ego0": 0.012527309748837572, "complete-iteration": 0.1756800523071565, "set_robot_commands": 0.0022910839825814717, "deviation-center-line": 1.8251994302404455, "driven_lanedir_consec": 4.220698576020977, "sim_compute_sim_state": 0.01105171215685108, "sim_compute_performance-ego0": 0.0021643267833302724}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2879064180549526, "get_ui_image": 0.03825705770462278, "step_physics": 0.18476254599434988, "survival_time": 3.099999999999997, "driven_lanedir": 0.13129118043946297, "get_state_dump": 0.0051816342368958485, "get_robot_state": 0.003895025404672774, "sim_render-ego0": 0.004244021006992885, "get_duckie_state": 1.457002427842882e-06, "in-drivable-lane": 1.4499999999999962, "deviation-heading": 1.139777659833168, "agent_compute-ego0": 0.01398670862591456, "complete-iteration": 0.2654725748395163, "set_robot_commands": 0.0024410240233890593, "deviation-center-line": 0.10478183979006513, "driven_lanedir_consec": 0.13129118043946297, "sim_compute_sim_state": 0.01050862433418395, "sim_compute_performance-ego0": 0.002103945565602136}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.523357536551859, "get_ui_image": 0.03236317589341802, "step_physics": 0.11902097778030772, "survival_time": 26.30000000000024, "driven_lanedir": 1.9189903207986283, "get_state_dump": 0.004947098654180596, "get_robot_state": 0.0037653002838482215, "sim_render-ego0": 0.004013156076536233, "get_duckie_state": 1.2834791440438954e-06, "in-drivable-lane": 11.750000000000169, "deviation-heading": 2.593663703924181, "agent_compute-ego0": 0.013617483443055705, "complete-iteration": 0.19283027893225657, "set_robot_commands": 0.0022512482058617378, "deviation-center-line": 0.8391177796043682, "driven_lanedir_consec": 1.9189903207986283, "sim_compute_sim_state": 0.010749891994121632, "sim_compute_performance-ego0": 0.0020130427105377025}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.338044608497098, "get_ui_image": 0.027102809663021397, "step_physics": 0.10394293084728232, "survival_time": 59.99999999999873, "driven_lanedir": 8.020109102326298, "get_state_dump": 0.004910822017901545, "get_robot_state": 0.00393308032859275, "sim_render-ego0": 0.00401724665290013, "get_duckie_state": 1.3467374193380515e-06, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 9.84094520520859, "agent_compute-ego0": 0.012532678273794156, "complete-iteration": 0.1674298176062693, "set_robot_commands": 0.002296333011242869, "deviation-center-line": 4.261005810816155, "driven_lanedir_consec": 8.020109102326298, "sim_compute_sim_state": 0.006496182290044653, "sim_compute_performance-ego0": 0.0021111030165698506}}
set_robot_commands_max0.0024410240233890593
set_robot_commands_mean0.0023199223057687843
set_robot_commands_median0.0022937084969121705
set_robot_commands_min0.0022512482058617378
sim_compute_performance-ego0_max0.0021643267833302724
sim_compute_performance-ego0_mean0.0020981045190099903
sim_compute_performance-ego0_median0.002107524291085994
sim_compute_performance-ego0_min0.0020130427105377025
sim_compute_sim_state_max0.01105171215685108
sim_compute_sim_state_mean0.009701602693800328
sim_compute_sim_state_median0.010629258164152793
sim_compute_sim_state_min0.006496182290044653
sim_render-ego0_max0.004244021006992885
sim_render-ego0_mean0.004093667213804282
sim_render-ego0_median0.004058745885844005
sim_render-ego0_min0.004013156076536233
simulation-passed1
step_physics_max0.18476254599434988
step_physics_mean0.1285480017621329
step_physics_median0.1127432651034497
step_physics_min0.10394293084728232
survival_time_max59.99999999999873
survival_time_mean36.16249999999949
survival_time_min3.099999999999997
No reset possible
5792110767Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:21:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4008587626112603
survival_time_median37.2749999999994
deviation-center-line_median1.7589522208554769
in-drivable-lane_median9.450000000000102


other stats
agent_compute-ego0_max0.043980348677862255
agent_compute-ego0_mean0.037612413605441666
agent_compute-ego0_median0.040418300261963656
agent_compute-ego0_min0.025632705219977108
complete-iteration_max0.23596313567388624
complete-iteration_mean0.2061564391982109
complete-iteration_median0.20185380084013188
complete-iteration_min0.18495501943869355
deviation-center-line_max3.1244439571050773
deviation-center-line_mean1.688884300692533
deviation-center-line_min0.11318880395410018
deviation-heading_max6.848048815508587
deviation-heading_mean3.9886700621132114
deviation-heading_median4.08923551976772
deviation-heading_min0.9281603934088192
driven_any_max10.21490092081017
driven_any_mean5.811950866784903
driven_any_median6.18355295174742
driven_any_min0.6657966428346023
driven_lanedir_consec_max7.321841222457158
driven_lanedir_consec_mean3.5820596270821725
driven_lanedir_consec_min0.20467976064901228
driven_lanedir_max7.321841222457158
driven_lanedir_mean3.5820596270821725
driven_lanedir_median3.4008587626112603
driven_lanedir_min0.20467976064901228
get_duckie_state_max1.6027933930697506e-06
get_duckie_state_mean1.5102796603027856e-06
get_duckie_state_median1.5027715601988575e-06
get_duckie_state_min1.4327821277436756e-06
get_robot_state_max0.00424448893925828
get_robot_state_mean0.0038883834023094657
get_robot_state_median0.0038134822364859463
get_robot_state_min0.0036820801970076887
get_state_dump_max0.005216586004188913
get_state_dump_mean0.005066317934362116
get_state_dump_median0.0050764547479906965
get_state_dump_min0.004895776237278159
get_ui_image_max0.03448469057170477
get_ui_image_mean0.030551188712748867
get_ui_image_median0.03083539797213057
get_ui_image_min0.026049268335029543
in-drivable-lane_max29.24999999999992
in-drivable-lane_mean12.750000000000044
in-drivable-lane_min2.8500000000000405
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4184738679443014, "get_ui_image": 0.027441935179984733, "step_physics": 0.09374155247048156, "survival_time": 14.550000000000072, "driven_lanedir": 2.0846264720895595, "get_state_dump": 0.005056469407800125, "get_robot_state": 0.0036820801970076887, "sim_render-ego0": 0.003904238955615318, "get_duckie_state": 1.6027933930697506e-06, "in-drivable-lane": 2.8500000000000405, "deviation-heading": 1.3768682982172915, "agent_compute-ego0": 0.041919625785252816, "complete-iteration": 0.18970466149996404, "set_robot_commands": 0.0022241456867897347, "deviation-center-line": 0.677811266334303, "driven_lanedir_consec": 2.0846264720895595, "sim_compute_sim_state": 0.009437841095336496, "sim_compute_performance-ego0": 0.002202964808842907}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6657966428346023, "get_ui_image": 0.03422886076427641, "step_physics": 0.12993850708007812, "survival_time": 5.1999999999999895, "driven_lanedir": 0.20467976064901228, "get_state_dump": 0.0050964400881812685, "get_robot_state": 0.003846116293044317, "sim_render-ego0": 0.003926835741315569, "get_duckie_state": 1.4327821277436756e-06, "in-drivable-lane": 3.399999999999989, "deviation-heading": 0.9281603934088192, "agent_compute-ego0": 0.043980348677862255, "complete-iteration": 0.23596313567388624, "set_robot_commands": 0.0022646131969633557, "deviation-center-line": 0.11318880395410018, "driven_lanedir_consec": 0.20467976064901228, "sim_compute_sim_state": 0.010517924172537668, "sim_compute_performance-ego0": 0.0020666190556117466}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.21490092081017, "get_ui_image": 0.03448469057170477, "step_physics": 0.12227904369789395, "survival_time": 59.99999999999873, "driven_lanedir": 4.717091053132961, "get_state_dump": 0.005216586004188913, "get_robot_state": 0.00424448893925828, "sim_render-ego0": 0.004475031764580745, "get_duckie_state": 1.528975767060978e-06, "in-drivable-lane": 29.24999999999992, "deviation-heading": 6.848048815508587, "agent_compute-ego0": 0.025632705219977108, "complete-iteration": 0.2140029401802997, "set_robot_commands": 0.0026255162133463814, "deviation-center-line": 2.8400931753766505, "driven_lanedir_consec": 4.717091053132961, "sim_compute_sim_state": 0.01250070179630378, "sim_compute_performance-ego0": 0.00244236230651703}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.948632035550538, "get_ui_image": 0.026049268335029543, "step_physics": 0.09661123198732348, "survival_time": 59.99999999999873, "driven_lanedir": 7.321841222457158, "get_state_dump": 0.004895776237278159, "get_robot_state": 0.003780848179927575, "sim_render-ego0": 0.003952670553939527, "get_duckie_state": 1.4765673533367376e-06, "in-drivable-lane": 15.500000000000217, "deviation-heading": 6.801602741318149, "agent_compute-ego0": 0.0389169747386745, "complete-iteration": 0.18495501943869355, "set_robot_commands": 0.0023623960004261787, "deviation-center-line": 3.1244439571050773, "driven_lanedir_consec": 7.321841222457158, "sim_compute_sim_state": 0.006236066429144536, "sim_compute_performance-ego0": 0.002052167770169756}}
set_robot_commands_max0.0026255162133463814
set_robot_commands_mean0.002369167774381413
set_robot_commands_median0.0023135045986947675
set_robot_commands_min0.0022241456867897347
sim_compute_performance-ego0_max0.00244236230651703
sim_compute_performance-ego0_mean0.00219102848528536
sim_compute_performance-ego0_median0.002134791932227327
sim_compute_performance-ego0_min0.002052167770169756
sim_compute_sim_state_max0.01250070179630378
sim_compute_sim_state_mean0.00967313337333062
sim_compute_sim_state_median0.009977882633937082
sim_compute_sim_state_min0.006236066429144536
sim_render-ego0_max0.004475031764580745
sim_render-ego0_mean0.00406469425386279
sim_render-ego0_median0.003939753147627548
sim_render-ego0_min0.003904238955615318
simulation-passed1
step_physics_max0.12993850708007812
step_physics_mean0.11064258380894428
step_physics_median0.10944513784260872
step_physics_min0.09374155247048156
survival_time_max59.99999999999873
survival_time_mean34.93749999999938
survival_time_min5.1999999999999895
No reset possible
5791510763Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6265335410139208
survival_time_median8.52499999999999
deviation-center-line_median0.18173425550509847
in-drivable-lane_median4.525000000000027


other stats
agent_compute-ego0_max0.013813497498631476
agent_compute-ego0_mean0.01346291732076364
agent_compute-ego0_median0.01359771319505149
agent_compute-ego0_min0.012842745394320102
complete-iteration_max0.2328741441365161
complete-iteration_mean0.20165444511242253
complete-iteration_median0.19931734139351423
complete-iteration_min0.17510895352614553
deviation-center-line_max0.4646684906387495
deviation-center-line_mean0.2377161012905917
deviation-center-line_min0.12272740351342036
deviation-heading_max1.6980015953665475
deviation-heading_mean1.0936518409407192
deviation-heading_median1.0166739502917603
deviation-heading_min0.6432578678128089
driven_any_max2.8687706365815924
driven_any_mean1.7523235783233653
driven_any_median1.5401035567140018
driven_any_min1.0603165632838656
driven_lanedir_consec_max1.946231075973194
driven_lanedir_consec_mean0.9454859647566276
driven_lanedir_consec_min0.5826457010254749
driven_lanedir_max1.946231075973194
driven_lanedir_mean0.9454859647566276
driven_lanedir_median0.6265335410139208
driven_lanedir_min0.5826457010254749
get_duckie_state_max1.8897809480365952e-06
get_duckie_state_mean1.6990465047029542e-06
get_duckie_state_median1.7016252176729196e-06
get_duckie_state_min1.5031546354293823e-06
get_robot_state_max0.00407760906842799
get_robot_state_mean0.00400629224467681
get_robot_state_median0.004015158440329527
get_robot_state_min0.003917243029620196
get_state_dump_max0.0053878017500335095
get_state_dump_mean0.005198018453798406
get_state_dump_median0.005182738036214033
get_state_dump_min0.005038795992732048
get_ui_image_max0.03824470713247661
get_ui_image_mean0.03252459828663824
get_ui_image_median0.03192822977497771
get_ui_image_min0.027997226464120964
in-drivable-lane_max5.950000000000004
in-drivable-lane_mean4.450000000000012
in-drivable-lane_min2.79999999999999
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8687706365815924, "get_ui_image": 0.03004004745870023, "step_physics": 0.11681364114220076, "survival_time": 14.750000000000076, "driven_lanedir": 1.946231075973194, "get_state_dump": 0.005157374046944283, "get_robot_state": 0.003917243029620196, "sim_render-ego0": 0.004044253278423, "get_duckie_state": 1.5956324500006598e-06, "in-drivable-lane": 4.90000000000007, "deviation-heading": 1.6980015953665475, "agent_compute-ego0": 0.012842745394320102, "complete-iteration": 0.18798130509015676, "set_robot_commands": 0.0022460786071983544, "deviation-center-line": 0.4646684906387495, "driven_lanedir_consec": 1.946231075973194, "sim_compute_sim_state": 0.010639876127243042, "sim_compute_performance-ego0": 0.0021812182825964852}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3318176276534497, "get_ui_image": 0.03824470713247661, "step_physics": 0.15141540882634183, "survival_time": 7.599999999999981, "driven_lanedir": 0.5826457010254749, "get_state_dump": 0.0053878017500335095, "get_robot_state": 0.00407760906842799, "sim_render-ego0": 0.004309446983088076, "get_duckie_state": 1.8076179853451797e-06, "in-drivable-lane": 4.149999999999985, "deviation-heading": 1.2996763290159623, "agent_compute-ego0": 0.01358856562695472, "complete-iteration": 0.2328741441365161, "set_robot_commands": 0.002379135368696225, "deviation-center-line": 0.1965375728097737, "driven_lanedir_consec": 0.5826457010254749, "sim_compute_sim_state": 0.01102290901483274, "sim_compute_performance-ego0": 0.0023316448810053805}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0603165632838656, "get_ui_image": 0.03381641209125519, "step_physics": 0.13624779507517815, "survival_time": 6.349999999999985, "driven_lanedir": 0.630561028232816, "get_state_dump": 0.005038795992732048, "get_robot_state": 0.00404481403529644, "sim_render-ego0": 0.004186300560832024, "get_duckie_state": 1.5031546354293823e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.6432578678128089, "agent_compute-ego0": 0.013813497498631476, "complete-iteration": 0.21065337769687176, "set_robot_commands": 0.0023812223225831985, "deviation-center-line": 0.12272740351342036, "driven_lanedir_consec": 0.630561028232816, "sim_compute_sim_state": 0.00883401557803154, "sim_compute_performance-ego0": 0.0021866559982299805}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7483894857745537, "get_ui_image": 0.027997226464120964, "step_physics": 0.10988051138426128, "survival_time": 9.45, "driven_lanedir": 0.6225060537950255, "get_state_dump": 0.0052081020254837835, "get_robot_state": 0.003985502845362613, "sim_render-ego0": 0.004165173831738924, "get_duckie_state": 1.8897809480365952e-06, "in-drivable-lane": 5.950000000000004, "deviation-heading": 0.7336715715675584, "agent_compute-ego0": 0.013606860763148258, "complete-iteration": 0.17510895352614553, "set_robot_commands": 0.00243687253249319, "deviation-center-line": 0.1669309382004233, "driven_lanedir_consec": 0.6225060537950255, "sim_compute_sim_state": 0.005555958496896845, "sim_compute_performance-ego0": 0.0021604061126708984}}
set_robot_commands_max0.00243687253249319
set_robot_commands_mean0.002360827207742742
set_robot_commands_median0.002380178845639712
set_robot_commands_min0.0022460786071983544
sim_compute_performance-ego0_max0.0023316448810053805
sim_compute_performance-ego0_mean0.002214981318625686
sim_compute_performance-ego0_median0.0021839371404132326
sim_compute_performance-ego0_min0.0021604061126708984
sim_compute_sim_state_max0.01102290901483274
sim_compute_sim_state_mean0.009013189804251042
sim_compute_sim_state_median0.009736945852637293
sim_compute_sim_state_min0.005555958496896845
sim_render-ego0_max0.004309446983088076
sim_render-ego0_mean0.004176293663520506
sim_render-ego0_median0.004175737196285474
sim_render-ego0_min0.004044253278423
simulation-passed1
step_physics_max0.15141540882634183
step_physics_mean0.1285893391069955
step_physics_median0.12653071810868946
step_physics_min0.10988051138426128
survival_time_max14.750000000000076
survival_time_mean9.537500000000009
survival_time_min6.349999999999985
No reset possible
5785710794Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:47:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013885920688969012
agent_compute-ego0_mean0.013598070305451862
agent_compute-ego0_median0.013646315277664984
agent_compute-ego0_min0.013213729977508469
complete-iteration_max0.3912422541873243
complete-iteration_mean0.3322712652986989
complete-iteration_median0.33629158742223353
complete-iteration_min0.26525963216300413
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.999261873548573e-06
get_duckie_state_mean1.8305226626940115e-06
get_duckie_state_median1.8910702618830016e-06
get_duckie_state_min1.540688253461471e-06
get_robot_state_max0.0044342566290862554
get_robot_state_mean0.004169094522827174
get_robot_state_median0.004164481043914871
get_robot_state_min0.003913159374392698
get_state_dump_max0.005264518858491133
get_state_dump_mean0.0050724912047088394
get_state_dump_median0.005055469537555526
get_state_dump_min0.004914506885233171
get_ui_image_max0.03908108354706649
get_ui_image_mean0.03336085382845876
get_ui_image_median0.03303585352250479
get_ui_image_min0.028290624721758965
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.029910468141998877, "step_physics": 0.23737926526827977, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005000068980589398, "get_robot_state": 0.004165820535473978, "sim_render-ego0": 0.004234706035363089, "get_duckie_state": 1.999261873548573e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013447128465828748, "complete-iteration": 0.30846713027985867, "set_robot_commands": 0.002477459268307904, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009399652282562385, "sim_compute_performance-ego0": 0.002343939305542907}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03908108354706649, "step_physics": 0.30708995707128367, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.005110870094521655, "get_robot_state": 0.004163141552355764, "sim_render-ego0": 0.004297772216161622, "get_duckie_state": 1.8374707478468465e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013845502089501222, "complete-iteration": 0.3912422541873243, "set_robot_commands": 0.0024092937885573464, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012805457119143672, "sim_compute_performance-ego0": 0.0023337262159183955}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03616123890301071, "step_physics": 0.28455919727099926, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005264518858491133, "get_robot_state": 0.0044342566290862554, "sim_render-ego0": 0.0043953419922789765, "get_duckie_state": 1.944669775919156e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.013885920688969012, "complete-iteration": 0.3641160445646085, "set_robot_commands": 0.0025922118575249387, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010272312521636734, "sim_compute_performance-ego0": 0.002435787631311981}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.028290624721758965, "step_physics": 0.19995308259841704, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004914506885233171, "get_robot_state": 0.003913159374392698, "sim_render-ego0": 0.003979338694373138, "get_duckie_state": 1.540688253461471e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.013213729977508469, "complete-iteration": 0.26525963216300413, "set_robot_commands": 0.0023481403163430298, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00649489967352544, "sim_compute_performance-ego0": 0.002059877762488779}}
set_robot_commands_max0.0025922118575249387
set_robot_commands_mean0.002456776307683305
set_robot_commands_median0.0024433765284326255
set_robot_commands_min0.0023481403163430298
sim_compute_performance-ego0_max0.002435787631311981
sim_compute_performance-ego0_mean0.0022933327288155157
sim_compute_performance-ego0_median0.002338832760730651
sim_compute_performance-ego0_min0.002059877762488779
sim_compute_sim_state_max0.012805457119143672
sim_compute_sim_state_mean0.009743080399217058
sim_compute_sim_state_median0.00983598240209956
sim_compute_sim_state_min0.00649489967352544
sim_render-ego0_max0.0043953419922789765
sim_render-ego0_mean0.004226789734544207
sim_render-ego0_median0.004266239125762355
sim_render-ego0_min0.003979338694373138
simulation-passed1
step_physics_max0.30708995707128367
step_physics_mean0.2572453755522449
step_physics_median0.2609692312696395
step_physics_min0.19995308259841704
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5784810796Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:03:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 41 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5780910820Raphael Jeanexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:19:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0949450522675495
survival_time_median32.87499999999996
deviation-center-line_median0.6640060587186429
in-drivable-lane_median16.300000000000086


other stats
agent_compute-ego0_max0.013722250125552183
agent_compute-ego0_mean0.01297971111941222
agent_compute-ego0_median0.012965601945661324
agent_compute-ego0_min0.01226539046077405
complete-iteration_max0.2169258861200388
complete-iteration_mean0.1887308140906987
complete-iteration_median0.1847276368341641
complete-iteration_min0.16854209657442773
deviation-center-line_max0.945049091552686
deviation-center-line_mean0.6724040656787088
deviation-center-line_min0.4165550537248636
deviation-heading_max3.702251168951684
deviation-heading_mean2.80046313934073
deviation-heading_median2.733106709263879
deviation-heading_min2.0333879698834783
driven_any_max7.754776638266869
driven_any_mean5.236348182725551
driven_any_median5.380432075921448
driven_any_min2.4297519407924413
driven_lanedir_consec_max3.8009144435530553
driven_lanedir_consec_mean2.4006245983928833
driven_lanedir_consec_min1.611693845483379
driven_lanedir_max3.8009144435530553
driven_lanedir_mean2.4006245983928833
driven_lanedir_median2.0949450522675495
driven_lanedir_min1.611693845483379
get_duckie_state_max1.7218808309732115e-06
get_duckie_state_mean1.511537821397974e-06
get_duckie_state_median1.5312980856092854e-06
get_duckie_state_min1.261674283400114e-06
get_robot_state_max0.004119381808594569
get_robot_state_mean0.003806457258557001
get_robot_state_median0.003798876668298709
get_robot_state_min0.003508693889036017
get_state_dump_max0.005001268991992561
get_state_dump_mean0.004768398384457481
get_state_dump_median0.004771373283061649
get_state_dump_min0.004529577979714062
get_ui_image_max0.03488053630861602
get_ui_image_mean0.030816571389894257
get_ui_image_median0.030681709997239827
get_ui_image_min0.027022329256481344
in-drivable-lane_max31.849999999999707
in-drivable-lane_mean16.699999999999978
in-drivable-lane_min2.3500000000000334
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4297519407924413, "get_ui_image": 0.027030206130722823, "step_physics": 0.10426585229776672, "survival_time": 14.700000000000074, "driven_lanedir": 2.1355449357823786, "get_state_dump": 0.004553927405405853, "get_robot_state": 0.003508693889036017, "sim_render-ego0": 0.0036850363521252648, "get_duckie_state": 1.3997999288268008e-06, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 2.0333879698834783, "agent_compute-ego0": 0.01226539046077405, "complete-iteration": 0.16854209657442773, "set_robot_commands": 0.0020946753227104576, "deviation-center-line": 0.4165550537248636, "driven_lanedir_consec": 2.1355449357823786, "sim_compute_sim_state": 0.00913579827648098, "sim_compute_performance-ego0": 0.0019175650709766451}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.327256319098839, "get_ui_image": 0.03488053630861602, "step_physics": 0.12609040225524248, "survival_time": 23.250000000000195, "driven_lanedir": 2.0543451687527208, "get_state_dump": 0.004529577979714062, "get_robot_state": 0.0035959661262741417, "sim_render-ego0": 0.0038390773560356174, "get_duckie_state": 1.261674283400114e-06, "in-drivable-lane": 8.800000000000125, "deviation-heading": 3.106263172875823, "agent_compute-ego0": 0.012461359920419848, "complete-iteration": 0.20081728159613876, "set_robot_commands": 0.002147388048949671, "deviation-center-line": 0.945049091552686, "driven_lanedir_consec": 2.0543451687527208, "sim_compute_sim_state": 0.011226774796907485, "sim_compute_performance-ego0": 0.001959418022581436}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.433607832744055, "get_ui_image": 0.03433321386375683, "step_physics": 0.13825242338031196, "survival_time": 44.6499999999996, "driven_lanedir": 3.8009144435530553, "get_state_dump": 0.004988819160717446, "get_robot_state": 0.004119381808594569, "sim_render-ego0": 0.00433425401947909, "get_duckie_state": 1.6627962423917698e-06, "in-drivable-lane": 23.800000000000047, "deviation-heading": 3.702251168951684, "agent_compute-ego0": 0.013722250125552183, "complete-iteration": 0.2169258861200388, "set_robot_commands": 0.0025475483879413645, "deviation-center-line": 0.817971375623865, "driven_lanedir_consec": 3.8009144435530553, "sim_compute_sim_state": 0.012162029343163409, "sim_compute_performance-ego0": 0.002357525313460587}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.754776638266869, "get_ui_image": 0.027022329256481344, "step_physics": 0.1037486215876076, "survival_time": 42.49999999999972, "driven_lanedir": 1.611693845483379, "get_state_dump": 0.005001268991992561, "get_robot_state": 0.004001787210323276, "sim_render-ego0": 0.0041697812556660135, "get_duckie_state": 1.7218808309732115e-06, "in-drivable-lane": 31.849999999999707, "deviation-heading": 2.3599502456519357, "agent_compute-ego0": 0.013469843970902798, "complete-iteration": 0.16863799207218946, "set_robot_commands": 0.002329699441212745, "deviation-center-line": 0.510040741813421, "driven_lanedir_consec": 1.611693845483379, "sim_compute_sim_state": 0.006605401022313765, "sim_compute_performance-ego0": 0.0021825839713933747}}
set_robot_commands_max0.0025475483879413645
set_robot_commands_mean0.0022798278002035596
set_robot_commands_median0.002238543745081208
set_robot_commands_min0.0020946753227104576
sim_compute_performance-ego0_max0.002357525313460587
sim_compute_performance-ego0_mean0.0021042730946030106
sim_compute_performance-ego0_median0.0020710009969874053
sim_compute_performance-ego0_min0.0019175650709766451
sim_compute_sim_state_max0.012162029343163409
sim_compute_sim_state_mean0.00978250085971641
sim_compute_sim_state_median0.010181286536694232
sim_compute_sim_state_min0.006605401022313765
sim_render-ego0_max0.00433425401947909
sim_render-ego0_mean0.004007037245826496
sim_render-ego0_median0.0040044293058508155
sim_render-ego0_min0.0036850363521252648
simulation-passed1
step_physics_max0.13825242338031196
step_physics_mean0.1180893248802322
step_physics_median0.11517812727650462
step_physics_min0.1037486215876076
survival_time_max44.6499999999996
survival_time_mean31.2749999999999
survival_time_min14.700000000000074
No reset possible
5775410845Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:36:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.957905529106691
survival_time_median59.99999999999873
deviation-center-line_median3.541731415589765
in-drivable-lane_median16.82499999999958


other stats
agent_compute-ego0_max0.013177824258605805
agent_compute-ego0_mean0.012961054622481804
agent_compute-ego0_median0.0129396861836277
agent_compute-ego0_min0.012787021864066016
complete-iteration_max0.20428778071089848
complete-iteration_mean0.18616216441773056
complete-iteration_median0.18570176389791088
complete-iteration_min0.16895734916420205
deviation-center-line_max4.195055050569046
deviation-center-line_mean3.6457271588912543
deviation-center-line_min3.3043907538164445
deviation-heading_max25.768163009174614
deviation-heading_mean17.85269689662501
deviation-heading_median17.059305083034364
deviation-heading_min11.524014411256692
driven_any_max11.112970252263892
driven_any_mean10.219728801171094
driven_any_median10.386172566677182
driven_any_min8.99359981906612
driven_lanedir_consec_max7.183334930501863
driven_lanedir_consec_mean5.288936281781211
driven_lanedir_consec_min2.0565991384095996
driven_lanedir_max9.351941140227911
driven_lanedir_mean7.350731457237741
driven_lanedir_median7.674543613947376
driven_lanedir_min4.701897460828299
get_duckie_state_max1.6020299195250703e-06
get_duckie_state_mean1.4527949762781098e-06
get_duckie_state_median1.43090850804668e-06
get_duckie_state_min1.347332969494009e-06
get_robot_state_max0.004137992858886719
get_robot_state_mean0.003982304037858009
get_robot_state_median0.003950635162023184
get_robot_state_min0.003889952968498947
get_state_dump_max0.005110549490021031
get_state_dump_mean0.004934702636201018
get_state_dump_median0.004904389778442129
get_state_dump_min0.004819481497898784
get_ui_image_max0.03672138102147899
get_ui_image_mean0.03207607853918846
get_ui_image_median0.031984856285520835
get_ui_image_min0.027613220564233175
in-drivable-lane_max20.849999999999653
in-drivable-lane_mean16.399999999999668
in-drivable-lane_min11.09999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.16451353832223, "get_ui_image": 0.02959883500892455, "step_physics": 0.103857793577704, "survival_time": 59.99999999999873, "driven_lanedir": 6.482855991730905, "get_state_dump": 0.004843277101413495, "get_robot_state": 0.003908748531420959, "sim_render-ego0": 0.004062687129799671, "get_duckie_state": 1.5049552441040343e-06, "in-drivable-lane": 20.849999999999653, "deviation-heading": 18.333286494369403, "agent_compute-ego0": 0.012787021864066016, "complete-iteration": 0.17386452998845006, "set_robot_commands": 0.002348909568627808, "deviation-center-line": 3.3085140096202044, "driven_lanedir_consec": 5.125431804606962, "sim_compute_sim_state": 0.010231159211793212, "sim_compute_performance-ego0": 0.00213634977729791}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.99359981906612, "get_ui_image": 0.03672138102147899, "step_physics": 0.12430275548606191, "survival_time": 59.99999999999873, "driven_lanedir": 4.701897460828299, "get_state_dump": 0.004819481497898784, "get_robot_state": 0.003889952968498947, "sim_render-ego0": 0.004063632466413894, "get_duckie_state": 1.347332969494009e-06, "in-drivable-lane": 18.349999999999472, "deviation-heading": 25.768163009174614, "agent_compute-ego0": 0.013177824258605805, "complete-iteration": 0.20428778071089848, "set_robot_commands": 0.002287962950834327, "deviation-center-line": 4.195055050569046, "driven_lanedir_consec": 2.0565991384095996, "sim_compute_sim_state": 0.012802720963210487, "sim_compute_performance-ego0": 0.0021325993994491285}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.607831595032131, "get_ui_image": 0.03437087756211712, "step_physics": 0.11940562814399662, "survival_time": 59.99999999999873, "driven_lanedir": 8.866231236163848, "get_state_dump": 0.004965502455470763, "get_robot_state": 0.003992521792625408, "sim_render-ego0": 0.004124640227356719, "get_duckie_state": 1.3568617719893254e-06, "in-drivable-lane": 11.09999999999986, "deviation-heading": 15.785323671699322, "agent_compute-ego0": 0.01288961391464856, "complete-iteration": 0.19753899780737172, "set_robot_commands": 0.002376813872668467, "deviation-center-line": 3.3043907538164445, "driven_lanedir_consec": 6.790379253606421, "sim_compute_sim_state": 0.013168896564734568, "sim_compute_performance-ego0": 0.0021525846730660243}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.112970252263892, "get_ui_image": 0.027613220564233175, "step_physics": 0.10340580535272476, "survival_time": 59.99999999999873, "driven_lanedir": 9.351941140227911, "get_state_dump": 0.005110549490021031, "get_robot_state": 0.004137992858886719, "sim_render-ego0": 0.004175378519926937, "get_duckie_state": 1.6020299195250703e-06, "in-drivable-lane": 15.299999999999688, "deviation-heading": 11.524014411256692, "agent_compute-ego0": 0.012989758452606836, "complete-iteration": 0.16895734916420205, "set_robot_commands": 0.002404137118273631, "deviation-center-line": 3.7749488215593248, "driven_lanedir_consec": 7.183334930501863, "sim_compute_sim_state": 0.006831738871400502, "sim_compute_performance-ego0": 0.002188354010982974}}
set_robot_commands_max0.002404137118273631
set_robot_commands_mean0.0023544558776010583
set_robot_commands_median0.0023628617206481375
set_robot_commands_min0.002287962950834327
sim_compute_performance-ego0_max0.002188354010982974
sim_compute_performance-ego0_mean0.0021524719651990097
sim_compute_performance-ego0_median0.002144467225181967
sim_compute_performance-ego0_min0.0021325993994491285
sim_compute_sim_state_max0.013168896564734568
sim_compute_sim_state_mean0.010758628902784692
sim_compute_sim_state_median0.01151694008750185
sim_compute_sim_state_min0.006831738871400502
sim_render-ego0_max0.004175378519926937
sim_render-ego0_mean0.004106584585874306
sim_render-ego0_median0.004094136346885307
sim_render-ego0_min0.004062687129799671
simulation-passed1
step_physics_max0.12430275548606191
step_physics_mean0.11274299564012182
step_physics_median0.1116317108608503
step_physics_min0.10340580535272476
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5774510849Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:09:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9395434791777556
survival_time_median15.450000000000085
deviation-center-line_median0.5144377252488446
in-drivable-lane_median7.625000000000059


other stats
agent_compute-ego0_max0.01389558009199194
agent_compute-ego0_mean0.013464304872591345
agent_compute-ego0_median0.0137625353306717
agent_compute-ego0_min0.01243656873703003
complete-iteration_max0.19922329770757796
complete-iteration_mean0.1872287167923161
complete-iteration_median0.19205393200055132
complete-iteration_min0.16558370546058374
deviation-center-line_max0.8563342090484201
deviation-center-line_mean0.5906322201983633
deviation-center-line_min0.47731922124734383
deviation-heading_max3.120032860843155
deviation-heading_mean2.4892669181540055
deviation-heading_median2.7111702177637884
deviation-heading_min1.4146943762452904
driven_any_max3.702280494877784
driven_any_mean2.800813881113471
driven_any_median3.020930104020206
driven_any_min1.4591148215356884
driven_lanedir_consec_max1.8415547517903332
driven_lanedir_consec_mean1.1546655135587318
driven_lanedir_consec_min0.8980203440890828
driven_lanedir_max1.8415547517903332
driven_lanedir_mean1.1546655135587318
driven_lanedir_median0.9395434791777556
driven_lanedir_min0.8980203440890828
get_duckie_state_max1.787398912891838e-06
get_duckie_state_mean1.6675120424123945e-06
get_duckie_state_median1.6738228444192106e-06
get_duckie_state_min1.535003567919319e-06
get_robot_state_max0.004136885734314614
get_robot_state_mean0.003929131040147938
get_robot_state_median0.003926306485189214
get_robot_state_min0.0037270254558987087
get_state_dump_max0.005029131757452133
get_state_dump_mean0.004838711443100813
get_state_dump_median0.004785141999717125
get_state_dump_min0.00475543001551687
get_ui_image_max0.03569052026078508
get_ui_image_mean0.03143450561331644
get_ui_image_median0.031769514436354424
get_ui_image_min0.02650847331977185
in-drivable-lane_max13.150000000000125
in-drivable-lane_mean7.887500000000057
in-drivable-lane_min3.149999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.4591148215356884, "get_ui_image": 0.0294423902997319, "step_physics": 0.11471954043607534, "survival_time": 7.99999999999998, "driven_lanedir": 0.8980203440890828, "get_state_dump": 0.0048139332244114845, "get_robot_state": 0.004042333697680361, "sim_render-ego0": 0.004132176037900936, "get_duckie_state": 1.787398912891838e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 1.4146943762452904, "agent_compute-ego0": 0.013700667375363178, "complete-iteration": 0.1852566781251327, "set_robot_commands": 0.0024746382458609825, "deviation-center-line": 0.5236619232568703, "driven_lanedir_consec": 0.8980203440890828, "sim_compute_sim_state": 0.009546205864189574, "sim_compute_performance-ego0": 0.0022775712220565133}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.874199553282147, "get_ui_image": 0.03569052026078508, "step_physics": 0.11970328479199796, "survival_time": 14.750000000000076, "driven_lanedir": 0.9800109488763524, "get_state_dump": 0.004756350775022764, "get_robot_state": 0.003810279272698067, "sim_render-ego0": 0.004129554774310137, "get_duckie_state": 1.646376944877006e-06, "in-drivable-lane": 8.800000000000061, "deviation-heading": 3.120032860843155, "agent_compute-ego0": 0.01389558009199194, "complete-iteration": 0.19885118587597, "set_robot_commands": 0.002353578805923462, "deviation-center-line": 0.5052135272408187, "driven_lanedir_consec": 0.9800109488763524, "sim_compute_sim_state": 0.01222258322947734, "sim_compute_performance-ego0": 0.002184440155287047}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.702280494877784, "get_ui_image": 0.03409663857297694, "step_physics": 0.1207165927328962, "survival_time": 18.75000000000013, "driven_lanedir": 0.8990760094791588, "get_state_dump": 0.005029131757452133, "get_robot_state": 0.004136885734314614, "sim_render-ego0": 0.004276087943543779, "get_duckie_state": 1.7012687439614154e-06, "in-drivable-lane": 13.150000000000125, "deviation-heading": 2.5944163968933895, "agent_compute-ego0": 0.013824403285980225, "complete-iteration": 0.19922329770757796, "set_robot_commands": 0.0025569251243104324, "deviation-center-line": 0.47731922124734383, "driven_lanedir_consec": 0.8990760094791588, "sim_compute_sim_state": 0.012213783695342694, "sim_compute_performance-ego0": 0.0022637412903156687}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.167660654758265, "get_ui_image": 0.02650847331977185, "step_physics": 0.10368384108131316, "survival_time": 16.150000000000095, "driven_lanedir": 1.8415547517903332, "get_state_dump": 0.00475543001551687, "get_robot_state": 0.0037270254558987087, "sim_render-ego0": 0.003915964085378765, "get_duckie_state": 1.535003567919319e-06, "in-drivable-lane": 6.450000000000056, "deviation-heading": 2.827924038634187, "agent_compute-ego0": 0.01243656873703003, "complete-iteration": 0.16558370546058374, "set_robot_commands": 0.00224735928170475, "deviation-center-line": 0.8563342090484201, "driven_lanedir_consec": 1.8415547517903332, "sim_compute_sim_state": 0.006247004609049102, "sim_compute_performance-ego0": 0.0019685434706417132}}
set_robot_commands_max0.0025569251243104324
set_robot_commands_mean0.0024081253644499066
set_robot_commands_median0.002414108525892222
set_robot_commands_min0.00224735928170475
sim_compute_performance-ego0_max0.0022775712220565133
sim_compute_performance-ego0_mean0.002173574034575235
sim_compute_performance-ego0_median0.0022240907228013576
sim_compute_performance-ego0_min0.0019685434706417132
sim_compute_sim_state_max0.01222258322947734
sim_compute_sim_state_mean0.010057394349514678
sim_compute_sim_state_median0.010879994779766134
sim_compute_sim_state_min0.006247004609049102
sim_render-ego0_max0.004276087943543779
sim_render-ego0_mean0.0041134457102834044
sim_render-ego0_median0.004130865406105537
sim_render-ego0_min0.003915964085378765
simulation-passed1
step_physics_max0.1207165927328962
step_physics_mean0.11470581476057064
step_physics_median0.11721141261403664
step_physics_min0.10368384108131316
survival_time_max18.75000000000013
survival_time_mean14.412500000000067
survival_time_min7.99999999999998
No reset possible
5772310864Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:20:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6386448570537965
survival_time_median23.6500000000002
deviation-center-line_median0.3894062114475262
in-drivable-lane_median15.975000000000152


other stats
agent_compute-ego0_max0.04480476712071618
agent_compute-ego0_mean0.04083807552560374
agent_compute-ego0_median0.044012252432845456
agent_compute-ego0_min0.030523030116007877
complete-iteration_max0.34857005851213324
complete-iteration_mean0.30228826973381157
complete-iteration_median0.29546196203408354
complete-iteration_min0.2696590963549459
deviation-center-line_max1.1147137607157982
deviation-center-line_mean0.4903577820504426
deviation-center-line_min0.06790494459092014
deviation-heading_max8.175311645907101
deviation-heading_mean3.6882305433753544
deviation-heading_median2.860924590022772
deviation-heading_min0.8557613475487736
driven_any_max14.584496014910458
driven_any_mean6.602835250609043
driven_any_median5.521085266694229
driven_any_min0.7846744541372541
driven_lanedir_consec_max1.5351088143503842
driven_lanedir_consec_mean0.7376579488186679
driven_lanedir_consec_min0.13823326681669412
driven_lanedir_max1.909077005613174
driven_lanedir_mean0.9233940473086224
driven_lanedir_median0.8231329584023104
driven_lanedir_min0.13823326681669412
get_duckie_state_max2.421109900684976e-06
get_duckie_state_mean2.224925998415674e-06
get_duckie_state_median2.1941365311250334e-06
get_duckie_state_min2.0903210307276525e-06
get_robot_state_max0.004166679318798869
get_robot_state_mean0.003941144052155336
get_robot_state_median0.003937361417388234
get_robot_state_min0.0037231740550460104
get_state_dump_max0.005152008166679969
get_state_dump_mean0.004916504948497395
get_state_dump_median0.004907965037999219
get_state_dump_min0.004698081551311172
get_ui_image_max0.037760795548904776
get_ui_image_mean0.03221184330497791
get_ui_image_median0.03170299135807347
get_ui_image_min0.027680594954859902
in-drivable-lane_max53.89999999999874
in-drivable-lane_mean22.21249999999976
in-drivable-lane_min2.999999999999994
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.965168740915566, "get_ui_image": 0.028892889758136784, "step_physics": 0.18003658769286682, "survival_time": 21.35000000000017, "driven_lanedir": 0.6263098225639667, "get_state_dump": 0.004698081551311172, "get_robot_state": 0.0037231740550460104, "sim_render-ego0": 0.0038466821207064337, "get_duckie_state": 2.1379684733453197e-06, "in-drivable-lane": 17.800000000000157, "deviation-heading": 1.9251763096163443, "agent_compute-ego0": 0.04436145931760842, "complete-iteration": 0.27746509670097136, "set_robot_commands": 0.002277442785066979, "deviation-center-line": 0.3186928850265521, "driven_lanedir_consec": 0.6263098225639667, "sim_compute_sim_state": 0.007596765723183891, "sim_compute_performance-ego0": 0.001943169353164245}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7846744541372541, "get_ui_image": 0.037760795548904776, "step_physics": 0.23826857777528984, "survival_time": 4.249999999999993, "driven_lanedir": 0.13823326681669412, "get_state_dump": 0.0047327889952548715, "get_robot_state": 0.003787182098211244, "sim_render-ego0": 0.004187331643215445, "get_duckie_state": 2.0903210307276525e-06, "in-drivable-lane": 2.999999999999994, "deviation-heading": 0.8557613475487736, "agent_compute-ego0": 0.04480476712071618, "complete-iteration": 0.34857005851213324, "set_robot_commands": 0.0023592072863911472, "deviation-center-line": 0.06790494459092014, "driven_lanedir_consec": 0.13823326681669412, "sim_compute_sim_state": 0.01044904631237651, "sim_compute_performance-ego0": 0.002122859622156897}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.077001792472892, "get_ui_image": 0.03451309295801016, "step_physics": 0.2207044917803544, "survival_time": 25.950000000000234, "driven_lanedir": 1.909077005613174, "get_state_dump": 0.005152008166679969, "get_robot_state": 0.0040875407365652235, "sim_render-ego0": 0.0042125504750471846, "get_duckie_state": 2.2503045889047476e-06, "in-drivable-lane": 14.150000000000148, "deviation-heading": 8.175311645907101, "agent_compute-ego0": 0.030523030116007877, "complete-iteration": 0.3134588273671957, "set_robot_commands": 0.0025425906364734355, "deviation-center-line": 1.1147137607157982, "driven_lanedir_consec": 1.5351088143503842, "sim_compute_sim_state": 0.009338388993189886, "sim_compute_performance-ego0": 0.002279974864079402}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.584496014910458, "get_ui_image": 0.027680594954859902, "step_physics": 0.17305703345782353, "survival_time": 59.99999999999873, "driven_lanedir": 1.019956094240654, "get_state_dump": 0.005083141080743566, "get_robot_state": 0.004166679318798869, "sim_render-ego0": 0.004232588457525223, "get_duckie_state": 2.421109900684976e-06, "in-drivable-lane": 53.89999999999874, "deviation-heading": 3.796672870429199, "agent_compute-ego0": 0.04366304554808249, "complete-iteration": 0.2696590963549459, "set_robot_commands": 0.002520732339673197, "deviation-center-line": 0.46011953786850024, "driven_lanedir_consec": 0.6509798915436262, "sim_compute_sim_state": 0.006853642015036298, "sim_compute_performance-ego0": 0.0022974641595057506}}
set_robot_commands_max0.0025425906364734355
set_robot_commands_mean0.00242499326190119
set_robot_commands_median0.002439969813032172
set_robot_commands_min0.002277442785066979
sim_compute_performance-ego0_max0.0022974641595057506
sim_compute_performance-ego0_mean0.0021608669997265732
sim_compute_performance-ego0_median0.0022014172431181495
sim_compute_performance-ego0_min0.001943169353164245
sim_compute_sim_state_max0.01044904631237651
sim_compute_sim_state_mean0.008559460760946646
sim_compute_sim_state_median0.008467577358186889
sim_compute_sim_state_min0.006853642015036298
sim_render-ego0_max0.004232588457525223
sim_render-ego0_mean0.0041197881741235716
sim_render-ego0_median0.004199941059131315
sim_render-ego0_min0.0038466821207064337
simulation-passed1
step_physics_max0.23826857777528984
step_physics_mean0.2030166726765837
step_physics_median0.20037053973661065
step_physics_min0.17305703345782353
survival_time_max59.99999999999873
survival_time_mean27.887499999999783
survival_time_min4.249999999999993
No reset possible
5771310865Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:03:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 58 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5770010874Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:03:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 78 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5764010900Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:35:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.042299124459116
survival_time_median59.99999999999873
deviation-center-line_median3.774283338876858
in-drivable-lane_median2.1499999999999875


other stats
agent_compute-ego0_max0.013372167560282
agent_compute-ego0_mean0.012920446340289342
agent_compute-ego0_median0.01289271027916774
agent_compute-ego0_min0.012524197242539888
complete-iteration_max0.2010019240430948
complete-iteration_mean0.17968444413289142
complete-iteration_median0.17698915624102385
complete-iteration_min0.16375754000642315
deviation-center-line_max4.876047014796711
deviation-center-line_mean3.931224587828551
deviation-center-line_min3.300284658763776
deviation-heading_max22.219786433382108
deviation-heading_mean16.697542567075736
deviation-heading_median16.945264957592094
deviation-heading_min10.679853919736637
driven_any_max8.9944938596916
driven_any_mean8.306275016449813
driven_any_median8.352344692917075
driven_any_min7.525916820273502
driven_lanedir_consec_max7.580032520995932
driven_lanedir_consec_mean5.213004549868601
driven_lanedir_consec_min3.18738742956024
driven_lanedir_max8.64735002262188
driven_lanedir_mean7.565449580137676
driven_lanedir_median7.609417007666022
driven_lanedir_min6.395614282596782
get_duckie_state_max2.328998143230251e-06
get_duckie_state_mean2.0910262267456563e-06
get_duckie_state_median2.025366822051367e-06
get_duckie_state_min1.984373119649641e-06
get_robot_state_max0.003989198622755166
get_robot_state_mean0.0038646958849015184
get_robot_state_median0.0038473859218435425
get_robot_state_min0.003774813073163823
get_state_dump_max0.004918883980362739
get_state_dump_mean0.004739173544535132
get_state_dump_median0.004706845593194382
get_state_dump_min0.004624119011389028
get_ui_image_max0.036173080028244896
get_ui_image_mean0.03128162296884364
get_ui_image_median0.03072314317974818
get_ui_image_min0.02750712548763329
in-drivable-lane_max4.699999999999843
in-drivable-lane_mean2.462499999999954
in-drivable-lane_min0.8499999999999979
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.597401694509813, "get_ui_image": 0.02820841974263187, "step_physics": 0.0970079871041888, "survival_time": 59.99999999999873, "driven_lanedir": 7.717084267525241, "get_state_dump": 0.004624119011389028, "get_robot_state": 0.003774813073163823, "sim_render-ego0": 0.003937683534264862, "get_duckie_state": 1.9986663233926154e-06, "in-drivable-lane": 2.7499999999999636, "deviation-heading": 16.6979875893542, "agent_compute-ego0": 0.012524197242539888, "complete-iteration": 0.16421673180757215, "set_robot_commands": 0.002307022540992146, "deviation-center-line": 3.300284658763776, "driven_lanedir_consec": 5.054034291143655, "sim_compute_sim_state": 0.009695685177818127, "sim_compute_performance-ego0": 0.002055069687563017}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.525916820273502, "get_ui_image": 0.036173080028244896, "step_physics": 0.12285726374134633, "survival_time": 59.99999999999873, "driven_lanedir": 6.395614282596782, "get_state_dump": 0.004705418555762349, "get_robot_state": 0.0038468595547640353, "sim_render-ego0": 0.004042655006237173, "get_duckie_state": 2.052067320710118e-06, "in-drivable-lane": 4.699999999999843, "deviation-heading": 22.219786433382108, "agent_compute-ego0": 0.01271524715185364, "complete-iteration": 0.2010019240430948, "set_robot_commands": 0.002309486331987341, "deviation-center-line": 3.8925444082854774, "driven_lanedir_consec": 3.18738742956024, "sim_compute_sim_state": 0.012147739666089924, "sim_compute_performance-ego0": 0.002119954480021125}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.107287691324338, "get_ui_image": 0.03323786661686449, "step_physics": 0.11385240384085192, "survival_time": 59.99999999999873, "driven_lanedir": 7.501749747806803, "get_state_dump": 0.004708272630626415, "get_robot_state": 0.0038479122889230498, "sim_render-ego0": 0.004106858886350303, "get_duckie_state": 1.984373119649641e-06, "in-drivable-lane": 0.8499999999999979, "deviation-heading": 17.192542325829987, "agent_compute-ego0": 0.013070173406481842, "complete-iteration": 0.18976158067447557, "set_robot_commands": 0.002354428333406345, "deviation-center-line": 4.876047014796711, "driven_lanedir_consec": 5.030563957774577, "sim_compute_sim_state": 0.012393920645924232, "sim_compute_performance-ego0": 0.0021064110739245005}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.9944938596916, "get_ui_image": 0.02750712548763329, "step_physics": 0.09808510070438686, "survival_time": 59.99999999999873, "driven_lanedir": 8.64735002262188, "get_state_dump": 0.004918883980362739, "get_robot_state": 0.003989198622755166, "sim_render-ego0": 0.0042182295447483744, "get_duckie_state": 2.328998143230251e-06, "in-drivable-lane": 1.5500000000000114, "deviation-heading": 10.679853919736637, "agent_compute-ego0": 0.013372167560282, "complete-iteration": 0.16375754000642315, "set_robot_commands": 0.0024111112091166095, "deviation-center-line": 3.65602226946824, "driven_lanedir_consec": 7.580032520995932, "sim_compute_sim_state": 0.006967653739859321, "sim_compute_performance-ego0": 0.002193745129511418}}
set_robot_commands_max0.0024111112091166095
set_robot_commands_mean0.0023455121038756105
set_robot_commands_median0.002331957332696843
set_robot_commands_min0.002307022540992146
sim_compute_performance-ego0_max0.002193745129511418
sim_compute_performance-ego0_mean0.002118795092755015
sim_compute_performance-ego0_median0.002113182776972813
sim_compute_performance-ego0_min0.002055069687563017
sim_compute_sim_state_max0.012393920645924232
sim_compute_sim_state_mean0.010301249807422905
sim_compute_sim_state_median0.010921712421954026
sim_compute_sim_state_min0.006967653739859321
sim_render-ego0_max0.0042182295447483744
sim_render-ego0_mean0.004076356742900179
sim_render-ego0_median0.004074756946293738
sim_render-ego0_min0.003937683534264862
simulation-passed1
step_physics_max0.12285726374134633
step_physics_mean0.10795068884769347
step_physics_median0.1059687522726194
step_physics_min0.0970079871041888
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5758410887Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:35:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.328716513866171
survival_time_median59.99999999999873
deviation-center-line_median1.1717064001850073
in-drivable-lane_median38.699999999998965


other stats
agent_compute-ego0_max0.04983746102211577
agent_compute-ego0_mean0.04133749532828731
agent_compute-ego0_median0.04188925539027841
agent_compute-ego0_min0.03173400951047665
complete-iteration_max0.21628717538419115
complete-iteration_mean0.20165128514973824
complete-iteration_median0.2029083109943531
complete-iteration_min0.18450134322605563
deviation-center-line_max3.143508068022714
deviation-center-line_mean1.487018099924234
deviation-center-line_min0.4611515313042074
deviation-heading_max9.843052407154005
deviation-heading_mean5.611478465338063
deviation-heading_median5.477763004504613
deviation-heading_min1.6473354451890254
driven_any_max8.520601806886972
driven_any_mean7.6984142494182946
driven_any_median7.720429630108896
driven_any_min6.832195930568412
driven_lanedir_consec_max7.7245408103438
driven_lanedir_consec_mean3.52636658939557
driven_lanedir_consec_min1.723492519506138
driven_lanedir_max7.7245408103438
driven_lanedir_mean3.529273426743651
driven_lanedir_median2.328716513866171
driven_lanedir_min1.7351198688984628
get_duckie_state_max1.418401954771577e-06
get_duckie_state_mean1.4036187773378696e-06
get_duckie_state_median1.4049154541150085e-06
get_duckie_state_min1.3862422463498842e-06
get_robot_state_max0.003932089163368478
get_robot_state_mean0.003778936322227403
get_robot_state_median0.003773264146466537
get_robot_state_min0.00363712783260806
get_state_dump_max0.0048152481288735215
get_state_dump_mean0.004737911445973257
get_state_dump_median0.0047626487842782105
get_state_dump_min0.004611100086463083
get_ui_image_max0.035925880856160615
get_ui_image_mean0.031621535145593
get_ui_image_median0.03158115177254151
get_ui_image_min0.027397956181128356
in-drivable-lane_max47.34999999999869
in-drivable-lane_mean31.18749999999915
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.520601806886972, "get_ui_image": 0.029085760013348456, "step_physics": 0.09427877488878744, "survival_time": 59.99999999999873, "driven_lanedir": 1.9939103648324168, "get_state_dump": 0.004755486457373677, "get_robot_state": 0.003743446637549865, "sim_render-ego0": 0.003996675556446491, "get_duckie_state": 1.418401954771577e-06, "in-drivable-lane": 47.34999999999869, "deviation-heading": 1.6473354451890254, "agent_compute-ego0": 0.04983746102211577, "complete-iteration": 0.1994633726235929, "set_robot_commands": 0.002298550641506935, "deviation-center-line": 0.4611515313042074, "driven_lanedir_consec": 1.9939103648324168, "sim_compute_sim_state": 0.009351144523842943, "sim_compute_performance-ego0": 0.002024647000429533}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.575887655258232, "get_ui_image": 0.035925880856160615, "step_physics": 0.10699715523001158, "survival_time": 59.99999999999873, "driven_lanedir": 2.663522662899925, "get_state_dump": 0.004611100086463083, "get_robot_state": 0.00363712783260806, "sim_render-ego0": 0.0039296108519008615, "get_duckie_state": 1.4035132008726451e-06, "in-drivable-lane": 37.19999999999882, "deviation-heading": 6.638238996666683, "agent_compute-ego0": 0.04459535648781096, "complete-iteration": 0.21628717538419115, "set_robot_commands": 0.0022565135352319724, "deviation-center-line": 1.6864388844731837, "driven_lanedir_consec": 2.663522662899925, "sim_compute_sim_state": 0.012276094223835583, "sim_compute_performance-ego0": 0.001964804929658634}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.832195930568412, "get_ui_image": 0.03407654353173457, "step_physics": 0.11259212507093085, "survival_time": 54.14999999999906, "driven_lanedir": 1.7351198688984628, "get_state_dump": 0.004769811111182744, "get_robot_state": 0.003932089163368478, "sim_render-ego0": 0.0041600272224398115, "get_duckie_state": 1.4063177073573714e-06, "in-drivable-lane": 40.1999999999991, "deviation-heading": 4.317287012342544, "agent_compute-ego0": 0.03173400951047665, "complete-iteration": 0.20635324936511332, "set_robot_commands": 0.0024225623845174305, "deviation-center-line": 0.656973915896831, "driven_lanedir_consec": 1.723492519506138, "sim_compute_sim_state": 0.010446225585092917, "sim_compute_performance-ego0": 0.00212803054119828}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.864971604959561, "get_ui_image": 0.027397956181128356, "step_physics": 0.09453901085230236, "survival_time": 59.99999999999873, "driven_lanedir": 7.7245408103438, "get_state_dump": 0.0048152481288735215, "get_robot_state": 0.0038030816553832098, "sim_render-ego0": 0.0038953544098967617, "get_duckie_state": 1.3862422463498842e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.843052407154005, "agent_compute-ego0": 0.03918315429274585, "complete-iteration": 0.18450134322605563, "set_robot_commands": 0.002334992752583398, "deviation-center-line": 3.143508068022714, "driven_lanedir_consec": 7.7245408103438, "sim_compute_sim_state": 0.006385312886361179, "sim_compute_performance-ego0": 0.0020566699308320743}}
set_robot_commands_max0.0024225623845174305
set_robot_commands_mean0.002328154828459934
set_robot_commands_median0.002316771697045167
set_robot_commands_min0.0022565135352319724
sim_compute_performance-ego0_max0.00212803054119828
sim_compute_performance-ego0_mean0.00204353810052963
sim_compute_performance-ego0_median0.002040658465630804
sim_compute_performance-ego0_min0.001964804929658634
sim_compute_sim_state_max0.012276094223835583
sim_compute_sim_state_mean0.009614694304783155
sim_compute_sim_state_median0.009898685054467933
sim_compute_sim_state_min0.006385312886361179
sim_render-ego0_max0.0041600272224398115
sim_render-ego0_mean0.0039954170101709815
sim_render-ego0_median0.003963143204173677
sim_render-ego0_min0.0038953544098967617
simulation-passed1
step_physics_max0.11259212507093085
step_physics_mean0.10210176651050806
step_physics_median0.10076808304115696
step_physics_min0.09427877488878744
survival_time_max59.99999999999873
survival_time_mean58.53749999999881
survival_time_min54.14999999999906
No reset possible
5756010933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:06:30
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5754710933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:01:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5747210921Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:26:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2703904430497657
survival_time_median59.99999999999873
deviation-center-line_median0.9634744751456796
in-drivable-lane_median21.12499999999946


other stats
agent_compute-ego0_max0.05176362839150936
agent_compute-ego0_mean0.03952990616162168
agent_compute-ego0_median0.04147702003895095
agent_compute-ego0_min0.02340195617707544
complete-iteration_max0.2616855717719869
complete-iteration_mean0.20390381316514652
complete-iteration_median0.1881827013776463
complete-iteration_min0.17756427813330658
deviation-center-line_max2.855336512607543
deviation-center-line_mean1.2456808597174511
deviation-center-line_min0.20043797597090296
deviation-heading_max9.248556812793645
deviation-heading_mean4.619545876821739
deviation-heading_median3.672905993437036
deviation-heading_min1.8838147076192395
driven_any_max8.836475559737076
driven_any_mean6.03980681048856
driven_any_median7.504857447378625
driven_any_min0.31303678745991587
driven_lanedir_consec_max7.849637169288016
driven_lanedir_consec_mean3.135957936582025
driven_lanedir_consec_min0.15341369094055368
driven_lanedir_max7.849637169288016
driven_lanedir_mean3.135957936582025
driven_lanedir_median2.2703904430497657
driven_lanedir_min0.15341369094055368
get_duckie_state_max2.1280126368745843e-06
get_duckie_state_mean1.9871307069409217e-06
get_duckie_state_median1.950029727322771e-06
get_duckie_state_min1.92045073624356e-06
get_robot_state_max0.003763462634796792
get_robot_state_mean0.003638612477902342
get_robot_state_median0.0036333015221143936
get_robot_state_min0.0035243842325837884
get_state_dump_max0.0047782431257532
get_state_dump_mean0.004593167848463871
get_state_dump_median0.00456686798082998
get_state_dump_min0.004460692306442324
get_ui_image_max0.03597269920592613
get_ui_image_mean0.03035867942959867
get_ui_image_median0.02963259039473077
get_ui_image_min0.026196837723007012
in-drivable-lane_max46.89999999999871
in-drivable-lane_mean22.287499999999408
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.836475559737076, "get_ui_image": 0.02737220955530273, "step_physics": 0.09157253840285276, "survival_time": 59.99999999999873, "driven_lanedir": 2.044434760707942, "get_state_dump": 0.004460692306442324, "get_robot_state": 0.0035243842325837884, "sim_render-ego0": 0.003776401405429761, "get_duckie_state": 1.94744900998029e-06, "in-drivable-lane": 46.89999999999871, "deviation-heading": 2.0729774591835057, "agent_compute-ego0": 0.04549060554726733, "complete-iteration": 0.18877145432115697, "set_robot_commands": 0.0021646179624838593, "deviation-center-line": 0.5900291681480319, "driven_lanedir_consec": 2.044434760707942, "sim_compute_sim_state": 0.008447571261340037, "sim_compute_performance-ego0": 0.0018787389988704688}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.31303678745991587, "get_ui_image": 0.03597269920592613, "step_physics": 0.1465186743026084, "survival_time": 4.6499999999999915, "driven_lanedir": 0.15341369094055368, "get_state_dump": 0.0047782431257532, "get_robot_state": 0.003763462634796792, "sim_render-ego0": 0.003955146099658723, "get_duckie_state": 2.1280126368745843e-06, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 1.8838147076192395, "agent_compute-ego0": 0.05176362839150936, "complete-iteration": 0.2616855717719869, "set_robot_commands": 0.002395792210355718, "deviation-center-line": 0.20043797597090296, "driven_lanedir_consec": 0.15341369094055368, "sim_compute_sim_state": 0.010453723846597877, "sim_compute_performance-ego0": 0.0019946504146494764}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.033991297718201, "get_ui_image": 0.03189297123415881, "step_physics": 0.10668502064370591, "survival_time": 59.99999999999873, "driven_lanedir": 2.496346125391589, "get_state_dump": 0.004479320916803949, "get_robot_state": 0.0036160529007224817, "sim_render-ego0": 0.003828556710337719, "get_duckie_state": 1.92045073624356e-06, "in-drivable-lane": 40.44999999999892, "deviation-heading": 5.2728345276905655, "agent_compute-ego0": 0.02340195617707544, "complete-iteration": 0.1875939484341357, "set_robot_commands": 0.002191647800378855, "deviation-center-line": 1.3369197821433272, "driven_lanedir_consec": 2.496346125391589, "sim_compute_sim_state": 0.00946739789945299, "sim_compute_performance-ego0": 0.00194992530752876}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.97572359703905, "get_ui_image": 0.026196837723007012, "step_physics": 0.0913302116251111, "survival_time": 59.99999999999873, "driven_lanedir": 7.849637169288016, "get_state_dump": 0.0046544150448560116, "get_robot_state": 0.0036505501435063065, "sim_render-ego0": 0.003827262579848824, "get_duckie_state": 1.952610444665253e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.248556812793645, "agent_compute-ego0": 0.03746343453063457, "complete-iteration": 0.17756427813330658, "set_robot_commands": 0.002286156647211308, "deviation-center-line": 2.855336512607543, "driven_lanedir_consec": 7.849637169288016, "sim_compute_sim_state": 0.00612975814558882, "sim_compute_performance-ego0": 0.001938877852135753}}
set_robot_commands_max0.002395792210355718
set_robot_commands_mean0.002259553655107435
set_robot_commands_median0.0022389022237950815
set_robot_commands_min0.0021646179624838593
sim_compute_performance-ego0_max0.0019946504146494764
sim_compute_performance-ego0_mean0.0019405481432961144
sim_compute_performance-ego0_median0.0019444015798322563
sim_compute_performance-ego0_min0.0018787389988704688
sim_compute_sim_state_max0.010453723846597877
sim_compute_sim_state_mean0.00862461278824493
sim_compute_sim_state_median0.008957484580396514
sim_compute_sim_state_min0.00612975814558882
sim_render-ego0_max0.003955146099658723
sim_render-ego0_mean0.003846841698818757
sim_render-ego0_median0.0038279096450932713
sim_render-ego0_min0.003776401405429761
simulation-passed1
step_physics_max0.1465186743026084
step_physics_mean0.10902661124356956
step_physics_median0.09912877952327934
step_physics_min0.0913302116251111
survival_time_max59.99999999999873
survival_time_mean46.16249999999904
survival_time_min4.6499999999999915
No reset possible
5744611010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:02:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5742511426Frank (Chude) QianΒ πŸ‡¨πŸ‡¦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-040:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5734410957Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:14:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.390260761421571
survival_time_median23.6250000000002
deviation-center-line_median0.9057031658329058
in-drivable-lane_median6.899999999999864


other stats
agent_compute-ego0_max0.013113485184390988
agent_compute-ego0_mean0.012983424855673976
agent_compute-ego0_median0.013060596571774157
agent_compute-ego0_min0.0126990210947566
complete-iteration_max0.24021348026063707
complete-iteration_mean0.18843330898726943
complete-iteration_median0.1771995730327327
complete-iteration_min0.1591206096229753
deviation-center-line_max2.8743821596419448
deviation-center-line_mean1.2149287006361469
deviation-center-line_min0.17392631123683128
deviation-heading_max5.961959342153701
deviation-heading_mean2.9958989323558507
deviation-heading_median2.590330190965532
deviation-heading_min0.8409760053386381
driven_any_max7.2670478546937085
driven_any_mean4.034523888589018
driven_any_median4.050017872105337
driven_any_min0.7710119554516872
driven_lanedir_consec_max5.841240792328222
driven_lanedir_consec_mean2.7376512586308346
driven_lanedir_consec_min0.32884271935197384
driven_lanedir_max5.841240792328222
driven_lanedir_mean2.7376512586308346
driven_lanedir_median2.390260761421571
driven_lanedir_min0.32884271935197384
get_duckie_state_max1.767270570750431e-06
get_duckie_state_mean1.448473620081066e-06
get_duckie_state_median1.3974324570900483e-06
get_duckie_state_min1.231758995393736e-06
get_robot_state_max0.00404778230104515
get_robot_state_mean0.0038749272539284263
get_robot_state_median0.0038702691707092206
get_robot_state_min0.0037113883732501126
get_state_dump_max0.00538034130025793
get_state_dump_mean0.0051338805080753565
get_state_dump_median0.005087086740301789
get_state_dump_min0.004981007251439918
get_ui_image_max0.036651050602948224
get_ui_image_mean0.030765892879907403
get_ui_image_median0.029851631394562907
get_ui_image_min0.026709258127555573
in-drivable-lane_max12.850000000000168
in-drivable-lane_mean7.424999999999971
in-drivable-lane_min3.049999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.237555361091146, "get_ui_image": 0.02741609006652033, "step_physics": 0.09182909895612308, "survival_time": 19.050000000000136, "driven_lanedir": 2.275445169931071, "get_state_dump": 0.004981007251439918, "get_robot_state": 0.0037113883732501126, "sim_render-ego0": 0.003987710513369575, "get_duckie_state": 1.3643534395707217e-06, "in-drivable-lane": 5.850000000000083, "deviation-heading": 1.3706068380974323, "agent_compute-ego0": 0.0126990210947566, "complete-iteration": 0.1591206096229753, "set_robot_commands": 0.0021777577425172814, "deviation-center-line": 0.5439606858543287, "driven_lanedir_consec": 2.275445169931071, "sim_compute_sim_state": 0.0101838380254376, "sim_compute_performance-ego0": 0.002043805197271377}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7710119554516872, "get_ui_image": 0.036651050602948224, "step_physics": 0.1612477214248092, "survival_time": 5.349999999999989, "driven_lanedir": 0.32884271935197384, "get_state_dump": 0.00538034130025793, "get_robot_state": 0.003955951443424931, "sim_render-ego0": 0.004210136554859302, "get_duckie_state": 1.430511474609375e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.8409760053386381, "agent_compute-ego0": 0.01303267037426984, "complete-iteration": 0.24021348026063707, "set_robot_commands": 0.0024585569346392594, "deviation-center-line": 0.17392631123683128, "driven_lanedir_consec": 0.32884271935197384, "sim_compute_sim_state": 0.010963640831134935, "sim_compute_performance-ego0": 0.002215826952898944}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.862480383119528, "get_ui_image": 0.03228717272260548, "step_physics": 0.11409689768225746, "survival_time": 28.200000000000266, "driven_lanedir": 2.505076352912071, "get_state_dump": 0.004986457065143416, "get_robot_state": 0.00378458689799351, "sim_render-ego0": 0.004089541139855849, "get_duckie_state": 1.231758995393736e-06, "in-drivable-lane": 12.850000000000168, "deviation-heading": 3.8100535438336314, "agent_compute-ego0": 0.013113485184390988, "complete-iteration": 0.18937313197988329, "set_robot_commands": 0.0022827291910627245, "deviation-center-line": 1.267445645811483, "driven_lanedir_consec": 2.505076352912071, "sim_compute_sim_state": 0.012452884690951457, "sim_compute_performance-ego0": 0.0021909658887745006}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.2670478546937085, "get_ui_image": 0.026709258127555573, "step_physics": 0.1002433926081486, "survival_time": 41.64999999999977, "driven_lanedir": 5.841240792328222, "get_state_dump": 0.005187716415460161, "get_robot_state": 0.00404778230104515, "sim_render-ego0": 0.004175964019281401, "get_duckie_state": 1.767270570750431e-06, "in-drivable-lane": 7.949999999999644, "deviation-heading": 5.961959342153701, "agent_compute-ego0": 0.013088522769278474, "complete-iteration": 0.16502601408558212, "set_robot_commands": 0.002392378070657488, "deviation-center-line": 2.8743821596419448, "driven_lanedir_consec": 5.841240792328222, "sim_compute_sim_state": 0.006832972133188225, "sim_compute_performance-ego0": 0.002235050967557253}}
set_robot_commands_max0.0024585569346392594
set_robot_commands_mean0.002327855484719188
set_robot_commands_median0.0023375536308601064
set_robot_commands_min0.0021777577425172814
sim_compute_performance-ego0_max0.002235050967557253
sim_compute_performance-ego0_mean0.0021714122516255188
sim_compute_performance-ego0_median0.002203396420836722
sim_compute_performance-ego0_min0.002043805197271377
sim_compute_sim_state_max0.012452884690951457
sim_compute_sim_state_mean0.010108333920178054
sim_compute_sim_state_median0.01057373942828627
sim_compute_sim_state_min0.006832972133188225
sim_render-ego0_max0.004210136554859302
sim_render-ego0_mean0.004115838056841532
sim_render-ego0_median0.004132752579568625
sim_render-ego0_min0.003987710513369575
simulation-passed1
step_physics_max0.1612477214248092
step_physics_mean0.11685427766783456
step_physics_median0.10717014514520302
step_physics_min0.09182909895612308
survival_time_max41.64999999999977
survival_time_mean23.56250000000004
survival_time_min5.349999999999989
No reset possible
5732511012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:06:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5727110979Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:10:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.35536339143187606
survival_time_median15.500000000000083
deviation-center-line_median0.2289501144317744
in-drivable-lane_median12.77500000000007


other stats
agent_compute-ego0_max0.013020056598591354
agent_compute-ego0_mean0.012763630845239134
agent_compute-ego0_median0.012992951953397112
agent_compute-ego0_min0.012048562875570962
complete-iteration_max0.2245297386961163
complete-iteration_mean0.18135857615905837
complete-iteration_median0.17353828939054755
complete-iteration_min0.15382798715902213
deviation-center-line_max0.3580508243960306
deviation-center-line_mean0.2256664423931649
deviation-center-line_min0.0867147163130803
deviation-heading_max3.0315430265108487
deviation-heading_mean1.651768324502492
deviation-heading_median1.507074155213075
deviation-heading_min0.5613819610729692
driven_any_max4.860795898085535
driven_any_mean2.757491700230839
driven_any_median2.92455569808358
driven_any_min0.32005950667066096
driven_lanedir_consec_max0.453105700988308
driven_lanedir_consec_mean0.3343138104429068
driven_lanedir_consec_min0.17342275791956707
driven_lanedir_max0.453105700988308
driven_lanedir_mean0.3343138104429068
driven_lanedir_median0.35536339143187606
driven_lanedir_min0.17342275791956707
get_duckie_state_max1.905805470488218e-06
get_duckie_state_mean1.4018232970421015e-06
get_duckie_state_median1.2794389617476709e-06
get_duckie_state_min1.1426097941848468e-06
get_robot_state_max0.004037778354385524
get_robot_state_mean0.003667881158344942
get_robot_state_median0.0036238088277318497
get_robot_state_min0.0033861286235305496
get_state_dump_max0.004847605251571507
get_state_dump_mean0.004535152538536908
get_state_dump_median0.004526698122945409
get_state_dump_min0.0042396086566853074
get_ui_image_max0.0344191497226931
get_ui_image_mean0.03011920699333442
get_ui_image_median0.029726969698977698
get_ui_image_min0.02660373885268918
in-drivable-lane_max22.850000000000215
in-drivable-lane_mean12.400000000000087
in-drivable-lane_min1.1999999999999982
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.9155642823916517, "get_ui_image": 0.027291246877310757, "step_physics": 0.08968834374278498, "survival_time": 15.600000000000088, "driven_lanedir": 0.453105700988308, "get_state_dump": 0.004437982845611085, "get_robot_state": 0.0034799438695938063, "sim_render-ego0": 0.003595299614123262, "get_duckie_state": 1.3200619731086511e-06, "in-drivable-lane": 11.950000000000054, "deviation-heading": 2.2024679775331575, "agent_compute-ego0": 0.012048562875570962, "complete-iteration": 0.15382798715902213, "set_robot_commands": 0.0020514837088295448, "deviation-center-line": 0.34712379858716813, "driven_lanedir_consec": 0.453105700988308, "sim_compute_sim_state": 0.00932166903925399, "sim_compute_performance-ego0": 0.0018343331333928216}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.32005950667066096, "get_ui_image": 0.0344191497226931, "step_physics": 0.15329229156925994, "survival_time": 2.5999999999999988, "driven_lanedir": 0.17342275791956707, "get_state_dump": 0.0042396086566853074, "get_robot_state": 0.0033861286235305496, "sim_render-ego0": 0.00375093604033848, "get_duckie_state": 1.1426097941848468e-06, "in-drivable-lane": 1.1999999999999982, "deviation-heading": 0.8116803328929925, "agent_compute-ego0": 0.013020056598591354, "complete-iteration": 0.2245297386961163, "set_robot_commands": 0.0021117903151602114, "deviation-center-line": 0.0867147163130803, "driven_lanedir_consec": 0.17342275791956707, "sim_compute_sim_state": 0.00844294620010088, "sim_compute_performance-ego0": 0.0017876894968860554}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.860795898085535, "get_ui_image": 0.03216269252064464, "step_physics": 0.10806089355832056, "survival_time": 27.250000000000252, "driven_lanedir": 0.4348206868499195, "get_state_dump": 0.0046154134002797335, "get_robot_state": 0.003767673785869892, "sim_render-ego0": 0.004004904202052525, "get_duckie_state": 1.2388159503866902e-06, "in-drivable-lane": 22.850000000000215, "deviation-heading": 3.0315430265108487, "agent_compute-ego0": 0.013003625712551913, "complete-iteration": 0.1813105440838433, "set_robot_commands": 0.002223996015695425, "deviation-center-line": 0.3580508243960306, "driven_lanedir_consec": 0.4348206868499195, "sim_compute_sim_state": 0.011347651044964354, "sim_compute_performance-ego0": 0.002037726042471526}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.933547113775509, "get_ui_image": 0.02660373885268918, "step_physics": 0.10268933333239508, "survival_time": 15.400000000000084, "driven_lanedir": 0.27590609601383265, "get_state_dump": 0.004847605251571507, "get_robot_state": 0.004037778354385524, "sim_render-ego0": 0.004015830728228424, "get_duckie_state": 1.905805470488218e-06, "in-drivable-lane": 13.600000000000083, "deviation-heading": 0.5613819610729692, "agent_compute-ego0": 0.012982278194242311, "complete-iteration": 0.1657660346972518, "set_robot_commands": 0.0023917835507192274, "deviation-center-line": 0.11077643027638064, "driven_lanedir_consec": 0.27590609601383265, "sim_compute_sim_state": 0.005941865513625654, "sim_compute_performance-ego0": 0.0021571480340556418}}
set_robot_commands_max0.0023917835507192274
set_robot_commands_mean0.002194763397601102
set_robot_commands_median0.0021678931654278183
set_robot_commands_min0.0020514837088295448
sim_compute_performance-ego0_max0.0021571480340556418
sim_compute_performance-ego0_mean0.001954224176701511
sim_compute_performance-ego0_median0.0019360295879321736
sim_compute_performance-ego0_min0.0017876894968860554
sim_compute_sim_state_max0.011347651044964354
sim_compute_sim_state_mean0.00876353294948622
sim_compute_sim_state_median0.008882307619677435
sim_compute_sim_state_min0.005941865513625654
sim_render-ego0_max0.004015830728228424
sim_render-ego0_mean0.003841742646185673
sim_render-ego0_median0.0038779201211955024
sim_render-ego0_min0.003595299614123262
simulation-passed1
step_physics_max0.15329229156925994
step_physics_mean0.11343271555069014
step_physics_median0.10537511344535784
step_physics_min0.08968834374278498
survival_time_max27.250000000000252
survival_time_mean15.212500000000103
survival_time_min2.5999999999999988
No reset possible
5724911312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:02:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5723611281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5709711018Olga (Ge Ya) XuΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:36:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.314953680033695
survival_time_median59.99999999999873
deviation-center-line_median4.689052254357567
in-drivable-lane_median4.099999999999838


other stats
agent_compute-ego0_max0.034618191476864776
agent_compute-ego0_mean0.030376817033387675
agent_compute-ego0_median0.03369351433225821
agent_compute-ego0_min0.01950204799216951
complete-iteration_max0.20896406396044775
complete-iteration_mean0.1893812262174532
complete-iteration_median0.18700264117600615
complete-iteration_min0.17455555855735275
deviation-center-line_max5.206606969692567
deviation-center-line_mean4.303189458427388
deviation-center-line_min2.6280463553018514
deviation-heading_max16.91866975941535
deviation-heading_mean13.988281684534126
deviation-heading_median14.898691226202214
deviation-heading_min9.23707452631672
driven_any_max7.802925570560337
driven_any_mean7.194723361908343
driven_any_median7.150761996669589
driven_any_min6.674443883733859
driven_lanedir_consec_max6.890044987079737
driven_lanedir_consec_mean6.4145516384728705
driven_lanedir_consec_min6.138254206744354
driven_lanedir_max6.890044987079737
driven_lanedir_mean6.419427684927813
driven_lanedir_median6.324705772943581
driven_lanedir_min6.138254206744354
get_duckie_state_max1.544460071115867e-06
get_duckie_state_mean1.3391211347032445e-06
get_duckie_state_median1.3071333339668928e-06
get_duckie_state_min1.1977577997633248e-06
get_robot_state_max0.003801019463709848
get_robot_state_mean0.003622503007250545
get_robot_state_median0.0036084283698508382
get_robot_state_min0.003472135825590654
get_state_dump_max0.004785843633990006
get_state_dump_mean0.0046289815105550495
get_state_dump_median0.004662665063968467
get_state_dump_min0.004404752280293257
get_ui_image_max0.03396144298391477
get_ui_image_mean0.029558683156607455
get_ui_image_median0.028987172144239497
get_ui_image_min0.02629894535403606
in-drivable-lane_max11.649999999999338
in-drivable-lane_mean5.162499999999742
in-drivable-lane_min0.7999999999999545
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.802925570560337, "get_ui_image": 0.02629894535403606, "step_physics": 0.08973083860618024, "survival_time": 48.34999999999939, "driven_lanedir": 6.3132149233386485, "get_state_dump": 0.004609661161406966, "get_robot_state": 0.003472135825590654, "sim_render-ego0": 0.0036071600500217154, "get_duckie_state": 1.1977577997633248e-06, "in-drivable-lane": 11.649999999999338, "deviation-heading": 9.23707452631672, "agent_compute-ego0": 0.03372215337989744, "complete-iteration": 0.17455555855735275, "set_robot_commands": 0.002063563786262323, "deviation-center-line": 2.6280463553018514, "driven_lanedir_consec": 6.293710737518878, "sim_compute_sim_state": 0.009129795161160557, "sim_compute_performance-ego0": 0.0018319982635088205}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.940858362677835, "get_ui_image": 0.03396144298391477, "step_physics": 0.11401545515068366, "survival_time": 59.99999999999873, "driven_lanedir": 6.138254206744354, "get_state_dump": 0.004404752280293257, "get_robot_state": 0.0035740872604662333, "sim_render-ego0": 0.003784773848038927, "get_duckie_state": 1.335620483093516e-06, "in-drivable-lane": 5.349999999999781, "deviation-heading": 16.91866975941535, "agent_compute-ego0": 0.03366487528461898, "complete-iteration": 0.20896406396044775, "set_robot_commands": 0.002164802185998769, "deviation-center-line": 4.61138387090983, "driven_lanedir_consec": 6.138254206744354, "sim_compute_sim_state": 0.011297445313122548, "sim_compute_performance-ego0": 0.0020029417779622327}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.674443883733859, "get_ui_image": 0.031564426858855923, "step_physics": 0.10877876039547885, "survival_time": 59.99999999999873, "driven_lanedir": 6.3361966225485125, "get_state_dump": 0.004785843633990006, "get_robot_state": 0.003642769479235443, "sim_render-ego0": 0.0037767938729825366, "get_duckie_state": 1.2786461848402698e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 16.162281269362968, "agent_compute-ego0": 0.01950204799216951, "complete-iteration": 0.18920427575695029, "set_robot_commands": 0.002164582427991221, "deviation-center-line": 5.206606969692567, "driven_lanedir_consec": 6.3361966225485125, "sim_compute_sim_state": 0.012889945040535271, "sim_compute_performance-ego0": 0.002008210014641831}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.360665630661344, "get_ui_image": 0.02640991742962306, "step_physics": 0.10038350742127278, "survival_time": 59.99999999999873, "driven_lanedir": 6.890044987079737, "get_state_dump": 0.004715668966529967, "get_robot_state": 0.003801019463709848, "sim_render-ego0": 0.00392985105713043, "get_duckie_state": 1.544460071115867e-06, "in-drivable-lane": 2.849999999999895, "deviation-heading": 13.635101183041462, "agent_compute-ego0": 0.034618191476864776, "complete-iteration": 0.18480100659506207, "set_robot_commands": 0.002262086296557983, "deviation-center-line": 4.766720637805305, "driven_lanedir_consec": 6.890044987079737, "sim_compute_sim_state": 0.006502255909051824, "sim_compute_performance-ego0": 0.0020727448221249545}}
set_robot_commands_max0.002262086296557983
set_robot_commands_mean0.002163758674202574
set_robot_commands_median0.0021646923069949947
set_robot_commands_min0.002063563786262323
sim_compute_performance-ego0_max0.0020727448221249545
sim_compute_performance-ego0_mean0.0019789737195594595
sim_compute_performance-ego0_median0.0020055758963020316
sim_compute_performance-ego0_min0.0018319982635088205
sim_compute_sim_state_max0.012889945040535271
sim_compute_sim_state_mean0.00995486035596755
sim_compute_sim_state_median0.010213620237141553
sim_compute_sim_state_min0.006502255909051824
sim_render-ego0_max0.00392985105713043
sim_render-ego0_mean0.0037746447070434023
sim_render-ego0_median0.003780783860510731
sim_render-ego0_min0.0036071600500217154
simulation-passed1
step_physics_max0.11401545515068366
step_physics_mean0.10322714039340387
step_physics_median0.1045811339083758
step_physics_min0.08973083860618024
survival_time_max59.99999999999873
survival_time_mean57.08749999999889
survival_time_min48.34999999999939
No reset possible
5708811427Frank (Chude) QianΒ πŸ‡¨πŸ‡¦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:00:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5708111313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:00:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5651211416Frank (Chude) QianΒ πŸ‡¨πŸ‡¦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-041:30:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.527457152398652
survival_time_median59.99999999999873
deviation-center-line_median2.340763301338666
in-drivable-lane_median2.974999999999917


other stats
agent_compute-ego0_max0.045460800329844155
agent_compute-ego0_mean0.04406652507079973
agent_compute-ego0_median0.04417209085278666
agent_compute-ego0_min0.04189150257887344
agent_compute-ego1_max0.04656593864028518
agent_compute-ego1_mean0.04434822157869499
agent_compute-ego1_median0.04414209596918187
agent_compute-ego1_min0.0417636983534869
complete-iteration_max1.2007060313006424
complete-iteration_mean0.8439045569421596
complete-iteration_median0.809222277220305
complete-iteration_min0.3358323419435711
deviation-center-line_max7.095212259829976
deviation-center-line_mean2.4071643184627187
deviation-center-line_min0.17012276741346194
deviation-heading_max22.14669411830537
deviation-heading_mean10.16456026742758
deviation-heading_median10.62680681832336
deviation-heading_min1.0191473292537532
driven_any_max14.590134540077422
driven_any_mean8.712042665333637
driven_any_median7.840342262593758
driven_any_min0.5526827992852295
driven_lanedir_consec_max13.490777819275216
driven_lanedir_consec_mean7.25111246023872
driven_lanedir_consec_min0.4801949691561933
driven_lanedir_max13.490777819275216
driven_lanedir_mean7.25111246023872
driven_lanedir_median6.527457152398652
driven_lanedir_min0.4801949691561933
get_duckie_state_max1.744107083157376e-06
get_duckie_state_mean1.5727216844547295e-06
get_duckie_state_median1.557165141109622e-06
get_duckie_state_min1.3100435651085855e-06
get_robot_state_max0.014975690626883292
get_robot_state_mean0.01333119060616786
get_robot_state_median0.01444999085774926
get_robot_state_min0.0070190095254199
get_state_dump_max0.009856575244181863
get_state_dump_mean0.00910908361909158
get_state_dump_median0.009625667338565824
get_state_dump_min0.006033094400374238
get_ui_image_max0.04732092770807551
get_ui_image_mean0.041880579270957896
get_ui_image_median0.04256530089938174
get_ui_image_min0.02912417472217957
in-drivable-lane_max57.44999999999872
in-drivable-lane_mean8.349999999999831
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 5.162530616459116, "get_ui_image": 0.04213371147980561, "step_physics": 0.5030677544104086, "survival_time": 22.15000000000018, "driven_lanedir": 4.585138479803474, "get_state_dump": 0.009856575244181863, "get_robot_state": 0.014975690626883292, "sim_render-ego0": 0.004001966467848769, "sim_render-ego1": 0.004034660957955025, "sim_render-ego2": 0.003932778362755303, "sim_render-ego3": 0.003864964923343143, "get_duckie_state": 1.744107083157376e-06, "in-drivable-lane": 2.0000000000000133, "deviation-heading": 5.080848239674109, "agent_compute-ego0": 0.045460800329844155, "agent_compute-ego1": 0.04656593864028518, "agent_compute-ego2": 0.04407170012190535, "agent_compute-ego3": 0.04449414294045251, "complete-iteration": 0.809222277220305, "set_robot_commands": 0.0022644062299986144, "deviation-center-line": 1.2097105748276284, "driven_lanedir_consec": 4.585138479803474, "sim_compute_sim_state": 0.024959993792009784, "sim_compute_performance-ego0": 0.0021906854870083095, "sim_compute_performance-ego1": 0.002042439606812623, "sim_compute_performance-ego2": 0.002010166645050049, "sim_compute_performance-ego3": 0.001986667379602655}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.450656015667263, "get_ui_image": 0.04213371147980561, "step_physics": 0.5030677544104086, "survival_time": 22.15000000000018, "driven_lanedir": 3.1722393416603047, "get_state_dump": 0.009856575244181863, "get_robot_state": 0.014975690626883292, "sim_render-ego0": 0.004001966467848769, "sim_render-ego1": 0.004034660957955025, "sim_render-ego2": 0.003932778362755303, "sim_render-ego3": 0.003864964923343143, "get_duckie_state": 1.744107083157376e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 3.0451611783649097, "agent_compute-ego0": 0.045460800329844155, "agent_compute-ego1": 0.04656593864028518, "agent_compute-ego2": 0.04407170012190535, "agent_compute-ego3": 0.04449414294045251, "complete-iteration": 0.809222277220305, "set_robot_commands": 0.0022644062299986144, "deviation-center-line": 1.3987767505060926, "driven_lanedir_consec": 3.1722393416603047, "sim_compute_sim_state": 0.024959993792009784, "sim_compute_performance-ego0": 0.0021906854870083095, "sim_compute_performance-ego1": 0.002042439606812623, "sim_compute_performance-ego2": 0.002010166645050049, "sim_compute_performance-ego3": 0.001986667379602655}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.450690726278296, "get_ui_image": 0.04213371147980561, "step_physics": 0.5030677544104086, "survival_time": 22.15000000000018, "driven_lanedir": 3.098969449214533, "get_state_dump": 0.009856575244181863, "get_robot_state": 0.014975690626883292, "sim_render-ego0": 0.004001966467848769, "sim_render-ego1": 0.004034660957955025, "sim_render-ego2": 0.003932778362755303, "sim_render-ego3": 0.003864964923343143, "get_duckie_state": 1.744107083157376e-06, "in-drivable-lane": 1.099999999999996, "deviation-heading": 7.479417725018329, "agent_compute-ego0": 0.045460800329844155, "agent_compute-ego1": 0.04656593864028518, "agent_compute-ego2": 0.04407170012190535, "agent_compute-ego3": 0.04449414294045251, "complete-iteration": 0.809222277220305, "set_robot_commands": 0.0022644062299986144, "deviation-center-line": 1.2555413745240371, "driven_lanedir_consec": 3.098969449214533, "sim_compute_sim_state": 0.024959993792009784, "sim_compute_performance-ego0": 0.0021906854870083095, "sim_compute_performance-ego1": 0.002042439606812623, "sim_compute_performance-ego2": 0.002010166645050049, "sim_compute_performance-ego3": 0.001986667379602655}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 5.162641684723338, "get_ui_image": 0.04213371147980561, "step_physics": 0.5030677544104086, "survival_time": 22.15000000000018, "driven_lanedir": 5.106283806909655, "get_state_dump": 0.009856575244181863, "get_robot_state": 0.014975690626883292, "sim_render-ego0": 0.004001966467848769, "sim_render-ego1": 0.004034660957955025, "sim_render-ego2": 0.003932778362755303, "sim_render-ego3": 0.003864964923343143, "get_duckie_state": 1.744107083157376e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.5588895069566258, "agent_compute-ego0": 0.045460800329844155, "agent_compute-ego1": 0.04656593864028518, "agent_compute-ego2": 0.04407170012190535, "agent_compute-ego3": 0.04449414294045251, "complete-iteration": 0.809222277220305, "set_robot_commands": 0.0022644062299986144, "deviation-center-line": 0.8373073979025072, "driven_lanedir_consec": 5.106283806909655, "sim_compute_sim_state": 0.024959993792009784, "sim_compute_performance-ego0": 0.0021906854870083095, "sim_compute_performance-ego1": 0.002042439606812623, "sim_compute_performance-ego2": 0.002010166645050049, "sim_compute_performance-ego3": 0.001986667379602655}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.5526827992852295, "get_ui_image": 0.04732092770807551, "step_physics": 0.8967314288578462, "survival_time": 59.99999999999873, "driven_lanedir": 0.4801949691561933, "get_state_dump": 0.009383002883885725, "get_robot_state": 0.01444999085774926, "sim_render-ego0": 0.004044978842945718, "sim_render-ego1": 0.003931615275209095, "sim_render-ego2": 0.0038423714887887415, "sim_render-ego3": 0.003799254451564309, "get_duckie_state": 1.557165141109622e-06, "in-drivable-lane": 57.44999999999872, "deviation-heading": 1.0191473292537532, "agent_compute-ego0": 0.04417209085278666, "agent_compute-ego1": 0.04362889173922194, "agent_compute-ego2": 0.04272294262863019, "agent_compute-ego3": 0.041791762241614454, "complete-iteration": 1.2007060313006424, "set_robot_commands": 0.002262475190809823, "deviation-center-line": 0.17012276741346194, "driven_lanedir_consec": 0.4801949691561933, "sim_compute_sim_state": 0.026857365180213286, "sim_compute_performance-ego0": 0.0021287886725178764, "sim_compute_performance-ego1": 0.002048755267776121, "sim_compute_performance-ego2": 0.001957599169804988, "sim_compute_performance-ego3": 0.0019931687999029737}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 14.590080756858097, "get_ui_image": 0.04732092770807551, "step_physics": 0.8967314288578462, "survival_time": 59.99999999999873, "driven_lanedir": 12.882676879579952, "get_state_dump": 0.009383002883885725, "get_robot_state": 0.01444999085774926, "sim_render-ego0": 0.004044978842945718, "sim_render-ego1": 0.003931615275209095, "sim_render-ego2": 0.0038423714887887415, "sim_render-ego3": 0.003799254451564309, "get_duckie_state": 1.557165141109622e-06, "in-drivable-lane": 3.849999999999907, "deviation-heading": 14.323086911273473, "agent_compute-ego0": 0.04417209085278666, "agent_compute-ego1": 0.04362889173922194, "agent_compute-ego2": 0.04272294262863019, "agent_compute-ego3": 0.041791762241614454, "complete-iteration": 1.2007060313006424, "set_robot_commands": 0.002262475190809823, "deviation-center-line": 3.382410185031243, "driven_lanedir_consec": 12.882676879579952, "sim_compute_sim_state": 0.026857365180213286, "sim_compute_performance-ego0": 0.0021287886725178764, "sim_compute_performance-ego1": 0.002048755267776121, "sim_compute_performance-ego2": 0.001957599169804988, "sim_compute_performance-ego3": 0.0019931687999029737}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.9683871442495025, "get_ui_image": 0.04732092770807551, "step_physics": 0.8967314288578462, "survival_time": 59.99999999999873, "driven_lanedir": 0.5967237345825644, "get_state_dump": 0.009383002883885725, "get_robot_state": 0.01444999085774926, "sim_render-ego0": 0.004044978842945718, "sim_render-ego1": 0.003931615275209095, "sim_render-ego2": 0.0038423714887887415, "sim_render-ego3": 0.003799254451564309, "get_duckie_state": 1.557165141109622e-06, "in-drivable-lane": 1.0499999999999996, "deviation-heading": 22.14669411830537, "agent_compute-ego0": 0.04417209085278666, "agent_compute-ego1": 0.04362889173922194, "agent_compute-ego2": 0.04272294262863019, "agent_compute-ego3": 0.041791762241614454, "complete-iteration": 1.2007060313006424, "set_robot_commands": 0.002262475190809823, "deviation-center-line": 7.095212259829976, "driven_lanedir_consec": 0.5967237345825644, "sim_compute_sim_state": 0.026857365180213286, "sim_compute_performance-ego0": 0.0021287886725178764, "sim_compute_performance-ego1": 0.002048755267776121, "sim_compute_performance-ego2": 0.001957599169804988, "sim_compute_performance-ego3": 0.0019931687999029737}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 14.590134540077422, "get_ui_image": 0.04732092770807551, "step_physics": 0.8967314288578462, "survival_time": 59.99999999999873, "driven_lanedir": 13.490777819275216, "get_state_dump": 0.009383002883885725, "get_robot_state": 0.01444999085774926, "sim_render-ego0": 0.004044978842945718, "sim_render-ego1": 0.003931615275209095, "sim_render-ego2": 0.0038423714887887415, "sim_render-ego3": 0.003799254451564309, "get_duckie_state": 1.557165141109622e-06, "in-drivable-lane": 2.099999999999927, "deviation-heading": 12.863706476516798, "agent_compute-ego0": 0.04417209085278666, "agent_compute-ego1": 0.04362889173922194, "agent_compute-ego2": 0.04272294262863019, "agent_compute-ego3": 0.041791762241614454, "complete-iteration": 1.2007060313006424, "set_robot_commands": 0.002262475190809823, "deviation-center-line": 3.157798543097953, "driven_lanedir_consec": 13.490777819275216, "sim_compute_sim_state": 0.026857365180213286, "sim_compute_performance-ego0": 0.0021287886725178764, "sim_compute_performance-ego1": 0.002048755267776121, "sim_compute_performance-ego2": 0.001957599169804988, "sim_compute_performance-ego3": 0.0019931687999029737}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 14.590026603312737, "get_ui_image": 0.04256530089938174, "step_physics": 0.4623201844297182, "survival_time": 59.99999999999873, "driven_lanedir": 11.508459895334006, "get_state_dump": 0.009625667338565824, "get_robot_state": 0.013723980874245012, "sim_render-ego0": 0.003790497680587832, "sim_render-ego1": 0.003745605109831773, "sim_render-ego2": 0.003669590279025698, "sim_render-ego3": 0.003688383658263805, "get_duckie_state": 1.548231888770263e-06, "in-drivable-lane": 8.999999999999797, "deviation-heading": 14.897816824910064, "agent_compute-ego0": 0.04365419527573153, "agent_compute-ego1": 0.04414209596918187, "agent_compute-ego2": 0.04419922927932675, "agent_compute-ego3": 0.044132222144629536, "complete-iteration": 0.7758214698048257, "set_robot_commands": 0.0021808397561485426, "deviation-center-line": 2.8131433479624044, "driven_lanedir_consec": 11.508459895334006, "sim_compute_sim_state": 0.04002043706590588, "sim_compute_performance-ego0": 0.0021070637968954296, "sim_compute_performance-ego1": 0.0019135433470180488, "sim_compute_performance-ego2": 0.0018441891491562004, "sim_compute_performance-ego3": 0.0019181572725929688}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 14.590005809703763, "get_ui_image": 0.04256530089938174, "step_physics": 0.4623201844297182, "survival_time": 59.99999999999873, "driven_lanedir": 11.852405566356866, "get_state_dump": 0.009625667338565824, "get_robot_state": 0.013723980874245012, "sim_render-ego0": 0.003790497680587832, "sim_render-ego1": 0.003745605109831773, "sim_render-ego2": 0.003669590279025698, "sim_render-ego3": 0.003688383658263805, "get_duckie_state": 1.548231888770263e-06, "in-drivable-lane": 7.599999999999901, "deviation-heading": 15.52823218335956, "agent_compute-ego0": 0.04365419527573153, "agent_compute-ego1": 0.04414209596918187, "agent_compute-ego2": 0.04419922927932675, "agent_compute-ego3": 0.044132222144629536, "complete-iteration": 0.7758214698048257, "set_robot_commands": 0.0021808397561485426, "deviation-center-line": 3.1377388598288745, "driven_lanedir_consec": 11.852405566356866, "sim_compute_sim_state": 0.04002043706590588, "sim_compute_performance-ego0": 0.0021070637968954296, "sim_compute_performance-ego1": 0.0019135433470180488, "sim_compute_performance-ego2": 0.0018441891491562004, "sim_compute_performance-ego3": 0.0019181572725929688}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 14.589987563578523, "get_ui_image": 0.04256530089938174, "step_physics": 0.4623201844297182, "survival_time": 59.99999999999873, "driven_lanedir": 11.694618601789738, "get_state_dump": 0.009625667338565824, "get_robot_state": 0.013723980874245012, "sim_render-ego0": 0.003790497680587832, "sim_render-ego1": 0.003745605109831773, "sim_render-ego2": 0.003669590279025698, "sim_render-ego3": 0.003688383658263805, "get_duckie_state": 1.548231888770263e-06, "in-drivable-lane": 8.199999999999806, "deviation-heading": 15.576546636642629, "agent_compute-ego0": 0.04365419527573153, "agent_compute-ego1": 0.04414209596918187, "agent_compute-ego2": 0.04419922927932675, "agent_compute-ego3": 0.044132222144629536, "complete-iteration": 0.7758214698048257, "set_robot_commands": 0.0021808397561485426, "deviation-center-line": 3.105477389180454, "driven_lanedir_consec": 11.694618601789738, "sim_compute_sim_state": 0.04002043706590588, "sim_compute_performance-ego0": 0.0021070637968954296, "sim_compute_performance-ego1": 0.0019135433470180488, "sim_compute_performance-ego2": 0.0018441891491562004, "sim_compute_performance-ego3": 0.0019181572725929688}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 14.590088529290115, "get_ui_image": 0.04256530089938174, "step_physics": 0.4623201844297182, "survival_time": 59.99999999999873, "driven_lanedir": 9.992171594882274, "get_state_dump": 0.009625667338565824, "get_robot_state": 0.013723980874245012, "sim_render-ego0": 0.003790497680587832, "sim_render-ego1": 0.003745605109831773, "sim_render-ego2": 0.003669590279025698, "sim_render-ego3": 0.003688383658263805, "get_duckie_state": 1.548231888770263e-06, "in-drivable-lane": 14.799999999999546, "deviation-heading": 14.6122556040069, "agent_compute-ego0": 0.04365419527573153, "agent_compute-ego1": 0.04414209596918187, "agent_compute-ego2": 0.04419922927932675, "agent_compute-ego3": 0.044132222144629536, "complete-iteration": 0.7758214698048257, "set_robot_commands": 0.0021808397561485426, "deviation-center-line": 2.707300215147701, "driven_lanedir_consec": 9.992171594882274, "sim_compute_sim_state": 0.04002043706590588, "sim_compute_performance-ego0": 0.0021070637968954296, "sim_compute_performance-ego1": 0.0019135433470180488, "sim_compute_performance-ego2": 0.0018441891491562004, "sim_compute_performance-ego3": 0.0019181572725929688}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 7.840462106424704, "get_ui_image": 0.02912417472217957, "step_physics": 0.18433029295632203, "survival_time": 33.10000000000026, "driven_lanedir": 7.72351436571707, "get_state_dump": 0.006033094400374238, "get_robot_state": 0.0070190095254199, "sim_render-ego0": 0.0038054309459473394, "sim_render-ego1": 0.0037724809948675234, "get_duckie_state": 1.3100435651085855e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.782133849573704, "agent_compute-ego0": 0.04189150257887344, "agent_compute-ego1": 0.0417636983534869, "complete-iteration": 0.3358323419435711, "set_robot_commands": 0.0021892946050537476, "deviation-center-line": 1.4555344056960988, "driven_lanedir_consec": 7.72351436571707, "sim_compute_sim_state": 0.009612148523690292, "sim_compute_performance-ego0": 0.0019421983808054284, "sim_compute_performance-ego1": 0.001968243542839499}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 7.840222418762812, "get_ui_image": 0.02912417472217957, "step_physics": 0.18433029295632203, "survival_time": 33.10000000000026, "driven_lanedir": 5.331399939080234, "get_state_dump": 0.006033094400374238, "get_robot_state": 0.0070190095254199, "sim_render-ego0": 0.0038054309459473394, "sim_render-ego1": 0.0037724809948675234, "get_duckie_state": 1.3100435651085855e-06, "in-drivable-lane": 9.100000000000026, "deviation-heading": 8.389907160129924, "agent_compute-ego0": 0.04189150257887344, "agent_compute-ego1": 0.0417636983534869, "complete-iteration": 0.3358323419435711, "set_robot_commands": 0.0021892946050537476, "deviation-center-line": 1.9742263875296313, "driven_lanedir_consec": 5.331399939080234, "sim_compute_sim_state": 0.009612148523690292, "sim_compute_performance-ego0": 0.0019421983808054284, "sim_compute_performance-ego1": 0.001968243542839499}}
set_robot_commands_max0.0022644062299986144
set_robot_commands_mean0.002229248136995387
set_robot_commands_median0.002262475190809823
set_robot_commands_min0.0021808397561485426
sim_compute_performance-ego0_max0.0021906854870083095
sim_compute_performance-ego0_mean0.00211361061337838
sim_compute_performance-ego0_median0.0021287886725178764
sim_compute_performance-ego0_min0.0019421983808054284
sim_compute_performance-ego1_max0.002048755267776121
sim_compute_performance-ego1_mean0.001996817140864727
sim_compute_performance-ego1_median0.002042439606812623
sim_compute_performance-ego1_min0.0019135433470180488
sim_compute_sim_state_max0.04002043706590588
sim_compute_sim_state_mean0.027612534371421176
sim_compute_sim_state_median0.026857365180213286
sim_compute_sim_state_min0.009612148523690292
sim_render-ego0_max0.004044978842945718
sim_render-ego0_mean0.003925759561244568
sim_render-ego0_median0.004001966467848769
sim_render-ego0_min0.003790497680587832
sim_render-ego1_max0.004034660957955025
sim_render-ego1_mean0.0038851776686941865
sim_render-ego1_median0.003931615275209095
sim_render-ego1_min0.003745605109831773
simulation-passed1
step_physics_max0.8967314288578462
step_physics_mean0.558367004050324
step_physics_median0.5030677544104086
step_physics_min0.18433029295632203
survival_time_max59.99999999999873
survival_time_mean45.34285714285651
survival_time_min22.15000000000018
No reset possible
5650111280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:32
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5642611284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:03:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56405