Duckietown Challenges Home Challenges Submissions

Evaluator 2268

ID2268
evaluatorreg05-221dc42400b8-1
ownerI don't have one 😀
machinearchimede
processreg05-221dc42400b8-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success3 40927
# timeout1 40960
# failed2 40911
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4096011283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simtimeoutnoreg05-221dc42400b8-1----No reset possible
4094610795Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02722724119822184
agent_compute-ego_mean0.026174837152163188
agent_compute-ego_median0.026093361377716066
agent_compute-ego_min0.02528538465499878
complete-iteration_max0.3046520590782166
complete-iteration_mean0.2879072266817093
complete-iteration_median0.28301694194475807
complete-iteration_min0.28094296375910444
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max4.690488179524739e-06
get_duckie_state_mean4.57306702931722e-06
get_duckie_state_median4.611810048421224e-06
get_duckie_state_min4.378159840901693e-06
get_robot_state_max0.025969521999359133
get_robot_state_mean0.02449217776457469
get_robot_state_median0.02426409920056661
get_robot_state_min0.023470990657806397
get_state_dump_max0.02081759532292684
get_state_dump_mean0.019808024565378824
get_state_dump_median0.019574439922968548
get_state_dump_min0.01926562309265137
get_ui_image_max0.05148042599360148
get_ui_image_mean0.05042068819204966
get_ui_image_median0.050455350081125894
get_ui_image_min0.04929162661234538
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.050564478238423666, "step_physics": 0.11078946352005004, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019266151587168375, "sim_render-ego": 0.009603277842203776, "get_robot_state": 0.023470990657806397, "get_duckie_state": 4.378159840901693e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02528538465499878, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.282922039826711, "set_robot_commands": 0.007306344509124756, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02994277318318685, "sim_compute_performance-ego": 0.006469539006551107}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.05148042599360148, "step_physics": 0.10249488910039266, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02081759532292684, "sim_render-ego": 0.010382797718048096, "get_robot_state": 0.025969521999359133, "get_duckie_state": 4.690488179524739e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02722724119822184, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.28311184406280515, "set_robot_commands": 0.008252336978912353, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.029068255424499513, "sim_compute_performance-ego": 0.007175831000010172}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04929162661234538, "step_physics": 0.10831709146499634, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.019882728258768717, "sim_render-ego": 0.009450727303822836, "get_robot_state": 0.02401912212371826, "get_duckie_state": 4.55776850382487e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026560130914052328, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.28094296375910444, "set_robot_commands": 0.007476511001586914, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.02939788341522217, "sim_compute_performance-ego": 0.006321721076965332}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.05034622192382812, "step_physics": 0.1276755650838216, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01926562309265137, "sim_render-ego": 0.009896812438964843, "get_robot_state": 0.024509076277414957, "get_duckie_state": 4.665851593017578e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0256265918413798, "deviation-heading": 0.486072248607516, "complete-iteration": 0.3046520590782166, "set_robot_commands": 0.0074177352587382, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03313708305358887, "sim_compute_performance-ego": 0.0065488640467325845}}
set_robot_commands_max0.008252336978912353
set_robot_commands_mean0.007613231937090555
set_robot_commands_median0.007447123130162557
set_robot_commands_min0.007306344509124756
sim_compute_performance-ego_max0.007175831000010172
sim_compute_performance-ego_mean0.006628988782564799
sim_compute_performance-ego_median0.006509201526641846
sim_compute_performance-ego_min0.006321721076965332
sim_compute_sim_state_max0.03313708305358887
sim_compute_sim_state_mean0.030386498769124352
sim_compute_sim_state_median0.02967032829920451
sim_compute_sim_state_min0.029068255424499513
sim_render-ego_max0.010382797718048096
sim_render-ego_mean0.009833403825759889
sim_render-ego_median0.00975004514058431
sim_render-ego_min0.009450727303822836
simulation-passed1
step_physics_max0.1276755650838216
step_physics_mean0.11231925229231517
step_physics_median0.1095532774925232
step_physics_min0.10249488910039266
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4093910799Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.29653391084570924
survival_time_median1.8250000000000008
deviation-center-line_median0.10515639248937764
in-drivable-lane_median0.27500000000000013


other stats
agent_compute-ego_max0.0709493613243103
agent_compute-ego_mean0.06503005982698001
agent_compute-ego_median0.06369343987016968
agent_compute-ego_min0.06178399824327038
complete-iteration_max0.3362680013974508
complete-iteration_mean0.32484231587408346
complete-iteration_median0.3249519746411931
complete-iteration_min0.3131973128164968
deviation-center-line_max0.5220925000803088
deviation-center-line_mean0.2033129374303956
deviation-center-line_min0.08084646466251824
deviation-heading_max3.0997512187102663
deviation-heading_mean1.1297456006938282
deviation-heading_median0.5356383267174334
deviation-heading_min0.3479545306301791
driven_any_max3.9816416048413217
driven_any_mean1.2601697399340623
driven_any_median0.3869139159620753
driven_any_min0.28520952297077723
driven_lanedir_consec_max1.2718388760802486
driven_lanedir_consec_mean0.5136818319556762
driven_lanedir_consec_min0.1898206300510377
driven_lanedir_max1.2718388760802486
driven_lanedir_mean0.5136818319556762
driven_lanedir_median0.29653391084570924
driven_lanedir_min0.1898206300510377
get_duckie_state_max4.168712731563684e-06
get_duckie_state_mean3.920528138254861e-06
get_duckie_state_median3.935778012839697e-06
get_duckie_state_min3.6418437957763673e-06
get_robot_state_max0.024661391576131186
get_robot_state_mean0.02375093053192454
get_robot_state_median0.02369897259819892
get_robot_state_min0.022944385355169124
get_state_dump_max0.02065380927055113
get_state_dump_mean0.02018011066891464
get_state_dump_median0.0203760082432718
get_state_dump_min0.019314616918563843
get_ui_image_max0.05235883683869333
get_ui_image_mean0.04955871853922819
get_ui_image_median0.04948148391580069
get_ui_image_min0.04691306948661804
in-drivable-lane_max8.550000000000047
in-drivable-lane_mean2.337500000000012
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.33299975205020055, "get_ui_image": 0.05235883683869333, "step_physics": 0.11013713027491714, "survival_time": 1.6500000000000008, "driven_lanedir": 0.24247474454729856, "get_state_dump": 0.02055237509987571, "sim_render-ego": 0.009931304238059303, "get_robot_state": 0.022944385355169124, "get_duckie_state": 4.168712731563684e-06, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.062399488506895126, "deviation-heading": 0.4874011806442024, "complete-iteration": 0.32006762244484643, "set_robot_commands": 0.006052291754520301, "deviation-center-line": 0.0919475392877638, "driven_lanedir_consec": 0.24247474454729856, "sim_compute_sim_state": 0.029199665242975407, "sim_compute_performance-ego": 0.006288391171079694}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.28520952297077723, "get_ui_image": 0.04829946640999087, "step_physics": 0.10806752789405084, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1898206300510377, "get_state_dump": 0.02065380927055113, "sim_render-ego": 0.009602246745940178, "get_robot_state": 0.024243716270692887, "get_duckie_state": 3.845460953251008e-06, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.06178399824327038, "deviation-heading": 0.5838754727906643, "complete-iteration": 0.3131973128164968, "set_robot_commands": 0.005651258653210056, "deviation-center-line": 0.08084646466251824, "driven_lanedir_consec": 0.1898206300510377, "sim_compute_sim_state": 0.02849086638419859, "sim_compute_performance-ego": 0.006193653229744204}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.9816416048413217, "get_ui_image": 0.05066350142161052, "step_physics": 0.11336941401163736, "survival_time": 14.950000000000076, "driven_lanedir": 1.2718388760802486, "get_state_dump": 0.02019964138666789, "sim_render-ego": 0.00992546319961548, "get_robot_state": 0.024661391576131186, "get_duckie_state": 4.0260950724283854e-06, "in-drivable-lane": 8.550000000000047, "agent_compute-ego": 0.0709493613243103, "deviation-heading": 3.0997512187102663, "complete-iteration": 0.3362680013974508, "set_robot_commands": 0.006112865606943766, "deviation-center-line": 0.5220925000803088, "driven_lanedir_consec": 1.2718388760802486, "sim_compute_sim_state": 0.032847816149393715, "sim_compute_performance-ego": 0.007328193187713623}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.4408280798739499, "get_ui_image": 0.04691306948661804, "step_physics": 0.12145467400550844, "survival_time": 2.000000000000001, "driven_lanedir": 0.3505930771441199, "get_state_dump": 0.019314616918563843, "sim_render-ego": 0.00869894027709961, "get_robot_state": 0.023154228925704956, "get_duckie_state": 3.6418437957763673e-06, "in-drivable-lane": 0.30000000000000004, "agent_compute-ego": 0.06498739123344421, "deviation-heading": 0.3479545306301791, "complete-iteration": 0.32983632683753966, "set_robot_commands": 0.00583651065826416, "deviation-center-line": 0.1183652456909915, "driven_lanedir_consec": 0.3505930771441199, "sim_compute_sim_state": 0.033401352167129514, "sim_compute_performance-ego": 0.005870574712753296}}
set_robot_commands_max0.006112865606943766
set_robot_commands_mean0.0059132316682345715
set_robot_commands_median0.00594440120639223
set_robot_commands_min0.005651258653210056
sim_compute_performance-ego_max0.007328193187713623
sim_compute_performance-ego_mean0.006420203075322704
sim_compute_performance-ego_median0.006241022200411949
sim_compute_performance-ego_min0.005870574712753296
sim_compute_sim_state_max0.033401352167129514
sim_compute_sim_state_mean0.030984924985924308
sim_compute_sim_state_median0.03102374069618456
sim_compute_sim_state_min0.02849086638419859
sim_render-ego_max0.009931304238059303
sim_render-ego_mean0.009539488615178645
sim_render-ego_median0.00976385497277783
sim_render-ego_min0.00869894027709961
simulation-passed1
step_physics_max0.12145467400550844
step_physics_mean0.11325718654652844
step_physics_median0.11175327214327728
step_physics_min0.10806752789405084
survival_time_max14.950000000000076
survival_time_mean5.03750000000002
survival_time_min1.5500000000000007
No reset possible
4092710807Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:11:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9540330045134529
survival_time_median14.950000000000076
deviation-center-line_median0.5961863148822916
in-drivable-lane_median3.7500000000000537


other stats
agent_compute-ego_max0.026275728543599445
agent_compute-ego_mean0.025816714962323507
agent_compute-ego_median0.025789774656295776
agent_compute-ego_min0.025411581993103022
complete-iteration_max0.28961923599243167
complete-iteration_mean0.28271929403146107
complete-iteration_median0.2810862048467
complete-iteration_min0.2790855304400126
deviation-center-line_max0.9071519715815676
deviation-center-line_mean0.6356218048138781
deviation-center-line_min0.4429626179093615
deviation-heading_max2.221440625533885
deviation-heading_mean1.2811591185274709
deviation-heading_median1.0551890492455016
deviation-heading_min0.792817750084994
driven_any_max2.654731995749677
driven_any_mean2.6525605602730877
driven_any_median2.6547204247359426
driven_any_min2.6460693958707884
driven_lanedir_consec_max2.0413967972716183
driven_lanedir_consec_mean1.831928534497971
driven_lanedir_consec_min1.37825133169336
driven_lanedir_max2.0413967972716183
driven_lanedir_mean1.831928534497971
driven_lanedir_median1.9540330045134529
driven_lanedir_min1.37825133169336
get_duckie_state_max5.428791046142578e-06
get_duckie_state_mean5.012949307759602e-06
get_duckie_state_median4.9507617950439454e-06
get_duckie_state_min4.721482594807943e-06
get_robot_state_max0.023587605953216552
get_robot_state_mean0.023050846060117085
get_robot_state_median0.023154596090316774
get_robot_state_min0.022306586106618245
get_state_dump_max0.019892717202504476
get_state_dump_mean0.019294785261154176
get_state_dump_median0.01917677402496338
get_state_dump_min0.018932875792185465
get_ui_image_max0.04925668716430664
get_ui_image_mean0.04839944322903951
get_ui_image_median0.04852474172910054
get_ui_image_min0.04729160229365031
in-drivable-lane_max6.500000000000059
in-drivable-lane_mean4.325000000000053
in-drivable-lane_min3.300000000000047
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6460693958707884, "get_ui_image": 0.04925668716430664, "step_physics": 0.10857120672861736, "survival_time": 14.950000000000076, "driven_lanedir": 1.884558286233717, "get_state_dump": 0.019099587599436443, "sim_render-ego": 0.009709513187408448, "get_robot_state": 0.023587605953216552, "get_duckie_state": 5.428791046142578e-06, "in-drivable-lane": 4.100000000000058, "agent_compute-ego": 0.025411581993103022, "deviation-heading": 1.189177368475913, "complete-iteration": 0.2801287237803141, "set_robot_commands": 0.0072124926249186195, "deviation-center-line": 0.9071519715815676, "driven_lanedir_consec": 1.884558286233717, "sim_compute_sim_state": 0.030706655184427896, "sim_compute_performance-ego": 0.006351266702016195}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.654731117750631, "get_ui_image": 0.04881522973378499, "step_physics": 0.11080125252405802, "survival_time": 14.950000000000076, "driven_lanedir": 2.0413967972716183, "get_state_dump": 0.019253960450490316, "sim_render-ego": 0.009201277097066245, "get_robot_state": 0.022306586106618245, "get_duckie_state": 4.917780558268229e-06, "in-drivable-lane": 3.300000000000047, "agent_compute-ego": 0.025492943127950033, "deviation-heading": 0.92120073001509, "complete-iteration": 0.2790855304400126, "set_robot_commands": 0.006776456832885742, "deviation-center-line": 0.569152844209475, "driven_lanedir_consec": 2.0413967972716183, "sim_compute_sim_state": 0.03019115368525187, "sim_compute_performance-ego": 0.0060347374280293785}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.654709731721254, "get_ui_image": 0.048234253724416094, "step_physics": 0.11213158051172892, "survival_time": 14.950000000000076, "driven_lanedir": 1.37825133169336, "get_state_dump": 0.018932875792185465, "sim_render-ego": 0.009524536927541098, "get_robot_state": 0.022865835030873617, "get_duckie_state": 4.721482594807943e-06, "in-drivable-lane": 6.500000000000059, "agent_compute-ego": 0.026275728543599445, "deviation-heading": 2.221440625533885, "complete-iteration": 0.28204368591308593, "set_robot_commands": 0.007432132562001546, "deviation-center-line": 0.6232197855551082, "driven_lanedir_consec": 1.37825133169336, "sim_compute_sim_state": 0.030278904438018797, "sim_compute_performance-ego": 0.0061555568377176925}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.654731995749677, "get_ui_image": 0.04729160229365031, "step_physics": 0.11067339738210044, "survival_time": 14.950000000000076, "driven_lanedir": 2.0235077227931884, "get_state_dump": 0.019892717202504476, "sim_render-ego": 0.009790190060933433, "get_robot_state": 0.023443357149759928, "get_duckie_state": 4.983743031819661e-06, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.02608660618464152, "deviation-heading": 0.792817750084994, "complete-iteration": 0.28961923599243167, "set_robot_commands": 0.01111655871073405, "deviation-center-line": 0.4429626179093615, "driven_lanedir_consec": 2.0235077227931884, "sim_compute_sim_state": 0.03483482042948405, "sim_compute_performance-ego": 0.006267505486806234}}
set_robot_commands_max0.01111655871073405
set_robot_commands_mean0.008134410182634989
set_robot_commands_median0.007322312593460082
set_robot_commands_min0.006776456832885742
sim_compute_performance-ego_max0.006351266702016195
sim_compute_performance-ego_mean0.006202266613642375
sim_compute_performance-ego_median0.006211531162261964
sim_compute_performance-ego_min0.0060347374280293785
sim_compute_sim_state_max0.03483482042948405
sim_compute_sim_state_mean0.03150288343429565
sim_compute_sim_state_median0.030492779811223347
sim_compute_sim_state_min0.03019115368525187
sim_render-ego_max0.009790190060933433
sim_render-ego_mean0.009556379318237305
sim_render-ego_median0.009617025057474773
sim_render-ego_min0.009201277097066245
simulation-passed1
step_physics_max0.11213158051172892
step_physics_mean0.11054435928662618
step_physics_median0.11073732495307922
step_physics_min0.10857120672861736
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4091810812Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg05-221dc42400b8-10:03:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 11 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4091110812Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg05-221dc42400b8-10:03:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 58 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible