Duckietown Challenges Home Challenges Submissions

Evaluator 2124

ID2124
evaluatorreg05-7d9c5d9f1ec5-1
ownerI don't have one πŸ˜€
machinearchimede
processreg05-7d9c5d9f1ec5-1
versiond-c:6.1.19;d-c-r:6.0.48
first heard
last heard
statusinactive
# evaluating
# success44 36107
# timeout
# failed5 36216
# error13 36118
# aborted3 36248
# host-error1 36436
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3659710063Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1165107313433555
survival_time_median14.950000000000076
deviation-center-line_median1.0175558384818906
in-drivable-lane_median1.050000000000015


other stats
agent_compute-ego_max0.07332905928293863
agent_compute-ego_mean0.05493534247080485
agent_compute-ego_median0.05934389114379883
agent_compute-ego_min0.027724528312683107
complete-iteration_max0.3031861901283264
complete-iteration_mean0.2826849434773127
complete-iteration_median0.2881576693058014
complete-iteration_min0.2512382451693217
deviation-center-line_max1.1591928312128836
deviation-center-line_mean1.0054990916425923
deviation-center-line_min0.8276918583937054
deviation-heading_max3.324940404513083
deviation-heading_mean1.8954948513793388
deviation-heading_median1.6167629015034182
deviation-heading_min1.0235131979974366
driven_any_max1.3803933021505308
driven_any_mean1.1372024743035578
driven_any_median1.1569433827437008
driven_any_min0.8545298295762987
driven_lanedir_consec_max1.3760460379243236
driven_lanedir_consec_mean1.0616667943792826
driven_lanedir_consec_min0.6375996769060956
driven_lanedir_max1.3760460379243236
driven_lanedir_mean1.0616667943792826
driven_lanedir_median1.1165107313433555
driven_lanedir_min0.6375996769060956
get_state_dump_max0.020325018564860027
get_state_dump_mean0.019115066329638164
get_state_dump_median0.019134721755981444
get_state_dump_min0.017865803241729736
get_ui_image_max0.04649236599604289
get_ui_image_mean0.045759649475415554
get_ui_image_median0.04593655069669088
get_ui_image_min0.04467313051223755
in-drivable-lane_max3.750000000000032
in-drivable-lane_mean1.4625000000000157
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.9464731540334586, "get_ui_image": 0.04607375462849935, "step_physics": 0.0938432002067566, "survival_time": 14.950000000000076, "driven_lanedir": 0.8709102981155283, "get_state_dump": 0.017865803241729736, "sim_render-ego": 0.009091274738311768, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.027724528312683107, "deviation-heading": 2.1288119261702, "complete-iteration": 0.2512382451693217, "set_robot_commands": 0.007447371482849121, "deviation-center-line": 1.0102713817319469, "driven_lanedir_consec": 0.8709102981155283, "sim_compute_sim_state": 0.019995316664377847, "sim_compute_performance-ego": 0.006220966974894206, "sim_compute_robot_state-ego": 0.011386122703552246, "sim_compute_robot_state-parked0": 0.011357819239298505}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3674136114539428, "get_ui_image": 0.045799346764882405, "step_physics": 0.09578298012415568, "survival_time": 14.950000000000076, "driven_lanedir": 1.3621111645711823, "get_state_dump": 0.018673174381256104, "sim_render-ego": 0.009304391543070474, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05157516956329346, "deviation-heading": 1.1047138768366362, "complete-iteration": 0.2786505953470866, "set_robot_commands": 0.008009769916534425, "deviation-center-line": 1.0248402952318345, "driven_lanedir_consec": 1.3621111645711823, "sim_compute_sim_state": 0.01885499954223633, "sim_compute_performance-ego": 0.006843648751576742, "sim_compute_robot_state-ego": 0.012034403483072916, "sim_compute_robot_state-parked0": 0.01153306484222412}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.8545298295762987, "get_ui_image": 0.04649236599604289, "step_physics": 0.09432965596516928, "survival_time": 14.950000000000076, "driven_lanedir": 0.6375996769060956, "get_state_dump": 0.01959626913070679, "sim_render-ego": 0.009497493108113608, "in-drivable-lane": 3.750000000000032, "agent_compute-ego": 0.07332905928293863, "deviation-heading": 3.324940404513083, "complete-iteration": 0.2976647432645162, "set_robot_commands": 0.007833209037780762, "deviation-center-line": 0.8276918583937054, "driven_lanedir_consec": 0.6375996769060956, "sim_compute_sim_state": 0.016054683526357014, "sim_compute_performance-ego": 0.006521730422973633, "sim_compute_robot_state-ego": 0.011902894973754885, "sim_compute_robot_state-parked0": 0.011853137016296388}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.3803933021505308, "get_ui_image": 0.04467313051223755, "step_physics": 0.1036004638671875, "survival_time": 14.950000000000076, "driven_lanedir": 1.3760460379243236, "get_state_dump": 0.020325018564860027, "sim_render-ego": 0.009448973337809244, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0671126127243042, "deviation-heading": 1.0235131979974366, "complete-iteration": 0.3031861901283264, "set_robot_commands": 0.007796214421590169, "deviation-center-line": 1.1591928312128836, "driven_lanedir_consec": 1.3760460379243236, "sim_compute_sim_state": 0.019511133829752603, "sim_compute_performance-ego": 0.006641698678334554, "sim_compute_robot_state-ego": 0.012020207246144611, "sim_compute_robot_state-parked0": 0.011801912784576415}}
set_robot_commands_max0.008009769916534425
set_robot_commands_mean0.007771641214688619
set_robot_commands_median0.007814711729685465
set_robot_commands_min0.007447371482849121
sim_compute_performance-ego_max0.006843648751576742
sim_compute_performance-ego_mean0.006557011206944783
sim_compute_performance-ego_median0.006581714550654093
sim_compute_performance-ego_min0.006220966974894206
sim_compute_robot_state-ego_max0.012034403483072916
sim_compute_robot_state-ego_mean0.011835907101631163
sim_compute_robot_state-ego_median0.011961551109949748
sim_compute_robot_state-ego_min0.011386122703552246
sim_compute_robot_state-parked0_max0.011853137016296388
sim_compute_robot_state-parked0_mean0.011636483470598856
sim_compute_robot_state-parked0_median0.011667488813400267
sim_compute_robot_state-parked0_min0.011357819239298505
sim_compute_sim_state_max0.019995316664377847
sim_compute_sim_state_mean0.01860403339068095
sim_compute_sim_state_median0.019183066685994468
sim_compute_sim_state_min0.016054683526357014
sim_render-ego_max0.009497493108113608
sim_render-ego_mean0.009335533181826273
sim_render-ego_median0.00937668244043986
sim_render-ego_min0.009091274738311768
simulation-passed1
step_physics_max0.1036004638671875
step_physics_mean0.09688907504081729
step_physics_median0.09505631804466248
step_physics_min0.0938432002067566
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3658810059Francois Hebertreal-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.72085498995939
survival_time_median11.375000000000028
deviation-center-line_median0.3224603134331736
in-drivable-lane_median2.950000000000042


other stats
agent_compute-ego_max0.05243184320595232
agent_compute-ego_mean0.03626221755416631
agent_compute-ego_median0.03137553370786163
agent_compute-ego_min0.029865959594989645
complete-iteration_max0.3164428296110555
complete-iteration_mean0.2752064205310546
complete-iteration_median0.26526581393847676
complete-iteration_min0.2538512246362094
deviation-center-line_max0.41614488995738014
deviation-center-line_mean0.31019672362491274
deviation-center-line_min0.17972137767592375
deviation-heading_max2.402575379405808
deviation-heading_mean1.523909815613586
deviation-heading_median1.4119626562317
deviation-heading_min0.8691385705851353
driven_any_max2.910788546443119
driven_any_mean2.6153867780203197
driven_any_median2.8189991295740757
driven_any_min1.9127603064900085
driven_lanedir_consec_max2.067246389673046
driven_lanedir_consec_mean1.6692580481002874
driven_lanedir_consec_min1.168075822809323
driven_lanedir_max2.067246389673046
driven_lanedir_mean1.6692580481002874
driven_lanedir_median1.72085498995939
driven_lanedir_min1.168075822809323
get_state_dump_max0.02170336941432525
get_state_dump_mean0.020618453222610737
get_state_dump_median0.02065884093288433
get_state_dump_min0.01945276161034902
get_ui_image_max0.04969013859872861
get_ui_image_mean0.04662305143715148
get_ui_image_median0.04602991976078201
get_ui_image_min0.044742227628313265
in-drivable-lane_max5.800000000000038
in-drivable-lane_mean3.4750000000000285
in-drivable-lane_min2.199999999999992
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9127603064900085, "get_ui_image": 0.04621342892916697, "step_physics": 0.09420282735764604, "survival_time": 7.94999999999998, "driven_lanedir": 1.4155007972242295, "get_state_dump": 0.021697060866925705, "sim_render-ego": 0.010154193302370468, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.03156896207317616, "deviation-heading": 0.8691385705851353, "complete-iteration": 0.26842442248602333, "set_robot_commands": 0.00867849625881363, "deviation-center-line": 0.17972137767592375, "driven_lanedir_consec": 1.4155007972242295, "sim_compute_sim_state": 0.022823357732041076, "sim_compute_performance-ego": 0.007137694448794959, "sim_compute_robot_state-ego": 0.01308597558699314, "sim_compute_robot_state-parked0": 0.01259757287847171}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.878678001367085, "get_ui_image": 0.044742227628313265, "step_physics": 0.09256584068824504, "survival_time": 11.60000000000003, "driven_lanedir": 2.0262091826945507, "get_state_dump": 0.01962062099884296, "sim_render-ego": 0.009261402590521451, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.029865959594989645, "deviation-heading": 1.8562121368220812, "complete-iteration": 0.2538512246362094, "set_robot_commands": 0.006973485494482106, "deviation-center-line": 0.3321342353327822, "driven_lanedir_consec": 2.0262091826945507, "sim_compute_sim_state": 0.023036836550153535, "sim_compute_performance-ego": 0.006172915984844339, "sim_compute_robot_state-ego": 0.010498203080275962, "sim_compute_robot_state-parked0": 0.010858929362790338}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7593202577810665, "get_ui_image": 0.04584641059239705, "step_physics": 0.101582266887029, "survival_time": 12.000000000000036, "driven_lanedir": 1.168075822809323, "get_state_dump": 0.01945276161034902, "sim_render-ego": 0.009430620074272157, "in-drivable-lane": 5.800000000000038, "agent_compute-ego": 0.0311821053425471, "deviation-heading": 2.402575379405808, "complete-iteration": 0.2621072053909302, "set_robot_commands": 0.007446769873301188, "deviation-center-line": 0.41614488995738014, "driven_lanedir_consec": 1.168075822809323, "sim_compute_sim_state": 0.017200095454851787, "sim_compute_performance-ego": 0.006778893868128458, "sim_compute_robot_state-ego": 0.01128413478533427, "sim_compute_robot_state-parked0": 0.011643607417742412}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.910788546443119, "get_ui_image": 0.04969013859872861, "step_physics": 0.10922915090894483, "survival_time": 11.150000000000023, "driven_lanedir": 2.067246389673046, "get_state_dump": 0.02170336941432525, "sim_render-ego": 0.01052106656301182, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.05243184320595232, "deviation-heading": 0.9677131756413192, "complete-iteration": 0.3164428296110555, "set_robot_commands": 0.017980794735553553, "deviation-center-line": 0.31278639153356497, "driven_lanedir_consec": 2.067246389673046, "sim_compute_sim_state": 0.02172340726638589, "sim_compute_performance-ego": 0.007276518997055533, "sim_compute_robot_state-ego": 0.013054586846732238, "sim_compute_robot_state-parked0": 0.01256848129990924}}
set_robot_commands_max0.017980794735553553
set_robot_commands_mean0.010269886590537618
set_robot_commands_median0.00806263306605741
set_robot_commands_min0.006973485494482106
sim_compute_performance-ego_max0.007276518997055533
sim_compute_performance-ego_mean0.006841505824705822
sim_compute_performance-ego_median0.0069582941584617084
sim_compute_performance-ego_min0.006172915984844339
sim_compute_robot_state-ego_max0.01308597558699314
sim_compute_robot_state-ego_mean0.011980725074833902
sim_compute_robot_state-ego_median0.012169360816033254
sim_compute_robot_state-ego_min0.010498203080275962
sim_compute_robot_state-parked0_max0.01259757287847171
sim_compute_robot_state-parked0_mean0.011917147739728426
sim_compute_robot_state-parked0_median0.012106044358825828
sim_compute_robot_state-parked0_min0.010858929362790338
sim_compute_sim_state_max0.023036836550153535
sim_compute_sim_state_mean0.02119592425085807
sim_compute_sim_state_median0.02227338249921348
sim_compute_sim_state_min0.017200095454851787
sim_render-ego_max0.01052106656301182
sim_render-ego_mean0.009841820632543971
sim_render-ego_median0.009792406688321311
sim_render-ego_min0.009261402590521451
simulation-passed1
step_physics_max0.10922915090894483
step_physics_mean0.09939502146046623
step_physics_median0.09789254712233753
step_physics_min0.09256584068824504
survival_time_max12.000000000000036
survival_time_mean10.675000000000018
survival_time_min7.94999999999998
No reset possible
3658510057Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.160722521640714
survival_time_median14.950000000000076
deviation-center-line_median0.32105821496513404
in-drivable-lane_median3.350000000000047


other stats
agent_compute-ego_max0.054347505569458006
agent_compute-ego_mean0.03628117620944977
agent_compute-ego_median0.030564432144165037
agent_compute-ego_min0.029648334980010987
complete-iteration_max0.28924724022547404
complete-iteration_mean0.2649414632717768
complete-iteration_median0.2605362327893575
complete-iteration_min0.2494461472829183
deviation-center-line_max0.47628582580738854
deviation-center-line_mean0.3186612642722884
deviation-center-line_min0.15624280135149707
deviation-heading_max2.279650243234324
deviation-heading_mean1.5713007017211296
deviation-heading_median1.477027332898063
deviation-heading_min1.051497897854068
driven_any_max3.3612199864800116
driven_any_mean2.890012117392491
driven_any_median2.7601833764481576
driven_any_min2.678461730193635
driven_lanedir_consec_max3.330846703276853
driven_lanedir_consec_mean2.2140577465642215
driven_lanedir_consec_min1.2039392396986064
driven_lanedir_max3.330846703276853
driven_lanedir_mean2.2140577465642215
driven_lanedir_median2.160722521640714
driven_lanedir_min1.2039392396986064
get_state_dump_max0.020283777713775635
get_state_dump_mean0.019824886719385783
get_state_dump_median0.019748155673344932
get_state_dump_min0.019519457817077635
get_ui_image_max0.047285468578338624
get_ui_image_mean0.04524405678113302
get_ui_image_median0.04484384338061015
get_ui_image_min0.04400307178497315
in-drivable-lane_max8.400000000000093
in-drivable-lane_mean3.7750000000000465
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.678461730193635, "get_ui_image": 0.044861786365509033, "step_physics": 0.09320499181747437, "survival_time": 14.950000000000076, "driven_lanedir": 1.2039392396986064, "get_state_dump": 0.019555348555246987, "sim_render-ego": 0.009608093102773031, "in-drivable-lane": 8.400000000000093, "agent_compute-ego": 0.03031777302424113, "deviation-heading": 1.051497897854068, "complete-iteration": 0.2589114459355672, "set_robot_commands": 0.008170697689056396, "deviation-center-line": 0.15624280135149707, "driven_lanedir_consec": 1.2039392396986064, "sim_compute_sim_state": 0.02198357105255127, "sim_compute_performance-ego": 0.006549485524495443, "sim_compute_robot_state-ego": 0.0123635204633077, "sim_compute_robot_state-parked0": 0.012071611881256104}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8211788713124197, "get_ui_image": 0.04400307178497315, "step_physics": 0.08935362180074057, "survival_time": 14.950000000000076, "driven_lanedir": 2.771695134645745, "get_state_dump": 0.019519457817077635, "sim_render-ego": 0.009215936660766602, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029648334980010987, "deviation-heading": 2.279650243234324, "complete-iteration": 0.2494461472829183, "set_robot_commands": 0.0076910614967346195, "deviation-center-line": 0.47628582580738854, "driven_lanedir_consec": 2.771695134645745, "sim_compute_sim_state": 0.020401609738667805, "sim_compute_performance-ego": 0.006408848762512207, "sim_compute_robot_state-ego": 0.011623685359954831, "sim_compute_robot_state-parked0": 0.01136055866877238}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.699187881583896, "get_ui_image": 0.047285468578338624, "step_physics": 0.09663102944691976, "survival_time": 14.950000000000076, "driven_lanedir": 1.5497499086356832, "get_state_dump": 0.019940962791442873, "sim_render-ego": 0.00961341937383016, "in-drivable-lane": 6.700000000000094, "agent_compute-ego": 0.030811091264088947, "deviation-heading": 1.5231474049913831, "complete-iteration": 0.2621610196431478, "set_robot_commands": 0.008264981905619303, "deviation-center-line": 0.2558600841034041, "driven_lanedir_consec": 1.5497499086356832, "sim_compute_sim_state": 0.018025707403818765, "sim_compute_performance-ego": 0.006665971279144287, "sim_compute_robot_state-ego": 0.012536703745524088, "sim_compute_robot_state-parked0": 0.012156935532887776}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.3612199864800116, "get_ui_image": 0.044825900395711264, "step_physics": 0.0983264422416687, "survival_time": 14.950000000000076, "driven_lanedir": 3.330846703276853, "get_state_dump": 0.020283777713775635, "sim_render-ego": 0.009689266681671143, "in-drivable-lane": 0.0, "agent_compute-ego": 0.054347505569458006, "deviation-heading": 1.4309072608047428, "complete-iteration": 0.28924724022547404, "set_robot_commands": 0.008469321727752686, "deviation-center-line": 0.386256345826864, "driven_lanedir_consec": 3.330846703276853, "sim_compute_sim_state": 0.021184024016062415, "sim_compute_performance-ego": 0.006803514162699382, "sim_compute_robot_state-ego": 0.012835143407185872, "sim_compute_robot_state-parked0": 0.012248619397481285}}
set_robot_commands_max0.008469321727752686
set_robot_commands_mean0.008149015704790753
set_robot_commands_median0.00821783979733785
set_robot_commands_min0.0076910614967346195
sim_compute_performance-ego_max0.006803514162699382
sim_compute_performance-ego_mean0.0066069549322128295
sim_compute_performance-ego_median0.006607728401819865
sim_compute_performance-ego_min0.006408848762512207
sim_compute_robot_state-ego_max0.012835143407185872
sim_compute_robot_state-ego_mean0.012339763243993124
sim_compute_robot_state-ego_median0.012450112104415894
sim_compute_robot_state-ego_min0.011623685359954831
sim_compute_robot_state-parked0_max0.012248619397481285
sim_compute_robot_state-parked0_mean0.011959431370099385
sim_compute_robot_state-parked0_median0.01211427370707194
sim_compute_robot_state-parked0_min0.01136055866877238
sim_compute_sim_state_max0.02198357105255127
sim_compute_sim_state_mean0.020398728052775063
sim_compute_sim_state_median0.02079281687736511
sim_compute_sim_state_min0.018025707403818765
sim_render-ego_max0.009689266681671143
sim_render-ego_mean0.009531678954760234
sim_render-ego_median0.009610756238301595
sim_render-ego_min0.009215936660766602
simulation-passed1
step_physics_max0.0983264422416687
step_physics_mean0.09437902132670084
step_physics_median0.09491801063219708
step_physics_min0.08935362180074057
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3658010054Olga (Ge Ya) XuΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg05-7d9c5d9f1ec5-10:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.553567586132095
survival_time_median10.675000000000017
deviation-center-line_median0.4792127767671678
in-drivable-lane_median2.324999999999992


other stats
agent_compute-ego_max0.06796785513559978
agent_compute-ego_mean0.0568538099763837
agent_compute-ego_median0.0647745095514457
agent_compute-ego_min0.02989836566704364
complete-iteration_max0.3172278536690606
complete-iteration_mean0.2902626413147297
complete-iteration_median0.2970581930688342
complete-iteration_min0.2497063254521898
deviation-center-line_max0.8973833423765681
deviation-center-line_mean0.5004887428832866
deviation-center-line_min0.14614607562224283
deviation-heading_max2.184799359181248
deviation-heading_mean0.9445064015969366
deviation-heading_median0.642300755163856
deviation-heading_min0.3086247368787864
driven_any_max3.7507063155464735
driven_any_mean2.921306576293118
driven_any_median2.846631055832445
driven_any_min2.2412578779611096
driven_lanedir_consec_max3.698168393603101
driven_lanedir_consec_mean1.8720650474291785
driven_lanedir_consec_min0.6829566238494221
driven_lanedir_max3.698168393603101
driven_lanedir_mean1.8720650474291785
driven_lanedir_median1.553567586132095
driven_lanedir_min0.6829566238494221
get_state_dump_max0.021770567069818943
get_state_dump_mean0.02000266424008363
get_state_dump_median0.019607430933493264
get_state_dump_min0.019025228023529052
get_ui_image_max0.04849137494593491
get_ui_image_mean0.046025276279509725
get_ui_image_median0.04551753079366384
get_ui_image_min0.04457466858477631
in-drivable-lane_max10.100000000000056
in-drivable-lane_mean3.68750000000001
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2412578779611096, "get_ui_image": 0.04457466858477631, "step_physics": 0.0904960415580056, "survival_time": 6.0499999999999865, "driven_lanedir": 1.2687635705099771, "get_state_dump": 0.019543811309436138, "sim_render-ego": 0.008754925294355913, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.02989836566704364, "deviation-heading": 0.3086247368787864, "complete-iteration": 0.2497063254521898, "set_robot_commands": 0.0065362098788426925, "deviation-center-line": 0.2959597777401097, "driven_lanedir_consec": 1.2687635705099771, "sim_compute_sim_state": 0.021588055555485496, "sim_compute_performance-ego": 0.005949883421590505, "sim_compute_robot_state-ego": 0.01049483315018583, "sim_compute_robot_state-parked0": 0.011632562668855526}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.834120794003253, "get_ui_image": 0.04849137494593491, "step_physics": 0.10428731382629018, "survival_time": 8.09999999999998, "driven_lanedir": 1.8383716017542129, "get_state_dump": 0.021770567069818943, "sim_render-ego": 0.010653768056704677, "in-drivable-lane": 2.3499999999999925, "agent_compute-ego": 0.06322534290360815, "deviation-heading": 0.5136971370108879, "complete-iteration": 0.3172278536690606, "set_robot_commands": 0.010242044189829883, "deviation-center-line": 0.6624657757942258, "driven_lanedir_consec": 1.8383716017542129, "sim_compute_sim_state": 0.023931422351319113, "sim_compute_performance-ego": 0.007539225213321639, "sim_compute_robot_state-ego": 0.012938486205206975, "sim_compute_robot_state-parked0": 0.01391456303773103}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.859141317661637, "get_ui_image": 0.045954308419857384, "step_physics": 0.09638019147908912, "survival_time": 13.250000000000052, "driven_lanedir": 0.6829566238494221, "get_state_dump": 0.019671050557550394, "sim_render-ego": 0.009557336231447616, "in-drivable-lane": 10.100000000000056, "agent_compute-ego": 0.06632367619928324, "deviation-heading": 0.7709043733168242, "complete-iteration": 0.29230347669349527, "set_robot_commands": 0.00798488293053969, "deviation-center-line": 0.14614607562224283, "driven_lanedir_consec": 0.6829566238494221, "sim_compute_sim_state": 0.015974938194706755, "sim_compute_performance-ego": 0.0066116674891058, "sim_compute_robot_state-ego": 0.011815969899015606, "sim_compute_robot_state-parked0": 0.01178784190483813}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.7507063155464735, "get_ui_image": 0.045080753167470296, "step_physics": 0.10054443836212158, "survival_time": 14.950000000000076, "driven_lanedir": 3.698168393603101, "get_state_dump": 0.019025228023529052, "sim_render-ego": 0.009470401604970296, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06796785513559978, "deviation-heading": 2.184799359181248, "complete-iteration": 0.30181290944417316, "set_robot_commands": 0.007850124835968017, "deviation-center-line": 0.8973833423765681, "driven_lanedir_consec": 3.698168393603101, "sim_compute_sim_state": 0.02163492520650228, "sim_compute_performance-ego": 0.006513017813364665, "sim_compute_robot_state-ego": 0.011799134413401286, "sim_compute_robot_state-parked0": 0.011689578692118329}}
set_robot_commands_max0.010242044189829883
set_robot_commands_mean0.008153315458795071
set_robot_commands_median0.007917503883253853
set_robot_commands_min0.0065362098788426925
sim_compute_performance-ego_max0.007539225213321639
sim_compute_performance-ego_mean0.0066534484843456514
sim_compute_performance-ego_median0.006562342651235233
sim_compute_performance-ego_min0.005949883421590505
sim_compute_robot_state-ego_max0.012938486205206975
sim_compute_robot_state-ego_mean0.011762105916952426
sim_compute_robot_state-ego_median0.011807552156208446
sim_compute_robot_state-ego_min0.01049483315018583
sim_compute_robot_state-parked0_max0.01391456303773103
sim_compute_robot_state-parked0_mean0.012256136575885751
sim_compute_robot_state-parked0_median0.011738710298478228
sim_compute_robot_state-parked0_min0.011632562668855526
sim_compute_sim_state_max0.023931422351319113
sim_compute_sim_state_mean0.02078233532700341
sim_compute_sim_state_median0.021611490380993886
sim_compute_sim_state_min0.015974938194706755
sim_render-ego_max0.010653768056704677
sim_render-ego_mean0.009609107796869625
sim_render-ego_median0.009513868918208957
sim_render-ego_min0.008754925294355913
simulation-passed1
step_physics_max0.10428731382629018
step_physics_mean0.09792699630637662
step_physics_median0.09846231492060536
step_physics_min0.0904960415580056
survival_time_max14.950000000000076
survival_time_mean10.587500000000023
survival_time_min6.0499999999999865
No reset possible
3657810052Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2901390684423424
survival_time_median14.950000000000076
deviation-center-line_median0.6513705206040911
in-drivable-lane_median1.3500000000000192


other stats
agent_compute-ego_max0.07032281716664632
agent_compute-ego_mean0.04205688083002753
agent_compute-ego_median0.03340985345502272
agent_compute-ego_min0.031084999243418374
complete-iteration_max0.3058530894915263
complete-iteration_mean0.27152416656203304
complete-iteration_median0.26235736151113576
complete-iteration_min0.2555288537343343
deviation-center-line_max0.9972600250513586
deviation-center-line_mean0.6390657635458777
deviation-center-line_min0.25626198792397026
deviation-heading_max1.455729231010686
deviation-heading_mean1.187455183439291
deviation-heading_median1.1728916399759233
deviation-heading_min0.948308222794631
driven_any_max2.646113494116107
driven_any_mean2.5140356522233755
driven_any_median2.5205320008266545
driven_any_min2.368965113124086
driven_lanedir_consec_max2.6155599958703584
driven_lanedir_consec_mean2.203749566390823
driven_lanedir_consec_min1.619160132808249
driven_lanedir_max2.6155599958703584
driven_lanedir_mean2.203749566390823
driven_lanedir_median2.2901390684423424
driven_lanedir_min1.619160132808249
get_state_dump_max0.02001266783856331
get_state_dump_mean0.019806170231061623
get_state_dump_median0.019802634716033933
get_state_dump_min0.01960674365361531
get_ui_image_max0.04568293491999308
get_ui_image_mean0.04526372178649226
get_ui_image_median0.04531593450417755
get_ui_image_min0.04474008321762085
in-drivable-lane_max4.300000000000061
in-drivable-lane_mean1.7500000000000249
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.368965113124086, "get_ui_image": 0.045063392490359906, "step_physics": 0.09500962115348652, "survival_time": 14.100000000000064, "driven_lanedir": 1.619160132808249, "get_state_dump": 0.02001266783856331, "sim_render-ego": 0.009272516196501173, "in-drivable-lane": 4.300000000000061, "agent_compute-ego": 0.031613630605927596, "deviation-heading": 1.042381310741979, "complete-iteration": 0.2582108509456012, "set_robot_commands": 0.006628906473200372, "deviation-center-line": 0.25626198792397026, "driven_lanedir_consec": 1.619160132808249, "sim_compute_sim_state": 0.022136073585943127, "sim_compute_performance-ego": 0.006611767390095596, "sim_compute_robot_state-ego": 0.010551068799715516, "sim_compute_robot_state-parked0": 0.01106973150943188}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.5743682963989776, "get_ui_image": 0.04474008321762085, "step_physics": 0.09058642625808716, "survival_time": 14.950000000000076, "driven_lanedir": 2.565415726607112, "get_state_dump": 0.019911775588989256, "sim_render-ego": 0.009542296727498373, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031084999243418374, "deviation-heading": 0.948308222794631, "complete-iteration": 0.2555288537343343, "set_robot_commands": 0.007923324902852377, "deviation-center-line": 0.4944088127183637, "driven_lanedir_consec": 2.565415726607112, "sim_compute_sim_state": 0.020896523793538412, "sim_compute_performance-ego": 0.006672004063924154, "sim_compute_robot_state-ego": 0.012003210385640464, "sim_compute_robot_state-parked0": 0.011921958128611248}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.466695705254331, "get_ui_image": 0.0455684765179952, "step_physics": 0.10061221202214558, "survival_time": 14.950000000000076, "driven_lanedir": 2.0148624102775727, "get_state_dump": 0.01960674365361531, "sim_render-ego": 0.009550185203552244, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.03520607630411784, "deviation-heading": 1.455729231010686, "complete-iteration": 0.2665038720766703, "set_robot_commands": 0.007706195513407389, "deviation-center-line": 0.9972600250513586, "driven_lanedir_consec": 2.0148624102775727, "sim_compute_sim_state": 0.017757709821065268, "sim_compute_performance-ego": 0.00662734587987264, "sim_compute_robot_state-ego": 0.011747060616811116, "sim_compute_robot_state-parked0": 0.011890623569488524}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.646113494116107, "get_ui_image": 0.04568293491999308, "step_physics": 0.10470538059870402, "survival_time": 14.950000000000076, "driven_lanedir": 2.6155599958703584, "get_state_dump": 0.019693493843078613, "sim_render-ego": 0.008947623570760092, "in-drivable-lane": 0.0, "agent_compute-ego": 0.07032281716664632, "deviation-heading": 1.3034019692098675, "complete-iteration": 0.3058530894915263, "set_robot_commands": 0.007059937318166097, "deviation-center-line": 0.8083322284898184, "driven_lanedir_consec": 2.6155599958703584, "sim_compute_sim_state": 0.021382129192352297, "sim_compute_performance-ego": 0.005873061021169026, "sim_compute_robot_state-ego": 0.010489051342010496, "sim_compute_robot_state-parked0": 0.011454482078552248}}
set_robot_commands_max0.007923324902852377
set_robot_commands_mean0.007329591051906559
set_robot_commands_median0.007383066415786743
set_robot_commands_min0.006628906473200372
sim_compute_performance-ego_max0.006672004063924154
sim_compute_performance-ego_mean0.006446044588765354
sim_compute_performance-ego_median0.006619556634984118
sim_compute_performance-ego_min0.005873061021169026
sim_compute_robot_state-ego_max0.012003210385640464
sim_compute_robot_state-ego_mean0.011197597786044398
sim_compute_robot_state-ego_median0.011149064708263316
sim_compute_robot_state-ego_min0.010489051342010496
sim_compute_robot_state-parked0_max0.011921958128611248
sim_compute_robot_state-parked0_mean0.011584198821520977
sim_compute_robot_state-parked0_median0.011672552824020386
sim_compute_robot_state-parked0_min0.01106973150943188
sim_compute_sim_state_max0.022136073585943127
sim_compute_sim_state_mean0.020543109098224772
sim_compute_sim_state_median0.02113932649294535
sim_compute_sim_state_min0.017757709821065268
sim_render-ego_max0.009550185203552244
sim_render-ego_mean0.009328155424577971
sim_render-ego_median0.009407406461999772
sim_render-ego_min0.008947623570760092
simulation-passed1
step_physics_max0.10470538059870402
step_physics_mean0.09772841000810584
step_physics_median0.09781091658781606
step_physics_min0.09058642625808716
survival_time_max14.950000000000076
survival_time_mean14.737500000000075
survival_time_min14.100000000000064
No reset possible
3657110047Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.873391569289813
survival_time_median14.37500000000007
deviation-center-line_median0.315354436842198
in-drivable-lane_median3.550000000000033


other stats
agent_compute-ego_max0.029229545362905604
agent_compute-ego_mean0.02853784525328941
agent_compute-ego_median0.028632337629038843
agent_compute-ego_min0.027657160392174356
complete-iteration_max0.2679022133767188
complete-iteration_mean0.25884029743081854
complete-iteration_median0.25793116624804513
complete-iteration_min0.25159664385046515
deviation-center-line_max0.701814473010578
deviation-center-line_mean0.3784059326888795
deviation-center-line_min0.1811003840605443
deviation-heading_max3.901736887727743
deviation-heading_mean1.7789659900435555
deviation-heading_median1.171045969163488
deviation-heading_min0.8720351341195028
driven_any_max2.879006487368793
driven_any_mean2.5130136576351942
driven_any_median2.627583130074337
driven_any_min1.9178818830233095
driven_lanedir_consec_max2.0349764717211074
driven_lanedir_consec_mean1.7999352729877054
driven_lanedir_consec_min1.4179814816500886
driven_lanedir_max2.0349764717211074
driven_lanedir_mean1.7999352729877054
driven_lanedir_median1.873391569289813
driven_lanedir_min1.4179814816500886
get_state_dump_max0.01881209850311279
get_state_dump_mean0.018474954972520767
get_state_dump_median0.01869294857936177
get_state_dump_min0.01770182422824673
get_ui_image_max0.04626022518931569
get_ui_image_mean0.04547049283061699
get_ui_image_median0.045561581141706824
get_ui_image_min0.04449858384973863
in-drivable-lane_max4.0500000000000576
in-drivable-lane_mean3.5125000000000384
in-drivable-lane_min2.9000000000000306
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9178818830233095, "get_ui_image": 0.044997426046841385, "step_physics": 0.09474361345963778, "survival_time": 10.350000000000012, "driven_lanedir": 1.4179814816500886, "get_state_dump": 0.018667638013904225, "sim_render-ego": 0.0095153350185081, "in-drivable-lane": 2.9000000000000306, "agent_compute-ego": 0.029229545362905604, "deviation-heading": 0.8720351341195028, "complete-iteration": 0.25859921565954236, "set_robot_commands": 0.007883536066985936, "deviation-center-line": 0.1811003840605443, "driven_lanedir_consec": 1.4179814816500886, "sim_compute_sim_state": 0.022960388718019937, "sim_compute_performance-ego": 0.006440477094788483, "sim_compute_robot_state-ego": 0.012433197187340778, "sim_compute_robot_state-parked0": 0.011501338746812608}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.879006487368793, "get_ui_image": 0.04449858384973863, "step_physics": 0.0929950950054974, "survival_time": 14.45000000000007, "driven_lanedir": 2.0349764717211074, "get_state_dump": 0.01871825914481932, "sim_render-ego": 0.009305850857269394, "in-drivable-lane": 3.950000000000056, "agent_compute-ego": 0.028953182656047252, "deviation-heading": 1.1972780859131849, "complete-iteration": 0.25159664385046515, "set_robot_commands": 0.007490815588347227, "deviation-center-line": 0.3228850846308518, "driven_lanedir_consec": 2.0349764717211074, "sim_compute_sim_state": 0.020369146109452296, "sim_compute_performance-ego": 0.006207708668956295, "sim_compute_robot_state-ego": 0.01147975146151744, "sim_compute_robot_state-parked0": 0.011357154813192294}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.414057975673198, "get_ui_image": 0.04612573623657226, "step_physics": 0.09865629514058433, "survival_time": 14.950000000000076, "driven_lanedir": 1.767092013400713, "get_state_dump": 0.01881209850311279, "sim_render-ego": 0.009400876363118487, "in-drivable-lane": 3.15000000000001, "agent_compute-ego": 0.028311492602030437, "deviation-heading": 3.901736887727743, "complete-iteration": 0.25726311683654784, "set_robot_commands": 0.008006420930226644, "deviation-center-line": 0.701814473010578, "driven_lanedir_consec": 1.767092013400713, "sim_compute_sim_state": 0.017494589487711588, "sim_compute_performance-ego": 0.00661672830581665, "sim_compute_robot_state-ego": 0.012031859556833904, "sim_compute_robot_state-parked0": 0.011582462787628174}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8411082844754763, "get_ui_image": 0.04626022518931569, "step_physics": 0.10802878199757396, "survival_time": 14.300000000000068, "driven_lanedir": 1.9796911251789129, "get_state_dump": 0.01770182422824673, "sim_render-ego": 0.00929915404819942, "in-drivable-lane": 4.0500000000000576, "agent_compute-ego": 0.027657160392174356, "deviation-heading": 1.1448138524137914, "complete-iteration": 0.2679022133767188, "set_robot_commands": 0.007502775092224975, "deviation-center-line": 0.3078237890535442, "driven_lanedir_consec": 1.9796911251789129, "sim_compute_sim_state": 0.022032030812510244, "sim_compute_performance-ego": 0.006351405090385383, "sim_compute_robot_state-ego": 0.011305314677578586, "sim_compute_robot_state-parked0": 0.01155285318414648}}
set_robot_commands_max0.008006420930226644
set_robot_commands_mean0.007720886919446196
set_robot_commands_median0.007693155579605456
set_robot_commands_min0.007490815588347227
sim_compute_performance-ego_max0.00661672830581665
sim_compute_performance-ego_mean0.006404079789986703
sim_compute_performance-ego_median0.006395941092586933
sim_compute_performance-ego_min0.006207708668956295
sim_compute_robot_state-ego_max0.012433197187340778
sim_compute_robot_state-ego_mean0.011812530720817678
sim_compute_robot_state-ego_median0.011755805509175671
sim_compute_robot_state-ego_min0.011305314677578586
sim_compute_robot_state-parked0_max0.011582462787628174
sim_compute_robot_state-parked0_mean0.01149845238294489
sim_compute_robot_state-parked0_median0.011527095965479545
sim_compute_robot_state-parked0_min0.011357154813192294
sim_compute_sim_state_max0.022960388718019937
sim_compute_sim_state_mean0.020714038781923516
sim_compute_sim_state_median0.02120058846098127
sim_compute_sim_state_min0.017494589487711588
sim_render-ego_max0.0095153350185081
sim_render-ego_mean0.009380304071773852
sim_render-ego_median0.00935336361019394
sim_render-ego_min0.00929915404819942
simulation-passed1
step_physics_max0.10802878199757396
step_physics_mean0.09860594640082336
step_physics_median0.09669995430011104
step_physics_min0.0929950950054974
survival_time_max14.950000000000076
survival_time_mean13.512500000000056
survival_time_min10.350000000000012
No reset possible
3656610044Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9377892432263757
survival_time_median14.950000000000076
deviation-center-line_median0.35327649658735816
in-drivable-lane_median2.4250000000000345


other stats
agent_compute-ego_max0.0301473331451416
agent_compute-ego_mean0.029470559159914655
agent_compute-ego_median0.02959524154663086
agent_compute-ego_min0.02854442040125529
complete-iteration_max0.2676411851247152
complete-iteration_mean0.2596173616250356
complete-iteration_median0.2592352302869161
complete-iteration_min0.25235780080159503
deviation-center-line_max0.684260162840181
deviation-center-line_mean0.4093422540064606
deviation-center-line_min0.2465558600109452
deviation-heading_max3.641325412361874
deviation-heading_mean1.7856889754246548
deviation-heading_median1.2059778787703173
deviation-heading_min1.0894747317961109
driven_any_max2.571706847927031
driven_any_mean2.357816380071664
driven_any_median2.3840260777977584
driven_any_min2.0915065167641087
driven_lanedir_consec_max2.430489579124833
driven_lanedir_consec_mean1.9252204285539551
driven_lanedir_consec_min1.3948136486382363
driven_lanedir_max2.430489579124833
driven_lanedir_mean1.9252204285539551
driven_lanedir_median1.9377892432263757
driven_lanedir_min1.3948136486382363
get_state_dump_max0.019290245374043783
get_state_dump_mean0.018948906461397807
get_state_dump_median0.018956716458002724
get_state_dump_min0.018591947555541992
get_ui_image_max0.04558240254720052
get_ui_image_mean0.044930947025616966
get_ui_image_median0.0448677126566569
get_ui_image_min0.044405960241953535
in-drivable-lane_max6.800000000000097
in-drivable-lane_mean2.9125000000000414
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3261207974489864, "get_ui_image": 0.04558240254720052, "step_physics": 0.09569501717885336, "survival_time": 14.950000000000076, "driven_lanedir": 1.3948136486382363, "get_state_dump": 0.019199068546295165, "sim_render-ego": 0.009602689743041992, "in-drivable-lane": 6.800000000000097, "agent_compute-ego": 0.02983436663945516, "deviation-heading": 1.0894747317961109, "complete-iteration": 0.26120405515034995, "set_robot_commands": 0.00806741714477539, "deviation-center-line": 0.2465558600109452, "driven_lanedir_consec": 1.3948136486382363, "sim_compute_sim_state": 0.02194518566131592, "sim_compute_performance-ego": 0.006735947926839193, "sim_compute_robot_state-ego": 0.012323464552561442, "sim_compute_robot_state-parked0": 0.011991589069366456}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.571706847927031, "get_ui_image": 0.04448224623998006, "step_physics": 0.0933580748240153, "survival_time": 14.950000000000076, "driven_lanedir": 1.994830198516504, "get_state_dump": 0.018591947555541992, "sim_render-ego": 0.009299929936726887, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.02854442040125529, "deviation-heading": 1.232807492255342, "complete-iteration": 0.25235780080159503, "set_robot_commands": 0.00776548703511556, "deviation-center-line": 0.316941478399293, "driven_lanedir_consec": 1.994830198516504, "sim_compute_sim_state": 0.020024596850077313, "sim_compute_performance-ego": 0.006592844327290853, "sim_compute_robot_state-ego": 0.01184852123260498, "sim_compute_robot_state-parked0": 0.01163733720779419}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.0915065167641087, "get_ui_image": 0.04525317907333374, "step_physics": 0.1015067227681478, "survival_time": 14.950000000000076, "driven_lanedir": 1.8807482879362472, "get_state_dump": 0.018714364369710287, "sim_render-ego": 0.00912682294845581, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.02935611645380656, "deviation-heading": 3.641325412361874, "complete-iteration": 0.2572664054234823, "set_robot_commands": 0.007554565270741781, "deviation-center-line": 0.684260162840181, "driven_lanedir_consec": 1.8807482879362472, "sim_compute_sim_state": 0.016492958068847655, "sim_compute_performance-ego": 0.006346472899119059, "sim_compute_robot_state-ego": 0.01135096311569214, "sim_compute_robot_state-parked0": 0.01135043780008952}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4419313581465305, "get_ui_image": 0.044405960241953535, "step_physics": 0.10390336831410726, "survival_time": 14.950000000000076, "driven_lanedir": 2.430489579124833, "get_state_dump": 0.019290245374043783, "sim_render-ego": 0.00939848264058431, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0301473331451416, "deviation-heading": 1.1791482652852925, "complete-iteration": 0.2676411851247152, "set_robot_commands": 0.007913422584533692, "deviation-center-line": 0.3896115147754233, "driven_lanedir_consec": 2.430489579124833, "sim_compute_sim_state": 0.020411625703175864, "sim_compute_performance-ego": 0.006568226814270019, "sim_compute_robot_state-ego": 0.013461395899454751, "sim_compute_robot_state-parked0": 0.011918460528055829}}
set_robot_commands_max0.00806741714477539
set_robot_commands_mean0.007825223008791606
set_robot_commands_median0.007839454809824627
set_robot_commands_min0.007554565270741781
sim_compute_performance-ego_max0.006735947926839193
sim_compute_performance-ego_mean0.006560872991879781
sim_compute_performance-ego_median0.006580535570780436
sim_compute_performance-ego_min0.006346472899119059
sim_compute_robot_state-ego_max0.013461395899454751
sim_compute_robot_state-ego_mean0.01224608620007833
sim_compute_robot_state-ego_median0.012085992892583212
sim_compute_robot_state-ego_min0.01135096311569214
sim_compute_robot_state-parked0_max0.011991589069366456
sim_compute_robot_state-parked0_mean0.011724456151326498
sim_compute_robot_state-parked0_median0.011777898867925008
sim_compute_robot_state-parked0_min0.01135043780008952
sim_compute_sim_state_max0.02194518566131592
sim_compute_sim_state_mean0.019718591570854187
sim_compute_sim_state_median0.020218111276626587
sim_compute_sim_state_min0.016492958068847655
sim_render-ego_max0.009602689743041992
sim_render-ego_mean0.00935698131720225
sim_render-ego_median0.009349206288655598
sim_render-ego_min0.00912682294845581
simulation-passed1
step_physics_max0.10390336831410726
step_physics_mean0.09861579577128092
step_physics_median0.09860086997350057
step_physics_min0.0933580748240153
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3656310042Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4284879808509017
survival_time_median14.950000000000076
deviation-center-line_median0.36220740018979025
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.030255920092264812
agent_compute-ego_mean0.029662860035896303
agent_compute-ego_median0.029767179489135744
agent_compute-ego_min0.02886116107304891
complete-iteration_max0.26512487888336184
complete-iteration_mean0.25750830173492434
complete-iteration_median0.2577801410357158
complete-iteration_min0.249348045984904
deviation-center-line_max0.4548762342441454
deviation-center-line_mean0.32072050975515964
deviation-center-line_min0.1035910043969126
deviation-heading_max1.0618944027720074
deviation-heading_mean0.720856198706626
deviation-heading_median0.7255651583168039
deviation-heading_min0.3704000754208888
driven_any_max1.4338141118299168
driven_any_mean1.4305538637728412
driven_any_median1.42947237855988
driven_any_min1.4294565861416886
driven_lanedir_consec_max1.4294882768492096
driven_lanedir_consec_mean1.21073872563795
driven_lanedir_consec_min0.5564906640007875
driven_lanedir_max1.4294882768492096
driven_lanedir_mean1.21073872563795
driven_lanedir_median1.4284879808509017
driven_lanedir_min0.5564906640007875
get_state_dump_max0.020792054335276287
get_state_dump_mean0.020172269344329835
get_state_dump_median0.020112500190734864
get_state_dump_min0.019672022660573323
get_ui_image_max0.04546472549438477
get_ui_image_mean0.0447334223985672
get_ui_image_median0.0447102153301239
get_ui_image_min0.04404853343963623
in-drivable-lane_max8.650000000000091
in-drivable-lane_mean2.1625000000000227
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4338141118299168, "get_ui_image": 0.04546472549438477, "step_physics": 0.09306116024653116, "survival_time": 14.950000000000076, "driven_lanedir": 1.4294882768492096, "get_state_dump": 0.0196826163927714, "sim_render-ego": 0.00993274450302124, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02886116107304891, "deviation-heading": 0.9465298643306226, "complete-iteration": 0.2575748912493388, "set_robot_commands": 0.00812724510828654, "deviation-center-line": 0.4548762342441454, "driven_lanedir_consec": 1.4294882768492096, "sim_compute_sim_state": 0.020914158821105956, "sim_compute_performance-ego": 0.006831874052683512, "sim_compute_robot_state-ego": 0.012506543000539144, "sim_compute_robot_state-parked0": 0.011962544918060303}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.4294718869884082, "get_ui_image": 0.04433774789174398, "step_physics": 0.08846352895100912, "survival_time": 14.950000000000076, "driven_lanedir": 1.4281801536824357, "get_state_dump": 0.019672022660573323, "sim_render-ego": 0.009658776919047036, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029406630198160807, "deviation-heading": 0.5046004523029852, "complete-iteration": 0.249348045984904, "set_robot_commands": 0.00769566535949707, "deviation-center-line": 0.1035910043969126, "driven_lanedir_consec": 1.4281801536824357, "sim_compute_sim_state": 0.019472165902455648, "sim_compute_performance-ego": 0.0066202950477600095, "sim_compute_robot_state-ego": 0.011959619522094726, "sim_compute_robot_state-parked0": 0.01182820479075114}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.4294565861416886, "get_ui_image": 0.04508268276850382, "step_physics": 0.09861036856969198, "survival_time": 14.950000000000076, "driven_lanedir": 0.5564906640007875, "get_state_dump": 0.020792054335276287, "sim_render-ego": 0.00937559684117635, "in-drivable-lane": 8.650000000000091, "agent_compute-ego": 0.030127728780110677, "deviation-heading": 1.0618944027720074, "complete-iteration": 0.2579853908220927, "set_robot_commands": 0.007356398105621338, "deviation-center-line": 0.33469284572308955, "driven_lanedir_consec": 0.5564906640007875, "sim_compute_sim_state": 0.016571380297342935, "sim_compute_performance-ego": 0.0064050404230753585, "sim_compute_robot_state-ego": 0.011701319217681885, "sim_compute_robot_state-parked0": 0.011721586386362712}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.4294728701313515, "get_ui_image": 0.04404853343963623, "step_physics": 0.10232609033584594, "survival_time": 14.950000000000076, "driven_lanedir": 1.4287958080193672, "get_state_dump": 0.02054238398869832, "sim_render-ego": 0.00959970235824585, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030255920092264812, "deviation-heading": 0.3704000754208888, "complete-iteration": 0.26512487888336184, "set_robot_commands": 0.007748354276021322, "deviation-center-line": 0.38972195465649095, "driven_lanedir_consec": 1.4287958080193672, "sim_compute_sim_state": 0.01941382646560669, "sim_compute_performance-ego": 0.006706376075744629, "sim_compute_robot_state-ego": 0.012240700721740725, "sim_compute_robot_state-parked0": 0.01199918746948242}}
set_robot_commands_max0.00812724510828654
set_robot_commands_mean0.007731915712356568
set_robot_commands_median0.007722009817759196
set_robot_commands_min0.007356398105621338
sim_compute_performance-ego_max0.006831874052683512
sim_compute_performance-ego_mean0.006640896399815878
sim_compute_performance-ego_median0.006663335561752319
sim_compute_performance-ego_min0.0064050404230753585
sim_compute_robot_state-ego_max0.012506543000539144
sim_compute_robot_state-ego_mean0.01210204561551412
sim_compute_robot_state-ego_median0.012100160121917725
sim_compute_robot_state-ego_min0.011701319217681885
sim_compute_robot_state-parked0_max0.01199918746948242
sim_compute_robot_state-parked0_mean0.011877880891164145
sim_compute_robot_state-parked0_median0.011895374854405722
sim_compute_robot_state-parked0_min0.011721586386362712
sim_compute_sim_state_max0.020914158821105956
sim_compute_sim_state_mean0.019092882871627807
sim_compute_sim_state_median0.01944299618403117
sim_compute_sim_state_min0.016571380297342935
sim_render-ego_max0.00993274450302124
sim_render-ego_mean0.00964170515537262
sim_render-ego_median0.009629239638646444
sim_render-ego_min0.00937559684117635
simulation-passed1
step_physics_max0.10232609033584594
step_physics_mean0.09561528702576956
step_physics_median0.09583576440811158
step_physics_min0.08846352895100912
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3656010041Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7018701351462566
survival_time_median13.950000000000063
deviation-center-line_median0.32311944495662337
in-drivable-lane_median3.800000000000048


other stats
agent_compute-ego_max0.03045167605082194
agent_compute-ego_mean0.030139758394717
agent_compute-ego_median0.03010109624576334
agent_compute-ego_min0.02990516503651937
complete-iteration_max0.26266983577183317
complete-iteration_mean0.253286332728778
complete-iteration_median0.25203877409299213
complete-iteration_min0.24639794695729444
deviation-center-line_max0.6703940379229422
deviation-center-line_mean0.38420081724375976
deviation-center-line_min0.22017034113885003
deviation-heading_max3.0901756579609323
deviation-heading_mean1.779909870606299
deviation-heading_median1.5958737501841491
deviation-heading_min0.8377163240959659
driven_any_max2.935015191722636
driven_any_mean2.5417730593143424
driven_any_median2.477360773487086
driven_any_min2.2773554985605613
driven_lanedir_consec_max2.692628623172846
driven_lanedir_consec_mean1.68725863579047
driven_lanedir_consec_min0.6526656496965214
driven_lanedir_max2.692628623172846
driven_lanedir_mean1.715942212002004
driven_lanedir_median1.7018701351462566
driven_lanedir_min0.7673999545426572
get_state_dump_max0.020146762268452703
get_state_dump_mean0.01996126934809996
get_state_dump_median0.020092716843004853
get_state_dump_min0.019512881437937415
get_ui_image_max0.04482611735661825
get_ui_image_mean0.04405883119871386
get_ui_image_median0.044021448818249855
get_ui_image_min0.04336630980173747
in-drivable-lane_max9.20000000000009
in-drivable-lane_mean4.512500000000051
in-drivable-lane_min1.2500000000000178
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2773554985605613, "get_ui_image": 0.043505327611029904, "step_physics": 0.08856620567257394, "survival_time": 11.850000000000032, "driven_lanedir": 1.4384268172034966, "get_state_dump": 0.020146762268452703, "sim_render-ego": 0.008947660148395264, "in-drivable-lane": 4.5000000000000515, "agent_compute-ego": 0.03016731809463179, "deviation-heading": 0.8377163240959659, "complete-iteration": 0.24639794695729444, "set_robot_commands": 0.006407490259484399, "deviation-center-line": 0.22017034113885003, "driven_lanedir_consec": 1.4384268172034966, "sim_compute_sim_state": 0.021347215909998125, "sim_compute_performance-ego": 0.005994570406177376, "sim_compute_robot_state-ego": 0.010188588613196265, "sim_compute_robot_state-parked0": 0.01089960915126881}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.935015191722636, "get_ui_image": 0.04336630980173747, "step_physics": 0.08973544200261434, "survival_time": 14.950000000000076, "driven_lanedir": 2.692628623172846, "get_state_dump": 0.020095338821411134, "sim_render-ego": 0.009091185728708902, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.02990516503651937, "deviation-heading": 2.1234858743707212, "complete-iteration": 0.24859073162078857, "set_robot_commands": 0.007015759150187174, "deviation-center-line": 0.6703940379229422, "driven_lanedir_consec": 2.692628623172846, "sim_compute_sim_state": 0.020499555269877116, "sim_compute_performance-ego": 0.006208860079447429, "sim_compute_robot_state-ego": 0.011128416061401369, "sim_compute_robot_state-parked0": 0.011322609583536784}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.50799581787321, "get_ui_image": 0.04482611735661825, "step_physics": 0.09567857503890992, "survival_time": 14.950000000000076, "driven_lanedir": 0.7673999545426572, "get_state_dump": 0.019512881437937415, "sim_render-ego": 0.009752949873606365, "in-drivable-lane": 9.20000000000009, "agent_compute-ego": 0.03045167605082194, "deviation-heading": 3.0901756579609323, "complete-iteration": 0.25548681656519573, "set_robot_commands": 0.008154563903808594, "deviation-center-line": 0.364049595568891, "driven_lanedir_consec": 0.6526656496965214, "sim_compute_sim_state": 0.015599191983540851, "sim_compute_performance-ego": 0.006765575408935547, "sim_compute_robot_state-ego": 0.012372827529907229, "sim_compute_robot_state-parked0": 0.012147775491078696}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4467257291009616, "get_ui_image": 0.044537570025469805, "step_physics": 0.09765592781273094, "survival_time": 12.950000000000047, "driven_lanedir": 1.9653134530890168, "get_state_dump": 0.020090094864598573, "sim_render-ego": 0.009630543845040458, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.030034874396894888, "deviation-heading": 1.0682616259975768, "complete-iteration": 0.26266983577183317, "set_robot_commands": 0.008025172134163757, "deviation-center-line": 0.2821892943443557, "driven_lanedir_consec": 1.9653134530890168, "sim_compute_sim_state": 0.021228069504255497, "sim_compute_performance-ego": 0.006839346241306614, "sim_compute_robot_state-ego": 0.01232761673945718, "sim_compute_robot_state-parked0": 0.01207394857664366}}
set_robot_commands_max0.008154563903808594
set_robot_commands_mean0.007400746361910981
set_robot_commands_median0.007520465642175466
set_robot_commands_min0.006407490259484399
sim_compute_performance-ego_max0.006839346241306614
sim_compute_performance-ego_mean0.006452088033966742
sim_compute_performance-ego_median0.006487217744191488
sim_compute_performance-ego_min0.005994570406177376
sim_compute_robot_state-ego_max0.012372827529907229
sim_compute_robot_state-ego_mean0.011504362235990507
sim_compute_robot_state-ego_median0.011728016400429274
sim_compute_robot_state-ego_min0.010188588613196265
sim_compute_robot_state-parked0_max0.012147775491078696
sim_compute_robot_state-parked0_mean0.011610985700631987
sim_compute_robot_state-parked0_median0.011698279080090222
sim_compute_robot_state-parked0_min0.01089960915126881
sim_compute_sim_state_max0.021347215909998125
sim_compute_sim_state_mean0.019668508166917897
sim_compute_sim_state_median0.020863812387066305
sim_compute_sim_state_min0.015599191983540851
sim_render-ego_max0.009752949873606365
sim_render-ego_mean0.009355584898937747
sim_render-ego_median0.00936086478687468
sim_render-ego_min0.008947660148395264
simulation-passed1
step_physics_max0.09765592781273094
step_physics_mean0.09290903763170728
step_physics_median0.09270700852076214
step_physics_min0.08856620567257394
survival_time_max14.950000000000076
survival_time_mean13.675000000000058
survival_time_min11.850000000000032
No reset possible
3655810028Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4851018518516352
survival_time_median14.950000000000076
deviation-center-line_median0.4851198053387045
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03132474899291992
agent_compute-ego_mean0.03099575797716777
agent_compute-ego_median0.031157819827397664
agent_compute-ego_min0.03034264326095581
complete-iteration_max0.2646828556060791
complete-iteration_mean0.25714843849341074
complete-iteration_median0.2582605707645416
complete-iteration_min0.24738975683848063
deviation-center-line_max0.49965921309454225
deviation-center-line_mean0.4564056021355268
deviation-center-line_min0.35572358477015614
deviation-heading_max1.226673322311376
deviation-heading_mean0.8966627958726063
deviation-heading_median0.8609960377506675
deviation-heading_min0.6379857856777146
driven_any_max1.5140634447365122
driven_any_mean1.479568358463244
driven_any_median1.4896652218622728
driven_any_min1.424879545391918
driven_lanedir_consec_max1.510773859478167
driven_lanedir_consec_mean1.4747225947272762
driven_lanedir_consec_min1.4179128157276684
driven_lanedir_max1.510773859478167
driven_lanedir_mean1.4747225947272762
driven_lanedir_median1.4851018518516352
driven_lanedir_min1.4179128157276684
get_state_dump_max0.020438944498697917
get_state_dump_mean0.020330390731493633
get_state_dump_median0.020387094020843505
get_state_dump_min0.0201084303855896
get_ui_image_max0.046688291231791176
get_ui_image_mean0.04541999379793803
get_ui_image_median0.045232534408569336
get_ui_image_min0.044526615142822266
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4712278854067316, "get_ui_image": 0.04562246640523275, "step_physics": 0.08776244640350342, "survival_time": 14.950000000000076, "driven_lanedir": 1.4658797513798416, "get_state_dump": 0.0201084303855896, "sim_render-ego": 0.009557262261708575, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03132474899291992, "deviation-heading": 0.9593183266563304, "complete-iteration": 0.2544116671880086, "set_robot_commands": 0.007850368817647299, "deviation-center-line": 0.4914119550986037, "driven_lanedir_consec": 1.4658797513798416, "sim_compute_sim_state": 0.02147575775782267, "sim_compute_performance-ego": 0.006663861274719238, "sim_compute_robot_state-ego": 0.011922139326731364, "sim_compute_robot_state-parked0": 0.011863176027933756}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.5140634447365122, "get_ui_image": 0.046688291231791176, "step_physics": 0.08869832515716553, "survival_time": 14.950000000000076, "driven_lanedir": 1.510773859478167, "get_state_dump": 0.020438944498697917, "sim_render-ego": 0.010223361651102702, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03106703519821167, "deviation-heading": 0.7626737488450045, "complete-iteration": 0.2621094743410746, "set_robot_commands": 0.009393951892852782, "deviation-center-line": 0.49965921309454225, "driven_lanedir_consec": 1.510773859478167, "sim_compute_sim_state": 0.02203317324320475, "sim_compute_performance-ego": 0.007411624590555827, "sim_compute_robot_state-ego": 0.013267465432484945, "sim_compute_robot_state-parked0": 0.012633993625640869}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.424879545391918, "get_ui_image": 0.044526615142822266, "step_physics": 0.09211639722188314, "survival_time": 14.950000000000076, "driven_lanedir": 1.4179128157276684, "get_state_dump": 0.020417651335398357, "sim_render-ego": 0.008919747670491536, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03124860445658366, "deviation-heading": 1.226673322311376, "complete-iteration": 0.24738975683848063, "set_robot_commands": 0.0063883360226949055, "deviation-center-line": 0.35572358477015614, "driven_lanedir_consec": 1.4179128157276684, "sim_compute_sim_state": 0.016222517490386962, "sim_compute_performance-ego": 0.00591901699701945, "sim_compute_robot_state-ego": 0.010286757946014405, "sim_compute_robot_state-parked0": 0.011101125876108803}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.508102558317814, "get_ui_image": 0.04484260241190592, "step_physics": 0.10231345097223918, "survival_time": 14.950000000000076, "driven_lanedir": 1.5043239523234286, "get_state_dump": 0.020356536706288657, "sim_render-ego": 0.009285391171773277, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03034264326095581, "deviation-heading": 0.6379857856777146, "complete-iteration": 0.2646828556060791, "set_robot_commands": 0.007639606793721517, "deviation-center-line": 0.47882765557880536, "driven_lanedir_consec": 1.5043239523234286, "sim_compute_sim_state": 0.0198529585202535, "sim_compute_performance-ego": 0.00644640604654948, "sim_compute_robot_state-ego": 0.011634212334950765, "sim_compute_robot_state-parked0": 0.011725599765777589}}
set_robot_commands_max0.009393951892852782
set_robot_commands_mean0.007818065881729126
set_robot_commands_median0.007744987805684408
set_robot_commands_min0.0063883360226949055
sim_compute_performance-ego_max0.007411624590555827
sim_compute_performance-ego_mean0.006610227227210998
sim_compute_performance-ego_median0.006555133660634359
sim_compute_performance-ego_min0.00591901699701945
sim_compute_robot_state-ego_max0.013267465432484945
sim_compute_robot_state-ego_mean0.01177764376004537
sim_compute_robot_state-ego_median0.011778175830841064
sim_compute_robot_state-ego_min0.010286757946014405
sim_compute_robot_state-parked0_max0.012633993625640869
sim_compute_robot_state-parked0_mean0.011830973823865255
sim_compute_robot_state-parked0_median0.011794387896855671
sim_compute_robot_state-parked0_min0.011101125876108803
sim_compute_sim_state_max0.02203317324320475
sim_compute_sim_state_mean0.01989610175291697
sim_compute_sim_state_median0.020664358139038087
sim_compute_sim_state_min0.016222517490386962
sim_render-ego_max0.010223361651102702
sim_render-ego_mean0.009496440688769025
sim_render-ego_median0.009421326716740926
sim_render-ego_min0.008919747670491536
simulation-passed1
step_physics_max0.10231345097223918
step_physics_mean0.09272265493869784
step_physics_median0.09040736118952432
step_physics_min0.08776244640350342
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3655610029Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.494553377787971
survival_time_median14.950000000000076
deviation-center-line_median0.5082192076691149
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.06982064008712768
agent_compute-ego_mean0.0425853564341863
agent_compute-ego_median0.035026522477467854
agent_compute-ego_min0.0304677406946818
complete-iteration_max0.3063118060429891
complete-iteration_mean0.2692582595348358
complete-iteration_median0.2596549387772878
complete-iteration_min0.25141135454177854
deviation-center-line_max0.7869171289482628
deviation-center-line_mean0.5672340005747352
deviation-center-line_min0.4655804580124483
deviation-heading_max2.4937483789713895
deviation-heading_mean1.2002187107818136
deviation-heading_median0.839944514165788
deviation-heading_min0.6272374358242886
driven_any_max1.5149378652143677
driven_any_mean1.483899093781398
driven_any_median1.4988470337050444
driven_any_min1.4229644425011356
driven_lanedir_consec_max1.5114884659834351
driven_lanedir_consec_mean1.4728900538211254
driven_lanedir_consec_min1.3909649937251236
driven_lanedir_max1.5114884659834351
driven_lanedir_mean1.4728900538211254
driven_lanedir_median1.494553377787971
driven_lanedir_min1.3909649937251236
get_state_dump_max0.02031864881515503
get_state_dump_mean0.020142621795336407
get_state_dump_median0.020161732832590738
get_state_dump_min0.019928372701009115
get_ui_image_max0.04417031685511271
get_ui_image_mean0.04398189743359883
get_ui_image_median0.043975341320037845
get_ui_image_min0.04380659023920695
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4831429655793262, "get_ui_image": 0.04417031685511271, "step_physics": 0.08851580699284871, "survival_time": 14.950000000000076, "driven_lanedir": 1.4784650632606986, "get_state_dump": 0.019928372701009115, "sim_render-ego": 0.009592087268829343, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030642924308776857, "deviation-heading": 0.8776354392636939, "complete-iteration": 0.25410327275594075, "set_robot_commands": 0.008181748390197753, "deviation-center-line": 0.4655804580124483, "driven_lanedir_consec": 1.4784650632606986, "sim_compute_sim_state": 0.021193048159281417, "sim_compute_performance-ego": 0.006780730883280436, "sim_compute_robot_state-ego": 0.012612905502319336, "sim_compute_robot_state-parked0": 0.012248355547587075}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.5149378652143677, "get_ui_image": 0.04380659023920695, "step_physics": 0.08676822026570638, "survival_time": 14.950000000000076, "driven_lanedir": 1.510641692315243, "get_state_dump": 0.02031864881515503, "sim_render-ego": 0.009634190400441488, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0304677406946818, "deviation-heading": 0.8022535890678819, "complete-iteration": 0.25141135454177854, "set_robot_commands": 0.008436827659606934, "deviation-center-line": 0.4984429859708261, "driven_lanedir_consec": 1.510641692315243, "sim_compute_sim_state": 0.01974236488342285, "sim_compute_performance-ego": 0.006836893558502197, "sim_compute_robot_state-ego": 0.012793424129486084, "sim_compute_robot_state-parked0": 0.012375915845235189}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.4229644425011356, "get_ui_image": 0.043836480776468914, "step_physics": 0.09362678050994871, "survival_time": 14.950000000000076, "driven_lanedir": 1.3909649937251236, "get_state_dump": 0.020247803529103596, "sim_render-ego": 0.009838344256083173, "in-drivable-lane": 0.0, "agent_compute-ego": 0.039410120646158855, "deviation-heading": 2.4937483789713895, "complete-iteration": 0.26520660479863484, "set_robot_commands": 0.008602801163991293, "deviation-center-line": 0.7869171289482628, "driven_lanedir_consec": 1.3909649937251236, "sim_compute_sim_state": 0.01688912073771159, "sim_compute_performance-ego": 0.006863698164621989, "sim_compute_robot_state-ego": 0.01316192865371704, "sim_compute_robot_state-parked0": 0.012477567990620933}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.5145511018307625, "get_ui_image": 0.04411420186360677, "step_physics": 0.1025908144315084, "survival_time": 14.950000000000076, "driven_lanedir": 1.5114884659834351, "get_state_dump": 0.02007566213607788, "sim_render-ego": 0.009602302710215251, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06982064008712768, "deviation-heading": 0.6272374358242886, "complete-iteration": 0.3063118060429891, "set_robot_commands": 0.009048155148824056, "deviation-center-line": 0.5179954293674036, "driven_lanedir_consec": 1.5114884659834351, "sim_compute_sim_state": 0.019743826389312744, "sim_compute_performance-ego": 0.006652099291483561, "sim_compute_robot_state-ego": 0.01242572546005249, "sim_compute_robot_state-parked0": 0.011995196342468262}}
set_robot_commands_max0.009048155148824056
set_robot_commands_mean0.00856738309065501
set_robot_commands_median0.008519814411799113
set_robot_commands_min0.008181748390197753
sim_compute_performance-ego_max0.006863698164621989
sim_compute_performance-ego_mean0.006783355474472046
sim_compute_performance-ego_median0.0068088122208913165
sim_compute_performance-ego_min0.006652099291483561
sim_compute_robot_state-ego_max0.01316192865371704
sim_compute_robot_state-ego_mean0.012748495936393735
sim_compute_robot_state-ego_median0.01270316481590271
sim_compute_robot_state-ego_min0.01242572546005249
sim_compute_robot_state-parked0_max0.012477567990620933
sim_compute_robot_state-parked0_mean0.012274258931477863
sim_compute_robot_state-parked0_median0.012312135696411132
sim_compute_robot_state-parked0_min0.011995196342468262
sim_compute_sim_state_max0.021193048159281417
sim_compute_sim_state_mean0.01939209004243215
sim_compute_sim_state_median0.019743095636367797
sim_compute_sim_state_min0.01688912073771159
sim_render-ego_max0.009838344256083173
sim_render-ego_mean0.009666731158892314
sim_render-ego_median0.00961824655532837
sim_render-ego_min0.009592087268829343
simulation-passed1
step_physics_max0.1025908144315084
step_physics_mean0.09287540555000304
step_physics_median0.09107129375139872
step_physics_min0.08676822026570638
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3655310039Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4654832219896265
survival_time_median14.950000000000076
deviation-center-line_median0.509307113747131
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.06896169662475586
agent_compute-ego_mean0.044177995522816975
agent_compute-ego_median0.038648876349131264
agent_compute-ego_min0.03045253276824951
complete-iteration_max0.31126583178838096
complete-iteration_mean0.27519493162631986
complete-iteration_median0.2679847474892934
complete-iteration_min0.2535443997383118
deviation-center-line_max0.8189633955598827
deviation-center-line_mean0.5671585663459364
deviation-center-line_min0.4310566423296009
deviation-heading_max1.7597419483698424
deviation-heading_mean1.3511815893848946
deviation-heading_median1.230370907866439
deviation-heading_min1.184242593436858
driven_any_max2.490752502939336
driven_any_mean2.4592590033498904
driven_any_median2.4847017786575907
driven_any_min2.376879953145044
driven_lanedir_consec_max2.4756912166384852
driven_lanedir_consec_mean2.440055163655625
driven_lanedir_consec_min2.353562994004763
driven_lanedir_max2.4756912166384852
driven_lanedir_mean2.440055163655625
driven_lanedir_median2.4654832219896265
driven_lanedir_min2.353562994004763
get_state_dump_max0.02044242779413859
get_state_dump_mean0.020198586781819666
get_state_dump_median0.02018835465113322
get_state_dump_min0.019975210030873616
get_ui_image_max0.04651792764663696
get_ui_image_mean0.0457118821144104
get_ui_image_median0.04554860353469849
get_ui_image_min0.04523239374160767
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.4823334624952387, "get_ui_image": 0.04651792764663696, "step_physics": 0.08952491839726766, "survival_time": 14.950000000000076, "driven_lanedir": 2.4658169683668403, "get_state_dump": 0.02044242779413859, "sim_render-ego": 0.010095249017079672, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031054502328236897, "deviation-heading": 1.2101973466679403, "complete-iteration": 0.2608279514312744, "set_robot_commands": 0.00839457114537557, "deviation-center-line": 0.4310566423296009, "driven_lanedir_consec": 2.4658169683668403, "sim_compute_sim_state": 0.02192670504252116, "sim_compute_performance-ego": 0.007076821327209473, "sim_compute_robot_state-ego": 0.01316909948984782, "sim_compute_robot_state-parked0": 0.01236711819966634}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.490752502939336, "get_ui_image": 0.045695730050404865, "step_physics": 0.09177042961120606, "survival_time": 14.950000000000076, "driven_lanedir": 2.4756912166384852, "get_state_dump": 0.019975210030873616, "sim_render-ego": 0.008998253345489503, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03045253276824951, "deviation-heading": 1.250544469064938, "complete-iteration": 0.2535443997383118, "set_robot_commands": 0.007092541853586833, "deviation-center-line": 0.46981192832680496, "driven_lanedir_consec": 2.4756912166384852, "sim_compute_sim_state": 0.020791387557983397, "sim_compute_performance-ego": 0.00627143383026123, "sim_compute_robot_state-ego": 0.01088408629099528, "sim_compute_robot_state-parked0": 0.01136721134185791}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.376879953145044, "get_ui_image": 0.04523239374160767, "step_physics": 0.0940232793490092, "survival_time": 14.950000000000076, "driven_lanedir": 2.353562994004763, "get_state_dump": 0.02020028591156006, "sim_render-ego": 0.010022501945495603, "in-drivable-lane": 0.0, "agent_compute-ego": 0.046243250370025635, "deviation-heading": 1.7597419483698424, "complete-iteration": 0.2751415435473124, "set_robot_commands": 0.008547581831614177, "deviation-center-line": 0.8189633955598827, "driven_lanedir_consec": 2.353562994004763, "sim_compute_sim_state": 0.01777357260386149, "sim_compute_performance-ego": 0.007076194286346435, "sim_compute_robot_state-ego": 0.013176031112670898, "sim_compute_robot_state-parked0": 0.012591625054677327}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4870700948199427, "get_ui_image": 0.04540147701899211, "step_physics": 0.10368361314137776, "survival_time": 14.950000000000076, "driven_lanedir": 2.465149475612413, "get_state_dump": 0.02017642339070638, "sim_render-ego": 0.010165069897969564, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06896169662475586, "deviation-heading": 1.184242593436858, "complete-iteration": 0.31126583178838096, "set_robot_commands": 0.00865739345550537, "deviation-center-line": 0.5488022991674569, "driven_lanedir_consec": 2.465149475612413, "sim_compute_sim_state": 0.02135129690170288, "sim_compute_performance-ego": 0.0069559597969055175, "sim_compute_robot_state-ego": 0.012714033921559653, "sim_compute_robot_state-parked0": 0.01293441375096639}}
set_robot_commands_max0.00865739345550537
set_robot_commands_mean0.008173022071520488
set_robot_commands_median0.008471076488494874
set_robot_commands_min0.007092541853586833
sim_compute_performance-ego_max0.007076821327209473
sim_compute_performance-ego_mean0.006845102310180665
sim_compute_performance-ego_median0.007016077041625976
sim_compute_performance-ego_min0.00627143383026123
sim_compute_robot_state-ego_max0.013176031112670898
sim_compute_robot_state-ego_mean0.01248581270376841
sim_compute_robot_state-ego_median0.012941566705703737
sim_compute_robot_state-ego_min0.01088408629099528
sim_compute_robot_state-parked0_max0.01293441375096639
sim_compute_robot_state-parked0_mean0.012315092086791992
sim_compute_robot_state-parked0_median0.012479371627171837
sim_compute_robot_state-parked0_min0.01136721134185791
sim_compute_sim_state_max0.02192670504252116
sim_compute_sim_state_mean0.02046074052651723
sim_compute_sim_state_median0.021071342229843137
sim_compute_sim_state_min0.01777357260386149
sim_render-ego_max0.010165069897969564
sim_render-ego_mean0.009820268551508584
sim_render-ego_median0.010058875481287638
sim_render-ego_min0.008998253345489503
simulation-passed1
step_physics_max0.10368361314137776
step_physics_mean0.09475056012471517
step_physics_median0.09289685448010762
step_physics_min0.08952491839726766
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3655110037Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.909959732004986
survival_time_median14.950000000000076
deviation-center-line_median0.3208398607464112
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.0316158550126212
agent_compute-ego_mean0.030142941105933414
agent_compute-ego_median0.0297380268573761
agent_compute-ego_min0.02947985569636027
complete-iteration_max0.2642017904917399
complete-iteration_mean0.2563238694980031
complete-iteration_median0.255531521382786
complete-iteration_min0.25003064473470055
deviation-center-line_max0.3400855556727046
deviation-center-line_mean0.3226685500530575
deviation-center-line_min0.30890892304670287
deviation-heading_max1.7770164765312948
deviation-heading_mean1.4866686273683918
deviation-heading_median1.454301050040915
deviation-heading_min1.2610559328604425
driven_any_max2.1741435715434547
driven_any_mean1.990440904318886
driven_any_median2.008268530954256
driven_any_min1.771082983823577
driven_lanedir_consec_max2.1635489611474807
driven_lanedir_consec_mean1.862490564195702
driven_lanedir_consec_min1.466493831625355
driven_lanedir_max2.1635489611474807
driven_lanedir_mean1.862490564195702
driven_lanedir_median1.909959732004986
driven_lanedir_min1.466493831625355
get_state_dump_max0.02071142622402736
get_state_dump_mean0.02005826162440436
get_state_dump_median0.01989567955334981
get_state_dump_min0.019730261166890466
get_ui_image_max0.045616452693939206
get_ui_image_mean0.04511313635678518
get_ui_image_median0.0450874757482892
get_ui_image_min0.044661141236623125
in-drivable-lane_max3.800000000000054
in-drivable-lane_mean0.9500000000000136
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9350558951354269, "get_ui_image": 0.04493882570947919, "step_physics": 0.08669476849692208, "survival_time": 14.000000000000064, "driven_lanedir": 1.466493831625355, "get_state_dump": 0.02071142622402736, "sim_render-ego": 0.010266544137682234, "in-drivable-lane": 3.800000000000054, "agent_compute-ego": 0.0316158550126212, "deviation-heading": 1.4440921066604615, "complete-iteration": 0.2588248772280557, "set_robot_commands": 0.009011606659208023, "deviation-center-line": 0.3400855556727046, "driven_lanedir_consec": 1.466493831625355, "sim_compute_sim_state": 0.02169291717665536, "sim_compute_performance-ego": 0.007356728826250348, "sim_compute_robot_state-ego": 0.013362405129841395, "sim_compute_robot_state-parked0": 0.012928847755704609}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.1741435715434547, "get_ui_image": 0.045616452693939206, "step_physics": 0.08992976109186808, "survival_time": 14.950000000000076, "driven_lanedir": 2.1635489611474807, "get_state_dump": 0.019730261166890466, "sim_render-ego": 0.00940200408299764, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029743269284566245, "deviation-heading": 1.2610559328604425, "complete-iteration": 0.25223816553751627, "set_robot_commands": 0.007639815807342529, "deviation-center-line": 0.31595697649614163, "driven_lanedir_consec": 2.1635489611474807, "sim_compute_sim_state": 0.020287476380666095, "sim_compute_performance-ego": 0.006591652234395345, "sim_compute_robot_state-ego": 0.011620481808980308, "sim_compute_robot_state-parked0": 0.01144368012746175}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.771082983823577, "get_ui_image": 0.044661141236623125, "step_physics": 0.09405322790145874, "survival_time": 14.950000000000076, "driven_lanedir": 1.7545943771261268, "get_state_dump": 0.02001933177312215, "sim_render-ego": 0.00922071615854899, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02947985569636027, "deviation-heading": 1.7770164765312948, "complete-iteration": 0.25003064473470055, "set_robot_commands": 0.007249146302541097, "deviation-center-line": 0.30890892304670287, "driven_lanedir_consec": 1.7545943771261268, "sim_compute_sim_state": 0.01647045373916626, "sim_compute_performance-ego": 0.006230701605478922, "sim_compute_robot_state-ego": 0.01107927163441976, "sim_compute_robot_state-parked0": 0.011335204442342125}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0814811667730853, "get_ui_image": 0.0452361257870992, "step_physics": 0.0998785392443339, "survival_time": 14.950000000000076, "driven_lanedir": 2.0653250868838455, "get_state_dump": 0.019772027333577472, "sim_render-ego": 0.00954803466796875, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029732784430185955, "deviation-heading": 1.4645099934213688, "complete-iteration": 0.2642017904917399, "set_robot_commands": 0.008050488630930582, "deviation-center-line": 0.32572274499668075, "driven_lanedir_consec": 2.0653250868838455, "sim_compute_sim_state": 0.02058734973271688, "sim_compute_performance-ego": 0.006730669339497884, "sim_compute_robot_state-ego": 0.01238698959350586, "sim_compute_robot_state-parked0": 0.01204411506652832}}
set_robot_commands_max0.009011606659208023
set_robot_commands_mean0.007987764350005559
set_robot_commands_median0.007845152219136555
set_robot_commands_min0.007249146302541097
sim_compute_performance-ego_max0.007356728826250348
sim_compute_performance-ego_mean0.006727438001405624
sim_compute_performance-ego_median0.006661160786946615
sim_compute_performance-ego_min0.006230701605478922
sim_compute_robot_state-ego_max0.013362405129841395
sim_compute_robot_state-ego_mean0.01211228704168683
sim_compute_robot_state-ego_median0.012003735701243082
sim_compute_robot_state-ego_min0.01107927163441976
sim_compute_robot_state-parked0_max0.012928847755704609
sim_compute_robot_state-parked0_mean0.0119379618480092
sim_compute_robot_state-parked0_median0.011743897596995036
sim_compute_robot_state-parked0_min0.011335204442342125
sim_compute_sim_state_max0.02169291717665536
sim_compute_sim_state_mean0.019759549257301147
sim_compute_sim_state_median0.020437413056691486
sim_compute_sim_state_min0.01647045373916626
sim_render-ego_max0.010266544137682234
sim_render-ego_mean0.009609324761799404
sim_render-ego_median0.009475019375483194
sim_render-ego_min0.00922071615854899
simulation-passed1
step_physics_max0.0998785392443339
step_physics_mean0.0926390741836457
step_physics_median0.0919914944966634
step_physics_min0.08669476849692208
survival_time_max14.950000000000076
survival_time_mean14.712500000000071
survival_time_min14.000000000000064
No reset possible
3654910034Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.185070012102332
survival_time_median14.950000000000076
deviation-center-line_median0.5310199261880012
in-drivable-lane_median2.1500000000000306


other stats
agent_compute-ego_max0.029981759389241535
agent_compute-ego_mean0.029556284432435933
agent_compute-ego_median0.029777202774733114
agent_compute-ego_min0.02868897279103597
complete-iteration_max0.27350639740626015
complete-iteration_mean0.26000511511677127
complete-iteration_median0.2601511785291357
complete-iteration_min0.2462117060025533
deviation-center-line_max0.791905127080799
deviation-center-line_mean0.5196386784264374
deviation-center-line_min0.22460973424894817
deviation-heading_max3.4973717047267674
deviation-heading_mean2.03037993406907
deviation-heading_median1.849579329099039
deviation-heading_min0.9249893733514344
driven_any_max2.838034584017215
driven_any_mean2.5180302421965624
driven_any_median2.5173346878308265
driven_any_min2.199417009107381
driven_lanedir_consec_max2.651420876218691
driven_lanedir_consec_mean2.109822016480957
driven_lanedir_consec_min1.417727165500472
driven_lanedir_max2.651420876218691
driven_lanedir_mean2.109822016480957
driven_lanedir_median2.185070012102332
driven_lanedir_min1.417727165500472
get_state_dump_max0.023314313888549806
get_state_dump_mean0.020174034999347692
get_state_dump_median0.01933864547120922
get_state_dump_min0.018704535166422526
get_ui_image_max0.046776726245880126
get_ui_image_mean0.045614497534805086
get_ui_image_median0.04552000457519996
get_ui_image_min0.04464125474294027
in-drivable-lane_max5.250000000000067
in-drivable-lane_mean2.725000000000037
in-drivable-lane_min1.3500000000000192
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.245069531837215, "get_ui_image": 0.04499868660121576, "step_physics": 0.09139625849890802, "survival_time": 12.850000000000048, "driven_lanedir": 1.417727165500472, "get_state_dump": 0.01941418554996238, "sim_render-ego": 0.009765856924687842, "in-drivable-lane": 5.250000000000067, "agent_compute-ego": 0.029617916285295896, "deviation-heading": 0.9249893733514344, "complete-iteration": 0.25633438923015667, "set_robot_commands": 0.008016230995089163, "deviation-center-line": 0.22460973424894817, "driven_lanedir_consec": 1.417727165500472, "sim_compute_sim_state": 0.02187278947941524, "sim_compute_performance-ego": 0.006802040315323767, "sim_compute_robot_state-ego": 0.012293690373461534, "sim_compute_robot_state-parked0": 0.011932339649719952}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.789599843824438, "get_ui_image": 0.04464125474294027, "step_physics": 0.0924609915415446, "survival_time": 14.950000000000076, "driven_lanedir": 2.547333761417427, "get_state_dump": 0.018704535166422526, "sim_render-ego": 0.008711262543996175, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.02868897279103597, "deviation-heading": 2.028809265920421, "complete-iteration": 0.2462117060025533, "set_robot_commands": 0.006416486104329427, "deviation-center-line": 0.5666356409492675, "driven_lanedir_consec": 2.547333761417427, "sim_compute_sim_state": 0.019976269404093423, "sim_compute_performance-ego": 0.005765741666158041, "sim_compute_robot_state-ego": 0.010062540372212728, "sim_compute_robot_state-parked0": 0.010567627747853596}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.199417009107381, "get_ui_image": 0.046776726245880126, "step_physics": 0.10250701745351155, "survival_time": 14.950000000000076, "driven_lanedir": 1.8228062627872377, "get_state_dump": 0.019263105392456056, "sim_render-ego": 0.009665040175120036, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.029936489264170328, "deviation-heading": 3.4973717047267674, "complete-iteration": 0.2639679678281148, "set_robot_commands": 0.007982835769653321, "deviation-center-line": 0.791905127080799, "driven_lanedir_consec": 1.8228062627872377, "sim_compute_sim_state": 0.016785701115926106, "sim_compute_performance-ego": 0.006634384791056315, "sim_compute_robot_state-ego": 0.01245404799779256, "sim_compute_robot_state-parked0": 0.011745105584462484}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.838034584017215, "get_ui_image": 0.046041322549184166, "step_physics": 0.10285455306371052, "survival_time": 14.950000000000076, "driven_lanedir": 2.651420876218691, "get_state_dump": 0.023314313888549806, "sim_render-ego": 0.010011169115702313, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.029981759389241535, "deviation-heading": 1.670349392277657, "complete-iteration": 0.27350639740626015, "set_robot_commands": 0.008466755549112956, "deviation-center-line": 0.4954042114267349, "driven_lanedir_consec": 2.651420876218691, "sim_compute_sim_state": 0.02070479949315389, "sim_compute_performance-ego": 0.006948323249816895, "sim_compute_robot_state-ego": 0.01282882293065389, "sim_compute_robot_state-parked0": 0.012126446564992267}}
set_robot_commands_max0.008466755549112956
set_robot_commands_mean0.007720577104546216
set_robot_commands_median0.007999533382371242
set_robot_commands_min0.006416486104329427
sim_compute_performance-ego_max0.006948323249816895
sim_compute_performance-ego_mean0.006537622505588755
sim_compute_performance-ego_median0.006718212553190041
sim_compute_performance-ego_min0.005765741666158041
sim_compute_robot_state-ego_max0.01282882293065389
sim_compute_robot_state-ego_mean0.011909775418530178
sim_compute_robot_state-ego_median0.012373869185627048
sim_compute_robot_state-ego_min0.010062540372212728
sim_compute_robot_state-parked0_max0.012126446564992267
sim_compute_robot_state-parked0_mean0.011592879886757074
sim_compute_robot_state-parked0_median0.011838722617091218
sim_compute_robot_state-parked0_min0.010567627747853596
sim_compute_sim_state_max0.02187278947941524
sim_compute_sim_state_mean0.019834889873147164
sim_compute_sim_state_median0.020340534448623656
sim_compute_sim_state_min0.016785701115926106
sim_render-ego_max0.010011169115702313
sim_render-ego_mean0.00953833218987659
sim_render-ego_median0.00971544854990394
sim_render-ego_min0.008711262543996175
simulation-passed1
step_physics_max0.10285455306371052
step_physics_mean0.09730470513941866
step_physics_median0.09748400449752807
step_physics_min0.09139625849890802
survival_time_max14.950000000000076
survival_time_mean14.425000000000068
survival_time_min12.850000000000048
No reset possible
3654410026Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4897260473941225
survival_time_median14.950000000000076
deviation-center-line_median0.4621903480250712
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.06398545742034913
agent_compute-ego_mean0.05632341225941976
agent_compute-ego_median0.062293576796849576
agent_compute-ego_min0.036721038023630775
complete-iteration_max0.3072522489229838
complete-iteration_mean0.292474740544955
complete-iteration_median0.29612491925557455
complete-iteration_min0.27039687474568685
deviation-center-line_max0.508785685966176
deviation-center-line_mean0.4524782370318619
deviation-center-line_min0.3767465661111295
deviation-heading_max1.4821125980233991
deviation-heading_mean0.97361915941549
deviation-heading_median0.916854517838638
deviation-heading_min0.5786550039612842
driven_any_max1.5176839650528309
driven_any_mean1.488386212811696
driven_any_median1.4960251303011405
driven_any_min1.4438106255916725
driven_lanedir_consec_max1.515102710455115
driven_lanedir_consec_mean1.4816512451261157
driven_lanedir_consec_min1.4320501752611026
driven_lanedir_max1.515102710455115
driven_lanedir_mean1.4816512451261157
driven_lanedir_median1.4897260473941225
driven_lanedir_min1.4320501752611026
get_state_dump_max0.019630555311838785
get_state_dump_mean0.018017176588376364
get_state_dump_median0.017567290862401327
get_state_dump_min0.017303569316864012
get_ui_image_max0.04785135269165039
get_ui_image_mean0.04709666093190511
get_ui_image_median0.047374329169591264
get_ui_image_min0.04578663269678752
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4770466435722835, "get_ui_image": 0.04785135269165039, "step_physics": 0.10390512148539226, "survival_time": 14.950000000000076, "driven_lanedir": 1.4680991151199974, "get_state_dump": 0.017303569316864012, "sim_render-ego": 0.008726391792297363, "in-drivable-lane": 0.0, "agent_compute-ego": 0.036721038023630775, "deviation-heading": 1.1022858058543177, "complete-iteration": 0.27039687474568685, "set_robot_commands": 0.007187176545461019, "deviation-center-line": 0.41940730894352374, "driven_lanedir_consec": 1.4680991151199974, "sim_compute_sim_state": 0.02007927179336548, "sim_compute_performance-ego": 0.006152447859446208, "sim_compute_robot_state-ego": 0.011195883750915528, "sim_compute_robot_state-parked0": 0.011061796347300212}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.5150036170299976, "get_ui_image": 0.04700023094813029, "step_physics": 0.10357686360677083, "survival_time": 14.950000000000076, "driven_lanedir": 1.5113529796682474, "get_state_dump": 0.01753084659576416, "sim_render-ego": 0.009081986745198568, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06101838827133179, "deviation-heading": 0.7314232298229586, "complete-iteration": 0.29184989134470624, "set_robot_commands": 0.007060534159342448, "deviation-center-line": 0.5049733871066187, "driven_lanedir_consec": 1.5113529796682474, "sim_compute_sim_state": 0.01838319619496663, "sim_compute_performance-ego": 0.006135564645131429, "sim_compute_robot_state-ego": 0.010977032979329428, "sim_compute_robot_state-parked0": 0.01087496836980184}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.4438106255916725, "get_ui_image": 0.04774842739105225, "step_physics": 0.10798858245213828, "survival_time": 14.950000000000076, "driven_lanedir": 1.4320501752611026, "get_state_dump": 0.017603735129038494, "sim_render-ego": 0.008869074980417887, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06398545742034913, "deviation-heading": 1.4821125980233991, "complete-iteration": 0.30039994716644286, "set_robot_commands": 0.00907357374827067, "deviation-center-line": 0.3767465661111295, "driven_lanedir_consec": 1.4320501752611026, "sim_compute_sim_state": 0.016873937447865806, "sim_compute_performance-ego": 0.006138894557952881, "sim_compute_robot_state-ego": 0.010930304527282714, "sim_compute_robot_state-parked0": 0.010975360075632733}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.5176839650528309, "get_ui_image": 0.04578663269678752, "step_physics": 0.11174201250076292, "survival_time": 14.950000000000076, "driven_lanedir": 1.515102710455115, "get_state_dump": 0.019630555311838785, "sim_render-ego": 0.009233878453572592, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06356876532236735, "deviation-heading": 0.5786550039612842, "complete-iteration": 0.3072522489229838, "set_robot_commands": 0.007446303367614746, "deviation-center-line": 0.508785685966176, "driven_lanedir_consec": 1.515102710455115, "sim_compute_sim_state": 0.01930416742960612, "sim_compute_performance-ego": 0.006442751089731852, "sim_compute_robot_state-ego": 0.01162212371826172, "sim_compute_robot_state-parked0": 0.012253812948862712}}
set_robot_commands_max0.00907357374827067
set_robot_commands_mean0.007691896955172221
set_robot_commands_median0.007316739956537883
set_robot_commands_min0.007060534159342448
sim_compute_performance-ego_max0.006442751089731852
sim_compute_performance-ego_mean0.006217414538065593
sim_compute_performance-ego_median0.006145671208699544
sim_compute_performance-ego_min0.006135564645131429
sim_compute_robot_state-ego_max0.01162212371826172
sim_compute_robot_state-ego_mean0.011181336243947348
sim_compute_robot_state-ego_median0.011086458365122478
sim_compute_robot_state-ego_min0.010930304527282714
sim_compute_robot_state-parked0_max0.012253812948862712
sim_compute_robot_state-parked0_mean0.011291484435399374
sim_compute_robot_state-parked0_median0.01101857821146647
sim_compute_robot_state-parked0_min0.01087496836980184
sim_compute_sim_state_max0.02007927179336548
sim_compute_sim_state_mean0.018660143216451007
sim_compute_sim_state_median0.018843681812286375
sim_compute_sim_state_min0.016873937447865806
sim_render-ego_max0.009233878453572592
sim_render-ego_mean0.008977832992871602
sim_render-ego_median0.008975530862808227
sim_render-ego_min0.008726391792297363
simulation-passed1
step_physics_max0.11174201250076292
step_physics_mean0.10680314501126607
step_physics_median0.10594685196876528
step_physics_min0.10357686360677083
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3653510019Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.908562795334996
survival_time_median14.950000000000076
deviation-center-line_median0.4730825538778037
in-drivable-lane_median3.875000000000055


other stats
agent_compute-ego_max0.06863061348597209
agent_compute-ego_mean0.05645695081296957
agent_compute-ego_median0.061828213135401405
agent_compute-ego_min0.03354076349510337
complete-iteration_max0.3248531476656596
complete-iteration_mean0.2995320979716643
complete-iteration_median0.3043713084856669
complete-iteration_min0.26453262724966375
deviation-center-line_max0.6453378817468555
deviation-center-line_mean0.468832865835517
deviation-center-line_min0.283828473839605
deviation-heading_max2.0418899149434475
deviation-heading_mean1.4365141597960531
deviation-heading_median1.3554464365355994
deviation-heading_min0.993273851169567
driven_any_max2.721834713313628
driven_any_mean2.5313834741201404
driven_any_median2.5421098912242868
driven_any_min2.319479400718361
driven_lanedir_consec_max2.563920060496404
driven_lanedir_consec_mean1.9622268224869948
driven_lanedir_consec_min1.4678616387815828
driven_lanedir_max2.563920060496404
driven_lanedir_mean1.9622268224869948
driven_lanedir_median1.908562795334996
driven_lanedir_min1.4678616387815828
get_state_dump_max0.01978924830754598
get_state_dump_mean0.01877114534752924
get_state_dump_median0.01891052246843494
get_state_dump_min0.01747428814570109
get_ui_image_max0.04888483842213948
get_ui_image_mean0.04815140366179388
get_ui_image_median0.04840144753456116
get_ui_image_min0.04691788115591373
in-drivable-lane_max4.350000000000062
in-drivable-lane_mean3.025000000000043
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.319479400718361, "get_ui_image": 0.04691788115591373, "step_physics": 0.0992596518318608, "survival_time": 13.250000000000052, "driven_lanedir": 1.4678616387815828, "get_state_dump": 0.018947873925263023, "sim_render-ego": 0.008954608665322357, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.03354076349510337, "deviation-heading": 1.057710405064451, "complete-iteration": 0.26453262724966375, "set_robot_commands": 0.007023098783672981, "deviation-center-line": 0.283828473839605, "driven_lanedir_consec": 1.4678616387815828, "sim_compute_sim_state": 0.020901703384687317, "sim_compute_performance-ego": 0.006938648223876953, "sim_compute_robot_state-ego": 0.01087445133137253, "sim_compute_robot_state-parked0": 0.010952463689840064}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.721834713313628, "get_ui_image": 0.047922869523366295, "step_physics": 0.10018788814544678, "survival_time": 14.950000000000076, "driven_lanedir": 1.9980654098328607, "get_state_dump": 0.01747428814570109, "sim_render-ego": 0.008732839425404867, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.05928562959035238, "deviation-heading": 1.6531824680067475, "complete-iteration": 0.29077194929122924, "set_robot_commands": 0.007366135915120442, "deviation-center-line": 0.42887783813112734, "driven_lanedir_consec": 1.9980654098328607, "sim_compute_sim_state": 0.02140646696090698, "sim_compute_performance-ego": 0.006084551016489664, "sim_compute_robot_state-ego": 0.010885382493336995, "sim_compute_robot_state-parked0": 0.01120169242223104}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5107748454787453, "get_ui_image": 0.04888483842213948, "step_physics": 0.11467135906219482, "survival_time": 14.950000000000076, "driven_lanedir": 1.8190601808371316, "get_state_dump": 0.018873171011606852, "sim_render-ego": 0.009904078642527262, "in-drivable-lane": 4.25000000000006, "agent_compute-ego": 0.06437079668045044, "deviation-heading": 2.0418899149434475, "complete-iteration": 0.31797066768010457, "set_robot_commands": 0.00825356403986613, "deviation-center-line": 0.6453378817468555, "driven_lanedir_consec": 1.8190601808371316, "sim_compute_sim_state": 0.022141873836517337, "sim_compute_performance-ego": 0.006601432164510091, "sim_compute_robot_state-ego": 0.011954821745554609, "sim_compute_robot_state-parked0": 0.012091422080993652}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.573444936969828, "get_ui_image": 0.048880025545756024, "step_physics": 0.11225815852483112, "survival_time": 14.950000000000076, "driven_lanedir": 2.563920060496404, "get_state_dump": 0.01978924830754598, "sim_render-ego": 0.01092875321706136, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06863061348597209, "deviation-heading": 0.993273851169567, "complete-iteration": 0.3248531476656596, "set_robot_commands": 0.008110404809316, "deviation-center-line": 0.51728726962448, "driven_lanedir_consec": 2.563920060496404, "sim_compute_sim_state": 0.021616169611612956, "sim_compute_performance-ego": 0.0071405601501464844, "sim_compute_robot_state-ego": 0.014310178756713868, "sim_compute_robot_state-parked0": 0.01294196923573812}}
set_robot_commands_max0.00825356403986613
set_robot_commands_mean0.007688300886993888
set_robot_commands_median0.007738270362218221
set_robot_commands_min0.007023098783672981
sim_compute_performance-ego_max0.0071405601501464844
sim_compute_performance-ego_mean0.006691297888755799
sim_compute_performance-ego_median0.006770040194193522
sim_compute_performance-ego_min0.006084551016489664
sim_compute_robot_state-ego_max0.014310178756713868
sim_compute_robot_state-ego_mean0.0120062085817445
sim_compute_robot_state-ego_median0.011420102119445802
sim_compute_robot_state-ego_min0.01087445133137253
sim_compute_robot_state-parked0_max0.01294196923573812
sim_compute_robot_state-parked0_mean0.01179688685720072
sim_compute_robot_state-parked0_median0.011646557251612346
sim_compute_robot_state-parked0_min0.010952463689840064
sim_compute_sim_state_max0.022141873836517337
sim_compute_sim_state_mean0.021516553448431147
sim_compute_sim_state_median0.02151131828625997
sim_compute_sim_state_min0.020901703384687317
sim_render-ego_max0.01092875321706136
sim_render-ego_mean0.009630069987578965
sim_render-ego_median0.00942934365392481
sim_render-ego_min0.008732839425404867
simulation-passed1
step_physics_max0.11467135906219482
step_physics_mean0.10659426439108338
step_physics_median0.10622302333513896
step_physics_min0.0992596518318608
survival_time_max14.950000000000076
survival_time_mean14.52500000000007
survival_time_min13.250000000000052
No reset possible
3653010016Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5057125146469925
survival_time_median14.950000000000076
deviation-center-line_median0.8254500597319119
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.07138099590937297
agent_compute-ego_mean0.06744596759478251
agent_compute-ego_median0.07006416956583658
agent_compute-ego_min0.0582745353380839
complete-iteration_max0.3098156460126241
complete-iteration_mean0.30302508493264513
complete-iteration_median0.30210571169853206
complete-iteration_min0.2980732703208923
deviation-center-line_max1.5659843694334965
deviation-center-line_mean0.9612666390940776
deviation-center-line_min0.6281820674789907
deviation-heading_max1.8644634002583351
deviation-heading_mean1.1394427362263728
deviation-heading_median1.0161875042151578
deviation-heading_min0.6609325362168397
driven_any_max2.8589153908718825
driven_any_mean2.8565720225183493
driven_any_median2.8588768919788485
driven_any_min2.8496189152438176
driven_lanedir_consec_max2.8429657569407087
driven_lanedir_consec_mean2.5126024437167738
driven_lanedir_consec_min2.1960189886324017
driven_lanedir_max2.8429657569407087
driven_lanedir_mean2.5126024437167738
driven_lanedir_median2.5057125146469925
driven_lanedir_min2.1960189886324017
get_state_dump_max0.02116131623586019
get_state_dump_mean0.01996186077594757
get_state_dump_median0.019682950973510745
get_state_dump_min0.01932022492090861
get_ui_image_max0.046417183081309
get_ui_image_mean0.04557248691717784
get_ui_image_median0.04547143975893657
get_ui_image_min0.04492988506952922
in-drivable-lane_max3.0500000000000433
in-drivable-lane_mean1.612500000000023
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.8496189152438176, "get_ui_image": 0.046417183081309, "step_physics": 0.10268769741058348, "survival_time": 14.950000000000076, "driven_lanedir": 2.8429657569407087, "get_state_dump": 0.02116131623586019, "sim_render-ego": 0.010437352657318115, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0582745353380839, "deviation-heading": 0.6609325362168397, "complete-iteration": 0.3024526874224345, "set_robot_commands": 0.007764468193054199, "deviation-center-line": 1.5659843694334965, "driven_lanedir_consec": 2.8429657569407087, "sim_compute_sim_state": 0.023404395580291747, "sim_compute_performance-ego": 0.007338635921478272, "sim_compute_robot_state-ego": 0.012398924032847088, "sim_compute_robot_state-parked0": 0.012343560059865316}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8589084681084227, "get_ui_image": 0.04492988506952922, "step_physics": 0.092406112353007, "survival_time": 14.950000000000076, "driven_lanedir": 2.535189995468231, "get_state_dump": 0.01932022492090861, "sim_render-ego": 0.010558056831359864, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.06930461168289184, "deviation-heading": 1.1943934136583794, "complete-iteration": 0.2980732703208923, "set_robot_commands": 0.008254992167154947, "deviation-center-line": 0.7743500106061983, "driven_lanedir_consec": 2.535189995468231, "sim_compute_sim_state": 0.021279396216074623, "sim_compute_performance-ego": 0.0067991844813028975, "sim_compute_robot_state-ego": 0.012596716086069742, "sim_compute_robot_state-parked0": 0.012397645314534503}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8588453158492744, "get_ui_image": 0.04561167160669963, "step_physics": 0.09686911265055338, "survival_time": 14.950000000000076, "driven_lanedir": 2.1960189886324017, "get_state_dump": 0.019870838324228923, "sim_render-ego": 0.009935527642567952, "in-drivable-lane": 3.0500000000000433, "agent_compute-ego": 0.07138099590937297, "deviation-heading": 1.8644634002583351, "complete-iteration": 0.3017587359746297, "set_robot_commands": 0.007957790692647298, "deviation-center-line": 0.6281820674789907, "driven_lanedir_consec": 2.1960189886324017, "sim_compute_sim_state": 0.018224412600199386, "sim_compute_performance-ego": 0.006856793562571207, "sim_compute_robot_state-ego": 0.012368803819020589, "sim_compute_robot_state-parked0": 0.012453165849049886}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8589153908718825, "get_ui_image": 0.0453312079111735, "step_physics": 0.10304940144220988, "survival_time": 14.950000000000076, "driven_lanedir": 2.4762350338257537, "get_state_dump": 0.01949506362279256, "sim_render-ego": 0.009438567956288656, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.07082372744878133, "deviation-heading": 0.8379815947719363, "complete-iteration": 0.3098156460126241, "set_robot_commands": 0.007707577546437581, "deviation-center-line": 0.8765501088576253, "driven_lanedir_consec": 2.4762350338257537, "sim_compute_sim_state": 0.021364850997924803, "sim_compute_performance-ego": 0.006433653036753337, "sim_compute_robot_state-ego": 0.0120635191599528, "sim_compute_robot_state-parked0": 0.013881794611612956}}
set_robot_commands_max0.008254992167154947
set_robot_commands_mean0.007921207149823507
set_robot_commands_median0.007861129442850749
set_robot_commands_min0.007707577546437581
sim_compute_performance-ego_max0.007338635921478272
sim_compute_performance-ego_mean0.0068570667505264285
sim_compute_performance-ego_median0.0068279890219370525
sim_compute_performance-ego_min0.006433653036753337
sim_compute_robot_state-ego_max0.012596716086069742
sim_compute_robot_state-ego_mean0.012356990774472554
sim_compute_robot_state-ego_median0.012383863925933838
sim_compute_robot_state-ego_min0.0120635191599528
sim_compute_robot_state-parked0_max0.013881794611612956
sim_compute_robot_state-parked0_mean0.012769041458765666
sim_compute_robot_state-parked0_median0.012425405581792196
sim_compute_robot_state-parked0_min0.012343560059865316
sim_compute_sim_state_max0.023404395580291747
sim_compute_sim_state_mean0.02106826384862264
sim_compute_sim_state_median0.021322123606999713
sim_compute_sim_state_min0.018224412600199386
sim_render-ego_max0.010558056831359864
sim_render-ego_mean0.010092376271883648
sim_render-ego_median0.010186440149943035
sim_render-ego_min0.009438567956288656
simulation-passed1
step_physics_max0.10304940144220988
step_physics_mean0.09875308096408844
step_physics_median0.09977840503056844
step_physics_min0.092406112353007
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3652710015Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2800761468318065
survival_time_median14.950000000000076
deviation-center-line_median0.9147059319405502
in-drivable-lane_median3.650000000000052


other stats
agent_compute-ego_max0.07321029742558798
agent_compute-ego_mean0.07016381522019705
agent_compute-ego_median0.07165885051091513
agent_compute-ego_min0.06412726243336996
complete-iteration_max0.3011526401837667
complete-iteration_mean0.29638518750667575
complete-iteration_median0.2982416637738546
complete-iteration_min0.28790478229522704
deviation-center-line_max1.1509664185492283
deviation-center-line_mean0.8920310091281736
deviation-center-line_min0.5877457540823652
deviation-heading_max2.0615450557262975
deviation-heading_mean1.1014471913930863
deviation-heading_median0.8080832470489728
deviation-heading_min0.7280772157481019
driven_any_max3.063130001602131
driven_any_mean3.0606224866448444
driven_any_median3.0631009188315947
driven_any_min3.0531581073140575
driven_lanedir_consec_max2.787584122469302
driven_lanedir_consec_mean2.1833321178159935
driven_lanedir_consec_min1.3855920551310574
driven_lanedir_max2.787584122469302
driven_lanedir_mean2.1833321178159935
driven_lanedir_median2.2800761468318065
driven_lanedir_min1.3855920551310574
get_state_dump_max0.02014670769373576
get_state_dump_mean0.019857955177625022
get_state_dump_median0.01981489896774292
get_state_dump_min0.019655315081278484
get_ui_image_max0.046094541549682615
get_ui_image_mean0.04502237975597381
get_ui_image_median0.044858287572860714
get_ui_image_min0.04427840232849121
in-drivable-lane_max7.550000000000051
in-drivable-lane_mean4.025000000000043
in-drivable-lane_min1.2500000000000178
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0531581073140575, "get_ui_image": 0.046094541549682615, "step_physics": 0.09202022075653075, "survival_time": 14.950000000000076, "driven_lanedir": 1.9721146910879237, "get_state_dump": 0.02014670769373576, "sim_render-ego": 0.010101314385732014, "in-drivable-lane": 5.1000000000000725, "agent_compute-ego": 0.06412726243336996, "deviation-heading": 0.7280772157481019, "complete-iteration": 0.29755247513453165, "set_robot_commands": 0.008592754205067953, "deviation-center-line": 0.6946512205965084, "driven_lanedir_consec": 1.9721146910879237, "sim_compute_sim_state": 0.023782592614491786, "sim_compute_performance-ego": 0.007087270418802897, "sim_compute_robot_state-ego": 0.012748439311981202, "sim_compute_robot_state-parked0": 0.012597169081370036}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.063130001602131, "get_ui_image": 0.04427840232849121, "step_physics": 0.08864904324213664, "survival_time": 14.950000000000076, "driven_lanedir": 2.588037602575689, "get_state_dump": 0.019700276056925457, "sim_render-ego": 0.008910197416941325, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.07105587959289551, "deviation-heading": 0.8085362978602341, "complete-iteration": 0.28790478229522704, "set_robot_commands": 0.0070631567637125655, "deviation-center-line": 1.1347606432845918, "driven_lanedir_consec": 2.588037602575689, "sim_compute_sim_state": 0.021160926818847656, "sim_compute_performance-ego": 0.005940928459167481, "sim_compute_robot_state-ego": 0.0099690842628479, "sim_compute_robot_state-parked0": 0.010918956597646075}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.063074103929014, "get_ui_image": 0.04491637388865153, "step_physics": 0.09426741043726604, "survival_time": 14.950000000000076, "driven_lanedir": 1.3855920551310574, "get_state_dump": 0.019655315081278484, "sim_render-ego": 0.009544905026753744, "in-drivable-lane": 7.550000000000051, "agent_compute-ego": 0.07321029742558798, "deviation-heading": 2.0615450557262975, "complete-iteration": 0.2989308524131775, "set_robot_commands": 0.008457376956939697, "deviation-center-line": 0.5877457540823652, "driven_lanedir_consec": 1.3855920551310574, "sim_compute_sim_state": 0.01844021717707316, "sim_compute_performance-ego": 0.006652561823527018, "sim_compute_robot_state-ego": 0.011859864393870037, "sim_compute_robot_state-parked0": 0.011671194235483804}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0631277337341754, "get_ui_image": 0.044800201257069905, "step_physics": 0.09694140593210857, "survival_time": 14.950000000000076, "driven_lanedir": 2.787584122469302, "get_state_dump": 0.019929521878560383, "sim_render-ego": 0.009310862223307292, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.07226182142893474, "deviation-heading": 0.8076301962377116, "complete-iteration": 0.3011526401837667, "set_robot_commands": 0.007628134886423747, "deviation-center-line": 1.1509664185492283, "driven_lanedir_consec": 2.787584122469302, "sim_compute_sim_state": 0.02106952428817749, "sim_compute_performance-ego": 0.006485929489135742, "sim_compute_robot_state-ego": 0.011169446309407551, "sim_compute_robot_state-parked0": 0.011294202009836832}}
set_robot_commands_max0.008592754205067953
set_robot_commands_mean0.00793535570303599
set_robot_commands_median0.008042755921681723
set_robot_commands_min0.0070631567637125655
sim_compute_performance-ego_max0.007087270418802897
sim_compute_performance-ego_mean0.006541672547658285
sim_compute_performance-ego_median0.0065692456563313795
sim_compute_performance-ego_min0.005940928459167481
sim_compute_robot_state-ego_max0.012748439311981202
sim_compute_robot_state-ego_mean0.011436708569526673
sim_compute_robot_state-ego_median0.011514655351638791
sim_compute_robot_state-ego_min0.0099690842628479
sim_compute_robot_state-parked0_max0.012597169081370036
sim_compute_robot_state-parked0_mean0.011620380481084186
sim_compute_robot_state-parked0_median0.01148269812266032
sim_compute_robot_state-parked0_min0.010918956597646075
sim_compute_sim_state_max0.023782592614491786
sim_compute_sim_state_mean0.02111331522464752
sim_compute_sim_state_median0.021115225553512577
sim_compute_sim_state_min0.01844021717707316
sim_render-ego_max0.010101314385732014
sim_render-ego_mean0.009466819763183594
sim_render-ego_median0.009427883625030518
sim_render-ego_min0.008910197416941325
simulation-passed1
step_physics_max0.09694140593210857
step_physics_mean0.09296952009201052
step_physics_median0.0931438155968984
step_physics_min0.08864904324213664
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
365219269Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.747111221281719
survival_time_median14.950000000000076
deviation-center-line_median0.471549433724188
in-drivable-lane_median1.3000000000000185


other stats
agent_compute-ego_max0.0688666280110677
agent_compute-ego_mean0.056689238746960954
agent_compute-ego_median0.06408873995145162
agent_compute-ego_min0.029712847073872884
complete-iteration_max0.297932391166687
complete-iteration_mean0.28600304583708447
complete-iteration_median0.29261019269625343
complete-iteration_min0.2608594067891439
deviation-center-line_max0.5266659310218884
deviation-center-line_mean0.4218819357450703
deviation-center-line_min0.2177629445100168
deviation-heading_max2.087906939891053
deviation-heading_mean1.466607538984241
deviation-heading_median1.455636738914139
deviation-heading_min0.8672497382176342
driven_any_max2.0180379396945884
driven_any_mean1.9749697729954072
driven_any_median1.98462681172338
driven_any_min1.9125875288402816
driven_lanedir_consec_max2.0093323552242204
driven_lanedir_consec_mean1.708731926565869
driven_lanedir_consec_min1.3313729084758172
driven_lanedir_max2.0093323552242204
driven_lanedir_mean1.708731926565869
driven_lanedir_median1.747111221281719
driven_lanedir_min1.3313729084758172
get_state_dump_max0.019173532327016195
get_state_dump_mean0.01890383005142212
get_state_dump_median0.01885745366414388
get_state_dump_min0.01872688055038452
get_ui_image_max0.04537261327107747
get_ui_image_mean0.0449891475836436
get_ui_image_median0.04512383143107096
get_ui_image_min0.04433631420135498
in-drivable-lane_max4.550000000000065
in-drivable-lane_mean1.7875000000000254
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.969711365799429, "get_ui_image": 0.04524439493815104, "step_physics": 0.09820011615753174, "survival_time": 14.950000000000076, "driven_lanedir": 1.3313729084758172, "get_state_dump": 0.019173532327016195, "sim_render-ego": 0.009517979621887208, "in-drivable-lane": 4.550000000000065, "agent_compute-ego": 0.029712847073872884, "deviation-heading": 1.2327362181007286, "complete-iteration": 0.2608594067891439, "set_robot_commands": 0.0078938094774882, "deviation-center-line": 0.2177629445100168, "driven_lanedir_consec": 1.3313729084758172, "sim_compute_sim_state": 0.020575968424479167, "sim_compute_performance-ego": 0.006628519694010417, "sim_compute_robot_state-ego": 0.012096859614054364, "sim_compute_robot_state-parked0": 0.011578354835510254}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9995422576473312, "get_ui_image": 0.04537261327107747, "step_physics": 0.09590291738510132, "survival_time": 14.950000000000076, "driven_lanedir": 1.909778792959148, "get_state_dump": 0.01872688055038452, "sim_render-ego": 0.009505518277486164, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.0610464882850647, "deviation-heading": 1.678537259727549, "complete-iteration": 0.2891649595896403, "set_robot_commands": 0.007636166413625081, "deviation-center-line": 0.454956164931676, "driven_lanedir_consec": 1.909778792959148, "sim_compute_sim_state": 0.0200600798924764, "sim_compute_performance-ego": 0.00679919163386027, "sim_compute_robot_state-ego": 0.011821235815684, "sim_compute_robot_state-parked0": 0.01203734795252482}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9125875288402816, "get_ui_image": 0.04500326792399088, "step_physics": 0.0986081584294637, "survival_time": 14.950000000000076, "driven_lanedir": 1.5844436496042902, "get_state_dump": 0.018765724500020346, "sim_render-ego": 0.010226414998372397, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.0688666280110677, "deviation-heading": 2.087906939891053, "complete-iteration": 0.29605542580286665, "set_robot_commands": 0.007672411600748698, "deviation-center-line": 0.5266659310218884, "driven_lanedir_consec": 1.5844436496042902, "sim_compute_sim_state": 0.016926801204681395, "sim_compute_performance-ego": 0.006410443782806396, "sim_compute_robot_state-ego": 0.011712024211883543, "sim_compute_robot_state-parked0": 0.01162269115447998}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0180379396945884, "get_ui_image": 0.04433631420135498, "step_physics": 0.1032281470298767, "survival_time": 14.950000000000076, "driven_lanedir": 2.0093323552242204, "get_state_dump": 0.018949182828267415, "sim_render-ego": 0.00920966625213623, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06713099161783855, "deviation-heading": 0.8672497382176342, "complete-iteration": 0.297932391166687, "set_robot_commands": 0.007196372350056966, "deviation-center-line": 0.4881427025167, "driven_lanedir_consec": 2.0093323552242204, "sim_compute_sim_state": 0.01945600986480713, "sim_compute_performance-ego": 0.006129113038380941, "sim_compute_robot_state-ego": 0.01118437131245931, "sim_compute_robot_state-parked0": 0.010866276423136392}}
set_robot_commands_max0.0078938094774882
set_robot_commands_mean0.007599689960479736
set_robot_commands_median0.00765428900718689
set_robot_commands_min0.007196372350056966
sim_compute_performance-ego_max0.00679919163386027
sim_compute_performance-ego_mean0.006491817037264506
sim_compute_performance-ego_median0.006519481738408406
sim_compute_performance-ego_min0.006129113038380941
sim_compute_robot_state-ego_max0.012096859614054364
sim_compute_robot_state-ego_mean0.011703622738520304
sim_compute_robot_state-ego_median0.011766630013783771
sim_compute_robot_state-ego_min0.01118437131245931
sim_compute_robot_state-parked0_max0.01203734795252482
sim_compute_robot_state-parked0_mean0.011526167591412863
sim_compute_robot_state-parked0_median0.011600522994995116
sim_compute_robot_state-parked0_min0.010866276423136392
sim_compute_sim_state_max0.020575968424479167
sim_compute_sim_state_mean0.019254714846611024
sim_compute_sim_state_median0.01975804487864177
sim_compute_sim_state_min0.016926801204681395
sim_render-ego_max0.010226414998372397
sim_render-ego_mean0.0096148947874705
sim_render-ego_median0.009511748949686687
sim_render-ego_min0.00920966625213623
simulation-passed1
step_physics_max0.1032281470298767
step_physics_mean0.09898483475049336
step_physics_median0.09840413729349771
step_physics_min0.09590291738510132
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
365199279Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.189089882149595
survival_time_median14.950000000000076
deviation-center-line_median0.6119564242380819
in-drivable-lane_median1.5250000000000217


other stats
agent_compute-ego_max0.03287894169489543
agent_compute-ego_mean0.032224529782931007
agent_compute-ego_median0.032242956956227614
agent_compute-ego_min0.03153326352437337
complete-iteration_max0.2675043376286825
complete-iteration_mean0.2598451910416285
complete-iteration_median0.26089537660280865
complete-iteration_min0.2500856733322144
deviation-center-line_max0.7039551120128882
deviation-center-line_mean0.5476084503574814
deviation-center-line_min0.2625658409408732
deviation-heading_max1.4598315329836609
deviation-heading_mean1.4145028543751703
deviation-heading_median1.4209704162207395
deviation-heading_min1.3562390520755412
driven_any_max2.509042184517162
driven_any_mean2.4316927584413603
driven_any_median2.466921555545607
driven_any_min2.283885738157065
driven_lanedir_consec_max2.364986635725154
driven_lanedir_consec_mean2.1100946286417996
driven_lanedir_consec_min1.6972121145428536
driven_lanedir_max2.364986635725154
driven_lanedir_mean2.1100946286417996
driven_lanedir_median2.189089882149595
driven_lanedir_min1.6972121145428536
get_state_dump_max0.02045153299967448
get_state_dump_mean0.02039704700311025
get_state_dump_median0.020386637449264527
get_state_dump_min0.020363380114237467
get_ui_image_max0.04483569622039795
get_ui_image_mean0.04431896726290385
get_ui_image_median0.04427013754844666
get_ui_image_min0.043899897734324136
in-drivable-lane_max4.100000000000058
in-drivable-lane_mean1.962500000000028
in-drivable-lane_min0.70000000000001
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.283885738157065, "get_ui_image": 0.04483569622039795, "step_physics": 0.08768854856491089, "survival_time": 14.950000000000076, "driven_lanedir": 2.0546564222920356, "get_state_dump": 0.02037192742029826, "sim_render-ego": 0.01040646235148112, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.03287894169489543, "deviation-heading": 1.4598315329836609, "complete-iteration": 0.2617851130167643, "set_robot_commands": 0.008791301250457764, "deviation-center-line": 0.652247115520871, "driven_lanedir_consec": 2.0546564222920356, "sim_compute_sim_state": 0.022486155033111573, "sim_compute_performance-ego": 0.0072715957959493, "sim_compute_robot_state-ego": 0.01388895591100057, "sim_compute_robot_state-parked0": 0.012911873658498128}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.497502157216133, "get_ui_image": 0.0444694193204244, "step_physics": 0.08712443908055624, "survival_time": 14.950000000000076, "driven_lanedir": 2.323523342007155, "get_state_dump": 0.02045153299967448, "sim_render-ego": 0.00938943068186442, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.03202324549357096, "deviation-heading": 1.4412569088855207, "complete-iteration": 0.2500856733322144, "set_robot_commands": 0.00727679967880249, "deviation-center-line": 0.571665732955293, "driven_lanedir_consec": 2.323523342007155, "sim_compute_sim_state": 0.020557443300882976, "sim_compute_performance-ego": 0.006310176054636637, "sim_compute_robot_state-ego": 0.010962679386138915, "sim_compute_robot_state-parked0": 0.011269771258036297}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4363409538750807, "get_ui_image": 0.04407085577646891, "step_physics": 0.09175115426381428, "survival_time": 14.950000000000076, "driven_lanedir": 1.6972121145428536, "get_state_dump": 0.020363380114237467, "sim_render-ego": 0.010303757985432942, "in-drivable-lane": 4.100000000000058, "agent_compute-ego": 0.032462668418884275, "deviation-heading": 1.400683923555959, "complete-iteration": 0.26000564018885297, "set_robot_commands": 0.008733638127644857, "deviation-center-line": 0.2625658409408732, "driven_lanedir_consec": 1.6972121145428536, "sim_compute_sim_state": 0.01819791873296102, "sim_compute_performance-ego": 0.007063225110371907, "sim_compute_robot_state-ego": 0.01418631394704183, "sim_compute_robot_state-parked0": 0.01262507438659668}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.509042184517162, "get_ui_image": 0.043899897734324136, "step_physics": 0.09890990098317463, "survival_time": 14.950000000000076, "driven_lanedir": 2.364986635725154, "get_state_dump": 0.020401347478230795, "sim_render-ego": 0.009947474002838136, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.03153326352437337, "deviation-heading": 1.3562390520755412, "complete-iteration": 0.2675043376286825, "set_robot_commands": 0.008279101848602295, "deviation-center-line": 0.7039551120128882, "driven_lanedir_consec": 2.364986635725154, "sim_compute_sim_state": 0.021269695758819585, "sim_compute_performance-ego": 0.006885764598846436, "sim_compute_robot_state-ego": 0.013611178398132324, "sim_compute_robot_state-parked0": 0.0125178861618042}}
set_robot_commands_max0.008791301250457764
set_robot_commands_mean0.008270210226376851
set_robot_commands_median0.008506369988123576
set_robot_commands_min0.00727679967880249
sim_compute_performance-ego_max0.0072715957959493
sim_compute_performance-ego_mean0.006882690389951071
sim_compute_performance-ego_median0.006974494854609171
sim_compute_performance-ego_min0.006310176054636637
sim_compute_robot_state-ego_max0.01418631394704183
sim_compute_robot_state-ego_mean0.01316228191057841
sim_compute_robot_state-ego_median0.013750067154566448
sim_compute_robot_state-ego_min0.010962679386138915
sim_compute_robot_state-parked0_max0.012911873658498128
sim_compute_robot_state-parked0_mean0.012331151366233828
sim_compute_robot_state-parked0_median0.01257148027420044
sim_compute_robot_state-parked0_min0.011269771258036297
sim_compute_sim_state_max0.022486155033111573
sim_compute_sim_state_mean0.020627803206443782
sim_compute_sim_state_median0.02091356952985128
sim_compute_sim_state_min0.01819791873296102
sim_render-ego_max0.01040646235148112
sim_render-ego_mean0.010011781255404155
sim_render-ego_median0.01012561599413554
sim_render-ego_min0.00938943068186442
simulation-passed1
step_physics_max0.09890990098317463
step_physics_mean0.091368510723114
step_physics_median0.08971985141436259
step_physics_min0.08712443908055624
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
365189340Jerome LabonteΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simabortednoreg05-7d9c5d9f1ec5-10:10:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.135466576581342
survival_time_median14.950000000000076
deviation-center-line_median0.6846447211123428
in-drivable-lane_median0.30000000000000426


other stats
agent_compute-ego_max0.03152235825856527
agent_compute-ego_mean0.03097493350505829
agent_compute-ego_median0.030873605410257975
agent_compute-ego_min0.030630164941151936
complete-iteration_max0.27252716620763145
complete-iteration_mean0.26195099234580993
complete-iteration_median0.26754871368408206
complete-iteration_min0.24017937580744425
deviation-center-line_max0.7912783832058914
deviation-center-line_mean0.6930777433577313
deviation-center-line_min0.6117431480003486
deviation-heading_max3.7716278129080982
deviation-heading_mean2.275532846200054
deviation-heading_median1.792132278359284
deviation-heading_min1.7462390151735503
driven_any_max3.261932898353229
driven_any_mean3.122708342216301
driven_any_median3.2091721865784413
driven_any_min2.810556097355094
driven_lanedir_consec_max3.2265644372341873
driven_lanedir_consec_mean2.7800455449721
driven_lanedir_consec_min1.622684589491529
driven_lanedir_max3.2265644372341873
driven_lanedir_mean3.0298262252949755
driven_lanedir_median3.135466576581342
driven_lanedir_min2.62180731078303
get_state_dump_max0.020674404303232828
get_state_dump_mean0.020229083498318992
get_state_dump_median0.020250696738560996
get_state_dump_min0.019740536212921145
get_ui_image_max0.04883711894353231
get_ui_image_mean0.04604607939720154
get_ui_image_median0.0458038600285848
get_ui_image_min0.04373947858810425
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.3250000000000015
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.223953626513298, "get_ui_image": 0.04565278768539429, "step_physics": 0.09383796532948813, "survival_time": 14.950000000000076, "driven_lanedir": 3.107988692843164, "get_state_dump": 0.02024230162302653, "sim_render-ego": 0.009895596504211426, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.03067618290583293, "deviation-heading": 1.7544602248952292, "complete-iteration": 0.2659057648976644, "set_robot_commands": 0.008486818472544353, "deviation-center-line": 0.6117431480003486, "driven_lanedir_consec": 3.107988692843164, "sim_compute_sim_state": 0.02274053414662679, "sim_compute_performance-ego": 0.007165380318959554, "sim_compute_robot_state-ego": 0.01415089209874471, "sim_compute_robot_state-parked0": 0.012799808184305829}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.194390746643584, "get_ui_image": 0.04883711894353231, "step_physics": 0.09924083948135376, "survival_time": 14.950000000000076, "driven_lanedir": 3.16294446031952, "get_state_dump": 0.020259091854095457, "sim_render-ego": 0.01003868818283081, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030630164941151936, "deviation-heading": 1.8298043318233383, "complete-iteration": 0.27252716620763145, "set_robot_commands": 0.009199252923329671, "deviation-center-line": 0.6124302922669427, "driven_lanedir_consec": 3.16294446031952, "sim_compute_sim_state": 0.021819953123728433, "sim_compute_performance-ego": 0.006972389221191406, "sim_compute_robot_state-ego": 0.012914257049560549, "sim_compute_robot_state-parked0": 0.012363523642222086}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.810556097355094, "get_ui_image": 0.04373947858810425, "step_physics": 0.0865695055325826, "survival_time": 14.950000000000076, "driven_lanedir": 2.62180731078303, "get_state_dump": 0.019740536212921145, "sim_render-ego": 0.00910330295562744, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.03152235825856527, "deviation-heading": 3.7716278129080982, "complete-iteration": 0.24017937580744425, "set_robot_commands": 0.006481342315673828, "deviation-center-line": 0.7568591499577427, "driven_lanedir_consec": 1.622684589491529, "sim_compute_sim_state": 0.015654629071553548, "sim_compute_performance-ego": 0.006144270896911621, "sim_compute_robot_state-ego": 0.009973737398783366, "sim_compute_robot_state-parked0": 0.010998587608337402}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.261932898353229, "get_ui_image": 0.04595493237177531, "step_physics": 0.10158143838246664, "survival_time": 14.950000000000076, "driven_lanedir": 3.2265644372341873, "get_state_dump": 0.020674404303232828, "sim_render-ego": 0.00950575828552246, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031071027914683025, "deviation-heading": 1.7462390151735503, "complete-iteration": 0.2691916624704997, "set_robot_commands": 0.007404193878173828, "deviation-center-line": 0.7912783832058914, "driven_lanedir_consec": 3.2265644372341873, "sim_compute_sim_state": 0.021878644625345865, "sim_compute_performance-ego": 0.007590078512827556, "sim_compute_robot_state-ego": 0.011641137599945069, "sim_compute_robot_state-parked0": 0.011633698145548503}}
set_robot_commands_max0.009199252923329671
set_robot_commands_mean0.00789290189743042
set_robot_commands_median0.00794550617535909
set_robot_commands_min0.006481342315673828
sim_compute_performance-ego_max0.007590078512827556
sim_compute_performance-ego_mean0.006968029737472534
sim_compute_performance-ego_median0.00706888477007548
sim_compute_performance-ego_min0.006144270896911621
sim_compute_robot_state-ego_max0.01415089209874471
sim_compute_robot_state-ego_mean0.012170006036758423
sim_compute_robot_state-ego_median0.012277697324752809
sim_compute_robot_state-ego_min0.009973737398783366
sim_compute_robot_state-parked0_max0.012799808184305829
sim_compute_robot_state-parked0_mean0.011948904395103451
sim_compute_robot_state-parked0_median0.011998610893885295
sim_compute_robot_state-parked0_min0.010998587608337402
sim_compute_sim_state_max0.02274053414662679
sim_compute_sim_state_mean0.020523440241813656
sim_compute_sim_state_median0.021849298874537147
sim_compute_sim_state_min0.015654629071553548
sim_render-ego_max0.01003868818283081
sim_render-ego_mean0.009635836482048035
sim_render-ego_median0.009700677394866944
sim_render-ego_min0.00910330295562744
simulation-passed1
step_physics_max0.10158143838246664
step_physics_mean0.09530743718147278
step_physics_median0.09653940240542094
step_physics_min0.0865695055325826
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3651510013Anthony CourchesneΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg05-7d9c5d9f1ec5-10:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
β”‚         k: observations
β”‚        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                                field jpg_data : bytes
β”‚                                       __doc__
β”‚                                                         An image in JPG format.
β”‚ 
β”‚                                                         jpg_data
β”‚             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                                field resolution_rad : float
β”‚                                field  axis_left_rad : float
β”‚                                field axis_right_rad : float
β”‚             field your_name : str
β”‚             field     state : dataclass aido_schemas.schemas.DTSimState
β”‚                                field t_effective : float
β”‚                                field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚             field  map_data : str
β”‚        v2: dataclass aido_schemas.schemas.DB20Observations
β”‚             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                               field jpg_data : bytes
β”‚                                      __doc__
β”‚                                                        An image in JPG format.
β”‚ 
β”‚                                                        jpg_data
β”‚             field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                               field resolution_rad : float
β”‚                               field  axis_left_rad : float
β”‚                               field axis_right_rad : float
β”‚         r: CanBeUsed
β”‚            β”‚ result: False
β”‚            β”‚ why:
β”‚            β”‚ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
β”‚            β”‚ | requires field "your_name"
β”‚            β”‚ |  of type <class 'str'>
β”‚            β”‚ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
β”‚            β”‚ M: Matches()
β”‚            β”‚ matches: {}
β”‚ p1_inputs: Dict[str,type][4]
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚            β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                     field jpg_data : bytes
β”‚            β”‚                            __doc__
β”‚            β”‚                                              An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                              jpg_data
β”‚            β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                     field resolution_rad : float
β”‚            β”‚                     field  axis_left_rad : float
β”‚            β”‚                     field axis_right_rad : float
β”‚            β”‚  field your_name : str
β”‚            β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚            β”‚                     field t_effective : float
β”‚            β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚            β”‚  field  map_data : str
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.
β”‚ p2_inputs: dict[4]
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚            β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                    field jpg_data : bytes
β”‚            β”‚                           __doc__
β”‚            β”‚                                             An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                             jpg_data
β”‚            β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                    field resolution_rad : float
β”‚            β”‚                    field  axis_left_rad : float
β”‚            β”‚                    field axis_right_rad : float
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
β”‚ p1: InteractionProtocol
β”‚     β”‚ description: Particularization for Duckiebot1 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ Dict[str,type][4]
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚     β”‚ β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                     field jpg_data : bytes
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                              jpg_data
β”‚     β”‚ β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                     field resolution_rad : float
β”‚     β”‚ β”‚                     field  axis_left_rad : float
β”‚     β”‚ β”‚                     field axis_right_rad : float
β”‚     β”‚ β”‚  field your_name : str
β”‚     β”‚ β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚     β”‚ β”‚                     field t_effective : float
β”‚     β”‚ β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚     β”‚ β”‚  field  map_data : str
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ Dict[str,type][1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.Duckiebot1Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
β”‚ p2: InteractionProtocol
β”‚     β”‚ description: Particularization for DB20 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ dict[4]
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚     β”‚ β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                    field jpg_data : bytes
β”‚     β”‚ β”‚                           __doc__
β”‚     β”‚ β”‚                                             An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                             jpg_data
β”‚     β”‚ β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                    field resolution_rad : float
β”‚     β”‚ β”‚                    field  axis_left_rad : float
β”‚     β”‚ β”‚                    field axis_right_rad : float
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ dict[1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7faabaeec7f0>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3651310012Anthony CourchesneΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg05-7d9c5d9f1ec5-10:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
β”‚         k: observations
β”‚        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                                field jpg_data : bytes
β”‚                                       __doc__
β”‚                                                         An image in JPG format.
β”‚ 
β”‚                                                         jpg_data
β”‚             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                                field resolution_rad : float
β”‚                                field  axis_left_rad : float
β”‚                                field axis_right_rad : float
β”‚             field your_name : str
β”‚             field     state : dataclass aido_schemas.schemas.DTSimState
β”‚                                field t_effective : float
β”‚                                field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚             field  map_data : str
β”‚        v2: dataclass aido_schemas.schemas.DB20Observations
β”‚             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                               field jpg_data : bytes
β”‚                                      __doc__
β”‚                                                        An image in JPG format.
β”‚ 
β”‚                                                        jpg_data
β”‚             field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                               field resolution_rad : float
β”‚                               field  axis_left_rad : float
β”‚                               field axis_right_rad : float
β”‚         r: CanBeUsed
β”‚            β”‚ result: False
β”‚            β”‚ why:
β”‚            β”‚ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
β”‚            β”‚ | requires field "your_name"
β”‚            β”‚ |  of type <class 'str'>
β”‚            β”‚ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
β”‚            β”‚ M: Matches()
β”‚            β”‚ matches: {}
β”‚ p1_inputs: Dict[str,type][4]
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚            β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                     field jpg_data : bytes
β”‚            β”‚                            __doc__
β”‚            β”‚                                              An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                              jpg_data
β”‚            β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                     field resolution_rad : float
β”‚            β”‚                     field  axis_left_rad : float
β”‚            β”‚                     field axis_right_rad : float
β”‚            β”‚  field your_name : str
β”‚            β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚            β”‚                     field t_effective : float
β”‚            β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚            β”‚  field  map_data : str
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.
β”‚ p2_inputs: dict[4]
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚            β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                    field jpg_data : bytes
β”‚            β”‚                           __doc__
β”‚            β”‚                                             An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                             jpg_data
β”‚            β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                    field resolution_rad : float
β”‚            β”‚                    field  axis_left_rad : float
β”‚            β”‚                    field axis_right_rad : float
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
β”‚ p1: InteractionProtocol
β”‚     β”‚ description: Particularization for Duckiebot1 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ Dict[str,type][4]
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚     β”‚ β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                     field jpg_data : bytes
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                              jpg_data
β”‚     β”‚ β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                     field resolution_rad : float
β”‚     β”‚ β”‚                     field  axis_left_rad : float
β”‚     β”‚ β”‚                     field axis_right_rad : float
β”‚     β”‚ β”‚  field your_name : str
β”‚     β”‚ β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚     β”‚ β”‚                     field t_effective : float
β”‚     β”‚ β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚     β”‚ β”‚  field  map_data : str
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ Dict[str,type][1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.Duckiebot1Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
β”‚ p2: InteractionProtocol
β”‚     β”‚ description: Particularization for DB20 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ dict[4]
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚     β”‚ β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                    field jpg_data : bytes
β”‚     β”‚ β”‚                           __doc__
β”‚     β”‚ β”‚                                             An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                             jpg_data
β”‚     β”‚ β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                    field resolution_rad : float
β”‚     β”‚ β”‚                    field  axis_left_rad : float
β”‚     β”‚ β”‚                    field axis_right_rad : float
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ dict[1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7f09f59c6c40>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3651110011Anthony CourchesneΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg05-7d9c5d9f1ec5-10:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
β”‚         k: observations
β”‚        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                                field jpg_data : bytes
β”‚                                       __doc__
β”‚                                                         An image in JPG format.
β”‚ 
β”‚                                                         jpg_data
β”‚             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                                field resolution_rad : float
β”‚                                field  axis_left_rad : float
β”‚                                field axis_right_rad : float
β”‚             field your_name : str
β”‚             field     state : dataclass aido_schemas.schemas.DTSimState
β”‚                                field t_effective : float
β”‚                                field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚             field  map_data : str
β”‚        v2: dataclass aido_schemas.schemas.DB20Observations
β”‚             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                               field jpg_data : bytes
β”‚                                      __doc__
β”‚                                                        An image in JPG format.
β”‚ 
β”‚                                                        jpg_data
β”‚             field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                               field resolution_rad : float
β”‚                               field  axis_left_rad : float
β”‚                               field axis_right_rad : float
β”‚         r: CanBeUsed
β”‚            β”‚ result: False
β”‚            β”‚ why:
β”‚            β”‚ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
β”‚            β”‚ | requires field "your_name"
β”‚            β”‚ |  of type <class 'str'>
β”‚            β”‚ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
β”‚            β”‚ M: Matches()
β”‚            β”‚ matches: {}
β”‚ p1_inputs: Dict[str,type][4]
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚            β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                     field jpg_data : bytes
β”‚            β”‚                            __doc__
β”‚            β”‚                                              An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                              jpg_data
β”‚            β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                     field resolution_rad : float
β”‚            β”‚                     field  axis_left_rad : float
β”‚            β”‚                     field axis_right_rad : float
β”‚            β”‚  field your_name : str
β”‚            β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚            β”‚                     field t_effective : float
β”‚            β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚            β”‚  field  map_data : str
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.
β”‚ p2_inputs: dict[4]
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚            β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                    field jpg_data : bytes
β”‚            β”‚                           __doc__
β”‚            β”‚                                             An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                             jpg_data
β”‚            β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                    field resolution_rad : float
β”‚            β”‚                    field  axis_left_rad : float
β”‚            β”‚                    field axis_right_rad : float
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
β”‚ p1: InteractionProtocol
β”‚     β”‚ description: Particularization for Duckiebot1 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ Dict[str,type][4]
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚     β”‚ β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                     field jpg_data : bytes
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                              jpg_data
β”‚     β”‚ β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                     field resolution_rad : float
β”‚     β”‚ β”‚                     field  axis_left_rad : float
β”‚     β”‚ β”‚                     field axis_right_rad : float
β”‚     β”‚ β”‚  field your_name : str
β”‚     β”‚ β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚     β”‚ β”‚                     field t_effective : float
β”‚     β”‚ β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚     β”‚ β”‚  field  map_data : str
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ Dict[str,type][1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.Duckiebot1Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
β”‚ p2: InteractionProtocol
β”‚     β”‚ description: Particularization for DB20 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ dict[4]
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚     β”‚ β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                    field jpg_data : bytes
β”‚     β”‚ β”‚                           __doc__
β”‚     β”‚ β”‚                                             An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                             jpg_data
β”‚     β”‚ β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                    field resolution_rad : float
β”‚     β”‚ β”‚                    field  axis_left_rad : float
β”‚     β”‚ β”‚                    field axis_right_rad : float
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ dict[1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7f88a5751dc0>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
365036756Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoreg05-7d9c5d9f1ec5-11:00:53
Waited 3604 seconds [...]
Waited 3604 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364946804Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simfailednoreg05-7d9c5d9f1ec5-10:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364906805Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simfailednoreg05-7d9c5d9f1ec5-10:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364836809Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4366244480654584
survival_time_median4.674999999999992
deviation-center-line_median0.30235620843499067
in-drivable-lane_median0.9249999999999968


other stats
agent_compute-ego_max0.030766858259836834
agent_compute-ego_mean0.029293025463235145
agent_compute-ego_median0.02964065074920654
agent_compute-ego_min0.02712394209469066
complete-iteration_max0.2594116942087809
complete-iteration_mean0.2558652040888282
complete-iteration_median0.25767211820565017
complete-iteration_min0.24870488573523128
deviation-center-line_max0.4359954898526317
deviation-center-line_mean0.3095824874105573
deviation-center-line_min0.1976220429196164
deviation-heading_max2.286581164642681
deviation-heading_mean1.1645862618115042
deviation-heading_median0.8548827100318721
deviation-heading_min0.6619984625395918
driven_any_max1.939997261048641
driven_any_mean0.87290559520545
driven_any_median0.5725844520211546
driven_any_min0.4064562157308501
driven_lanedir_consec_max0.6802395853288715
driven_lanedir_consec_mean0.4567689421819272
driven_lanedir_consec_min0.2735872872679206
driven_lanedir_max0.6802395853288715
driven_lanedir_mean0.4567689421819272
driven_lanedir_median0.4366244480654584
driven_lanedir_min0.2735872872679206
get_state_dump_max0.01995720349106134
get_state_dump_mean0.019465303748261695
get_state_dump_median0.01943182391278884
get_state_dump_min0.019040363676407757
get_ui_image_max0.04601252317428589
get_ui_image_mean0.0455719644649356
get_ui_image_median0.04554937692249522
get_ui_image_min0.04517658084046607
in-drivable-lane_max8.700000000000092
in-drivable-lane_mean2.85000000000002
in-drivable-lane_min0.849999999999997
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5129966915856362, "get_ui_image": 0.04584165180430693, "step_physics": 0.09106422312119428, "survival_time": 4.249999999999993, "driven_lanedir": 0.3781075339199065, "get_state_dump": 0.019263368494370405, "sim_render-ego": 0.009782235762652228, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.029172723433550665, "deviation-heading": 0.8218240116725859, "complete-iteration": 0.2560214154860553, "set_robot_commands": 0.008087713578168084, "deviation-center-line": 0.25178734328466934, "driven_lanedir_consec": 0.3781075339199065, "sim_compute_sim_state": 0.02027734027189367, "sim_compute_performance-ego": 0.007083300983204561, "sim_compute_robot_state-ego": 0.013057515200446634, "sim_compute_robot_state-parked0": 0.01215071397669175}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.4064562157308501, "get_ui_image": 0.04525710204068352, "step_physics": 0.09191190845826092, "survival_time": 3.399999999999996, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.019040363676407757, "sim_render-ego": 0.00937652587890625, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02712394209469066, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.24870488573523128, "set_robot_commands": 0.007010459899902344, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.019328471492318547, "sim_compute_performance-ego": 0.006495528361376594, "sim_compute_robot_state-ego": 0.011649450835059671, "sim_compute_robot_state-parked0": 0.011273015947902905}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939997261048641, "get_ui_image": 0.04601252317428589, "step_physics": 0.0954418444633484, "survival_time": 14.950000000000076, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.019600279331207275, "sim_render-ego": 0.00974541187286377, "in-drivable-lane": 8.700000000000092, "agent_compute-ego": 0.030766858259836834, "deviation-heading": 2.286581164642681, "complete-iteration": 0.2594116942087809, "set_robot_commands": 0.007774933973948161, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.018666117986043295, "sim_compute_performance-ego": 0.007488858699798584, "sim_compute_robot_state-ego": 0.012047463258107504, "sim_compute_robot_state-parked0": 0.011622238159179689}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.632172212456673, "get_ui_image": 0.04517658084046607, "step_physics": 0.10222930767956902, "survival_time": 5.09999999999999, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.01995720349106134, "sim_render-ego": 0.008980968419243307, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.030108578064862414, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.2593228209252451, "set_robot_commands": 0.006731570935716816, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.018830949184941312, "sim_compute_performance-ego": 0.00625613390230665, "sim_compute_robot_state-ego": 0.010258298294216978, "sim_compute_robot_state-parked0": 0.010540464345146628}}
set_robot_commands_max0.008087713578168084
set_robot_commands_mean0.007401169596933851
set_robot_commands_median0.0073926969369252525
set_robot_commands_min0.006731570935716816
sim_compute_performance-ego_max0.007488858699798584
sim_compute_performance-ego_mean0.006830955486671598
sim_compute_performance-ego_median0.006789414672290578
sim_compute_performance-ego_min0.00625613390230665
sim_compute_robot_state-ego_max0.013057515200446634
sim_compute_robot_state-ego_mean0.011753181896957695
sim_compute_robot_state-ego_median0.011848457046583587
sim_compute_robot_state-ego_min0.010258298294216978
sim_compute_robot_state-parked0_max0.01215071397669175
sim_compute_robot_state-parked0_mean0.011396608107230245
sim_compute_robot_state-parked0_median0.011447627053541297
sim_compute_robot_state-parked0_min0.010540464345146628
sim_compute_sim_state_max0.02027734027189367
sim_compute_sim_state_mean0.01927571973379921
sim_compute_sim_state_median0.01907971033862993
sim_compute_sim_state_min0.018666117986043295
sim_render-ego_max0.009782235762652228
sim_render-ego_mean0.009471285483416388
sim_render-ego_median0.00956096887588501
sim_render-ego_min0.008980968419243307
simulation-passed1
step_physics_max0.10222930767956902
step_physics_mean0.09516182093059317
step_physics_median0.09367687646080466
step_physics_min0.09106422312119428
survival_time_max14.950000000000076
survival_time_mean6.925000000000014
survival_time_min3.399999999999996
No reset possible
364746821Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.30870654754751
survival_time_median14.950000000000076
deviation-center-line_median0.6305561602997654
in-drivable-lane_median4.9000000000000306


other stats
agent_compute-ego_max0.06158766695248184
agent_compute-ego_mean0.05626748529172713
agent_compute-ego_median0.05998352090517679
agent_compute-ego_min0.04351523240407308
complete-iteration_max0.2981822617848714
complete-iteration_mean0.28836019589695877
complete-iteration_median0.28785068937527236
complete-iteration_min0.279557143052419
deviation-center-line_max1.2534555895984747
deviation-center-line_mean0.6790688687737234
deviation-center-line_min0.20170756489688807
deviation-heading_max2.2269836055362195
deviation-heading_mean1.4414902043407796
deviation-heading_median1.3916340994936112
deviation-heading_min0.7557090128396764
driven_any_max2.271904343292208
driven_any_mean1.88692711350746
driven_any_median1.8641584647686749
driven_any_min1.5474871812002826
driven_lanedir_consec_max2.1221307532213234
driven_lanedir_consec_mean1.3328779760206766
driven_lanedir_consec_min0.5919680557663634
driven_lanedir_max2.1221307532213234
driven_lanedir_mean1.3328779760206766
driven_lanedir_median1.30870654754751
driven_lanedir_min0.5919680557663634
get_state_dump_max0.02047721783320109
get_state_dump_mean0.019435321233605828
get_state_dump_median0.01951398281640904
get_state_dump_min0.018236101468404133
get_ui_image_max0.04666183074315389
get_ui_image_mean0.04597749797246789
get_ui_image_median0.045941988383570026
get_ui_image_min0.045364184379577635
in-drivable-lane_max9.150000000000093
in-drivable-lane_mean4.737500000000038
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.1442097274620164, "get_ui_image": 0.045364184379577635, "step_physics": 0.09522682825724284, "survival_time": 14.950000000000076, "driven_lanedir": 2.1221307532213234, "get_state_dump": 0.02047721783320109, "sim_render-ego": 0.009735254446665446, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04351523240407308, "deviation-heading": 2.0090248902727423, "complete-iteration": 0.279557143052419, "set_robot_commands": 0.008913214206695557, "deviation-center-line": 1.2534555895984747, "driven_lanedir_consec": 2.1221307532213234, "sim_compute_sim_state": 0.023108881314595545, "sim_compute_performance-ego": 0.0069173034032185875, "sim_compute_robot_state-ego": 0.01360386848449707, "sim_compute_robot_state-parked0": 0.012445902824401856}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.271904343292208, "get_ui_image": 0.0459593145052592, "step_physics": 0.09377896070480346, "survival_time": 14.950000000000076, "driven_lanedir": 1.645610915937768, "get_state_dump": 0.019016191959381104, "sim_render-ego": 0.009356690247853598, "in-drivable-lane": 4.20000000000006, "agent_compute-ego": 0.060359349250793455, "deviation-heading": 2.2269836055362195, "complete-iteration": 0.2872391064961751, "set_robot_commands": 0.007855540911356608, "deviation-center-line": 0.8923870941998503, "driven_lanedir_consec": 1.645610915937768, "sim_compute_sim_state": 0.02027290900548299, "sim_compute_performance-ego": 0.006622215906778971, "sim_compute_robot_state-ego": 0.012071229616800945, "sim_compute_robot_state-parked0": 0.011705041726430256}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.5841072020753333, "get_ui_image": 0.045924662261880855, "step_physics": 0.09693778458461969, "survival_time": 9.299999999999995, "driven_lanedir": 0.5919680557663634, "get_state_dump": 0.020011773673436976, "sim_render-ego": 0.009766823501997096, "in-drivable-lane": 5.600000000000002, "agent_compute-ego": 0.06158766695248184, "deviation-heading": 0.7557090128396764, "complete-iteration": 0.2884622722543696, "set_robot_commands": 0.00802873283304194, "deviation-center-line": 0.20170756489688807, "driven_lanedir_consec": 0.5919680557663634, "sim_compute_sim_state": 0.015474334839851623, "sim_compute_performance-ego": 0.006538234731202484, "sim_compute_robot_state-ego": 0.012024606427838725, "sim_compute_robot_state-parked0": 0.011919021606445312}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.5474871812002826, "get_ui_image": 0.04666183074315389, "step_physics": 0.10839986165364585, "survival_time": 14.950000000000076, "driven_lanedir": 0.9718021791572518, "get_state_dump": 0.018236101468404133, "sim_render-ego": 0.009316415786743163, "in-drivable-lane": 9.150000000000093, "agent_compute-ego": 0.05960769255956014, "deviation-heading": 0.7742433087144801, "complete-iteration": 0.2981822617848714, "set_robot_commands": 0.007412096659342448, "deviation-center-line": 0.3687252263996803, "driven_lanedir_consec": 0.9718021791572518, "sim_compute_sim_state": 0.01944803794225057, "sim_compute_performance-ego": 0.006446597576141358, "sim_compute_robot_state-ego": 0.011171374320983888, "sim_compute_robot_state-parked0": 0.01123622179031372}}
set_robot_commands_max0.008913214206695557
set_robot_commands_mean0.008052396152609139
set_robot_commands_median0.007942136872199274
set_robot_commands_min0.007412096659342448
sim_compute_performance-ego_max0.0069173034032185875
sim_compute_performance-ego_mean0.0066310879043353504
sim_compute_performance-ego_median0.006580225318990728
sim_compute_performance-ego_min0.006446597576141358
sim_compute_robot_state-ego_max0.01360386848449707
sim_compute_robot_state-ego_mean0.012217769712530156
sim_compute_robot_state-ego_median0.012047918022319836
sim_compute_robot_state-ego_min0.011171374320983888
sim_compute_robot_state-parked0_max0.012445902824401856
sim_compute_robot_state-parked0_mean0.011826546986897786
sim_compute_robot_state-parked0_median0.011812031666437784
sim_compute_robot_state-parked0_min0.01123622179031372
sim_compute_sim_state_max0.023108881314595545
sim_compute_sim_state_mean0.019576040775545183
sim_compute_sim_state_median0.019860473473866783
sim_compute_sim_state_min0.015474334839851623
sim_render-ego_max0.009766823501997096
sim_render-ego_mean0.009543795995814827
sim_render-ego_median0.009545972347259525
sim_render-ego_min0.009316415786743163
simulation-passed1
step_physics_max0.10839986165364585
step_physics_mean0.09858585880007796
step_physics_median0.09608230642093124
step_physics_min0.09377896070480346
survival_time_max14.950000000000076
survival_time_mean13.537500000000058
survival_time_min9.299999999999995
No reset possible
364676825Liam PaullΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7055954475449944
survival_time_median14.950000000000076
deviation-center-line_median0.4648366280719677
in-drivable-lane_median6.775000000000071


other stats
agent_compute-ego_max0.06126366058985392
agent_compute-ego_mean0.05035842632355333
agent_compute-ego_median0.05450172056957167
agent_compute-ego_min0.031166603565216063
complete-iteration_max0.31050875663757327
complete-iteration_mean0.2842684191019357
complete-iteration_median0.2821368832490882
complete-iteration_min0.262291153271993
deviation-center-line_max0.61980849628257
deviation-center-line_mean0.43295700621565886
deviation-center-line_min0.18234627243613025
deviation-heading_max2.4144606932870736
deviation-heading_mean1.6898112583161562
deviation-heading_median1.6569091820207176
deviation-heading_min1.0309659759361165
driven_any_max1.939975437522146
driven_any_mean1.8487567366756112
driven_any_median1.9367722503738851
driven_any_min1.5815070084325284
driven_lanedir_consec_max1.0185150867013733
driven_lanedir_consec_mean0.7636316125495894
driven_lanedir_consec_min0.6248204684069961
driven_lanedir_max1.5245234324334678
driven_lanedir_mean0.9733950045984736
driven_lanedir_median0.8721180587767153
driven_lanedir_min0.6248204684069961
get_state_dump_max0.020546748638153076
get_state_dump_mean0.019529161931706125
get_state_dump_median0.019470916353926365
get_state_dump_min0.018628066380818684
get_ui_image_max0.04582218726476033
get_ui_image_mean0.04534021467578655
get_ui_image_median0.04538767716511577
get_ui_image_min0.044763317108154295
in-drivable-lane_max8.550000000000082
in-drivable-lane_mean6.200000000000056
in-drivable-lane_min2.6999999999999984
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336577949095364, "get_ui_image": 0.044763317108154295, "step_physics": 0.0938696273167928, "survival_time": 14.950000000000076, "driven_lanedir": 0.7257210308520574, "get_state_dump": 0.02002872228622437, "sim_render-ego": 0.010699435869852702, "in-drivable-lane": 8.550000000000082, "agent_compute-ego": 0.031166603565216063, "deviation-heading": 1.8287503159798613, "complete-iteration": 0.262291153271993, "set_robot_commands": 0.008351051807403564, "deviation-center-line": 0.3876479963392154, "driven_lanedir_consec": 0.7089962590170615, "sim_compute_sim_state": 0.020831772486368815, "sim_compute_performance-ego": 0.006983049710591634, "sim_compute_robot_state-ego": 0.012922439575195312, "sim_compute_robot_state-parked0": 0.012444492975870768}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9398867058382336, "get_ui_image": 0.04519111553827922, "step_physics": 0.10105323870976766, "survival_time": 14.950000000000076, "driven_lanedir": 1.5245234324334678, "get_state_dump": 0.018628066380818684, "sim_render-ego": 0.00965723196665446, "in-drivable-lane": 2.6999999999999984, "agent_compute-ego": 0.04786377191543579, "deviation-heading": 2.4144606932870736, "complete-iteration": 0.28048937797546386, "set_robot_commands": 0.008034207026163738, "deviation-center-line": 0.61980849628257, "driven_lanedir_consec": 0.7021946360729272, "sim_compute_sim_state": 0.01893299738566081, "sim_compute_performance-ego": 0.006692802906036377, "sim_compute_robot_state-ego": 0.012274696032206217, "sim_compute_robot_state-parked0": 0.011933993498484294}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.5815070084325284, "get_ui_image": 0.04558423879195233, "step_physics": 0.09461464200701032, "survival_time": 12.25000000000004, "driven_lanedir": 0.6248204684069961, "get_state_dump": 0.018913110421628368, "sim_render-ego": 0.009526610861019212, "in-drivable-lane": 6.95000000000005, "agent_compute-ego": 0.061139669223707546, "deviation-heading": 1.0309659759361165, "complete-iteration": 0.28378438852271254, "set_robot_commands": 0.00796022317847427, "deviation-center-line": 0.18234627243613025, "driven_lanedir_consec": 0.6248204684069961, "sim_compute_sim_state": 0.015562624834021745, "sim_compute_performance-ego": 0.0067446231842041016, "sim_compute_robot_state-ego": 0.011822728721462951, "sim_compute_robot_state-parked0": 0.011689304818912429}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939975437522146, "get_ui_image": 0.04582218726476033, "step_physics": 0.11630206823349, "survival_time": 14.950000000000076, "driven_lanedir": 1.0185150867013733, "get_state_dump": 0.020546748638153076, "sim_render-ego": 0.0094406525293986, "in-drivable-lane": 6.600000000000094, "agent_compute-ego": 0.06126366058985392, "deviation-heading": 1.485068048061574, "complete-iteration": 0.31050875663757327, "set_robot_commands": 0.007885402838389078, "deviation-center-line": 0.5420252598047199, "driven_lanedir_consec": 1.0185150867013733, "sim_compute_sim_state": 0.019386573632558187, "sim_compute_performance-ego": 0.006500224272410075, "sim_compute_robot_state-ego": 0.011613725026448567, "sim_compute_robot_state-parked0": 0.011520883242289226}}
set_robot_commands_max0.008351051807403564
set_robot_commands_mean0.008057721212607663
set_robot_commands_median0.007997215102319004
set_robot_commands_min0.007885402838389078
sim_compute_performance-ego_max0.006983049710591634
sim_compute_performance-ego_mean0.006730175018310547
sim_compute_performance-ego_median0.006718713045120239
sim_compute_performance-ego_min0.006500224272410075
sim_compute_robot_state-ego_max0.012922439575195312
sim_compute_robot_state-ego_mean0.012158397338828262
sim_compute_robot_state-ego_median0.012048712376834584
sim_compute_robot_state-ego_min0.011613725026448567
sim_compute_robot_state-parked0_max0.012444492975870768
sim_compute_robot_state-parked0_mean0.01189716863388918
sim_compute_robot_state-parked0_median0.01181164915869836
sim_compute_robot_state-parked0_min0.011520883242289226
sim_compute_sim_state_max0.020831772486368815
sim_compute_sim_state_mean0.018678492084652387
sim_compute_sim_state_median0.019159785509109496
sim_compute_sim_state_min0.015562624834021745
sim_render-ego_max0.010699435869852702
sim_render-ego_mean0.009830982806731245
sim_render-ego_median0.009591921413836836
sim_render-ego_min0.0094406525293986
simulation-passed1
step_physics_max0.11630206823349
step_physics_mean0.1014598940667652
step_physics_median0.097833940358389
step_physics_min0.0938696273167928
survival_time_max14.950000000000076
survival_time_mean14.275000000000066
survival_time_min12.25000000000004
No reset possible
364596831Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03059800148010254
agent_compute-ego_mean0.02990216175715129
agent_compute-ego_median0.029963435729344685
agent_compute-ego_min0.029083774089813233
complete-iteration_max0.27654011090596514
complete-iteration_mean0.2617273990313212
complete-iteration_median0.25835851073265076
complete-iteration_min0.2536524637540181
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.020082534154256183
get_state_dump_mean0.019462342659632363
get_state_dump_median0.01942521333694458
get_state_dump_min0.018916409810384116
get_ui_image_max0.046489851474761965
get_ui_image_mean0.04601931254069011
get_ui_image_median0.04603875676790873
get_ui_image_min0.04550988515218099
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04550988515218099, "step_physics": 0.09287269512812296, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020082534154256183, "sim_render-ego": 0.0101536496480306, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03059800148010254, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2608955748875936, "set_robot_commands": 0.008500345547993978, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02033828099568685, "sim_compute_performance-ego": 0.007082375685373942, "sim_compute_robot_state-ego": 0.013090404669443766, "sim_compute_robot_state-parked0": 0.012417833805084228}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04602147658665975, "step_physics": 0.09457791407903036, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.018916409810384116, "sim_render-ego": 0.010123062133789062, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029083774089813233, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.25582144657770794, "set_robot_commands": 0.007782999674479167, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.018574004968007405, "sim_compute_performance-ego": 0.006711354255676269, "sim_compute_robot_state-ego": 0.011948881149291992, "sim_compute_robot_state-parked0": 0.011839179992675782}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.046489851474761965, "step_physics": 0.09619715770085652, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.019190794626871743, "sim_render-ego": 0.009519352912902831, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030204657713572183, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2536524637540181, "set_robot_commands": 0.007453800837198893, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.01500230391820272, "sim_compute_performance-ego": 0.006483161449432373, "sim_compute_robot_state-ego": 0.011396955649058025, "sim_compute_robot_state-parked0": 0.011468772888183591}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04605603694915771, "step_physics": 0.11472877025604249, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019659632047017418, "sim_render-ego": 0.00968689521153768, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029722213745117188, "deviation-heading": 0.486072248607516, "complete-iteration": 0.27654011090596514, "set_robot_commands": 0.007618481318155924, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.018097538153330484, "sim_compute_performance-ego": 0.006780996322631836, "sim_compute_robot_state-ego": 0.012290805180867514, "sim_compute_robot_state-parked0": 0.011650564670562745}}
set_robot_commands_max0.008500345547993978
set_robot_commands_mean0.00783890684445699
set_robot_commands_median0.007700740496317545
set_robot_commands_min0.007453800837198893
sim_compute_performance-ego_max0.007082375685373942
sim_compute_performance-ego_mean0.006764471928278604
sim_compute_performance-ego_median0.006746175289154053
sim_compute_performance-ego_min0.006483161449432373
sim_compute_robot_state-ego_max0.013090404669443766
sim_compute_robot_state-ego_mean0.012181761662165324
sim_compute_robot_state-ego_median0.012119843165079754
sim_compute_robot_state-ego_min0.011396955649058025
sim_compute_robot_state-parked0_max0.012417833805084228
sim_compute_robot_state-parked0_mean0.011844087839126587
sim_compute_robot_state-parked0_median0.011744872331619263
sim_compute_robot_state-parked0_min0.011468772888183591
sim_compute_sim_state_max0.02033828099568685
sim_compute_sim_state_mean0.018003032008806864
sim_compute_sim_state_median0.018335771560668943
sim_compute_sim_state_min0.01500230391820272
sim_render-ego_max0.0101536496480306
sim_render-ego_mean0.009870739976565042
sim_render-ego_median0.009904978672663371
sim_render-ego_min0.009519352912902831
simulation-passed1
step_physics_max0.11472877025604249
step_physics_mean0.09959413429101308
step_physics_median0.09538753588994343
step_physics_min0.09287269512812296
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
364526838Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03108600378036499
agent_compute-ego_mean0.030028845071792605
agent_compute-ego_median0.030207053820292155
agent_compute-ego_min0.02861526886622111
complete-iteration_max0.2728192400932312
complete-iteration_mean0.2580228841304779
complete-iteration_median0.2546696563561758
complete-iteration_min0.24993298371632897
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.020324477354685466
get_state_dump_mean0.019279302755991615
get_state_dump_median0.01926720420519511
get_state_dump_min0.018258325258890783
get_ui_image_max0.04639170010884603
get_ui_image_mean0.046076570153236386
get_ui_image_median0.04600366234779358
get_ui_image_min0.04590725580851237
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04604565302530925, "step_physics": 0.08899007399876913, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020324477354685466, "sim_render-ego": 0.009860196908315022, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03108600378036499, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2553344480196635, "set_robot_commands": 0.007823224862416584, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020194148222605388, "sim_compute_performance-ego": 0.006745477517445882, "sim_compute_robot_state-ego": 0.011932249069213868, "sim_compute_robot_state-parked0": 0.01208189884821574}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04596167167027791, "step_physics": 0.09415446201960244, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.018258325258890783, "sim_render-ego": 0.009290796915690104, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02861526886622111, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.24993298371632897, "set_robot_commands": 0.007297921975453695, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01769838492075602, "sim_compute_performance-ego": 0.006395134131113688, "sim_compute_robot_state-ego": 0.011026525497436525, "sim_compute_robot_state-parked0": 0.010994319915771484}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04590725580851237, "step_physics": 0.09194844404856364, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.01957188924153646, "sim_render-ego": 0.00998170296351115, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03104613780975342, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.254004864692688, "set_robot_commands": 0.008104999860127768, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.015309462547302246, "sim_compute_performance-ego": 0.006896396478017171, "sim_compute_robot_state-ego": 0.012644306023915608, "sim_compute_robot_state-parked0": 0.012348446051279703}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04639170010884603, "step_physics": 0.11426788171132406, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01896251916885376, "sim_render-ego": 0.009467790126800536, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02936796983083089, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2728192400932312, "set_robot_commands": 0.007055007616678874, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01809092442194621, "sim_compute_performance-ego": 0.006467568079630534, "sim_compute_robot_state-ego": 0.011283167203267415, "sim_compute_robot_state-parked0": 0.011217751502990723}}
set_robot_commands_max0.008104999860127768
set_robot_commands_mean0.007570288578669229
set_robot_commands_median0.007560573418935139
set_robot_commands_min0.007055007616678874
sim_compute_performance-ego_max0.006896396478017171
sim_compute_performance-ego_mean0.006626144051551819
sim_compute_performance-ego_median0.006606522798538208
sim_compute_performance-ego_min0.006395134131113688
sim_compute_robot_state-ego_max0.012644306023915608
sim_compute_robot_state-ego_mean0.011721561948458354
sim_compute_robot_state-ego_median0.011607708136240642
sim_compute_robot_state-ego_min0.011026525497436525
sim_compute_robot_state-parked0_max0.012348446051279703
sim_compute_robot_state-parked0_mean0.011660604079564412
sim_compute_robot_state-parked0_median0.011649825175603232
sim_compute_robot_state-parked0_min0.010994319915771484
sim_compute_sim_state_max0.020194148222605388
sim_compute_sim_state_mean0.01782323002815247
sim_compute_sim_state_median0.017894654671351116
sim_compute_sim_state_min0.015309462547302246
sim_render-ego_max0.00998170296351115
sim_render-ego_mean0.009650121728579203
sim_render-ego_median0.00966399351755778
sim_render-ego_min0.009290796915690104
simulation-passed1
step_physics_max0.11426788171132406
step_physics_mean0.09734021544456482
step_physics_median0.09305145303408303
step_physics_min0.08899007399876913
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
364446845Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9919131850210048
survival_time_median14.950000000000076
deviation-center-line_median0.5376744170062344
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.030582931836446125
agent_compute-ego_mean0.029582977493604026
agent_compute-ego_median0.029544856548309326
agent_compute-ego_min0.02865926504135132
complete-iteration_max0.2682782046000163
complete-iteration_mean0.2583990691105525
complete-iteration_median0.25791325529416403
complete-iteration_min0.24949156125386557
deviation-center-line_max0.8647180556161689
deviation-center-line_mean0.5804452288881085
deviation-center-line_min0.3817140259237961
deviation-heading_max5.0575671878978365
deviation-heading_mean3.7790097445261055
deviation-heading_median3.6916851082433313
deviation-heading_min2.6751015737199233
driven_any_max2.590387413301859
driven_any_mean2.0766696508825313
driven_any_median2.050311120324974
driven_any_min1.615668949578317
driven_lanedir_consec_max2.5600110735315167
driven_lanedir_consec_mean1.947142759137375
driven_lanedir_consec_min1.2447335929759724
driven_lanedir_max2.5600110735315167
driven_lanedir_mean1.947142759137375
driven_lanedir_median1.9919131850210048
driven_lanedir_min1.2447335929759724
get_state_dump_max0.020297861099243163
get_state_dump_mean0.018703444997469586
get_state_dump_median0.01819693684577942
get_state_dump_min0.018122045199076335
get_ui_image_max0.04664100646972656
get_ui_image_mean0.04578361670176189
get_ui_image_median0.0458897320429484
get_ui_image_min0.04471399625142415
in-drivable-lane_max3.350000000000013
in-drivable-lane_mean0.8375000000000032
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.105463179935752, "get_ui_image": 0.04471399625142415, "step_physics": 0.08980240027109782, "survival_time": 14.950000000000076, "driven_lanedir": 2.0269846512753578, "get_state_dump": 0.020297861099243163, "sim_render-ego": 0.009698340098063153, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030582931836446125, "deviation-heading": 2.8525984532516526, "complete-iteration": 0.25684293667475383, "set_robot_commands": 0.008279976844787597, "deviation-center-line": 0.5767809883691923, "driven_lanedir_consec": 2.0269846512753578, "sim_compute_sim_state": 0.02147586027781169, "sim_compute_performance-ego": 0.006832675139109293, "sim_compute_robot_state-ego": 0.01282379706700643, "sim_compute_robot_state-parked0": 0.012084318002065024}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.995159060714197, "get_ui_image": 0.04567007382710775, "step_physics": 0.0986124046643575, "survival_time": 14.950000000000076, "driven_lanedir": 1.9568417187666511, "get_state_dump": 0.018122045199076335, "sim_render-ego": 0.009350210825602213, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02943854014078776, "deviation-heading": 5.0575671878978365, "complete-iteration": 0.25898357391357424, "set_robot_commands": 0.007501599788665772, "deviation-center-line": 0.3817140259237961, "driven_lanedir_consec": 1.9568417187666511, "sim_compute_sim_state": 0.0206527837117513, "sim_compute_performance-ego": 0.006467609405517578, "sim_compute_robot_state-ego": 0.01162805716196696, "sim_compute_robot_state-parked0": 0.0113042147954305}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.615668949578317, "get_ui_image": 0.04610939025878906, "step_physics": 0.09616788148880004, "survival_time": 14.950000000000076, "driven_lanedir": 1.2447335929759724, "get_state_dump": 0.018201744556427, "sim_render-ego": 0.00901216427485148, "in-drivable-lane": 3.350000000000013, "agent_compute-ego": 0.029651172955830897, "deviation-heading": 4.53077176323501, "complete-iteration": 0.24949156125386557, "set_robot_commands": 0.006721642812093099, "deviation-center-line": 0.8647180556161689, "driven_lanedir_consec": 1.2447335929759724, "sim_compute_sim_state": 0.016109543641408285, "sim_compute_performance-ego": 0.006023565928141276, "sim_compute_robot_state-ego": 0.010454087257385256, "sim_compute_robot_state-parked0": 0.01079954465230306}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.590387413301859, "get_ui_image": 0.04664100646972656, "step_physics": 0.10831920782725016, "survival_time": 14.950000000000076, "driven_lanedir": 2.5600110735315167, "get_state_dump": 0.01819212913513184, "sim_render-ego": 0.009343833128611246, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02865926504135132, "deviation-heading": 2.6751015737199233, "complete-iteration": 0.2682782046000163, "set_robot_commands": 0.007396800518035889, "deviation-center-line": 0.4985678456432764, "driven_lanedir_consec": 2.5600110735315167, "sim_compute_sim_state": 0.02063042163848877, "sim_compute_performance-ego": 0.006403943697611491, "sim_compute_robot_state-ego": 0.011264511744181315, "sim_compute_robot_state-parked0": 0.011188294092814128}}
set_robot_commands_max0.008279976844787597
set_robot_commands_mean0.007475004990895588
set_robot_commands_median0.00744920015335083
set_robot_commands_min0.006721642812093099
sim_compute_performance-ego_max0.006832675139109293
sim_compute_performance-ego_mean0.00643194854259491
sim_compute_performance-ego_median0.006435776551564534
sim_compute_performance-ego_min0.006023565928141276
sim_compute_robot_state-ego_max0.01282379706700643
sim_compute_robot_state-ego_mean0.01154261330763499
sim_compute_robot_state-ego_median0.011446284453074138
sim_compute_robot_state-ego_min0.010454087257385256
sim_compute_robot_state-parked0_max0.012084318002065024
sim_compute_robot_state-parked0_mean0.011344092885653178
sim_compute_robot_state-parked0_median0.011246254444122314
sim_compute_robot_state-parked0_min0.01079954465230306
sim_compute_sim_state_max0.02147586027781169
sim_compute_sim_state_mean0.01971715231736501
sim_compute_sim_state_median0.020641602675120035
sim_compute_sim_state_min0.016109543641408285
sim_render-ego_max0.009698340098063153
sim_render-ego_mean0.009351137081782025
sim_render-ego_median0.00934702197710673
sim_render-ego_min0.00901216427485148
simulation-passed1
step_physics_max0.10831920782725016
step_physics_mean0.0982254735628764
step_physics_median0.09739014307657878
step_physics_min0.08980240027109782
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
364386851Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:09:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7233303747424793
survival_time_median13.275000000000054
deviation-center-line_median0.47778584881313063
in-drivable-lane_median3.75000000000005


other stats
agent_compute-ego_max0.029476957661764964
agent_compute-ego_mean0.028987026118194724
agent_compute-ego_median0.028954701821009315
agent_compute-ego_min0.028561743168995297
complete-iteration_max0.26210188229878745
complete-iteration_mean0.25569515358993083
complete-iteration_median0.25750464451454935
complete-iteration_min0.2456694430318372
deviation-center-line_max0.6097422584060069
deviation-center-line_mean0.4168628511085999
deviation-center-line_min0.10213744840213149
deviation-heading_max1.53532905643229
deviation-heading_mean1.303919718105491
deviation-heading_median1.449992947547586
deviation-heading_min0.7803639208945006
driven_any_max3.021137220058124
driven_any_mean2.6308599074923107
driven_any_median2.6281268065955423
driven_any_min2.246048796720033
driven_lanedir_consec_max2.1450660664080052
driven_lanedir_consec_mean1.5616382658286936
driven_lanedir_consec_min0.6548262474218102
driven_lanedir_max2.1450660664080052
driven_lanedir_mean1.5616382658286936
driven_lanedir_median1.7233303747424793
driven_lanedir_min0.6548262474218102
get_state_dump_max0.019426971276601156
get_state_dump_mean0.019120804383151835
get_state_dump_median0.01906785786151886
get_state_dump_min0.018920530532968455
get_ui_image_max0.0453797968228658
get_ui_image_mean0.044780214233033376
get_ui_image_median0.04469723737665585
get_ui_image_min0.04434658535595598
in-drivable-lane_max11.250000000000082
in-drivable-lane_mean5.075000000000051
in-drivable-lane_min1.550000000000022
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.246048796720033, "get_ui_image": 0.04480807376759393, "step_physics": 0.09463962593248912, "survival_time": 11.200000000000024, "driven_lanedir": 1.4705884791336734, "get_state_dump": 0.019088298082351685, "sim_render-ego": 0.009655573538371496, "in-drivable-lane": 3.5000000000000435, "agent_compute-ego": 0.029476957661764964, "deviation-heading": 1.45111167251978, "complete-iteration": 0.25733160440410885, "set_robot_commands": 0.007989265024662018, "deviation-center-line": 0.3837809854755123, "driven_lanedir_consec": 1.4705884791336734, "sim_compute_sim_state": 0.021144411393574307, "sim_compute_performance-ego": 0.0064905062317848206, "sim_compute_robot_state-ego": 0.012168715042727334, "sim_compute_robot_state-parked0": 0.011650868824550084}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.2979520923390293, "get_ui_image": 0.04434658535595598, "step_physics": 0.0902282934764336, "survival_time": 11.60000000000003, "driven_lanedir": 1.9760722703512852, "get_state_dump": 0.018920530532968455, "sim_render-ego": 0.008812788231619474, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.028561743168995297, "deviation-heading": 1.4488742225753917, "complete-iteration": 0.2456694430318372, "set_robot_commands": 0.006949418577654609, "deviation-center-line": 0.571790712150749, "driven_lanedir_consec": 1.9760722703512852, "sim_compute_sim_state": 0.020755649640642363, "sim_compute_performance-ego": 0.005891645776814428, "sim_compute_robot_state-ego": 0.010391579619769392, "sim_compute_robot_state-parked0": 0.010595725528125105}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.958301520852056, "get_ui_image": 0.0453797968228658, "step_physics": 0.10115415970484416, "survival_time": 14.950000000000076, "driven_lanedir": 0.6548262474218102, "get_state_dump": 0.019426971276601156, "sim_render-ego": 0.009472374121348064, "in-drivable-lane": 11.250000000000082, "agent_compute-ego": 0.02879499594370524, "deviation-heading": 0.7803639208945006, "complete-iteration": 0.2576776846249898, "set_robot_commands": 0.007539467811584473, "deviation-center-line": 0.10213744840213149, "driven_lanedir_consec": 0.6548262474218102, "sim_compute_sim_state": 0.01664474089940389, "sim_compute_performance-ego": 0.0063778114318847655, "sim_compute_robot_state-ego": 0.011614045302073162, "sim_compute_robot_state-parked0": 0.011054420471191406}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.021137220058124, "get_ui_image": 0.044586400985717776, "step_physics": 0.10180858532587687, "survival_time": 14.950000000000076, "driven_lanedir": 2.1450660664080052, "get_state_dump": 0.019047417640686036, "sim_render-ego": 0.00947632869084676, "in-drivable-lane": 4.000000000000057, "agent_compute-ego": 0.029114407698313395, "deviation-heading": 1.53532905643229, "complete-iteration": 0.26210188229878745, "set_robot_commands": 0.007576462427775065, "deviation-center-line": 0.6097422584060069, "driven_lanedir_consec": 2.1450660664080052, "sim_compute_sim_state": 0.020640060106913247, "sim_compute_performance-ego": 0.006360568205515543, "sim_compute_robot_state-ego": 0.011798181533813476, "sim_compute_robot_state-parked0": 0.011474546591440836}}
set_robot_commands_max0.007989265024662018
set_robot_commands_mean0.007513653460419041
set_robot_commands_median0.007557965119679769
set_robot_commands_min0.006949418577654609
sim_compute_performance-ego_max0.0064905062317848206
sim_compute_performance-ego_mean0.006280132911499889
sim_compute_performance-ego_median0.0063691898187001545
sim_compute_performance-ego_min0.005891645776814428
sim_compute_robot_state-ego_max0.012168715042727334
sim_compute_robot_state-ego_mean0.01149313037459584
sim_compute_robot_state-ego_median0.01170611341794332
sim_compute_robot_state-ego_min0.010391579619769392
sim_compute_robot_state-parked0_max0.011650868824550084
sim_compute_robot_state-parked0_mean0.011193890353826858
sim_compute_robot_state-parked0_median0.011264483531316122
sim_compute_robot_state-parked0_min0.010595725528125105
sim_compute_sim_state_max0.021144411393574307
sim_compute_sim_state_mean0.019796215510133452
sim_compute_sim_state_median0.020697854873777805
sim_compute_sim_state_min0.01664474089940389
sim_render-ego_max0.009655573538371496
sim_render-ego_mean0.009354266145546448
sim_render-ego_median0.009474351406097412
sim_render-ego_min0.008812788231619474
simulation-passed1
step_physics_max0.10180858532587687
step_physics_mean0.09695766610991094
step_physics_median0.09789689281866663
step_physics_min0.0902282934764336
survival_time_max14.950000000000076
survival_time_mean13.17500000000005
survival_time_min11.200000000000024
No reset possible
364366851Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg05-7d9c5d9f1ec5-10:00:17
Error while running [...]
Error while running Docker Compose:

Could not run command
β”‚    cmd: [docker-compose, -p, reg05-7d9c5d9f1ec5-1-job36436-578473, pull]
β”‚ stdout: ''
β”‚  sderr: ''
β”‚      e: Command '['docker-compose', '-p', 'reg05-7d9c5d9f1ec5-1-job36436-578473', 'pull']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364189236Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.108973644232075
survival_time_median14.100000000000064
deviation-center-line_median0.6464879765214254
in-drivable-lane_median3.4750000000000494


other stats
agent_compute-ego_max0.06230332421474769
agent_compute-ego_mean0.05925163312785316
agent_compute-ego_median0.061523377343599195
agent_compute-ego_min0.05165645360946655
complete-iteration_max0.2955342008055543
complete-iteration_mean0.28944372652134776
complete-iteration_median0.29062780002336125
complete-iteration_min0.28098510523311426
deviation-center-line_max1.110648025802017
deviation-center-line_mean0.6417606998781583
deviation-center-line_min0.16341882066776542
deviation-heading_max1.8702777206863224
deviation-heading_mean1.334271994666702
deviation-heading_median1.4145044745237527
deviation-heading_min0.6378013089329795
driven_any_max3.0531604456171952
driven_any_mean2.827421506100807
driven_any_median2.884951585491467
driven_any_min2.4866224078030985
driven_lanedir_consec_max2.9463006251112205
driven_lanedir_consec_mean1.9409177876178136
driven_lanedir_consec_min0.5994232368958818
driven_lanedir_max2.9463006251112205
driven_lanedir_mean1.9409177876178136
driven_lanedir_median2.108973644232075
driven_lanedir_min0.5994232368958818
get_state_dump_max0.01928605107094744
get_state_dump_mean0.01898606315537618
get_state_dump_median0.019067479313397015
get_state_dump_min0.01852324292376325
get_ui_image_max0.04687024752298991
get_ui_image_mean0.04589929979325737
get_ui_image_median0.04600852524606949
get_ui_image_min0.044709901157900585
in-drivable-lane_max8.900000000000041
in-drivable-lane_mean4.037500000000036
in-drivable-lane_min0.30000000000000426
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0531604456171952, "get_ui_image": 0.04687024752298991, "step_physics": 0.09777876297632854, "survival_time": 14.950000000000076, "driven_lanedir": 2.9463006251112205, "get_state_dump": 0.019210488796234132, "sim_render-ego": 0.009623472690582276, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.05165645360946655, "deviation-heading": 1.8702777206863224, "complete-iteration": 0.2884304889043172, "set_robot_commands": 0.00779471476872762, "deviation-center-line": 1.110648025802017, "driven_lanedir_consec": 2.9463006251112205, "sim_compute_sim_state": 0.024870715141296382, "sim_compute_performance-ego": 0.006659850279490153, "sim_compute_robot_state-ego": 0.01208282788594564, "sim_compute_robot_state-parked0": 0.011639317671457927}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9268798847578803, "get_ui_image": 0.04662055152279514, "step_physics": 0.0969580887080906, "survival_time": 14.300000000000068, "driven_lanedir": 2.1262191310716143, "get_state_dump": 0.01852324292376325, "sim_render-ego": 0.009597910034072983, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.061124005517759525, "deviation-heading": 1.4644378375383953, "complete-iteration": 0.2928251111424053, "set_robot_commands": 0.00796696439489618, "deviation-center-line": 0.6577802337349906, "driven_lanedir_consec": 2.1262191310716143, "sim_compute_sim_state": 0.02132218784385628, "sim_compute_performance-ego": 0.006754787651808945, "sim_compute_robot_state-ego": 0.011864617987946196, "sim_compute_robot_state-parked0": 0.011845123517763364}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4866224078030985, "get_ui_image": 0.04539649896934384, "step_physics": 0.09391012738962642, "survival_time": 12.200000000000038, "driven_lanedir": 0.5994232368958818, "get_state_dump": 0.0189244698305599, "sim_render-ego": 0.009209819504472076, "in-drivable-lane": 8.900000000000041, "agent_compute-ego": 0.06230332421474769, "deviation-heading": 0.6378013089329795, "complete-iteration": 0.28098510523311426, "set_robot_commands": 0.007175386929121174, "deviation-center-line": 0.16341882066776542, "driven_lanedir_consec": 0.5994232368958818, "sim_compute_sim_state": 0.015171916758427854, "sim_compute_performance-ego": 0.006178717144200059, "sim_compute_robot_state-ego": 0.011365390214763705, "sim_compute_robot_state-parked0": 0.011111258483323895}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.843023286225053, "get_ui_image": 0.044709901157900585, "step_physics": 0.100839894452541, "survival_time": 13.900000000000064, "driven_lanedir": 2.0917281573925357, "get_state_dump": 0.01928605107094744, "sim_render-ego": 0.009595976459036627, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.061922749169438865, "deviation-heading": 1.36457111150911, "complete-iteration": 0.2955342008055543, "set_robot_commands": 0.007797391294575424, "deviation-center-line": 0.6351957193078602, "driven_lanedir_consec": 2.0917281573925357, "sim_compute_sim_state": 0.02077110465481985, "sim_compute_performance-ego": 0.0066823993655417465, "sim_compute_robot_state-ego": 0.011966004646081718, "sim_compute_robot_state-parked0": 0.01172156385380587}}
set_robot_commands_max0.00796696439489618
set_robot_commands_mean0.007683614346830099
set_robot_commands_median0.007796053031651522
set_robot_commands_min0.007175386929121174
sim_compute_performance-ego_max0.006754787651808945
sim_compute_performance-ego_mean0.006568938610260226
sim_compute_performance-ego_median0.00667112482251595
sim_compute_performance-ego_min0.006178717144200059
sim_compute_robot_state-ego_max0.01208282788594564
sim_compute_robot_state-ego_mean0.011819710183684317
sim_compute_robot_state-ego_median0.011915311317013958
sim_compute_robot_state-ego_min0.011365390214763705
sim_compute_robot_state-parked0_max0.011845123517763364
sim_compute_robot_state-parked0_mean0.011579315881587764
sim_compute_robot_state-parked0_median0.0116804407626319
sim_compute_robot_state-parked0_min0.011111258483323895
sim_compute_sim_state_max0.024870715141296382
sim_compute_sim_state_mean0.020533981099600092
sim_compute_sim_state_median0.021046646249338063
sim_compute_sim_state_min0.015171916758427854
sim_render-ego_max0.009623472690582276
sim_render-ego_mean0.009506794672040991
sim_render-ego_median0.009596943246554804
sim_render-ego_min0.009209819504472076
simulation-passed1
step_physics_max0.100839894452541
step_physics_mean0.09737171838164664
step_physics_median0.09736842584220956
step_physics_min0.09391012738962642
survival_time_max14.950000000000076
survival_time_mean13.837500000000064
survival_time_min12.200000000000038
No reset possible
363979250Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8517505894941453
survival_time_median14.775000000000077
deviation-center-line_median0.4541335280588415
in-drivable-lane_median3.3250000000000473


other stats
agent_compute-ego_max0.03064012200865027
agent_compute-ego_mean0.030029837857984035
agent_compute-ego_median0.030003820644260125
agent_compute-ego_min0.029471588134765626
complete-iteration_max0.266620593528225
complete-iteration_mean0.2620289045402061
complete-iteration_median0.2625785888588361
complete-iteration_min0.25633784691492717
deviation-center-line_max0.5219181035488373
deviation-center-line_mean0.4406557144845037
deviation-center-line_min0.33243769827149433
deviation-heading_max1.7629798634307938
deviation-heading_mean1.336075190876571
deviation-heading_median1.2268536795707503
deviation-heading_min1.127613540933988
driven_any_max2.503504075381788
driven_any_mean2.2376966102518687
driven_any_median2.302214978854499
driven_any_min1.8428524079166888
driven_lanedir_consec_max2.031741054079831
driven_lanedir_consec_mean1.7923297695834703
driven_lanedir_consec_min1.4340768452657604
driven_lanedir_max2.031741054079831
driven_lanedir_mean1.7923297695834703
driven_lanedir_median1.8517505894941453
driven_lanedir_min1.4340768452657604
get_state_dump_max0.02094973521689846
get_state_dump_mean0.01929960959873446
get_state_dump_median0.018927694249287835
get_state_dump_min0.018393314679463705
get_ui_image_max0.04635456879933675
get_ui_image_mean0.04581163587630897
get_ui_image_median0.04566008280401361
get_ui_image_min0.045571809097871945
in-drivable-lane_max3.5500000000000504
in-drivable-lane_mean3.3250000000000473
in-drivable-lane_min3.100000000000044
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8428524079166888, "get_ui_image": 0.045571809097871945, "step_physics": 0.0941107485253932, "survival_time": 11.800000000000033, "driven_lanedir": 1.4340768452657604, "get_state_dump": 0.018751476780842928, "sim_render-ego": 0.009969146574957895, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.029733143620571847, "deviation-heading": 1.182141921858862, "complete-iteration": 0.25912065930285694, "set_robot_commands": 0.008138998080108125, "deviation-center-line": 0.33243769827149433, "driven_lanedir_consec": 1.4340768452657604, "sim_compute_sim_state": 0.021368230803538175, "sim_compute_performance-ego": 0.0067636562606035655, "sim_compute_robot_state-ego": 0.012403452800492107, "sim_compute_robot_state-parked0": 0.012081557411258504}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.503504075381788, "get_ui_image": 0.04563354015350342, "step_physics": 0.0940020481745402, "survival_time": 14.950000000000076, "driven_lanedir": 2.031741054079831, "get_state_dump": 0.019103911717732742, "sim_render-ego": 0.00966129223505656, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.029471588134765626, "deviation-heading": 1.2715654372826388, "complete-iteration": 0.25633784691492717, "set_robot_commands": 0.007586118380228679, "deviation-center-line": 0.4460941186890792, "driven_lanedir_consec": 2.031741054079831, "sim_compute_sim_state": 0.020420092741648355, "sim_compute_performance-ego": 0.00668947696685791, "sim_compute_robot_state-ego": 0.0121549654006958, "sim_compute_robot_state-parked0": 0.011378379662831624}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.1841667099014095, "get_ui_image": 0.04635456879933675, "step_physics": 0.1064252503712972, "survival_time": 14.950000000000076, "driven_lanedir": 1.7091006784202216, "get_state_dump": 0.018393314679463705, "sim_render-ego": 0.00953381061553955, "in-drivable-lane": 3.5500000000000504, "agent_compute-ego": 0.03027449766794841, "deviation-heading": 1.7629798634307938, "complete-iteration": 0.2660365184148153, "set_robot_commands": 0.007744672298431396, "deviation-center-line": 0.5219181035488373, "driven_lanedir_consec": 1.7091006784202216, "sim_compute_sim_state": 0.01753437598546346, "sim_compute_performance-ego": 0.006551620165506999, "sim_compute_robot_state-ego": 0.011467349529266358, "sim_compute_robot_state-parked0": 0.011526382764180502}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.420263247807588, "get_ui_image": 0.045686625454523795, "step_physics": 0.09852702078753955, "survival_time": 14.600000000000072, "driven_lanedir": 1.994400500568069, "get_state_dump": 0.02094973521689846, "sim_render-ego": 0.009806618298569773, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.03064012200865027, "deviation-heading": 1.127613540933988, "complete-iteration": 0.266620593528225, "set_robot_commands": 0.008005267136717497, "deviation-center-line": 0.462172937428604, "driven_lanedir_consec": 1.994400500568069, "sim_compute_sim_state": 0.02134223588525433, "sim_compute_performance-ego": 0.00704487872450319, "sim_compute_robot_state-ego": 0.01235597264276792, "sim_compute_robot_state-parked0": 0.012017875501554306}}
set_robot_commands_max0.008138998080108125
set_robot_commands_mean0.007868763973871424
set_robot_commands_median0.007874969717574447
set_robot_commands_min0.007586118380228679
sim_compute_performance-ego_max0.00704487872450319
sim_compute_performance-ego_mean0.006762408029367916
sim_compute_performance-ego_median0.006726566613730738
sim_compute_performance-ego_min0.006551620165506999
sim_compute_robot_state-ego_max0.012403452800492107
sim_compute_robot_state-ego_mean0.012095435093305544
sim_compute_robot_state-ego_median0.01225546902173186
sim_compute_robot_state-ego_min0.011467349529266358
sim_compute_robot_state-parked0_max0.012081557411258504
sim_compute_robot_state-parked0_mean0.011751048834956236
sim_compute_robot_state-parked0_median0.011772129132867404
sim_compute_robot_state-parked0_min0.011378379662831624
sim_compute_sim_state_max0.021368230803538175
sim_compute_sim_state_mean0.02016623385397608
sim_compute_sim_state_median0.020881164313451345
sim_compute_sim_state_min0.01753437598546346
sim_render-ego_max0.009969146574957895
sim_render-ego_mean0.009742716931030944
sim_render-ego_median0.009733955266813164
sim_render-ego_min0.00953381061553955
simulation-passed1
step_physics_max0.1064252503712972
step_physics_mean0.09826626696469254
step_physics_median0.09631888465646636
step_physics_min0.0940020481745402
survival_time_max14.950000000000076
survival_time_mean14.075000000000063
survival_time_min11.800000000000033
No reset possible
363819264Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5943161738698723
survival_time_median14.950000000000076
deviation-center-line_median0.5842225306744973
in-drivable-lane_median3.625000000000018


other stats
agent_compute-ego_max0.094382746219635
agent_compute-ego_mean0.0879132541465522
agent_compute-ego_median0.0865694530804952
agent_compute-ego_min0.08413136420558341
complete-iteration_max0.33889803012212116
complete-iteration_mean0.3183409690886588
complete-iteration_median0.3130860543251037
complete-iteration_min0.3082937375823064
deviation-center-line_max1.0927330127866357
deviation-center-line_mean0.6347144895287107
deviation-center-line_min0.27767988397921267
deviation-heading_max4.072956184979164
deviation-heading_mean2.269372145815261
deviation-heading_median2.0690770069196738
deviation-heading_min0.866378384442531
driven_any_max4.2167868258031
driven_any_mean3.6858601249015472
driven_any_median3.832616861966621
driven_any_min2.861419949869848
driven_lanedir_consec_max3.4770585957034914
driven_lanedir_consec_mean2.6733932543148637
driven_lanedir_consec_min2.0278820738162184
driven_lanedir_max3.4770585957034914
driven_lanedir_mean2.93381040026194
driven_lanedir_median3.115150465764025
driven_lanedir_min2.0278820738162184
get_state_dump_max0.019319500128428143
get_state_dump_mean0.018914010246001665
get_state_dump_median0.018876179693943233
get_state_dump_min0.018584181467692057
get_ui_image_max0.04781121969223023
get_ui_image_mean0.04588768758287477
get_ui_image_median0.045577460924784347
get_ui_image_min0.04458460878970018
in-drivable-lane_max5.400000000000037
in-drivable-lane_mean3.4625000000000177
in-drivable-lane_min1.1999999999999955
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.072210271532973, "get_ui_image": 0.04532273372014363, "step_physics": 0.09697269996007284, "survival_time": 14.950000000000076, "driven_lanedir": 2.908702336959214, "get_state_dump": 0.018584181467692057, "sim_render-ego": 0.009362704753875732, "in-drivable-lane": 5.400000000000037, "agent_compute-ego": 0.08740921815236409, "deviation-heading": 1.980324738773864, "complete-iteration": 0.31752468188603716, "set_robot_commands": 0.007710413932800293, "deviation-center-line": 0.5210446481603112, "driven_lanedir_consec": 2.908702336959214, "sim_compute_sim_state": 0.021917951107025147, "sim_compute_performance-ego": 0.006584814389546712, "sim_compute_robot_state-ego": 0.011822884877522786, "sim_compute_robot_state-parked0": 0.011605857213338216}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.861419949869848, "get_ui_image": 0.04458460878970018, "step_physics": 0.093735821804597, "survival_time": 10.050000000000008, "driven_lanedir": 2.0278820738162184, "get_state_dump": 0.01893518813213899, "sim_render-ego": 0.009421276215890154, "in-drivable-lane": 3.6000000000000227, "agent_compute-ego": 0.08413136420558341, "deviation-heading": 0.866378384442531, "complete-iteration": 0.3082937375823064, "set_robot_commands": 0.00748803247859822, "deviation-center-line": 0.27767988397921267, "driven_lanedir_consec": 2.0278820738162184, "sim_compute_sim_state": 0.020792554267010287, "sim_compute_performance-ego": 0.006280806527208926, "sim_compute_robot_state-ego": 0.011291623708620592, "sim_compute_robot_state-parked0": 0.011398977308130977}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5930234524002684, "get_ui_image": 0.04583218812942505, "step_physics": 0.09871070146560668, "survival_time": 14.950000000000076, "driven_lanedir": 3.321598594568836, "get_state_dump": 0.018817171255747476, "sim_render-ego": 0.009087404410044351, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.0857296880086263, "deviation-heading": 4.072956184979164, "complete-iteration": 0.30864742676417034, "set_robot_commands": 0.007181936105092366, "deviation-center-line": 1.0927330127866357, "driven_lanedir_consec": 2.2799300107805305, "sim_compute_sim_state": 0.015072969595591228, "sim_compute_performance-ego": 0.0061618773142496745, "sim_compute_robot_state-ego": 0.010892037550608318, "sim_compute_robot_state-parked0": 0.010921600659688314}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.2167868258031, "get_ui_image": 0.04781121969223023, "step_physics": 0.10205113013585408, "survival_time": 14.950000000000076, "driven_lanedir": 3.4770585957034914, "get_state_dump": 0.019319500128428143, "sim_render-ego": 0.00989728053410848, "in-drivable-lane": 3.6500000000000146, "agent_compute-ego": 0.094382746219635, "deviation-heading": 2.157829275065484, "complete-iteration": 0.33889803012212116, "set_robot_commands": 0.00848743200302124, "deviation-center-line": 0.6474004131886835, "driven_lanedir_consec": 3.4770585957034914, "sim_compute_sim_state": 0.02385375181833903, "sim_compute_performance-ego": 0.008297963937123617, "sim_compute_robot_state-ego": 0.01221789518992106, "sim_compute_robot_state-parked0": 0.01233153502146403}}
set_robot_commands_max0.00848743200302124
set_robot_commands_mean0.00771695362987803
set_robot_commands_median0.007599223205699257
set_robot_commands_min0.007181936105092366
sim_compute_performance-ego_max0.008297963937123617
sim_compute_performance-ego_mean0.006831365542032232
sim_compute_performance-ego_median0.006432810458377819
sim_compute_performance-ego_min0.0061618773142496745
sim_compute_robot_state-ego_max0.01221789518992106
sim_compute_robot_state-ego_mean0.01155611033166819
sim_compute_robot_state-ego_median0.01155725429307169
sim_compute_robot_state-ego_min0.010892037550608318
sim_compute_robot_state-parked0_max0.01233153502146403
sim_compute_robot_state-parked0_mean0.011564492550655383
sim_compute_robot_state-parked0_median0.011502417260734596
sim_compute_robot_state-parked0_min0.010921600659688314
sim_compute_sim_state_max0.02385375181833903
sim_compute_sim_state_mean0.020409306696991425
sim_compute_sim_state_median0.02135525268701772
sim_compute_sim_state_min0.015072969595591228
sim_render-ego_max0.00989728053410848
sim_render-ego_mean0.00944216647847968
sim_render-ego_median0.009391990484882942
sim_render-ego_min0.009087404410044351
simulation-passed1
step_physics_max0.10205113013585408
step_physics_mean0.09786758834153264
step_physics_median0.09784170071283976
step_physics_min0.093735821804597
survival_time_max14.950000000000076
survival_time_mean13.725000000000058
survival_time_min10.050000000000008
No reset possible
363599282Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6661545348536473
survival_time_median10.675000000000017
deviation-center-line_median0.26128423686588226
in-drivable-lane_median3.000000000000036


other stats
agent_compute-ego_max0.06818182557542747
agent_compute-ego_mean0.04352375956888782
agent_compute-ego_median0.038208100766670416
agent_compute-ego_min0.029497011166783008
complete-iteration_max0.31359310016453823
complete-iteration_mean0.27585360329107134
complete-iteration_median0.2681910261196819
complete-iteration_min0.2534392607603834
deviation-center-line_max0.2963163449512068
deviation-center-line_mean0.2516919749880981
deviation-center-line_min0.1878830812694211
deviation-heading_max1.4014185451286751
deviation-heading_mean0.975325746855495
deviation-heading_median0.9283024483708648
deviation-heading_min0.643279545551575
driven_any_max3.634040115391202
driven_any_mean2.865471843886032
driven_any_median2.850359196258657
driven_any_min2.1271288676356104
driven_lanedir_consec_max2.02511532682155
driven_lanedir_consec_mean1.671472206980397
driven_lanedir_consec_min1.3284644313927434
driven_lanedir_max2.02511532682155
driven_lanedir_mean1.671472206980397
driven_lanedir_median1.6661545348536473
driven_lanedir_min1.3284644313927434
get_state_dump_max0.02077807778509978
get_state_dump_mean0.019575607908945865
get_state_dump_median0.019403054148938177
get_state_dump_min0.01871824555280732
get_ui_image_max0.04665205857464086
get_ui_image_mean0.04617372455232046
get_ui_image_median0.046268418998253055
get_ui_image_min0.04550600163813488
in-drivable-lane_max9.400000000000045
in-drivable-lane_mean4.525000000000027
in-drivable-lane_min2.699999999999993
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.1271288676356104, "get_ui_image": 0.04596408838179053, "step_physics": 0.09641008406150632, "survival_time": 8.199999999999982, "driven_lanedir": 1.3881184485077536, "get_state_dump": 0.01871824555280732, "sim_render-ego": 0.00997697725528624, "in-drivable-lane": 2.699999999999993, "agent_compute-ego": 0.02952870363142432, "deviation-heading": 0.643279545551575, "complete-iteration": 0.2621597633129213, "set_robot_commands": 0.007861412153011414, "deviation-center-line": 0.1878830812694211, "driven_lanedir_consec": 1.3881184485077536, "sim_compute_sim_state": 0.021534678412646783, "sim_compute_performance-ego": 0.007316295693560344, "sim_compute_robot_state-ego": 0.013068319820776218, "sim_compute_robot_state-parked0": 0.011537528619533633}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8321410355773255, "get_ui_image": 0.04550600163813488, "step_physics": 0.09204761634969937, "survival_time": 10.650000000000016, "driven_lanedir": 1.944190621199541, "get_state_dump": 0.019286735516758594, "sim_render-ego": 0.009325483035593524, "in-drivable-lane": 3.0500000000000353, "agent_compute-ego": 0.029497011166783008, "deviation-heading": 1.1331900870801332, "complete-iteration": 0.2534392607603834, "set_robot_commands": 0.007335024820247167, "deviation-center-line": 0.2697773818845107, "driven_lanedir_consec": 1.944190621199541, "sim_compute_sim_state": 0.02086402216987431, "sim_compute_performance-ego": 0.006389056013223711, "sim_compute_robot_state-ego": 0.011580578038390254, "sim_compute_robot_state-parked0": 0.01135944424660553}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.634040115391202, "get_ui_image": 0.046572749614715574, "step_physics": 0.09425621430079142, "survival_time": 14.950000000000076, "driven_lanedir": 1.3284644313927434, "get_state_dump": 0.019519372781117757, "sim_render-ego": 0.009675803979237877, "in-drivable-lane": 9.400000000000045, "agent_compute-ego": 0.04688749790191651, "deviation-heading": 1.4014185451286751, "complete-iteration": 0.27422228892644246, "set_robot_commands": 0.00786777416865031, "deviation-center-line": 0.2963163449512068, "driven_lanedir_consec": 1.3284644313927434, "sim_compute_sim_state": 0.018513814608256025, "sim_compute_performance-ego": 0.006668136914571126, "sim_compute_robot_state-ego": 0.012032154401143393, "sim_compute_robot_state-parked0": 0.011976714928944905}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8685773569399884, "get_ui_image": 0.04665205857464086, "step_physics": 0.10050813059940517, "survival_time": 10.700000000000015, "driven_lanedir": 2.02511532682155, "get_state_dump": 0.02077807778509978, "sim_render-ego": 0.010474464603673631, "in-drivable-lane": 2.9500000000000366, "agent_compute-ego": 0.06818182557542747, "deviation-heading": 0.7234148096615964, "complete-iteration": 0.31359310016453823, "set_robot_commands": 0.009319421286894896, "deviation-center-line": 0.2527910918472538, "driven_lanedir_consec": 2.02511532682155, "sim_compute_sim_state": 0.022994587354570904, "sim_compute_performance-ego": 0.007358426245573525, "sim_compute_robot_state-ego": 0.014060300087260308, "sim_compute_robot_state-parked0": 0.013000939493981477}}
set_robot_commands_max0.009319421286894896
set_robot_commands_mean0.008095908107200947
set_robot_commands_median0.007864593160830862
set_robot_commands_min0.007335024820247167
sim_compute_performance-ego_max0.007358426245573525
sim_compute_performance-ego_mean0.006932978716732176
sim_compute_performance-ego_median0.006992216304065735
sim_compute_performance-ego_min0.006389056013223711
sim_compute_robot_state-ego_max0.014060300087260308
sim_compute_robot_state-ego_mean0.012685338086892544
sim_compute_robot_state-ego_median0.012550237110959806
sim_compute_robot_state-ego_min0.011580578038390254
sim_compute_robot_state-parked0_max0.013000939493981477
sim_compute_robot_state-parked0_mean0.011968656822266386
sim_compute_robot_state-parked0_median0.011757121774239269
sim_compute_robot_state-parked0_min0.01135944424660553
sim_compute_sim_state_max0.022994587354570904
sim_compute_sim_state_mean0.020976775636337007
sim_compute_sim_state_median0.021199350291260546
sim_compute_sim_state_min0.018513814608256025
sim_render-ego_max0.010474464603673631
sim_render-ego_mean0.009863182218447815
sim_render-ego_median0.009826390617262058
sim_render-ego_min0.009325483035593524
simulation-passed1
step_physics_max0.10050813059940517
step_physics_mean0.09580551132785058
step_physics_median0.09533314918114888
step_physics_min0.09204761634969937
survival_time_max14.950000000000076
survival_time_mean11.125000000000025
survival_time_min8.199999999999982
No reset possible
363479302Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:05:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.795934198523258
survival_time_median6.474999999999988
deviation-center-line_median0.16046531334123337
in-drivable-lane_median1.8749999999999964


other stats
agent_compute-ego_max0.06613330046335857
agent_compute-ego_mean0.04924529704289797
agent_compute-ego_median0.0505522522446397
agent_compute-ego_min0.0297433832189539
complete-iteration_max0.3020115565685999
complete-iteration_mean0.27822547582608637
complete-iteration_median0.2759319319353475
complete-iteration_min0.2590264828650506
deviation-center-line_max0.27798313969472005
deviation-center-line_mean0.16808600303775875
deviation-center-line_min0.07343024577384821
deviation-heading_max0.5705858770134726
deviation-heading_mean0.4300263263330618
deviation-heading_median0.40681310901046014
deviation-heading_min0.3358932102978547
driven_any_max2.8166528663194685
driven_any_mean1.9346144718935427
driven_any_median2.1357337697345637
driven_any_min0.6503374817855754
driven_lanedir_consec_max1.9766897141280495
driven_lanedir_consec_mean0.9989182096864916
driven_lanedir_consec_min0.42711472757140134
driven_lanedir_max1.9766897141280495
driven_lanedir_mean0.9989182096864916
driven_lanedir_median0.795934198523258
driven_lanedir_min0.42711472757140134
get_state_dump_max0.019601594318043106
get_state_dump_mean0.019113975738014256
get_state_dump_median0.019075644649428763
get_state_dump_min0.018703019335156397
get_ui_image_max0.046384588593528384
get_ui_image_mean0.04572663277070045
get_ui_image_median0.045672088117151705
get_ui_image_min0.045177766254970005
in-drivable-lane_max6.0999999999999845
in-drivable-lane_mean2.6124999999999945
in-drivable-lane_min0.5999999999999994
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.454814673149687, "get_ui_image": 0.04600871002281105, "step_physics": 0.09504433778616098, "survival_time": 4.549999999999992, "driven_lanedir": 0.9426129776318064, "get_state_dump": 0.018895835666866093, "sim_render-ego": 0.009765818878844545, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.0297433832189539, "deviation-heading": 0.3358932102978547, "complete-iteration": 0.2590264828650506, "set_robot_commands": 0.007932505764804044, "deviation-center-line": 0.27798313969472005, "driven_lanedir_consec": 0.9426129776318064, "sim_compute_sim_state": 0.02089872989025745, "sim_compute_performance-ego": 0.006591448417076698, "sim_compute_robot_state-ego": 0.01192386071760576, "sim_compute_robot_state-parked0": 0.011985702829046563}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6503374817855754, "get_ui_image": 0.04533546621149236, "step_physics": 0.0949499173597856, "survival_time": 2.2, "driven_lanedir": 0.42711472757140134, "get_state_dump": 0.019601594318043106, "sim_render-ego": 0.00913714278828014, "in-drivable-lane": 0.5999999999999994, "agent_compute-ego": 0.036593984473835335, "deviation-heading": 0.3987533767534558, "complete-iteration": 0.2598461996425282, "set_robot_commands": 0.006744644858620383, "deviation-center-line": 0.13028918484893084, "driven_lanedir_consec": 0.42711472757140134, "sim_compute_sim_state": 0.018299585038965397, "sim_compute_performance-ego": 0.006070212884382768, "sim_compute_robot_state-ego": 0.011254175142808394, "sim_compute_robot_state-parked0": 0.011625707149505615}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8166528663194685, "get_ui_image": 0.046384588593528384, "step_physics": 0.0992724597454071, "survival_time": 8.399999999999984, "driven_lanedir": 0.6492554194147097, "get_state_dump": 0.018703019335156397, "sim_render-ego": 0.009379811230159942, "in-drivable-lane": 6.0999999999999845, "agent_compute-ego": 0.06451052001544408, "deviation-heading": 0.4148728412674645, "complete-iteration": 0.29201766422816683, "set_robot_commands": 0.007764396213349842, "deviation-center-line": 0.07343024577384821, "driven_lanedir_consec": 0.6492554194147097, "sim_compute_sim_state": 0.01602748462132045, "sim_compute_performance-ego": 0.0066153378713698615, "sim_compute_robot_state-ego": 0.011498691070647467, "sim_compute_robot_state-parked0": 0.01162675590742202}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.816652866319441, "get_ui_image": 0.045177766254970005, "step_physics": 0.10091627211797805, "survival_time": 8.399999999999984, "driven_lanedir": 1.9766897141280495, "get_state_dump": 0.01925545363199143, "sim_render-ego": 0.009669586306526548, "in-drivable-lane": 2.299999999999998, "agent_compute-ego": 0.06613330046335857, "deviation-heading": 0.5705858770134726, "complete-iteration": 0.3020115565685999, "set_robot_commands": 0.007793301627749488, "deviation-center-line": 0.19064144183353585, "driven_lanedir_consec": 1.9766897141280495, "sim_compute_sim_state": 0.021952220371791297, "sim_compute_performance-ego": 0.006992284740720477, "sim_compute_robot_state-ego": 0.01215266329901559, "sim_compute_robot_state-parked0": 0.01172882460412525}}
set_robot_commands_max0.007932505764804044
set_robot_commands_mean0.007558712116130939
set_robot_commands_median0.007778848920549666
set_robot_commands_min0.006744644858620383
sim_compute_performance-ego_max0.006992284740720477
sim_compute_performance-ego_mean0.006567320978387451
sim_compute_performance-ego_median0.00660339314422328
sim_compute_performance-ego_min0.006070212884382768
sim_compute_robot_state-ego_max0.01215266329901559
sim_compute_robot_state-ego_mean0.011707347557519303
sim_compute_robot_state-ego_median0.011711275894126611
sim_compute_robot_state-ego_min0.011254175142808394
sim_compute_robot_state-parked0_max0.011985702829046563
sim_compute_robot_state-parked0_mean0.011741747622524862
sim_compute_robot_state-parked0_median0.011677790255773635
sim_compute_robot_state-parked0_min0.011625707149505615
sim_compute_sim_state_max0.021952220371791297
sim_compute_sim_state_mean0.01929450498058365
sim_compute_sim_state_median0.019599157464611425
sim_compute_sim_state_min0.01602748462132045
sim_render-ego_max0.009765818878844545
sim_render-ego_mean0.009488089800952794
sim_render-ego_median0.009524698768343245
sim_render-ego_min0.00913714278828014
simulation-passed1
step_physics_max0.10091627211797805
step_physics_mean0.09754574675233292
step_physics_median0.09715839876578404
step_physics_min0.0949499173597856
survival_time_max8.399999999999984
survival_time_mean5.88749999999999
survival_time_min2.2
No reset possible
363399307Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg05-7d9c5d9f1ec5-10:03:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363289315Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5914727947785887
survival_time_median14.950000000000076
deviation-center-line_median0.5420653831723712
in-drivable-lane_median2.2000000000000313


other stats
agent_compute-ego_max0.09137882788976032
agent_compute-ego_mean0.08046696889749813
agent_compute-ego_median0.08741718189620273
agent_compute-ego_min0.05565468390782674
complete-iteration_max0.3306163271268209
complete-iteration_mean0.3083563012648851
complete-iteration_median0.3099432601072849
complete-iteration_min0.28292235771814983
deviation-center-line_max0.6920942982079501
deviation-center-line_mean0.48579365139244773
deviation-center-line_min0.16694954101709847
deviation-heading_max1.6524421043203057
deviation-heading_mean1.3481345163778202
deviation-heading_median1.4459838060456716
deviation-heading_min0.8481283490996319
driven_any_max3.2657879570283637
driven_any_mean2.9451888060881193
driven_any_median2.990519791699934
driven_any_min2.5339276839242455
driven_lanedir_consec_max3.229979777337353
driven_lanedir_consec_mean2.276348446251536
driven_lanedir_consec_min0.6924684181116132
driven_lanedir_max3.229979777337353
driven_lanedir_mean2.276348446251536
driven_lanedir_median2.5914727947785887
driven_lanedir_min0.6924684181116132
get_state_dump_max0.01879969914754232
get_state_dump_mean0.018580793402133845
get_state_dump_median0.01869197964668274
get_state_dump_min0.01813951516762758
get_ui_image_max0.04643469095230102
get_ui_image_mean0.04599470088333437
get_ui_image_median0.04595877546967168
get_ui_image_min0.04562656164169312
in-drivable-lane_max11.250000000000082
in-drivable-lane_mean3.912500000000036
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.1591690593702055, "get_ui_image": 0.04562656164169312, "step_physics": 0.0943255352973938, "survival_time": 14.950000000000076, "driven_lanedir": 3.132687595029988, "get_state_dump": 0.018628695011138917, "sim_render-ego": 0.009405425389607747, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05565468390782674, "deviation-heading": 1.5731444258902372, "complete-iteration": 0.28292235771814983, "set_robot_commands": 0.007458022435506185, "deviation-center-line": 0.6886528015635165, "driven_lanedir_consec": 3.132687595029988, "sim_compute_sim_state": 0.02159687042236328, "sim_compute_performance-ego": 0.006441359519958496, "sim_compute_robot_state-ego": 0.011951508522033692, "sim_compute_robot_state-parked0": 0.011599414348602295}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8218705240296624, "get_ui_image": 0.04579967456859547, "step_physics": 0.09323361417749426, "survival_time": 13.65000000000006, "driven_lanedir": 2.0502579945271893, "get_state_dump": 0.01813951516762758, "sim_render-ego": 0.009091724842895957, "in-drivable-lane": 4.4000000000000625, "agent_compute-ego": 0.08505803936130397, "deviation-heading": 1.3188231862011062, "complete-iteration": 0.3080147229708158, "set_robot_commands": 0.007269692508292285, "deviation-center-line": 0.3954779647812259, "driven_lanedir_consec": 2.0502579945271893, "sim_compute_sim_state": 0.02057021092145871, "sim_compute_performance-ego": 0.006222729281191424, "sim_compute_robot_state-ego": 0.011190728826837226, "sim_compute_robot_state-parked0": 0.011200007064875228}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5339276839242455, "get_ui_image": 0.046117876370747886, "step_physics": 0.09293102502822875, "survival_time": 14.950000000000076, "driven_lanedir": 0.6924684181116132, "get_state_dump": 0.01875526428222656, "sim_render-ego": 0.009267640908559164, "in-drivable-lane": 11.250000000000082, "agent_compute-ego": 0.09137882788976032, "deviation-heading": 0.8481283490996319, "complete-iteration": 0.3118717972437541, "set_robot_commands": 0.007537651856740316, "deviation-center-line": 0.16694954101709847, "driven_lanedir_consec": 0.6924684181116132, "sim_compute_sim_state": 0.01658461570739746, "sim_compute_performance-ego": 0.0062995044390360515, "sim_compute_robot_state-ego": 0.011385447978973388, "sim_compute_robot_state-parked0": 0.011368688742319742}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.2657879570283637, "get_ui_image": 0.04643469095230102, "step_physics": 0.10291582822799684, "survival_time": 14.950000000000076, "driven_lanedir": 3.229979777337353, "get_state_dump": 0.01879969914754232, "sim_render-ego": 0.00945931116739909, "in-drivable-lane": 0.0, "agent_compute-ego": 0.08977632443110148, "deviation-heading": 1.6524421043203057, "complete-iteration": 0.3306163271268209, "set_robot_commands": 0.007808663050333659, "deviation-center-line": 0.6920942982079501, "driven_lanedir_consec": 3.229979777337353, "sim_compute_sim_state": 0.02483585198720296, "sim_compute_performance-ego": 0.006559120814005534, "sim_compute_robot_state-ego": 0.012087469895680745, "sim_compute_robot_state-parked0": 0.011690550645192465}}
set_robot_commands_max0.007808663050333659
set_robot_commands_mean0.007518507462718111
set_robot_commands_median0.007497837146123251
set_robot_commands_min0.007269692508292285
sim_compute_performance-ego_max0.006559120814005534
sim_compute_performance-ego_mean0.006380678513547877
sim_compute_performance-ego_median0.006370431979497274
sim_compute_performance-ego_min0.006222729281191424
sim_compute_robot_state-ego_max0.012087469895680745
sim_compute_robot_state-ego_mean0.011653788805881264
sim_compute_robot_state-ego_median0.01166847825050354
sim_compute_robot_state-ego_min0.011190728826837226
sim_compute_robot_state-parked0_max0.011690550645192465
sim_compute_robot_state-parked0_mean0.011464665200247432
sim_compute_robot_state-parked0_median0.01148405154546102
sim_compute_robot_state-parked0_min0.011200007064875228
sim_compute_sim_state_max0.02483585198720296
sim_compute_sim_state_mean0.020896887259605604
sim_compute_sim_state_median0.021083540671910997
sim_compute_sim_state_min0.01658461570739746
sim_render-ego_max0.00945931116739909
sim_render-ego_mean0.00930602557711549
sim_render-ego_median0.009336533149083457
sim_render-ego_min0.009091724842895957
simulation-passed1
step_physics_max0.10291582822799684
step_physics_mean0.0958515006827784
step_physics_median0.09377957473744404
step_physics_min0.09293102502822875
survival_time_max14.950000000000076
survival_time_mean14.625000000000073
survival_time_min13.65000000000006
No reset possible
363179321Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg05-7d9c5d9f1ec5-10:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363019333Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.795934198523258
survival_time_median6.474999999999988
deviation-center-line_median0.16046531334123337
in-drivable-lane_median1.8749999999999964


other stats
agent_compute-ego_max0.17508026144721292
agent_compute-ego_mean0.1525974321044805
agent_compute-ego_median0.15276085768208836
agent_compute-ego_min0.1297877516065325
complete-iteration_max0.5960499166132329
complete-iteration_mean0.49049886091526373
complete-iteration_median0.5007268987692796
complete-iteration_min0.3644917295092628
deviation-center-line_max0.27798313969472005
deviation-center-line_mean0.16808600303775875
deviation-center-line_min0.07343024577384821
deviation-heading_max0.5705858770134726
deviation-heading_mean0.4300263263330618
deviation-heading_median0.40681310901046014
deviation-heading_min0.3358932102978547
driven_any_max2.8166528663194685
driven_any_mean1.9346144718935427
driven_any_median2.1357337697345637
driven_any_min0.6503374817855754
driven_lanedir_consec_max1.9766897141280495
driven_lanedir_consec_mean0.9989182096864916
driven_lanedir_consec_min0.42711472757140134
driven_lanedir_max1.9766897141280495
driven_lanedir_mean0.9989182096864916
driven_lanedir_median0.795934198523258
driven_lanedir_min0.42711472757140134
get_state_dump_max0.06083246794613925
get_state_dump_mean0.03948332664571998
get_state_dump_median0.03873864897004851
get_state_dump_min0.019623540696643647
get_ui_image_max0.08924540058597104
get_ui_image_mean0.0686325121409211
get_ui_image_median0.07071287826800243
get_ui_image_min0.04385889144170852
in-drivable-lane_max6.0999999999999845
in-drivable-lane_mean2.6124999999999945
in-drivable-lane_min0.5999999999999994
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.454814673149687, "get_ui_image": 0.08924540058597104, "step_physics": 0.13677846468411958, "survival_time": 4.549999999999992, "driven_lanedir": 0.9426129776318064, "get_state_dump": 0.05456210492731451, "sim_render-ego": 0.02126795380980104, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.1658397899879204, "deviation-heading": 0.3358932102978547, "complete-iteration": 0.5960499166132329, "set_robot_commands": 0.026841899850866296, "deviation-center-line": 0.27798313969472005, "driven_lanedir_consec": 0.9426129776318064, "sim_compute_sim_state": 0.03722613722413451, "sim_compute_performance-ego": 0.013436796900990243, "sim_compute_robot_state-ego": 0.028106060656872423, "sim_compute_robot_state-parked0": 0.022487252623170285}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6503374817855754, "get_ui_image": 0.08358625932173296, "step_physics": 0.14136154001409357, "survival_time": 2.2, "driven_lanedir": 0.42711472757140134, "get_state_dump": 0.06083246794613925, "sim_render-ego": 0.01230899312279441, "in-drivable-lane": 0.5999999999999994, "agent_compute-ego": 0.17508026144721292, "deviation-heading": 0.3987533767534558, "complete-iteration": 0.5930055271495472, "set_robot_commands": 0.025053479454734108, "deviation-center-line": 0.13028918484893084, "driven_lanedir_consec": 0.42711472757140134, "sim_compute_sim_state": 0.019974686882712624, "sim_compute_performance-ego": 0.01798555525866422, "sim_compute_robot_state-ego": 0.035802884535356, "sim_compute_robot_state-parked0": 0.020759544589302757}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8166528663194685, "get_ui_image": 0.05783949721427191, "step_physics": 0.1074670936380114, "survival_time": 8.399999999999984, "driven_lanedir": 0.6492554194147097, "get_state_dump": 0.022915193012782505, "sim_render-ego": 0.011450507811137609, "in-drivable-lane": 6.0999999999999845, "agent_compute-ego": 0.13968192537625632, "deviation-heading": 0.4148728412674645, "complete-iteration": 0.40844827038901194, "set_robot_commands": 0.00961501541591826, "deviation-center-line": 0.07343024577384821, "driven_lanedir_consec": 0.6492554194147097, "sim_compute_sim_state": 0.0207886000474294, "sim_compute_performance-ego": 0.007741953645433698, "sim_compute_robot_state-ego": 0.01735193104971023, "sim_compute_robot_state-parked0": 0.013354427757717316}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.816652866319441, "get_ui_image": 0.04385889144170852, "step_physics": 0.09835614902632576, "survival_time": 8.399999999999984, "driven_lanedir": 1.9766897141280495, "get_state_dump": 0.019623540696643647, "sim_render-ego": 0.00982615493592762, "in-drivable-lane": 2.299999999999998, "agent_compute-ego": 0.1297877516065325, "deviation-heading": 0.5705858770134726, "complete-iteration": 0.3644917295092628, "set_robot_commands": 0.008396467992237635, "deviation-center-line": 0.19064144183353585, "driven_lanedir_consec": 1.9766897141280495, "sim_compute_sim_state": 0.02138499135062808, "sim_compute_performance-ego": 0.0068571070830027265, "sim_compute_robot_state-ego": 0.012419557287579493, "sim_compute_robot_state-parked0": 0.013731122016906738}}
set_robot_commands_max0.026841899850866296
set_robot_commands_mean0.017476715678439073
set_robot_commands_median0.017334247435326182
set_robot_commands_min0.008396467992237635
sim_compute_performance-ego_max0.01798555525866422
sim_compute_performance-ego_mean0.01150535322202272
sim_compute_performance-ego_median0.010589375273211972
sim_compute_performance-ego_min0.0068571070830027265
sim_compute_robot_state-ego_max0.035802884535356
sim_compute_robot_state-ego_mean0.023420108382379533
sim_compute_robot_state-ego_median0.02272899585329133
sim_compute_robot_state-ego_min0.012419557287579493
sim_compute_robot_state-parked0_max0.022487252623170285
sim_compute_robot_state-parked0_mean0.017583086746774272
sim_compute_robot_state-parked0_median0.017245333303104748
sim_compute_robot_state-parked0_min0.013354427757717316
sim_compute_sim_state_max0.03722613722413451
sim_compute_sim_state_mean0.024843603876226153
sim_compute_sim_state_median0.021086795699028743
sim_compute_sim_state_min0.019974686882712624
sim_render-ego_max0.02126795380980104
sim_render-ego_mean0.013713402419915168
sim_render-ego_median0.011879750466966007
sim_render-ego_min0.00982615493592762
simulation-passed1
step_physics_max0.14136154001409357
step_physics_mean0.12099081184063758
step_physics_median0.12212277916106548
step_physics_min0.09835614902632576
survival_time_max8.399999999999984
survival_time_mean5.88749999999999
survival_time_min2.2
No reset possible
362749360Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:15:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.770882991339638
survival_time_median14.875000000000076
deviation-center-line_median0.3689512263265536
in-drivable-lane_median3.2750000000000465


other stats
agent_compute-ego_max0.10951614379882812
agent_compute-ego_mean0.10458537816120948
agent_compute-ego_median0.10501781067182853
agent_compute-ego_min0.09878974750235274
complete-iteration_max0.5232404470443726
complete-iteration_mean0.5081927079193352
complete-iteration_median0.5107067163785299
complete-iteration_min0.4881169518759084
deviation-center-line_max0.5815319384143187
deviation-center-line_mean0.3804877499868112
deviation-center-line_min0.2025166088798191
deviation-heading_max2.100881882110979
deviation-heading_mean1.2012154947530285
deviation-heading_median0.9808986357923412
deviation-heading_min0.7421828253164526
driven_any_max2.858921543088879
driven_any_mean2.646116924144243
driven_any_median2.844219403333999
driven_any_min2.037107346820095
driven_lanedir_consec_max2.84853407446554
driven_lanedir_consec_mean1.9177363306654187
driven_lanedir_consec_min1.2806452655168592
driven_lanedir_max2.84853407446554
driven_lanedir_mean1.9177363306654187
driven_lanedir_median1.770882991339638
driven_lanedir_min1.2806452655168592
get_state_dump_max0.06016245725992564
get_state_dump_mean0.05177977510775357
get_state_dump_median0.05233110427856445
get_state_dump_min0.042294434613959736
get_ui_image_max0.08061551729838054
get_ui_image_mean0.07823828318116302
get_ui_image_median0.07800095674191385
get_ui_image_min0.07633570194244385
in-drivable-lane_max7.5000000000000835
in-drivable-lane_mean3.512500000000044
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.037107346820095, "get_ui_image": 0.07641283412312352, "step_physics": 0.12846578997234964, "survival_time": 10.750000000000018, "driven_lanedir": 1.499499223638035, "get_state_dump": 0.042294434613959736, "sim_render-ego": 0.016698013350021006, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.1048088971958604, "deviation-heading": 0.7421828253164526, "complete-iteration": 0.4881169518759084, "set_robot_commands": 0.02475693946660951, "deviation-center-line": 0.2025166088798191, "driven_lanedir_consec": 1.499499223638035, "sim_compute_sim_state": 0.032264369033103764, "sim_compute_performance-ego": 0.012248135721960733, "sim_compute_robot_state-ego": 0.022629594802856444, "sim_compute_robot_state-parked0": 0.027276117857112443}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.829578914980949, "get_ui_image": 0.07958907936070417, "step_physics": 0.13269609857249903, "survival_time": 14.800000000000075, "driven_lanedir": 2.042266759041241, "get_state_dump": 0.06016245725992564, "sim_render-ego": 0.01851626908456957, "in-drivable-lane": 3.900000000000055, "agent_compute-ego": 0.09878974750235274, "deviation-heading": 1.071683357288069, "complete-iteration": 0.5232404470443726, "set_robot_commands": 0.021906839029209035, "deviation-center-line": 0.3497255581182235, "driven_lanedir_consec": 2.042266759041241, "sim_compute_sim_state": 0.04099394340772886, "sim_compute_performance-ego": 0.012432855528754156, "sim_compute_robot_state-ego": 0.028812557458877563, "sim_compute_robot_state-parked0": 0.02907657945478285}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8588598916870485, "get_ui_image": 0.07633570194244385, "step_physics": 0.14060672283172607, "survival_time": 14.950000000000076, "driven_lanedir": 1.2806452655168592, "get_state_dump": 0.05003109057744344, "sim_render-ego": 0.013550542990366616, "in-drivable-lane": 7.5000000000000835, "agent_compute-ego": 0.10522672414779664, "deviation-heading": 2.100881882110979, "complete-iteration": 0.5052114645640056, "set_robot_commands": 0.020789532661437987, "deviation-center-line": 0.5815319384143187, "driven_lanedir_consec": 1.2806452655168592, "sim_compute_sim_state": 0.03351359367370606, "sim_compute_performance-ego": 0.012993475596110029, "sim_compute_robot_state-ego": 0.02400665044784546, "sim_compute_robot_state-parked0": 0.027891387939453127}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.858921543088879, "get_ui_image": 0.08061551729838054, "step_physics": 0.1376006245613098, "survival_time": 14.950000000000076, "driven_lanedir": 2.84853407446554, "get_state_dump": 0.054631117979685465, "sim_render-ego": 0.011621010303497315, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10951614379882812, "deviation-heading": 0.8901139142966132, "complete-iteration": 0.5162019681930542, "set_robot_commands": 0.02508544127146403, "deviation-center-line": 0.3881768945348837, "driven_lanedir_consec": 2.84853407446554, "sim_compute_sim_state": 0.0388113284111023, "sim_compute_performance-ego": 0.008200968901316325, "sim_compute_robot_state-ego": 0.022918452421824137, "sim_compute_robot_state-parked0": 0.02691992441813151}}
set_robot_commands_max0.02508544127146403
set_robot_commands_mean0.02313468810718014
set_robot_commands_median0.02333188924790927
set_robot_commands_min0.020789532661437987
sim_compute_performance-ego_max0.012993475596110029
sim_compute_performance-ego_mean0.01146885893703531
sim_compute_performance-ego_median0.012340495625357445
sim_compute_performance-ego_min0.008200968901316325
sim_compute_robot_state-ego_max0.028812557458877563
sim_compute_robot_state-ego_mean0.0245918137828509
sim_compute_robot_state-ego_median0.0234625514348348
sim_compute_robot_state-ego_min0.022629594802856444
sim_compute_robot_state-parked0_max0.02907657945478285
sim_compute_robot_state-parked0_mean0.027791002417369984
sim_compute_robot_state-parked0_median0.027583752898282785
sim_compute_robot_state-parked0_min0.02691992441813151
sim_compute_sim_state_max0.04099394340772886
sim_compute_sim_state_mean0.036395808631410245
sim_compute_sim_state_median0.03616246104240418
sim_compute_sim_state_min0.032264369033103764
sim_render-ego_max0.01851626908456957
sim_render-ego_mean0.015096458932113626
sim_render-ego_median0.015124278170193812
sim_render-ego_min0.011621010303497315
simulation-passed1
step_physics_max0.14060672283172607
step_physics_mean0.13484230898447114
step_physics_median0.1351483615669044
step_physics_min0.12846578997234964
survival_time_max14.950000000000076
survival_time_mean13.86250000000006
survival_time_min10.750000000000018
No reset possible
362569372Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:18:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6417605229673025
survival_time_median14.950000000000076
deviation-center-line_median0.5807207411444224
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.22874746719996136
agent_compute-ego_mean0.2119093023526074
agent_compute-ego_median0.22539065917332968
agent_compute-ego_min0.16810842386380895
complete-iteration_max0.6249629346529643
complete-iteration_mean0.6035220302168153
complete-iteration_median0.6126184153556824
complete-iteration_min0.563888355502932
deviation-center-line_max0.9905954542596568
deviation-center-line_mean0.6191359587344607
deviation-center-line_min0.3245068983893413
deviation-heading_max2.8088683896400637
deviation-heading_mean1.8667850030129112
deviation-heading_median1.8620359051668496
deviation-heading_min0.934199812077882
driven_any_max2.9782841956481563
driven_any_mean2.716620776230861
driven_any_median2.7791303867094728
driven_any_min2.329938135856344
driven_lanedir_consec_max2.9574015170880124
driven_lanedir_consec_mean2.4284204127189097
driven_lanedir_consec_min1.472759087853022
driven_lanedir_max2.9574015170880124
driven_lanedir_mean2.4284204127189097
driven_lanedir_median2.6417605229673025
driven_lanedir_min1.472759087853022
get_state_dump_max0.05536601146062215
get_state_dump_mean0.054362280919483016
get_state_dump_median0.05425269157554847
get_state_dump_min0.05357772906621297
get_ui_image_max0.08250678805854376
get_ui_image_mean0.07878477342016116
get_ui_image_median0.07856364488601686
get_ui_image_min0.07550501585006714
in-drivable-lane_max5.000000000000065
in-drivable-lane_mean1.5000000000000198
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.329938135856344, "get_ui_image": 0.08250678805854376, "step_physics": 0.12985045140183818, "survival_time": 12.700000000000044, "driven_lanedir": 1.472759087853022, "get_state_dump": 0.054443897224786715, "sim_render-ego": 0.016829447483453226, "in-drivable-lane": 5.000000000000065, "agent_compute-ego": 0.16810842386380895, "deviation-heading": 0.934199812077882, "complete-iteration": 0.563888355502932, "set_robot_commands": 0.015909056025227224, "deviation-center-line": 0.3245068983893413, "driven_lanedir_consec": 1.472759087853022, "sim_compute_sim_state": 0.03793708733686312, "sim_compute_performance-ego": 0.012235933401453214, "sim_compute_robot_state-ego": 0.027901871936527763, "sim_compute_robot_state-parked0": 0.017933100227295884}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9782841956481563, "get_ui_image": 0.07960026105244955, "step_physics": 0.13090821504592895, "survival_time": 14.950000000000076, "driven_lanedir": 2.9574015170880124, "get_state_dump": 0.05536601146062215, "sim_render-ego": 0.017549227873484292, "in-drivable-lane": 0.0, "agent_compute-ego": 0.22820507526397704, "deviation-heading": 1.3346499709687567, "complete-iteration": 0.6042166511217754, "set_robot_commands": 0.014805194536844889, "deviation-center-line": 0.4754520651431268, "driven_lanedir_consec": 2.9574015170880124, "sim_compute_sim_state": 0.03050677537918091, "sim_compute_performance-ego": 0.01060256322224935, "sim_compute_robot_state-ego": 0.021073270638783777, "sim_compute_robot_state-parked0": 0.01536749283472697}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.656183537754305, "get_ui_image": 0.07752702871958415, "step_physics": 0.13364253441492716, "survival_time": 14.950000000000076, "driven_lanedir": 2.589240678669012, "get_state_dump": 0.05406148592631022, "sim_render-ego": 0.01511473019917806, "in-drivable-lane": 0.0, "agent_compute-ego": 0.22874746719996136, "deviation-heading": 2.8088683896400637, "complete-iteration": 0.6249629346529643, "set_robot_commands": 0.02092230796813965, "deviation-center-line": 0.685989417145718, "driven_lanedir_consec": 2.589240678669012, "sim_compute_sim_state": 0.028879252274831135, "sim_compute_performance-ego": 0.012397812207539875, "sim_compute_robot_state-ego": 0.02806670188903809, "sim_compute_robot_state-parked0": 0.02536742846171061}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.90207723566464, "get_ui_image": 0.07550501585006714, "step_physics": 0.13620356877644857, "survival_time": 14.950000000000076, "driven_lanedir": 2.694280367265593, "get_state_dump": 0.05357772906621297, "sim_render-ego": 0.015233204364776612, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.22257624308268228, "deviation-heading": 2.3894218393649425, "complete-iteration": 0.6210201795895894, "set_robot_commands": 0.019512903690338135, "deviation-center-line": 0.9905954542596568, "driven_lanedir_consec": 2.694280367265593, "sim_compute_sim_state": 0.03202588240305582, "sim_compute_performance-ego": 0.015771623452504477, "sim_compute_robot_state-ego": 0.029220505555470785, "sim_compute_robot_state-parked0": 0.02115385055541992}}
set_robot_commands_max0.02092230796813965
set_robot_commands_mean0.017787365555137474
set_robot_commands_median0.01771097985778268
set_robot_commands_min0.014805194536844889
sim_compute_performance-ego_max0.015771623452504477
sim_compute_performance-ego_mean0.012751983070936728
sim_compute_performance-ego_median0.012316872804496544
sim_compute_performance-ego_min0.01060256322224935
sim_compute_robot_state-ego_max0.029220505555470785
sim_compute_robot_state-ego_mean0.0265655875049551
sim_compute_robot_state-ego_median0.027984286912782923
sim_compute_robot_state-ego_min0.021073270638783777
sim_compute_robot_state-parked0_max0.02536742846171061
sim_compute_robot_state-parked0_mean0.01995546801978835
sim_compute_robot_state-parked0_median0.019543475391357906
sim_compute_robot_state-parked0_min0.01536749283472697
sim_compute_sim_state_max0.03793708733686312
sim_compute_sim_state_mean0.03233724934848275
sim_compute_sim_state_median0.03126632889111837
sim_compute_sim_state_min0.028879252274831135
sim_render-ego_max0.017549227873484292
sim_render-ego_mean0.016181652480223047
sim_render-ego_median0.01603132592411492
sim_render-ego_min0.01511473019917806
simulation-passed1
step_physics_max0.13620356877644857
step_physics_mean0.1326511924097857
step_physics_median0.13227537473042805
step_physics_min0.12985045140183818
survival_time_max14.950000000000076
survival_time_mean14.38750000000007
survival_time_min12.700000000000044
No reset possible
362489377Jerome LabonteΒ πŸ‡¨πŸ‡¦real-exercise-1aido5-LF-sim-validationLFv-simabortednoreg05-7d9c5d9f1ec5-10:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5741668481505195
survival_time_median5.4999999999999885
deviation-center-line_median0.15001497201806074
in-drivable-lane_median0.44999999999999907


other stats
agent_compute-ego_max0.1474302095525405
agent_compute-ego_mean0.14301786682731418
agent_compute-ego_median0.1424452458625232
agent_compute-ego_min0.13975076603166986
complete-iteration_max0.5245587895898258
complete-iteration_mean0.5132049070973721
complete-iteration_median0.5188509284521079
complete-iteration_min0.4905589818954468
deviation-center-line_max0.21063342770717944
deviation-center-line_mean0.14542573501797348
deviation-center-line_min0.071039568328593
deviation-heading_max1.0968770042172291
deviation-heading_mean0.7810612283583892
deviation-heading_median0.7172712380760862
deviation-heading_min0.5928254330641552
driven_any_max3.087295376005276
driven_any_mean1.48830238039174
driven_any_median1.3098009120815028
driven_any_min0.2463123213986788
driven_lanedir_consec_max1.8225639597033896
driven_lanedir_consec_mean0.7744664200268383
driven_lanedir_consec_min0.12696802410292474
driven_lanedir_max1.8225639597033896
driven_lanedir_mean0.7744664200268383
driven_lanedir_median0.5741668481505195
driven_lanedir_min0.12696802410292474
get_state_dump_max0.05602604537815243
get_state_dump_mean0.050391499887509655
get_state_dump_median0.05011155675439274
get_state_dump_min0.04531684066310073
get_ui_image_max0.08694914976755778
get_ui_image_mean0.07786153961008124
get_ui_image_median0.07694949811580135
get_ui_image_min0.07059801244116448
in-drivable-lane_max12.000000000000078
in-drivable-lane_mean3.300000000000019
in-drivable-lane_min0.29999999999999893
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5958445715885069, "get_ui_image": 0.08694914976755778, "step_physics": 0.12297704364314224, "survival_time": 3.2999999999999963, "driven_lanedir": 0.4892226693454574, "get_state_dump": 0.04531684066310073, "sim_render-ego": 0.01212014573993105, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.13975076603166986, "deviation-heading": 0.5928254330641552, "complete-iteration": 0.4905589818954468, "set_robot_commands": 0.015260342395666874, "deviation-center-line": 0.1774666580506417, "driven_lanedir_consec": 0.4892226693454574, "sim_compute_sim_state": 0.028160073540427467, "sim_compute_performance-ego": 0.00779094479300759, "sim_compute_robot_state-ego": 0.010379877957430754, "sim_compute_robot_state-parked0": 0.021589593453840775}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.2463123213986788, "get_ui_image": 0.07986439676845775, "step_physics": 0.13065939089831183, "survival_time": 1.7000000000000008, "driven_lanedir": 0.12696802410292474, "get_state_dump": 0.049567510099972, "sim_render-ego": 0.014353071942048917, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.1474302095525405, "deviation-heading": 0.7334519417420262, "complete-iteration": 0.5245587895898258, "set_robot_commands": 0.02239188025979435, "deviation-center-line": 0.071039568328593, "driven_lanedir_consec": 0.12696802410292474, "sim_compute_sim_state": 0.02174082924337948, "sim_compute_performance-ego": 0.009430583785561957, "sim_compute_robot_state-ego": 0.02438278057995965, "sim_compute_robot_state-parked0": 0.024477502878974464}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.087295376005276, "get_ui_image": 0.07403459946314493, "step_physics": 0.14104581435521443, "survival_time": 14.950000000000076, "driven_lanedir": 0.6591110269555817, "get_state_dump": 0.05065560340881348, "sim_render-ego": 0.01766397794087728, "in-drivable-lane": 12.000000000000078, "agent_compute-ego": 0.14301017920176187, "deviation-heading": 0.701090534410146, "complete-iteration": 0.5210909295082092, "set_robot_commands": 0.01828943967819214, "deviation-center-line": 0.1225632859854798, "driven_lanedir_consec": 0.6591110269555817, "sim_compute_sim_state": 0.02327599287033081, "sim_compute_performance-ego": 0.011475778420766195, "sim_compute_robot_state-ego": 0.021872840722401934, "sim_compute_robot_state-parked0": 0.01951618432998657}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.023757252574499, "get_ui_image": 0.07059801244116448, "step_physics": 0.13608496684532662, "survival_time": 7.699999999999981, "driven_lanedir": 1.8225639597033896, "get_state_dump": 0.05602604537815243, "sim_render-ego": 0.013928829849540414, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1418803125232845, "deviation-heading": 1.0968770042172291, "complete-iteration": 0.5166109273960064, "set_robot_commands": 0.02421177981735824, "deviation-center-line": 0.21063342770717944, "driven_lanedir_consec": 1.8225639597033896, "sim_compute_sim_state": 0.026250168874666288, "sim_compute_performance-ego": 0.008518085851297751, "sim_compute_robot_state-ego": 0.020256689616612027, "sim_compute_robot_state-parked0": 0.01859304347595611}}
set_robot_commands_max0.02421177981735824
set_robot_commands_mean0.020038360537752903
set_robot_commands_median0.020340659968993244
set_robot_commands_min0.015260342395666874
sim_compute_performance-ego_max0.011475778420766195
sim_compute_performance-ego_mean0.009303848212658374
sim_compute_performance-ego_median0.008974334818429852
sim_compute_performance-ego_min0.00779094479300759
sim_compute_robot_state-ego_max0.02438278057995965
sim_compute_robot_state-ego_mean0.01922304721910109
sim_compute_robot_state-ego_median0.021064765169506984
sim_compute_robot_state-ego_min0.010379877957430754
sim_compute_robot_state-parked0_max0.024477502878974464
sim_compute_robot_state-parked0_mean0.02104408103468948
sim_compute_robot_state-parked0_median0.020552888891913673
sim_compute_robot_state-parked0_min0.01859304347595611
sim_compute_sim_state_max0.028160073540427467
sim_compute_sim_state_mean0.024856766132201013
sim_compute_sim_state_median0.02476308087249855
sim_compute_sim_state_min0.02174082924337948
sim_render-ego_max0.01766397794087728
sim_render-ego_mean0.014516506368099414
sim_render-ego_median0.014140950895794663
sim_render-ego_min0.01212014573993105
simulation-passed1
step_physics_max0.14104581435521443
step_physics_mean0.1326918039354988
step_physics_median0.13337217887181924
step_physics_min0.12297704364314224
survival_time_max14.950000000000076
survival_time_mean6.912500000000014
survival_time_min1.7000000000000008
No reset possible
362349387Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:15:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.055045928160349526
agent_compute-ego_mean0.04936211148897807
agent_compute-ego_median0.04851412733395895
agent_compute-ego_min0.04537426312764486
complete-iteration_max0.4648376655578613
complete-iteration_mean0.4506728825966517
complete-iteration_median0.4515740410486857
complete-iteration_min0.4347057827313741
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.05963792403539022
get_state_dump_mean0.05083801925182343
get_state_dump_median0.048880295753479006
get_state_dump_min0.045953561464945475
get_ui_image_max0.08819552659988403
get_ui_image_mean0.07961325387159983
get_ui_image_median0.07847495754559836
get_ui_image_min0.0733075737953186
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.07335744063059489, "step_physics": 0.13408690770467122, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.051301840941111246, "sim_render-ego": 0.01704598108927409, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04537426312764486, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.4347057827313741, "set_robot_commands": 0.015003193219502766, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.04430310249328613, "sim_compute_performance-ego": 0.011296058495839437, "sim_compute_robot_state-ego": 0.02075338363647461, "sim_compute_robot_state-parked0": 0.021922967433929443}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.08819552659988403, "step_physics": 0.13831095218658448, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.04645875056584676, "sim_render-ego": 0.01714131991068522, "in-drivable-lane": 0.0, "agent_compute-ego": 0.055045928160349526, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.4648376655578613, "set_robot_commands": 0.017259825070699057, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.044896552562713625, "sim_compute_performance-ego": 0.011622172991434731, "sim_compute_robot_state-ego": 0.024084484577178954, "sim_compute_robot_state-parked0": 0.021572386423746745}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.0835924744606018, "step_physics": 0.1351750667889913, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.05963792403539022, "sim_render-ego": 0.01708057959874471, "in-drivable-lane": 0.0, "agent_compute-ego": 0.051548810799916585, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.4637476555506389, "set_robot_commands": 0.013730254968007406, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.03245833555857341, "sim_compute_performance-ego": 0.01333048105239868, "sim_compute_robot_state-ego": 0.034341835975646974, "sim_compute_robot_state-parked0": 0.02259550094604492}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.0733075737953186, "step_physics": 0.14972743034362793, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.045953561464945475, "sim_render-ego": 0.016598027547200522, "in-drivable-lane": 0.0, "agent_compute-ego": 0.045479443868001304, "deviation-heading": 0.486072248607516, "complete-iteration": 0.43940042654673256, "set_robot_commands": 0.012555222511291503, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.04258411963780721, "sim_compute_performance-ego": 0.0094733198483785, "sim_compute_robot_state-ego": 0.022279401620229084, "sim_compute_robot_state-parked0": 0.02118944803873698}}
set_robot_commands_max0.017259825070699057
set_robot_commands_mean0.014637123942375183
set_robot_commands_median0.014366724093755086
set_robot_commands_min0.012555222511291503
sim_compute_performance-ego_max0.01333048105239868
sim_compute_performance-ego_mean0.011430508097012838
sim_compute_performance-ego_median0.011459115743637085
sim_compute_performance-ego_min0.0094733198483785
sim_compute_robot_state-ego_max0.034341835975646974
sim_compute_robot_state-ego_mean0.025364776452382404
sim_compute_robot_state-ego_median0.02318194309870402
sim_compute_robot_state-ego_min0.02075338363647461
sim_compute_robot_state-parked0_max0.02259550094604492
sim_compute_robot_state-parked0_mean0.02182007571061452
sim_compute_robot_state-parked0_median0.021747676928838097
sim_compute_robot_state-parked0_min0.02118944803873698
sim_compute_sim_state_max0.044896552562713625
sim_compute_sim_state_mean0.0410605275630951
sim_compute_sim_state_median0.04344361106554667
sim_compute_sim_state_min0.03245833555857341
sim_render-ego_max0.01714131991068522
sim_render-ego_mean0.016966477036476135
sim_render-ego_median0.017063280344009397
sim_render-ego_min0.016598027547200522
simulation-passed1
step_physics_max0.14972743034362793
step_physics_mean0.13932508925596873
step_physics_median0.1367430094877879
step_physics_min0.13408690770467122
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
362219392Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:18:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5056463151668356
survival_time_median14.950000000000076
deviation-center-line_median0.26785886498605427
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.11707416534423828
agent_compute-ego_mean0.10737867335478464
agent_compute-ego_median0.1067270831267039
agent_compute-ego_min0.09898636182149252
complete-iteration_max0.5463620249430339
complete-iteration_mean0.5160719112555185
complete-iteration_median0.5084094138940175
complete-iteration_min0.5011067922910054
deviation-center-line_max0.3422906329542941
deviation-center-line_mean0.2756919885192982
deviation-center-line_min0.22475959115079017
deviation-heading_max2.186199256458353
deviation-heading_mean1.6417684764851417
deviation-heading_median1.6521956644742717
deviation-heading_min1.0764833205336706
driven_any_max1.53156909179977
driven_any_mean1.5289459872610671
driven_any_median1.5315628444507878
driven_any_min1.5210891683429235
driven_lanedir_consec_max1.5227992043711158
driven_lanedir_consec_mean1.4513188700159827
driven_lanedir_consec_min1.2711836453591436
driven_lanedir_max1.5227992043711158
driven_lanedir_mean1.4513188700159827
driven_lanedir_median1.5056463151668356
driven_lanedir_min1.2711836453591436
get_state_dump_max0.04999756813049317
get_state_dump_mean0.04832047402858734
get_state_dump_median0.04826566815376282
get_state_dump_min0.04675299167633057
get_ui_image_max0.08937854131062825
get_ui_image_mean0.07766267001628877
get_ui_image_median0.07502336303393045
get_ui_image_min0.07122541268666585
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.5000000000000071
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.5210891683429235, "get_ui_image": 0.08937854131062825, "step_physics": 0.14517802953720094, "survival_time": 14.950000000000076, "driven_lanedir": 1.2711836453591436, "get_state_dump": 0.04999756813049317, "sim_render-ego": 0.02024648427963257, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.09898636182149252, "deviation-heading": 2.0347285888318876, "complete-iteration": 0.5463620249430339, "set_robot_commands": 0.024930496215820313, "deviation-center-line": 0.2782786086195186, "driven_lanedir_consec": 1.2711836453591436, "sim_compute_sim_state": 0.0419150972366333, "sim_compute_performance-ego": 0.01568236748377482, "sim_compute_robot_state-ego": 0.030062790711720785, "sim_compute_robot_state-parked0": 0.02976251522699992}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.53156909179977, "get_ui_image": 0.07393861214319865, "step_physics": 0.1409856390953064, "survival_time": 14.950000000000076, "driven_lanedir": 1.5227992043711158, "get_state_dump": 0.04675299167633057, "sim_render-ego": 0.015759178002675376, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10728928009668988, "deviation-heading": 1.2696627401166556, "complete-iteration": 0.5011067922910054, "set_robot_commands": 0.02138857126235962, "deviation-center-line": 0.22475959115079017, "driven_lanedir_consec": 1.5227992043711158, "sim_compute_sim_state": 0.033684046268463136, "sim_compute_performance-ego": 0.011493199666341146, "sim_compute_robot_state-ego": 0.02429120381673177, "sim_compute_robot_state-parked0": 0.02528219699859619}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.5315566946381352, "get_ui_image": 0.07122541268666585, "step_physics": 0.1412402367591858, "survival_time": 14.950000000000076, "driven_lanedir": 1.4901769380812993, "get_state_dump": 0.04857148249944051, "sim_render-ego": 0.015231738090515135, "in-drivable-lane": 0.0, "agent_compute-ego": 0.11707416534423828, "deviation-heading": 2.186199256458353, "complete-iteration": 0.5022326970100403, "set_robot_commands": 0.02381051778793335, "deviation-center-line": 0.3422906329542941, "driven_lanedir_consec": 1.4901769380812993, "sim_compute_sim_state": 0.025757822195688885, "sim_compute_performance-ego": 0.012664825121561684, "sim_compute_robot_state-ego": 0.02058511018753052, "sim_compute_robot_state-parked0": 0.025833465258280435}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.5315689942634405, "get_ui_image": 0.07610811392466227, "step_physics": 0.14724003394444785, "survival_time": 14.950000000000076, "driven_lanedir": 1.521115692252372, "get_state_dump": 0.04795985380808512, "sim_render-ego": 0.019122490882873537, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10616488615671792, "deviation-heading": 1.0764833205336706, "complete-iteration": 0.5145861307779948, "set_robot_commands": 0.01898717164993286, "deviation-center-line": 0.25743912135258995, "driven_lanedir_consec": 1.521115692252372, "sim_compute_sim_state": 0.03231817881266276, "sim_compute_performance-ego": 0.01367702086766561, "sim_compute_robot_state-ego": 0.02621174414952596, "sim_compute_robot_state-parked0": 0.02656540791193644}}
set_robot_commands_max0.024930496215820313
set_robot_commands_mean0.022279189229011537
set_robot_commands_median0.022599544525146485
set_robot_commands_min0.01898717164993286
sim_compute_performance-ego_max0.01568236748377482
sim_compute_performance-ego_mean0.013379353284835816
sim_compute_performance-ego_median0.013170922994613646
sim_compute_performance-ego_min0.011493199666341146
sim_compute_robot_state-ego_max0.030062790711720785
sim_compute_robot_state-ego_mean0.025287712216377257
sim_compute_robot_state-ego_median0.025251473983128863
sim_compute_robot_state-ego_min0.02058511018753052
sim_compute_robot_state-parked0_max0.02976251522699992
sim_compute_robot_state-parked0_mean0.026860896348953247
sim_compute_robot_state-parked0_median0.02619943658510844
sim_compute_robot_state-parked0_min0.02528219699859619
sim_compute_sim_state_max0.0419150972366333
sim_compute_sim_state_mean0.03341878612836202
sim_compute_sim_state_median0.03300111254056295
sim_compute_sim_state_min0.025757822195688885
sim_render-ego_max0.02024648427963257
sim_render-ego_mean0.017589972813924156
sim_render-ego_median0.017440834442774455
sim_render-ego_min0.015231738090515135
simulation-passed1
step_physics_max0.14724003394444785
step_physics_mean0.14366098483403522
step_physics_median0.14320913314819336
step_physics_min0.1409856390953064
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
362169758Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg05-7d9c5d9f1ec5-10:05:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 129 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362029766Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:15:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9414595374043404
survival_time_median14.950000000000076
deviation-center-line_median0.296507499077855
in-drivable-lane_median9.475000000000051


other stats
agent_compute-ego_max0.11946172447678466
agent_compute-ego_mean0.10432437412857268
agent_compute-ego_median0.10253500461578367
agent_compute-ego_min0.09276576280593872
complete-iteration_max0.6337464374044667
complete-iteration_mean0.5212652926082196
complete-iteration_median0.5086048305034638
complete-iteration_min0.4341050720214843
deviation-center-line_max0.42415289028412045
deviation-center-line_mean0.29844058997124007
deviation-center-line_min0.17659447144512969
deviation-heading_max2.917252375341275
deviation-heading_mean1.695817248753036
deviation-heading_median1.6423669207753742
deviation-heading_min0.5812827781201207
driven_any_max3.9644428930750872
driven_any_mean3.392715064907453
driven_any_median3.8191293993997935
driven_any_min1.9681585677551376
driven_lanedir_consec_max1.0575565997225649
driven_lanedir_consec_mean0.8794620127711601
driven_lanedir_consec_min0.5773723765533947
driven_lanedir_max1.0575565997225649
driven_lanedir_mean0.8794620127711601
driven_lanedir_median0.9414595374043404
driven_lanedir_min0.5773723765533947
get_state_dump_max0.06418701284420417
get_state_dump_mean0.047422299269070045
get_state_dump_median0.0468584938844045
get_state_dump_min0.03178519646326701
get_ui_image_max0.10846438022874157
get_ui_image_mean0.08467087371255547
get_ui_image_median0.08161219239234924
get_ui_image_min0.06699472983678181
in-drivable-lane_max11.150000000000064
in-drivable-lane_mean8.850000000000037
in-drivable-lane_min5.299999999999981
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.897262029503843, "get_ui_image": 0.07996579170227051, "step_physics": 0.13964325507481892, "survival_time": 14.950000000000076, "driven_lanedir": 0.9252867204966264, "get_state_dump": 0.047636206150054934, "sim_render-ego": 0.015879819393157957, "in-drivable-lane": 10.100000000000056, "agent_compute-ego": 0.10282982190450032, "deviation-heading": 2.3133669488734165, "complete-iteration": 0.517861831188202, "set_robot_commands": 0.023605559666951496, "deviation-center-line": 0.3311620454375308, "driven_lanedir_consec": 0.9252867204966264, "sim_compute_sim_state": 0.04116782267888387, "sim_compute_performance-ego": 0.013454398314158122, "sim_compute_robot_state-ego": 0.02560585578282674, "sim_compute_robot_state-parked0": 0.027844444115956626}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.740996769295744, "get_ui_image": 0.06699472983678181, "step_physics": 0.13408785899480183, "survival_time": 14.950000000000076, "driven_lanedir": 1.0575565997225649, "get_state_dump": 0.03178519646326701, "sim_render-ego": 0.012357794443766276, "in-drivable-lane": 8.850000000000051, "agent_compute-ego": 0.09276576280593872, "deviation-heading": 2.917252375341275, "complete-iteration": 0.4341050720214843, "set_robot_commands": 0.017225949764251708, "deviation-center-line": 0.42415289028412045, "driven_lanedir_consec": 1.0575565997225649, "sim_compute_sim_state": 0.0320538322130839, "sim_compute_performance-ego": 0.008400259017944335, "sim_compute_robot_state-ego": 0.018440543015797933, "sim_compute_robot_state-parked0": 0.019784288406372072}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.9644428930750872, "get_ui_image": 0.08325859308242797, "step_physics": 0.13605277140935262, "survival_time": 14.950000000000076, "driven_lanedir": 0.9576323543120544, "get_state_dump": 0.04608078161875407, "sim_render-ego": 0.0153074049949646, "in-drivable-lane": 11.150000000000064, "agent_compute-ego": 0.10224018732706706, "deviation-heading": 0.9713668926773316, "complete-iteration": 0.4993478298187256, "set_robot_commands": 0.01982227325439453, "deviation-center-line": 0.26185295271817915, "driven_lanedir_consec": 0.9576323543120544, "sim_compute_sim_state": 0.03746922890345256, "sim_compute_performance-ego": 0.012975130081176758, "sim_compute_robot_state-ego": 0.0224140731493632, "sim_compute_robot_state-parked0": 0.023515686988830567}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9681585677551376, "get_ui_image": 0.10846438022874157, "step_physics": 0.1646901998460663, "survival_time": 8.04999999999998, "driven_lanedir": 0.5773723765533947, "get_state_dump": 0.06418701284420417, "sim_render-ego": 0.021644580438270333, "in-drivable-lane": 5.299999999999981, "agent_compute-ego": 0.11946172447678466, "deviation-heading": 0.5812827781201207, "complete-iteration": 0.6337464374044667, "set_robot_commands": 0.035075529761936355, "deviation-center-line": 0.17659447144512969, "driven_lanedir_consec": 0.5773723765533947, "sim_compute_sim_state": 0.035682512366253395, "sim_compute_performance-ego": 0.01616445387372319, "sim_compute_robot_state-ego": 0.034608583272614096, "sim_compute_robot_state-parked0": 0.03354409170446929}}
set_robot_commands_max0.035075529761936355
set_robot_commands_mean0.023932328111883523
set_robot_commands_median0.021713916460673013
set_robot_commands_min0.017225949764251708
sim_compute_performance-ego_max0.01616445387372319
sim_compute_performance-ego_mean0.0127485603217506
sim_compute_performance-ego_median0.01321476419766744
sim_compute_performance-ego_min0.008400259017944335
sim_compute_robot_state-ego_max0.034608583272614096
sim_compute_robot_state-ego_mean0.025267263805150493
sim_compute_robot_state-ego_median0.02400996446609497
sim_compute_robot_state-ego_min0.018440543015797933
sim_compute_robot_state-parked0_max0.03354409170446929
sim_compute_robot_state-parked0_mean0.02617212780390714
sim_compute_robot_state-parked0_median0.0256800655523936
sim_compute_robot_state-parked0_min0.019784288406372072
sim_compute_sim_state_max0.04116782267888387
sim_compute_sim_state_mean0.03659334904041843
sim_compute_sim_state_median0.03657587063485297
sim_compute_sim_state_min0.0320538322130839
sim_render-ego_max0.021644580438270333
sim_render-ego_mean0.01629739981753979
sim_render-ego_median0.01559361219406128
sim_render-ego_min0.012357794443766276
simulation-passed1
step_physics_max0.1646901998460663
step_physics_mean0.1436185213312599
step_physics_median0.1378480132420858
step_physics_min0.13408785899480183
survival_time_max14.950000000000076
survival_time_mean13.225000000000056
survival_time_min8.04999999999998
No reset possible
361899779Frank (Chude) QianΒ πŸ‡¨πŸ‡¦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2736135304822254
survival_time_median11.050000000000022
deviation-center-line_median0.3220825243163405
in-drivable-lane_median3.3750000000000333


other stats
agent_compute-ego_max0.14903456003237994
agent_compute-ego_mean0.12134927850685404
agent_compute-ego_median0.11402617298317984
agent_compute-ego_min0.10831020802867657
complete-iteration_max0.5065516798119796
complete-iteration_mean0.4786292312943475
complete-iteration_median0.4812498816771385
complete-iteration_min0.4454654820111333
deviation-center-line_max0.579897431302872
deviation-center-line_mean0.3443160472465426
deviation-center-line_min0.1532017090506173
deviation-heading_max1.4931192740123282
deviation-heading_mean1.0364465442034398
deviation-heading_median1.060350139409897
deviation-heading_min0.5319666239816374
driven_any_max3.5737021369896653
driven_any_mean2.3324375224691978
driven_any_median2.6198298557603064
driven_any_min0.516388241366512
driven_lanedir_consec_max2.0650178364041523
driven_lanedir_consec_mean1.2536259493549569
driven_lanedir_consec_min0.4022589000512249
driven_lanedir_max2.0650178364041523
driven_lanedir_mean1.2536259493549569
driven_lanedir_median1.2736135304822254
driven_lanedir_min0.4022589000512249
get_state_dump_max0.04750366153022056
get_state_dump_mean0.03919124615460322
get_state_dump_median0.0407614224216565
get_state_dump_min0.027738478244879308
get_ui_image_max0.07440553792575111
get_ui_image_mean0.06932064123183104
get_ui_image_median0.07124138697599752
get_ui_image_min0.06039425304957798
in-drivable-lane_max9.800000000000052
in-drivable-lane_mean4.237500000000029
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.301869210536389, "get_ui_image": 0.06867715884477664, "step_physics": 0.1237869653946314, "survival_time": 9.750000000000004, "driven_lanedir": 1.4469436873765735, "get_state_dump": 0.027738478244879308, "sim_render-ego": 0.015886594087649614, "in-drivable-lane": 3.3500000000000183, "agent_compute-ego": 0.14903456003237994, "deviation-heading": 0.9189689964965406, "complete-iteration": 0.49881559151869553, "set_robot_commands": 0.018390629841731145, "deviation-center-line": 0.3099483273295465, "driven_lanedir_consec": 1.4469436873765735, "sim_compute_sim_state": 0.040577621949024686, "sim_compute_performance-ego": 0.011613831153282753, "sim_compute_robot_state-ego": 0.021802179629986103, "sim_compute_robot_state-parked0": 0.021090025779528496}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.516388241366512, "get_ui_image": 0.06039425304957798, "step_physics": 0.12862428353757274, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4022589000512249, "get_state_dump": 0.04715821207786093, "sim_render-ego": 0.008360507536907586, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.10831020802867657, "deviation-heading": 0.5319666239816374, "complete-iteration": 0.4454654820111333, "set_robot_commands": 0.012222294904747789, "deviation-center-line": 0.1532017090506173, "driven_lanedir_consec": 0.4022589000512249, "sim_compute_sim_state": 0.02299970023486079, "sim_compute_performance-ego": 0.009143878002556003, "sim_compute_robot_state-ego": 0.02417865578009158, "sim_compute_robot_state-parked0": 0.023868098550913285}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5737021369896653, "get_ui_image": 0.07380561510721842, "step_physics": 0.12816947062810263, "survival_time": 14.950000000000076, "driven_lanedir": 1.1002833735878772, "get_state_dump": 0.03436463276545207, "sim_render-ego": 0.01711770296096802, "in-drivable-lane": 9.800000000000052, "agent_compute-ego": 0.1139561899503072, "deviation-heading": 1.4931192740123282, "complete-iteration": 0.4636841718355814, "set_robot_commands": 0.01699805974960327, "deviation-center-line": 0.33421672130313446, "driven_lanedir_consec": 1.1002833735878772, "sim_compute_sim_state": 0.02795964479446411, "sim_compute_performance-ego": 0.011592137813568116, "sim_compute_robot_state-ego": 0.022040661176045737, "sim_compute_robot_state-parked0": 0.01746484359105428}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.937790500984224, "get_ui_image": 0.07440553792575111, "step_physics": 0.14400554861616993, "survival_time": 12.35000000000004, "driven_lanedir": 2.0650178364041523, "get_state_dump": 0.04750366153022056, "sim_render-ego": 0.015369614126228613, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.1140961560160525, "deviation-heading": 1.2017312823232538, "complete-iteration": 0.5065516798119796, "set_robot_commands": 0.017975997345650245, "deviation-center-line": 0.579897431302872, "driven_lanedir_consec": 2.0650178364041523, "sim_compute_sim_state": 0.03532650692742846, "sim_compute_performance-ego": 0.013801870075797262, "sim_compute_robot_state-ego": 0.02153662534860464, "sim_compute_robot_state-parked0": 0.022308090920390388}}
set_robot_commands_max0.018390629841731145
set_robot_commands_mean0.016396745460433113
set_robot_commands_median0.017487028547626758
set_robot_commands_min0.012222294904747789
sim_compute_performance-ego_max0.013801870075797262
sim_compute_performance-ego_mean0.011537929261301035
sim_compute_performance-ego_median0.011602984483425434
sim_compute_performance-ego_min0.009143878002556003
sim_compute_robot_state-ego_max0.02417865578009158
sim_compute_robot_state-ego_mean0.022389530483682016
sim_compute_robot_state-ego_median0.02192142040301592
sim_compute_robot_state-ego_min0.02153662534860464
sim_compute_robot_state-parked0_max0.023868098550913285
sim_compute_robot_state-parked0_mean0.021182764710471612
sim_compute_robot_state-parked0_median0.021699058349959444
sim_compute_robot_state-parked0_min0.01746484359105428
sim_compute_sim_state_max0.040577621949024686
sim_compute_sim_state_mean0.03171586847644452
sim_compute_sim_state_median0.031643075860946286
sim_compute_sim_state_min0.02299970023486079
sim_render-ego_max0.01711770296096802
sim_render-ego_mean0.014183604677938458
sim_render-ego_median0.015628104106939114
sim_render-ego_min0.008360507536907586
simulation-passed1
step_physics_max0.14400554861616993
step_physics_mean0.13114656704411917
step_physics_median0.1283968770828377
step_physics_min0.1237869653946314
survival_time_max14.950000000000076
survival_time_mean9.87500000000003
survival_time_min2.4499999999999993
No reset possible
361789944Bea Baselines 🐀baseline-duckietownaido5-LFV-sim-testingLFVv-simsuccessnoreg05-7d9c5d9f1ec5-10:40:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.45785888425669263
survival_time_median14.950000000000076
deviation-center-line_median0.31639228023814514
in-drivable-lane_median3.2500000000000107


other stats
agent_compute-ego_max0.07163124243418376
agent_compute-ego_mean0.061372621884793914
agent_compute-ego_median0.06572743972142538
agent_compute-ego_min0.035678046090262275
complete-iteration_max0.4876824575311997
complete-iteration_mean0.4626756726285917
complete-iteration_median0.46752081871032714
complete-iteration_min0.4366502181688944
deviation-center-line_max1.0596785797595965
deviation-center-line_mean0.36409494563978567
deviation-center-line_min0.06574239978421487
deviation-heading_max4.468907947229808
deviation-heading_mean2.0769699898020844
deviation-heading_median1.768522226749545
deviation-heading_min0.35210683102839135
driven_any_max1.939756628957868
driven_any_mean1.3338118603534614
driven_any_median1.939166788372956
driven_any_min0.2005987916498564
driven_lanedir_consec_max1.2871216038503062
driven_lanedir_consec_mean0.5714189156005945
driven_lanedir_consec_min0.060615927897113675
driven_lanedir_max1.3587298464949078
driven_lanedir_mean0.6398444890063705
driven_lanedir_median0.4982479540536242
driven_lanedir_min0.060615927897113675
get_state_dump_max0.041196544571678234
get_state_dump_mean0.03608364622232372
get_state_dump_median0.03521234958202808
get_state_dump_min0.033911354541778564
get_ui_image_max0.08134305874506632
get_ui_image_mean0.07670303174220737
get_ui_image_median0.0761789592107137
get_ui_image_min0.07253524275387034
in-drivable-lane_max10.850000000000083
in-drivable-lane_mean4.483333333333366
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.45988688799155303, "get_ui_image": 0.07573044145262087, "step_physics": 0.1936824910052411, "survival_time": 3.8499999999999943, "driven_lanedir": 0.45785888425669263, "get_state_dump": 0.03521234958202808, "sim_render-ego": 0.00884325782974045, "in-drivable-lane": 0.0, "agent_compute-ego": 0.035678046090262275, "deviation-heading": 0.35210683102839135, "complete-iteration": 0.4449798100954526, "set_robot_commands": 0.006977598388473709, "deviation-center-line": 0.06574239978421487, "driven_lanedir_consec": 0.45785888425669263, "sim_compute_sim_state": 0.019206050154450652, "sim_compute_performance-ego": 0.006172613664106889, "sim_compute_robot_state-ego": 0.010835040699351916, "sim_compute_robot_state-npc0": 0.01041222857190417, "sim_compute_robot_state-npc1": 0.010406813064178864, "sim_compute_robot_state-npc2": 0.010474359834349, "sim_compute_robot_state-npc3": 0.01047534756846242, "sim_compute_robot_state-parked0": 0.010585648672921315}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.8178840698047651, "get_ui_image": 0.0770776656957773, "step_physics": 0.1962124622785128, "survival_time": 6.499999999999985, "driven_lanedir": 0.4484099260010814, "get_state_dump": 0.03446505803328294, "sim_render-ego": 0.008368769058814415, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.03595594076009897, "deviation-heading": 0.8876094518616808, "complete-iteration": 0.44305442846738374, "set_robot_commands": 0.006798045451824481, "deviation-center-line": 0.216861574345118, "driven_lanedir_consec": 0.4484099260010814, "sim_compute_sim_state": 0.01613620061140794, "sim_compute_performance-ego": 0.006053818189180814, "sim_compute_robot_state-ego": 0.010628542533287636, "sim_compute_robot_state-npc0": 0.010277406985943134, "sim_compute_robot_state-npc1": 0.010018365199749286, "sim_compute_robot_state-npc2": 0.010165018301743729, "sim_compute_robot_state-npc3": 0.010504568540132963, "sim_compute_robot_state-parked0": 0.010107023899371808}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939594489475668, "get_ui_image": 0.07604938824971517, "step_physics": 0.1785809644063314, "survival_time": 14.950000000000076, "driven_lanedir": 1.3587298464949078, "get_state_dump": 0.03501474142074585, "sim_render-ego": 0.00880994478861491, "in-drivable-lane": 3.2500000000000107, "agent_compute-ego": 0.054342004458109536, "deviation-heading": 3.493242715540939, "complete-iteration": 0.4523878486951192, "set_robot_commands": 0.0071973832448323566, "deviation-center-line": 1.0596785797595965, "driven_lanedir_consec": 0.9880376849132833, "sim_compute_sim_state": 0.01902582248051961, "sim_compute_performance-ego": 0.006219468911488851, "sim_compute_robot_state-ego": 0.012773684660593669, "sim_compute_robot_state-npc0": 0.010736765861511233, "sim_compute_robot_state-npc1": 0.010863754749298096, "sim_compute_robot_state-npc2": 0.010894881884256998, "sim_compute_robot_state-npc3": 0.010785566965738931, "sim_compute_robot_state-parked0": 0.01080142100652059}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9395085961810772, "get_ui_image": 0.0761789592107137, "step_physics": 0.1896899072329203, "survival_time": 14.950000000000076, "driven_lanedir": 0.6895096923098776, "get_state_dump": 0.03447069644927978, "sim_render-ego": 0.008613167603810628, "in-drivable-lane": 8.300000000000084, "agent_compute-ego": 0.06522015810012817, "deviation-heading": 2.798039888492144, "complete-iteration": 0.4668239696820577, "set_robot_commands": 0.006909077167510986, "deviation-center-line": 0.32994206637458173, "driven_lanedir_consec": 0.43725438687270746, "sim_compute_sim_state": 0.016738526821136475, "sim_compute_performance-ego": 0.005969384511311849, "sim_compute_robot_state-ego": 0.010583571592966716, "sim_compute_robot_state-npc0": 0.010697450637817385, "sim_compute_robot_state-npc1": 0.010542032718658449, "sim_compute_robot_state-npc2": 0.01041400671005249, "sim_compute_robot_state-npc3": 0.0103800900777181, "sim_compute_robot_state-parked0": 0.01013378381729126}, "ETHZ_autolab_technical_track-sc4-0-ego": {"driven_any": 1.3953910557999578, "get_ui_image": 0.07520892982658703, "step_physics": 0.17611212334874587, "survival_time": 10.85000000000002, "driven_lanedir": 1.1005883252158195, "get_state_dump": 0.034382773983863094, "sim_render-ego": 0.008435113089425223, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.06778930519033687, "deviation-heading": 1.7858053497730193, "complete-iteration": 0.4520953646453295, "set_robot_commands": 0.006603573873845113, "deviation-center-line": 0.4224903218808452, "driven_lanedir_consec": 1.1005883252158195, "sim_compute_sim_state": 0.01610912815217049, "sim_compute_performance-ego": 0.005987405776977539, "sim_compute_robot_state-ego": 0.0107879638671875, "sim_compute_robot_state-npc0": 0.01032613499373335, "sim_compute_robot_state-npc1": 0.009985901793027252, "sim_compute_robot_state-npc2": 0.00991737348143406, "sim_compute_robot_state-npc3": 0.010090667531237624, "sim_compute_robot_state-parked0": 0.010082706328361266}, "ETHZ_autolab_technical_track-sc5-0-ego": {"driven_any": 0.2005987916498564, "get_ui_image": 0.07582793364653716, "step_physics": 0.16633662661990603, "survival_time": 1.850000000000001, "driven_lanedir": 0.060615927897113675, "get_state_dump": 0.03412971625456939, "sim_render-ego": 0.008791846198004645, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.05769219269623627, "deviation-heading": 1.18523441333779, "complete-iteration": 0.43928017487397064, "set_robot_commands": 0.007148420488512194, "deviation-center-line": 0.09081228034457746, "driven_lanedir_consec": 0.060615927897113675, "sim_compute_sim_state": 0.01784366530341071, "sim_compute_performance-ego": 0.006209547455246384, "sim_compute_robot_state-ego": 0.010743753330127613, "sim_compute_robot_state-npc0": 0.010701823878932645, "sim_compute_robot_state-npc1": 0.010588549278877877, "sim_compute_robot_state-npc2": 0.011158769195144242, "sim_compute_robot_state-npc3": 0.011023856498099662, "sim_compute_robot_state-parked0": 0.01078682332425504}, "ETHZ_autolab_technical_track-sc6-0-ego": {"driven_any": 1.939756628957868, "get_ui_image": 0.07726164182027181, "step_physics": 0.18438959121704104, "survival_time": 14.950000000000076, "driven_lanedir": 0.4982479540536242, "get_state_dump": 0.033911354541778564, "sim_render-ego": 0.008638145923614502, "in-drivable-lane": 10.450000000000085, "agent_compute-ego": 0.0676376708348592, "deviation-heading": 1.2372742830455787, "complete-iteration": 0.4711721666653951, "set_robot_commands": 0.006739330291748047, "deviation-center-line": 0.14402829821573876, "driven_lanedir_consec": 0.4982479540536242, "sim_compute_sim_state": 0.023805455366770423, "sim_compute_performance-ego": 0.005953544775644938, "sim_compute_robot_state-ego": 0.010623328685760498, "sim_compute_robot_state-npc0": 0.01041462024052938, "sim_compute_robot_state-npc1": 0.010347394148508708, "sim_compute_robot_state-npc2": 0.010317862033843994, "sim_compute_robot_state-npc3": 0.010422809918721515, "sim_compute_robot_state-parked0": 0.01042331377665202}, "ETHZ_autolab_technical_track-sc7-0-ego": {"driven_any": 1.9394954853566573, "get_ui_image": 0.08134305874506632, "step_physics": 0.19381089369455973, "survival_time": 14.950000000000076, "driven_lanedir": 1.0384139606364036, "get_state_dump": 0.03577804644902547, "sim_render-ego": 0.008129402001698812, "in-drivable-lane": 5.350000000000032, "agent_compute-ego": 0.05853655815124512, "deviation-heading": 4.111758838938402, "complete-iteration": 0.46752081871032714, "set_robot_commands": 0.00653339147567749, "deviation-center-line": 0.7761847720340571, "driven_lanedir_consec": 1.0384139606364036, "sim_compute_sim_state": 0.016531275113423664, "sim_compute_performance-ego": 0.005840260187784831, "sim_compute_robot_state-ego": 0.01081682046254476, "sim_compute_robot_state-npc0": 0.010174883206685383, "sim_compute_robot_state-npc1": 0.010155595143636068, "sim_compute_robot_state-npc2": 0.010030076503753664, "sim_compute_robot_state-npc3": 0.009848516782124835, "sim_compute_robot_state-parked0": 0.009718475341796876}, "ETHZ_autolab_technical_track-sc8-0-ego": {"driven_any": 1.939166788372956, "get_ui_image": 0.07690325419108072, "step_physics": 0.173744580745697, "survival_time": 14.950000000000076, "driven_lanedir": 0.5928905729476999, "get_state_dump": 0.03702787160873413, "sim_render-ego": 0.009588075478871664, "in-drivable-lane": 8.150000000000047, "agent_compute-ego": 0.06572743972142538, "deviation-heading": 4.468907947229808, "complete-iteration": 0.4718642822901408, "set_robot_commands": 0.007660258611043295, "deviation-center-line": 0.5879766416003134, "driven_lanedir_consec": 0.29358343760000927, "sim_compute_sim_state": 0.025546804269154868, "sim_compute_performance-ego": 0.006407593091328939, "sim_compute_robot_state-ego": 0.012264018853505452, "sim_compute_robot_state-npc0": 0.011101036866505942, "sim_compute_robot_state-npc1": 0.0112013840675354, "sim_compute_robot_state-npc2": 0.011658286253611249, "sim_compute_robot_state-npc3": 0.01183722416559855, "sim_compute_robot_state-parked0": 0.010912702878316244}, "ETHZ_autolab_technical_track-sc9-0-ego": {"driven_any": 0.4728411077558675, "get_ui_image": 0.08066679269839556, "step_physics": 0.18200179552420592, "survival_time": 3.899999999999994, "driven_lanedir": 0.4618923199266262, "get_state_dump": 0.03566600114871294, "sim_render-ego": 0.008358946213355431, "in-drivable-lane": 0.0, "agent_compute-ego": 0.07098845335153434, "deviation-heading": 0.7509697318293318, "complete-iteration": 0.47274592900887513, "set_robot_commands": 0.006905543498503856, "deviation-center-line": 0.17365584517458826, "driven_lanedir_consec": 0.4618923199266262, "sim_compute_sim_state": 0.017784919494237654, "sim_compute_performance-ego": 0.006080260643592248, "sim_compute_robot_state-ego": 0.01034080982208252, "sim_compute_robot_state-npc0": 0.010485169215080066, "sim_compute_robot_state-npc1": 0.011532979133801583, "sim_compute_robot_state-npc2": 0.010290271196609888, "sim_compute_robot_state-npc3": 0.011115086384308644, "sim_compute_robot_state-parked0": 0.010256586930690668}, "ETHZ_autolab_technical_track-sc10-0-ego": {"driven_any": 1.9395573054341948, "get_ui_image": 0.0771715521812439, "step_physics": 0.15651641448338827, "survival_time": 14.950000000000076, "driven_lanedir": 1.2871216038503062, "get_state_dump": 0.03497327486673991, "sim_render-ego": 0.008884266217549642, "in-drivable-lane": 3.700000000000049, "agent_compute-ego": 0.06502715190251668, "deviation-heading": 3.4516945158587977, "complete-iteration": 0.4366502181688944, "set_robot_commands": 0.00730144739151001, "deviation-center-line": 0.6521548829226703, "driven_lanedir_consec": 1.2871216038503062, "sim_compute_sim_state": 0.015114117463429768, "sim_compute_performance-ego": 0.006019782225290934, "sim_compute_robot_state-ego": 0.011202321847279867, "sim_compute_robot_state-npc0": 0.010963521003723144, "sim_compute_robot_state-npc1": 0.010975226561228436, "sim_compute_robot_state-npc2": 0.010710240205128988, "sim_compute_robot_state-npc3": 0.010731215476989749, "sim_compute_robot_state-parked0": 0.010765259265899656}, "ETHZ_autolab_technical_track-sc11-0-ego": {"driven_any": 1.9392852160001688, "get_ui_image": 0.07968859275182089, "step_physics": 0.17577266693115234, "survival_time": 14.950000000000076, "driven_lanedir": 0.3695356596443211, "get_state_dump": 0.03835267623265584, "sim_render-ego": 0.010506384372711182, "in-drivable-lane": 10.850000000000083, "agent_compute-ego": 0.06941690683364868, "deviation-heading": 2.2145706390084596, "complete-iteration": 0.48684151967366535, "set_robot_commands": 0.007554512023925781, "deviation-center-line": 0.3705111519624111, "driven_lanedir_consec": 0.27437059402313635, "sim_compute_sim_state": 0.02614360491434733, "sim_compute_performance-ego": 0.007653042475382487, "sim_compute_robot_state-ego": 0.013476730982462564, "sim_compute_robot_state-npc0": 0.011528921922047934, "sim_compute_robot_state-npc1": 0.011693956057230632, "sim_compute_robot_state-npc2": 0.011080478032430011, "sim_compute_robot_state-npc3": 0.011359414259592693, "sim_compute_robot_state-parked0": 0.012330838839213052}, "ETHZ_autolab_technical_track-sc12-0-ego": {"driven_any": 0.519269984370998, "get_ui_image": 0.07253524275387034, "step_physics": 0.19481327112983257, "survival_time": 4.249999999999993, "driven_lanedir": 0.42298258519489695, "get_state_dump": 0.040690068637623505, "sim_render-ego": 0.008905421986299403, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.0689813866334803, "deviation-heading": 1.4543635750060118, "complete-iteration": 0.4876824575311997, "set_robot_commands": 0.006900310516357422, "deviation-center-line": 0.31639228023814514, "driven_lanedir_consec": 0.42298258519489695, "sim_compute_sim_state": 0.020803546905517577, "sim_compute_performance-ego": 0.006011713252348058, "sim_compute_robot_state-ego": 0.011834175446454216, "sim_compute_robot_state-npc0": 0.010319805145263672, "sim_compute_robot_state-npc1": 0.010532589519725126, "sim_compute_robot_state-npc2": 0.011909294128417968, "sim_compute_robot_state-npc3": 0.012048895218793085, "sim_compute_robot_state-parked0": 0.011094342961030849}, "ETHZ_autolab_technical_track-sc13-0-ego": {"driven_any": 0.6252287548036395, "get_ui_image": 0.07411073930192702, "step_physics": 0.17870949990678542, "survival_time": 5.04999999999999, "driven_lanedir": 0.3028799768413033, "get_state_dump": 0.041196544571678234, "sim_render-ego": 0.00942392396454764, "in-drivable-lane": 1.7999999999999974, "agent_compute-ego": 0.06596487111384326, "deviation-heading": 1.768522226749545, "complete-iteration": 0.47713550954762074, "set_robot_commands": 0.007436119683898321, "deviation-center-line": 0.08763416552325506, "driven_lanedir_consec": 0.3028799768413033, "sim_compute_sim_state": 0.016850712275741125, "sim_compute_performance-ego": 0.006801461229229918, "sim_compute_robot_state-ego": 0.012670136914394867, "sim_compute_robot_state-npc0": 0.013572555957454263, "sim_compute_robot_state-npc1": 0.011811140740271842, "sim_compute_robot_state-npc2": 0.012066361927750086, "sim_compute_robot_state-npc3": 0.01507184056952448, "sim_compute_robot_state-parked0": 0.01115137279623806}, "ETHZ_autolab_technical_track-sc14-0-ego": {"driven_any": 1.9397127433466976, "get_ui_image": 0.07479128360748291, "step_physics": 0.1721498401959737, "survival_time": 14.950000000000076, "driven_lanedir": 0.5079900998248839, "get_state_dump": 0.035983519554138185, "sim_render-ego": 0.009595563411712646, "in-drivable-lane": 10.300000000000086, "agent_compute-ego": 0.07163124243418376, "deviation-heading": 1.1944494393313625, "complete-iteration": 0.4699005913734436, "set_robot_commands": 0.006770768960316976, "deviation-center-line": 0.16735892443667233, "driven_lanedir_consec": 0.4990261667259137, "sim_compute_sim_state": 0.02447400093078613, "sim_compute_performance-ego": 0.006721285978953043, "sim_compute_robot_state-ego": 0.010752837657928466, "sim_compute_robot_state-npc0": 0.011042211055755617, "sim_compute_robot_state-npc1": 0.010840902328491211, "sim_compute_robot_state-npc2": 0.01213836669921875, "sim_compute_robot_state-npc3": 0.011046361128489175, "sim_compute_robot_state-parked0": 0.011685654322306315}}
set_robot_commands_max0.007660258611043295
set_robot_commands_mean0.0070290520711986685
set_robot_commands_median0.006909077167510986
set_robot_commands_min0.00653339147567749
sim_compute_performance-ego_max0.007653042475382487
sim_compute_performance-ego_mean0.006273412157857848
sim_compute_performance-ego_median0.006080260643592248
sim_compute_performance-ego_min0.005840260187784831
sim_compute_robot_state-ego_max0.013476730982462564
sim_compute_robot_state-ego_mean0.01135558249039522
sim_compute_robot_state-ego_median0.01081682046254476
sim_compute_robot_state-ego_min0.01034080982208252
sim_compute_robot_state-npc0_max0.013572555957454263
sim_compute_robot_state-npc0_mean0.010850302369525822
sim_compute_robot_state-npc0_median0.010697450637817385
sim_compute_robot_state-npc0_min0.010174883206685383
sim_compute_robot_state-npc1_max0.011811140740271842
sim_compute_robot_state-npc1_mean0.010766438966947922
sim_compute_robot_state-npc1_median0.010588549278877877
sim_compute_robot_state-npc1_min0.009985901793027252
sim_compute_robot_state-npc2_max0.01213836669921875
sim_compute_robot_state-npc2_mean0.010881709759183008
sim_compute_robot_state-npc2_median0.010710240205128988
sim_compute_robot_state-npc2_min0.00991737348143406
sim_compute_robot_state-npc3_max0.01507184056952448
sim_compute_robot_state-npc3_mean0.01111609740570216
sim_compute_robot_state-npc3_median0.010785566965738931
sim_compute_robot_state-npc3_min0.009848516782124835
sim_compute_robot_state-parked0_max0.012330838839213052
sim_compute_robot_state-parked0_mean0.010722396944057667
sim_compute_robot_state-parked0_median0.010765259265899656
sim_compute_robot_state-parked0_min0.009718475341796876
sim_compute_sim_state_max0.02614360491434733
sim_compute_sim_state_mean0.01947425535043363
sim_compute_sim_state_median0.01784366530341071
sim_compute_sim_state_min0.015114117463429768
sim_render-ego_max0.010506384372711182
sim_render-ego_mean0.008926148542584746
sim_render-ego_median0.00880994478861491
sim_render-ego_min0.008129402001698812
simulation-passed1
step_physics_max0.1962124622785128
step_physics_mean0.1808348752480196
step_physics_median0.17870949990678542
step_physics_min0.15651641448338827
survival_time_max14.950000000000076
survival_time_mean10.39000000000004
survival_time_min1.850000000000001
No reset possible
361769945Bea Baselines 🐀baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg05-7d9c5d9f1ec5-10:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
β”‚         k: observations
β”‚        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                                field jpg_data : bytes
β”‚                                       __doc__
β”‚                                                         An image in JPG format.
β”‚ 
β”‚                                                         jpg_data
β”‚             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                                field resolution_rad : float
β”‚                                field  axis_left_rad : float
β”‚                                field axis_right_rad : float
β”‚             field your_name : str
β”‚             field     state : dataclass aido_schemas.schemas.DTSimState
β”‚                                field t_effective : float
β”‚                                field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚             field  map_data : str
β”‚        v2: dataclass aido_schemas.schemas.DB20Observations
β”‚             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                               field jpg_data : bytes
β”‚                                      __doc__
β”‚                                                        An image in JPG format.
β”‚ 
β”‚                                                        jpg_data
β”‚             field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                               field resolution_rad : float
β”‚                               field  axis_left_rad : float
β”‚                               field axis_right_rad : float
β”‚         r: CanBeUsed
β”‚            β”‚ result: False
β”‚            β”‚ why:
β”‚            β”‚ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
β”‚            β”‚ | requires field "your_name"
β”‚            β”‚ |  of type <class 'str'>
β”‚            β”‚ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
β”‚            β”‚ M: Matches()
β”‚            β”‚ matches: {}
β”‚ p1_inputs: Dict[str,type][4]
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚            β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                     field jpg_data : bytes
β”‚            β”‚                            __doc__
β”‚            β”‚                                              An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                              jpg_data
β”‚            β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                     field resolution_rad : float
β”‚            β”‚                     field  axis_left_rad : float
β”‚            β”‚                     field axis_right_rad : float
β”‚            β”‚  field your_name : str
β”‚            β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚            β”‚                     field t_effective : float
β”‚            β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚            β”‚  field  map_data : str
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.
β”‚ p2_inputs: dict[4]
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚            β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                    field jpg_data : bytes
β”‚            β”‚                           __doc__
β”‚            β”‚                                             An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                             jpg_data
β”‚            β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                    field resolution_rad : float
β”‚            β”‚                    field  axis_left_rad : float
β”‚            β”‚                    field axis_right_rad : float
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
β”‚ p1: InteractionProtocol
β”‚     β”‚ description: Particularization for Duckiebot1 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ Dict[str,type][4]
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚     β”‚ β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                     field jpg_data : bytes
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                              jpg_data
β”‚     β”‚ β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                     field resolution_rad : float
β”‚     β”‚ β”‚                     field  axis_left_rad : float
β”‚     β”‚ β”‚                     field axis_right_rad : float
β”‚     β”‚ β”‚  field your_name : str
β”‚     β”‚ β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚     β”‚ β”‚                     field t_effective : float
β”‚     β”‚ β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚     β”‚ β”‚  field  map_data : str
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ Dict[str,type][1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.Duckiebot1Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
β”‚ p2: InteractionProtocol
β”‚     β”‚ description: Particularization for DB20 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ dict[4]
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚     β”‚ β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                    field jpg_data : bytes
β”‚     β”‚ β”‚                           __doc__
β”‚     β”‚ β”‚                                             An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                             jpg_data
β”‚     β”‚ β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                    field resolution_rad : float
β”‚     β”‚ β”‚                    field  axis_left_rad : float
β”‚     β”‚ β”‚                    field axis_right_rad : float
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ dict[1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7fa898749640>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361649953Bea Baselines 🐀template-randomaido5-LFV-sim-testingLFVv-simsuccessnoreg05-7d9c5d9f1ec5-10:15:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6085881804686812
survival_time_median2.9499999999999975
deviation-center-line_median0.1403114265422864
in-drivable-lane_median1.1999999999999966


other stats
agent_compute-ego_max0.044111291567484535
agent_compute-ego_mean0.03768443144057682
agent_compute-ego_median0.03750498541470232
agent_compute-ego_min0.03554690920788309
complete-iteration_max0.4883942957277651
complete-iteration_mean0.44799510772006707
complete-iteration_median0.4535061233448533
complete-iteration_min0.4090462702291983
deviation-center-line_max0.22475775167746137
deviation-center-line_mean0.13903485287735887
deviation-center-line_min0.05776713390489609
deviation-heading_max1.188478455030241
deviation-heading_mean0.5927151736963178
deviation-heading_median0.4188222725951362
deviation-heading_min0.1568455346002119
driven_any_max2.565673944182525
driven_any_mean1.4189125835581955
driven_any_median1.16193217979593
driven_any_min0.45167940085539654
driven_lanedir_consec_max1.1541294215697278
driven_lanedir_consec_mean0.626209252534499
driven_lanedir_consec_min0.2673410952697477
driven_lanedir_max1.1541294215697278
driven_lanedir_mean0.626209252534499
driven_lanedir_median0.6085881804686812
driven_lanedir_min0.2673410952697477
get_state_dump_max0.03643304011860832
get_state_dump_mean0.035457746477966214
get_state_dump_median0.03547633310844158
get_state_dump_min0.03436304021764685
get_ui_image_max0.08557413659005794
get_ui_image_mean0.0780315048001873
get_ui_image_median0.07692376704051576
get_ui_image_min0.07484333798036737
in-drivable-lane_max4.1999999999999895
in-drivable-lane_mean1.583333333333329
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.07769241575467384, "step_physics": 0.17854711969020004, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.036121808876425535, "sim_render-ego": 0.009171611171657755, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.036651469893374686, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.44712261022147487, "set_robot_commands": 0.012714802208593336, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.02075910164138018, "sim_compute_performance-ego": 0.006162869728217691, "sim_compute_robot_state-ego": 0.011772268909519002, "sim_compute_robot_state-npc0": 0.011384208323591846, "sim_compute_robot_state-npc1": 0.012368804317409708, "sim_compute_robot_state-npc2": 0.01108065702147403, "sim_compute_robot_state-npc3": 0.011341983989133672, "sim_compute_robot_state-parked0": 0.011020733138262215}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.165661360859449, "get_ui_image": 0.07484333798036737, "step_physics": 0.20027730020426088, "survival_time": 2.9499999999999975, "driven_lanedir": 0.903572228918366, "get_state_dump": 0.03630750058060986, "sim_render-ego": 0.008480383177935067, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.03658760200112553, "deviation-heading": 0.20416053912704435, "complete-iteration": 0.4547732603752007, "set_robot_commands": 0.007063073627019333, "deviation-center-line": 0.2228917410038796, "driven_lanedir_consec": 0.903572228918366, "sim_compute_sim_state": 0.01742590483972582, "sim_compute_performance-ego": 0.006368026895038152, "sim_compute_robot_state-ego": 0.010969913611977787, "sim_compute_robot_state-npc0": 0.010845487400636835, "sim_compute_robot_state-npc1": 0.010777679540343204, "sim_compute_robot_state-npc2": 0.011714591818340754, "sim_compute_robot_state-npc3": 0.01162446151345463, "sim_compute_robot_state-parked0": 0.011164127770116774}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4032841803614384, "get_ui_image": 0.08285482724507649, "step_physics": 0.16223789097969993, "survival_time": 5.699999999999988, "driven_lanedir": 0.36534142757143206, "get_state_dump": 0.03575664444973594, "sim_render-ego": 0.009071348006265204, "in-drivable-lane": 4.1999999999999895, "agent_compute-ego": 0.03802634749496192, "deviation-heading": 0.8931271150847406, "complete-iteration": 0.4322051018999334, "set_robot_commands": 0.007092107806289405, "deviation-center-line": 0.1430198732155313, "driven_lanedir_consec": 0.36534142757143206, "sim_compute_sim_state": 0.02201581210420843, "sim_compute_performance-ego": 0.006400089514882941, "sim_compute_robot_state-ego": 0.011671976039284156, "sim_compute_robot_state-npc0": 0.011495056905244529, "sim_compute_robot_state-npc1": 0.011297650504530524, "sim_compute_robot_state-npc2": 0.010942967314469186, "sim_compute_robot_state-npc3": 0.011535629891512689, "sim_compute_robot_state-parked0": 0.011468801582068727}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.565673944182525, "get_ui_image": 0.07571521856017031, "step_physics": 0.2153433480505216, "survival_time": 5.899999999999987, "driven_lanedir": 0.7246419193452476, "get_state_dump": 0.035777354644516764, "sim_render-ego": 0.009077094369015453, "in-drivable-lane": 3.599999999999988, "agent_compute-ego": 0.03840018531023446, "deviation-heading": 1.0156362799580263, "complete-iteration": 0.4754714319261454, "set_robot_commands": 0.007443704847562111, "deviation-center-line": 0.18506300264177303, "driven_lanedir_consec": 0.7246419193452476, "sim_compute_sim_state": 0.019255577507665603, "sim_compute_performance-ego": 0.006611680580397784, "sim_compute_robot_state-ego": 0.011340721178863008, "sim_compute_robot_state-npc0": 0.01147546000399832, "sim_compute_robot_state-npc1": 0.011063068600024208, "sim_compute_robot_state-npc2": 0.011208103874982412, "sim_compute_robot_state-npc3": 0.01138273942268501, "sim_compute_robot_state-parked0": 0.01104656518515894}, "ETHZ_autolab_technical_track-sc4-0-ego": {"driven_any": 1.7539176822196014, "get_ui_image": 0.07561610142389934, "step_physics": 0.1766420773097447, "survival_time": 4.199999999999993, "driven_lanedir": 0.3204495925205987, "get_state_dump": 0.03543974104381743, "sim_render-ego": 0.00891042607171195, "in-drivable-lane": 2.7499999999999947, "agent_compute-ego": 0.038126951172238306, "deviation-heading": 0.971930877880294, "complete-iteration": 0.43196647791635423, "set_robot_commands": 0.007115747247423444, "deviation-center-line": 0.1443532927850436, "driven_lanedir_consec": 0.3204495925205987, "sim_compute_sim_state": 0.01672662723632086, "sim_compute_performance-ego": 0.006271972542717343, "sim_compute_robot_state-ego": 0.011244169303349084, "sim_compute_robot_state-npc0": 0.011206379958561488, "sim_compute_robot_state-npc1": 0.011215136164710636, "sim_compute_robot_state-npc2": 0.011137187480926514, "sim_compute_robot_state-npc3": 0.010919431845347086, "sim_compute_robot_state-parked0": 0.011060053393954324}, "ETHZ_autolab_technical_track-sc5-0-ego": {"driven_any": 1.1596420239493832, "get_ui_image": 0.07555886174811692, "step_physics": 0.21052108827184457, "survival_time": 3.049999999999997, "driven_lanedir": 1.148914725250399, "get_state_dump": 0.03643304011860832, "sim_render-ego": 0.009134386406570183, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0378667878322914, "deviation-heading": 0.4188222725951362, "complete-iteration": 0.4679115952038374, "set_robot_commands": 0.006836410428656906, "deviation-center-line": 0.16491706160482691, "driven_lanedir_consec": 1.148914725250399, "sim_compute_sim_state": 0.0186653449887135, "sim_compute_performance-ego": 0.006179383543671154, "sim_compute_robot_state-ego": 0.011331437063998863, "sim_compute_robot_state-npc0": 0.011055973709606731, "sim_compute_robot_state-npc1": 0.010847502067440846, "sim_compute_robot_state-npc2": 0.0111421600717013, "sim_compute_robot_state-npc3": 0.011023775475924131, "sim_compute_robot_state-parked0": 0.010981958420550235}, "ETHZ_autolab_technical_track-sc6-0-ego": {"driven_any": 2.4635702672656032, "get_ui_image": 0.07692376704051576, "step_physics": 0.20765981180914517, "survival_time": 5.799999999999987, "driven_lanedir": 1.1541294215697278, "get_state_dump": 0.03547633310844158, "sim_render-ego": 0.008949756622314453, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.03750498541470232, "deviation-heading": 1.188478455030241, "complete-iteration": 0.4700284333064638, "set_robot_commands": 0.007316965481330608, "deviation-center-line": 0.22475775167746137, "driven_lanedir_consec": 1.1541294215697278, "sim_compute_sim_state": 0.024327385014501112, "sim_compute_performance-ego": 0.005988168305364148, "sim_compute_robot_state-ego": 0.011055436627618195, "sim_compute_robot_state-npc0": 0.010958688012484846, "sim_compute_robot_state-npc1": 0.010588974788271147, "sim_compute_robot_state-npc2": 0.01087077938277146, "sim_compute_robot_state-npc3": 0.011046405496268437, "sim_compute_robot_state-parked0": 0.01103267998530947}, "ETHZ_autolab_technical_track-sc7-0-ego": {"driven_any": 0.8701412575291315, "get_ui_image": 0.08148813247680664, "step_physics": 0.2201032379399175, "survival_time": 2.3, "driven_lanedir": 0.2673410952697477, "get_state_dump": 0.035064039023026176, "sim_render-ego": 0.008758897366731064, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.03554690920788309, "deviation-heading": 0.2583833741523752, "complete-iteration": 0.47607620902683423, "set_robot_commands": 0.007236905719922936, "deviation-center-line": 0.097353713813239, "driven_lanedir_consec": 0.2673410952697477, "sim_compute_sim_state": 0.01724253530087678, "sim_compute_performance-ego": 0.006397547929183296, "sim_compute_robot_state-ego": 0.011085178541100544, "sim_compute_robot_state-npc0": 0.010879739471103834, "sim_compute_robot_state-npc1": 0.0107563941375069, "sim_compute_robot_state-npc2": 0.010307078776152235, "sim_compute_robot_state-npc3": 0.01054878856824792, "sim_compute_robot_state-parked0": 0.010344484578008238}, "ETHZ_autolab_technical_track-sc8-0-ego": {"driven_any": 1.6784216991973973, "get_ui_image": 0.07645584330146696, "step_physics": 0.1602025385256167, "survival_time": 4.049999999999994, "driven_lanedir": 0.4710687049176945, "get_state_dump": 0.034713015144253956, "sim_render-ego": 0.008486526983755606, "in-drivable-lane": 2.699999999999993, "agent_compute-ego": 0.03580603776154695, "deviation-heading": 0.2248266426213769, "complete-iteration": 0.4165655506981744, "set_robot_commands": 0.006872807020022545, "deviation-center-line": 0.1403114265422864, "driven_lanedir_consec": 0.4710687049176945, "sim_compute_sim_state": 0.022108078002929688, "sim_compute_performance-ego": 0.006002508563759886, "sim_compute_robot_state-ego": 0.010530560104935258, "sim_compute_robot_state-npc0": 0.012525196428652165, "sim_compute_robot_state-npc1": 0.010676604730111582, "sim_compute_robot_state-npc2": 0.010485710921110933, "sim_compute_robot_state-npc3": 0.010577316637392396, "sim_compute_robot_state-parked0": 0.0107971179632493}, "ETHZ_autolab_technical_track-sc9-0-ego": {"driven_any": 1.8576055563161276, "get_ui_image": 0.07783707434480841, "step_physics": 0.16521431641145187, "survival_time": 4.399999999999992, "driven_lanedir": 0.4765889135209004, "get_state_dump": 0.034655329856005584, "sim_render-ego": 0.008964449167251587, "in-drivable-lane": 2.6499999999999937, "agent_compute-ego": 0.03787303241816434, "deviation-heading": 1.0432301257911911, "complete-iteration": 0.42167395082387055, "set_robot_commands": 0.007111240517009388, "deviation-center-line": 0.13483708321452476, "driven_lanedir_consec": 0.4765889135209004, "sim_compute_sim_state": 0.01680388233878396, "sim_compute_performance-ego": 0.006183426488529552, "sim_compute_robot_state-ego": 0.010742902755737305, "sim_compute_robot_state-npc0": 0.010923163457350298, "sim_compute_robot_state-npc1": 0.011171812360936943, "sim_compute_robot_state-npc2": 0.01125761866569519, "sim_compute_robot_state-npc3": 0.01148084889758717, "sim_compute_robot_state-parked0": 0.011122291738336737}, "ETHZ_autolab_technical_track-sc10-0-ego": {"driven_any": 1.0711387488577857, "get_ui_image": 0.07658730171344898, "step_physics": 0.16156916706650346, "survival_time": 2.6999999999999984, "driven_lanedir": 0.6756397547363227, "get_state_dump": 0.035076653515851056, "sim_render-ego": 0.008904240749500416, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.03647956141719112, "deviation-heading": 0.6037720799768409, "complete-iteration": 0.4154200377287688, "set_robot_commands": 0.007515218522813585, "deviation-center-line": 0.12132331019245668, "driven_lanedir_consec": 0.6756397547363227, "sim_compute_sim_state": 0.015619794527689615, "sim_compute_performance-ego": 0.006185814186378762, "sim_compute_robot_state-ego": 0.01150593051203975, "sim_compute_robot_state-npc0": 0.01124531251412851, "sim_compute_robot_state-npc1": 0.011002337491070782, "sim_compute_robot_state-npc2": 0.011349081993103027, "sim_compute_robot_state-npc3": 0.0111530930907638, "sim_compute_robot_state-parked0": 0.01090185730545609}, "ETHZ_autolab_technical_track-sc11-0-ego": {"driven_any": 1.081042559681037, "get_ui_image": 0.08557413659005794, "step_physics": 0.17364536591295926, "survival_time": 2.6499999999999986, "driven_lanedir": 0.6753369638743661, "get_state_dump": 0.0355509766992533, "sim_render-ego": 0.008767213461534033, "in-drivable-lane": 0.7499999999999976, "agent_compute-ego": 0.03886608357699412, "deviation-heading": 0.4012102812778944, "complete-iteration": 0.4535061233448533, "set_robot_commands": 0.0072361928112102, "deviation-center-line": 0.05847614377055608, "driven_lanedir_consec": 0.6753369638743661, "sim_compute_sim_state": 0.025815900766624593, "sim_compute_performance-ego": 0.01075867436966806, "sim_compute_robot_state-ego": 0.01131226881495062, "sim_compute_robot_state-npc0": 0.01111872691028523, "sim_compute_robot_state-npc1": 0.010811031989331516, "sim_compute_robot_state-npc2": 0.011299394211679137, "sim_compute_robot_state-npc3": 0.011459993866254698, "sim_compute_robot_state-parked0": 0.010972895712222694}, "ETHZ_autolab_technical_track-sc12-0-ego": {"driven_any": 0.45167940085539654, "get_ui_image": 0.07988294848689327, "step_physics": 0.23342826631334093, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4484607082072362, "get_state_dump": 0.03436304021764685, "sim_render-ego": 0.008597197356047455, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0365597407023112, "deviation-heading": 0.1568455346002119, "complete-iteration": 0.4883942957277651, "set_robot_commands": 0.007121545297128183, "deviation-center-line": 0.05776713390489609, "driven_lanedir_consec": 0.4484607082072362, "sim_compute_sim_state": 0.020107657821090134, "sim_compute_performance-ego": 0.006362093819512261, "sim_compute_robot_state-ego": 0.010715899644074616, "sim_compute_robot_state-npc0": 0.010436623184769242, "sim_compute_robot_state-npc1": 0.010472227025915076, "sim_compute_robot_state-npc2": 0.010248272507279008, "sim_compute_robot_state-npc3": 0.010036450845223886, "sim_compute_robot_state-parked0": 0.00975473721822103}, "ETHZ_autolab_technical_track-sc13-0-ego": {"driven_any": 0.5269469092032995, "get_ui_image": 0.07845519383748373, "step_physics": 0.19784269332885743, "survival_time": 1.5000000000000009, "driven_lanedir": 0.3061192219544848, "get_state_dump": 0.0359662135442098, "sim_render-ego": 0.008706394831339519, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.044111291567484535, "deviation-heading": 0.36789897268648614, "complete-iteration": 0.45976526737213136, "set_robot_commands": 0.00789502461751302, "deviation-center-line": 0.0736122868842703, "driven_lanedir_consec": 0.3061192219544848, "sim_compute_sim_state": 0.015898569424947103, "sim_compute_performance-ego": 0.0069724400838216145, "sim_compute_robot_state-ego": 0.011109606424967448, "sim_compute_robot_state-npc0": 0.01027071475982666, "sim_compute_robot_state-npc1": 0.011170427004496256, "sim_compute_robot_state-npc2": 0.010677146911621091, "sim_compute_robot_state-npc3": 0.010470175743103029, "sim_compute_robot_state-parked0": 0.009910917282104493}, "ETHZ_autolab_technical_track-sc14-0-ego": {"driven_any": 1.0730309830988245, "get_ui_image": 0.07498741149902344, "step_physics": 0.14575682746039498, "survival_time": 2.6999999999999984, "driven_lanedir": 0.8469459298922781, "get_state_dump": 0.03516450634709111, "sim_render-ego": 0.008629436846132632, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.036859485838148326, "deviation-heading": 0.8719942361704109, "complete-iteration": 0.4090462702291983, "set_robot_commands": 0.0075809602384214044, "deviation-center-line": 0.1922003475773841, "driven_lanedir_consec": 0.8469459298922781, "sim_compute_sim_state": 0.02527592800281666, "sim_compute_performance-ego": 0.006035217532405147, "sim_compute_robot_state-ego": 0.01127875734258581, "sim_compute_robot_state-npc0": 0.011103157643918638, "sim_compute_robot_state-npc1": 0.011447279541580766, "sim_compute_robot_state-npc2": 0.012424005402459038, "sim_compute_robot_state-npc3": 0.01102574666341146, "sim_compute_robot_state-parked0": 0.011151494803252044}}
set_robot_commands_max0.012714802208593336
set_robot_commands_mean0.007610180426061095
set_robot_commands_median0.0072361928112102
set_robot_commands_min0.006836410428656906
sim_compute_performance-ego_max0.01075867436966806
sim_compute_performance-ego_mean0.006591994272236519
sim_compute_performance-ego_median0.006271972542717343
sim_compute_performance-ego_min0.005988168305364148
sim_compute_robot_state-ego_max0.011772268909519002
sim_compute_robot_state-ego_mean0.011177801791666766
sim_compute_robot_state-ego_median0.011244169303349084
sim_compute_robot_state-ego_min0.010530560104935258
sim_compute_robot_state-npc0_max0.012525196428652165
sim_compute_robot_state-npc0_mean0.011128259245610611
sim_compute_robot_state-npc0_median0.011103157643918638
sim_compute_robot_state-npc0_min0.01027071475982666
sim_compute_robot_state-npc1_max0.012368804317409708
sim_compute_robot_state-npc1_mean0.011044462017578673
sim_compute_robot_state-npc1_median0.011002337491070782
sim_compute_robot_state-npc1_min0.010472227025915076
sim_compute_robot_state-npc2_max0.012424005402459038
sim_compute_robot_state-npc2_mean0.01107631709025102
sim_compute_robot_state-npc2_median0.011137187480926514
sim_compute_robot_state-npc2_min0.010248272507279008
sim_compute_robot_state-npc3_max0.01162446151345463
sim_compute_robot_state-npc3_mean0.011041789463087336
sim_compute_robot_state-npc3_median0.011046405496268437
sim_compute_robot_state-npc3_min0.010036450845223886
sim_compute_robot_state-parked0_max0.011468801582068727
sim_compute_robot_state-parked0_mean0.010848714405084753
sim_compute_robot_state-parked0_median0.011020733138262215
sim_compute_robot_state-parked0_min0.00975473721822103
sim_compute_sim_state_max0.025815900766624593
sim_compute_sim_state_mean0.019869873301218265
sim_compute_sim_state_median0.019255577507665603
sim_compute_sim_state_min0.015619794527689615
sim_render-ego_max0.009171611171657755
sim_render-ego_mean0.008840624172517492
sim_render-ego_median0.008904240749500416
sim_render-ego_min0.008480383177935067
simulation-passed1
step_physics_max0.23342826631334093
step_physics_mean0.1872660699516306
step_physics_median0.17854711969020004
step_physics_min0.14575682746039498
survival_time_max5.899999999999987
survival_time_mean3.4799999999999955
survival_time_min1.3500000000000003
No reset possible
361619954Bea Baselines 🐀template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg05-7d9c5d9f1ec5-10:01:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
β”‚         k: observations
β”‚        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                                field jpg_data : bytes
β”‚                                       __doc__
β”‚                                                         An image in JPG format.
β”‚ 
β”‚                                                         jpg_data
β”‚             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                                field resolution_rad : float
β”‚                                field  axis_left_rad : float
β”‚                                field axis_right_rad : float
β”‚             field your_name : str
β”‚             field     state : dataclass aido_schemas.schemas.DTSimState
β”‚                                field t_effective : float
β”‚                                field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚             field  map_data : str
β”‚        v2: dataclass aido_schemas.schemas.DB20Observations
β”‚             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                               field jpg_data : bytes
β”‚                                      __doc__
β”‚                                                        An image in JPG format.
β”‚ 
β”‚                                                        jpg_data
β”‚             field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                               field resolution_rad : float
β”‚                               field  axis_left_rad : float
β”‚                               field axis_right_rad : float
β”‚         r: CanBeUsed
β”‚            β”‚ result: False
β”‚            β”‚ why:
β”‚            β”‚ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
β”‚            β”‚ | requires field "your_name"
β”‚            β”‚ |  of type <class 'str'>
β”‚            β”‚ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
β”‚            β”‚ M: Matches()
β”‚            β”‚ matches: {}
β”‚ p1_inputs: Dict[str,type][4]
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚            β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                     field jpg_data : bytes
β”‚            β”‚                            __doc__
β”‚            β”‚                                              An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                              jpg_data
β”‚            β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                     field resolution_rad : float
β”‚            β”‚                     field  axis_left_rad : float
β”‚            β”‚                     field axis_right_rad : float
β”‚            β”‚  field your_name : str
β”‚            β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚            β”‚                     field t_effective : float
β”‚            β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚            β”‚  field  map_data : str
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.
β”‚ p2_inputs: dict[4]
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚            β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                    field jpg_data : bytes
β”‚            β”‚                           __doc__
β”‚            β”‚                                             An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                             jpg_data
β”‚            β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                    field resolution_rad : float
β”‚            β”‚                    field  axis_left_rad : float
β”‚            β”‚                    field axis_right_rad : float
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
β”‚ p1: InteractionProtocol
β”‚     β”‚ description: Particularization for Duckiebot1 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ Dict[str,type][4]
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚     β”‚ β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                     field jpg_data : bytes
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                              jpg_data
β”‚     β”‚ β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                     field resolution_rad : float
β”‚     β”‚ β”‚                     field  axis_left_rad : float
β”‚     β”‚ β”‚                     field axis_right_rad : float
β”‚     β”‚ β”‚  field your_name : str
β”‚     β”‚ β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚     β”‚ β”‚                     field t_effective : float
β”‚     β”‚ β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚     β”‚ β”‚  field  map_data : str
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ Dict[str,type][1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.Duckiebot1Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
β”‚ p2: InteractionProtocol
β”‚     β”‚ description: Particularization for DB20 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ dict[4]
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚     β”‚ β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                    field jpg_data : bytes
β”‚     β”‚ β”‚                           __doc__
β”‚     β”‚ β”‚                                             An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                             jpg_data
β”‚     β”‚ β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                    field resolution_rad : float
β”‚     β”‚ β”‚                    field  axis_left_rad : float
β”‚     β”‚ β”‚                    field axis_right_rad : float
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ dict[1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7fa07bb10550>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361469965Bea Baselines 🐀template-rosaido5-LFVI-sim-testingLFVIt-simsuccessnoreg05-7d9c5d9f1ec5-10:26:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6110360678506344
survival_time_median6.499999999999985
deviation-center-line_median0.19691847778988247
in-drivable-lane_median3.2999999999999883


other stats
agent_compute-ego_max0.03980673897650934
agent_compute-ego_mean0.037502123573335024
agent_compute-ego_median0.03752530756450835
agent_compute-ego_min0.03661698603448067
complete-iteration_max0.4910852142742702
complete-iteration_mean0.46337700032947465
complete-iteration_median0.45634688702664633
complete-iteration_min0.4452618460618813
deviation-center-line_max0.4232558823379271
deviation-center-line_mean0.22453680100557744
deviation-center-line_min0.14138306573395992
deviation-heading_max2.259351132189125
deviation-heading_mean1.0781576493350489
deviation-heading_median1.0328428663145206
deviation-heading_min0.3007715468309916
driven_any_max3.556691939681581
driven_any_mean1.7263034739408745
driven_any_median1.7790130692109372
driven_any_min0.7559073026891169
driven_lanedir_consec_max1.1405795818067217
driven_lanedir_consec_mean0.5940101361797357
driven_lanedir_consec_min0.30795254668181604
driven_lanedir_max1.1405795818067217
driven_lanedir_mean0.6171129521903327
driven_lanedir_median0.6110360678506344
driven_lanedir_min0.30795254668181604
get_state_dump_max0.0458468500773112
get_state_dump_mean0.036438565994387107
get_state_dump_median0.03582807659178741
get_state_dump_min0.034370161238170806
get_ui_image_max0.09449856243436298
get_ui_image_mean0.08419758122512322
get_ui_image_median0.08307728075212048
get_ui_image_min0.07899513944879279
in-drivable-lane_max7.600000000000042
in-drivable-lane_mean3.3966666666666607
in-drivable-lane_min0.849999999999997
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 1.046110118925388, "get_ui_image": 0.07940966288248698, "step_physics": 0.18967159271240233, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6988974156615684, "get_state_dump": 0.0458468500773112, "sim_render-ego": 0.009000263214111327, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.03753099123636881, "deviation-heading": 0.7766766886793283, "complete-iteration": 0.4624165407816569, "set_robot_commands": 0.007217394510904948, "deviation-center-line": 0.17491015355206296, "driven_lanedir_consec": 0.6936831634685361, "sim_compute_sim_state": 0.01940125783284505, "sim_compute_performance-ego": 0.006162694295247396, "sim_compute_robot_state-ego": 0.01305943489074707, "sim_compute_robot_state-npc0": 0.011219517389933268, "sim_compute_robot_state-npc1": 0.01097169558207194, "sim_compute_robot_state-npc2": 0.011067838668823242, "sim_compute_robot_state-npc3": 0.011002044677734376, "sim_compute_robot_state-parked0": 0.01056060791015625}, "udem1-sc1-0-ego": {"driven_any": 1.760361126191798, "get_ui_image": 0.08537679046164942, "step_physics": 0.19069327106912629, "survival_time": 6.549999999999985, "driven_lanedir": 0.38118234647456495, "get_state_dump": 0.03488347912562712, "sim_render-ego": 0.008925379687593183, "in-drivable-lane": 4.799999999999984, "agent_compute-ego": 0.03737838941676016, "deviation-heading": 0.3007715468309916, "complete-iteration": 0.453091908957212, "set_robot_commands": 0.006725806316346613, "deviation-center-line": 0.1585005758177395, "driven_lanedir_consec": 0.38118234647456495, "sim_compute_sim_state": 0.01970268933827641, "sim_compute_performance-ego": 0.0062867448530124345, "sim_compute_robot_state-ego": 0.011173657788575151, "sim_compute_robot_state-npc0": 0.010303171536394658, "sim_compute_robot_state-npc1": 0.010397390554879458, "sim_compute_robot_state-npc2": 0.010748648461494738, "sim_compute_robot_state-npc3": 0.010309162940687806, "sim_compute_robot_state-parked0": 0.009915592106244035}, "udem1-sc2-0-ego": {"driven_any": 1.677268686263963, "get_ui_image": 0.09449856243436298, "step_physics": 0.1798956242818681, "survival_time": 6.299999999999986, "driven_lanedir": 0.7638167004523511, "get_state_dump": 0.03644492701878623, "sim_render-ego": 0.00932587328411284, "in-drivable-lane": 2.84999999999999, "agent_compute-ego": 0.03742012523469471, "deviation-heading": 1.0328428663145206, "complete-iteration": 0.4606826551376827, "set_robot_commands": 0.007641436561705574, "deviation-center-line": 0.31755265093071444, "driven_lanedir_consec": 0.7638167004523511, "sim_compute_sim_state": 0.019188897950308665, "sim_compute_performance-ego": 0.006544652439299084, "sim_compute_robot_state-ego": 0.01219748126135932, "sim_compute_robot_state-npc0": 0.012022894526284838, "sim_compute_robot_state-npc1": 0.011023616033887108, "sim_compute_robot_state-npc2": 0.011597425218612428, "sim_compute_robot_state-npc3": 0.011329230808076404, "sim_compute_robot_state-parked0": 0.01124634061540876}, "udem1-sc3-0-ego": {"driven_any": 0.9169613778659852, "get_ui_image": 0.0823855715639451, "step_physics": 0.1972359629238353, "survival_time": 3.399999999999996, "driven_lanedir": 0.3507858255540761, "get_state_dump": 0.03695807036231546, "sim_render-ego": 0.00885163335239186, "in-drivable-lane": 1.6999999999999955, "agent_compute-ego": 0.03682130925795611, "deviation-heading": 0.5431219512392664, "complete-iteration": 0.4682584054329816, "set_robot_commands": 0.007078766822814941, "deviation-center-line": 0.14138306573395992, "driven_lanedir_consec": 0.3507858255540761, "sim_compute_sim_state": 0.026159731780781462, "sim_compute_performance-ego": 0.006396391812492819, "sim_compute_robot_state-ego": 0.011666417121887209, "sim_compute_robot_state-npc0": 0.01091169609743006, "sim_compute_robot_state-npc1": 0.010710109682644115, "sim_compute_robot_state-npc2": 0.010927649105296417, "sim_compute_robot_state-npc3": 0.010822632733513329, "sim_compute_robot_state-parked0": 0.011045214007882512}, "udem1-sc4-0-ego": {"driven_any": 1.7790130692109372, "get_ui_image": 0.08661358047077675, "step_physics": 0.17592611385665777, "survival_time": 6.549999999999985, "driven_lanedir": 0.30795254668181604, "get_state_dump": 0.03495927257392243, "sim_render-ego": 0.008606291909254235, "in-drivable-lane": 4.549999999999987, "agent_compute-ego": 0.03661698603448067, "deviation-heading": 1.3689817968978728, "complete-iteration": 0.4452618460618813, "set_robot_commands": 0.007417589653539293, "deviation-center-line": 0.19691847778988247, "driven_lanedir_consec": 0.30795254668181604, "sim_compute_sim_state": 0.021562292375637376, "sim_compute_performance-ego": 0.0063927373813308834, "sim_compute_robot_state-ego": 0.011113201388875948, "sim_compute_robot_state-npc0": 0.01130965647806648, "sim_compute_robot_state-npc1": 0.010918054871886742, "sim_compute_robot_state-npc2": 0.011461052275795972, "sim_compute_robot_state-npc3": 0.011033622363141477, "sim_compute_robot_state-parked0": 0.011037924817500225}, "udem1-sc5-0-ego": {"driven_any": 1.823116283446278, "get_ui_image": 0.0799350169988779, "step_physics": 0.18136595029097335, "survival_time": 6.499999999999985, "driven_lanedir": 0.4958254270507241, "get_state_dump": 0.03696217903724083, "sim_render-ego": 0.009511943963857798, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.03767642424656795, "deviation-heading": 2.259351132189125, "complete-iteration": 0.4521862763624925, "set_robot_commands": 0.007455561711237981, "deviation-center-line": 0.2570912463187073, "driven_lanedir_consec": 0.4641943678122489, "sim_compute_sim_state": 0.025519141784081097, "sim_compute_performance-ego": 0.006735425729017992, "sim_compute_robot_state-ego": 0.01217932517711933, "sim_compute_robot_state-npc0": 0.011315516325143668, "sim_compute_robot_state-npc1": 0.010886801206148588, "sim_compute_robot_state-npc2": 0.011217014606182392, "sim_compute_robot_state-npc3": 0.010524929486788235, "sim_compute_robot_state-parked0": 0.010602708963247446}, "udem1-sc6-0-ego": {"driven_any": 1.8708876021418763, "get_ui_image": 0.07966918169065963, "step_physics": 0.19205192447632785, "survival_time": 6.449999999999985, "driven_lanedir": 0.3773685489382188, "get_state_dump": 0.03582807659178741, "sim_render-ego": 0.009347786274991294, "in-drivable-lane": 4.449999999999987, "agent_compute-ego": 0.0380283326141594, "deviation-heading": 1.25615874895112, "complete-iteration": 0.45634688702664633, "set_robot_commands": 0.007154522016066913, "deviation-center-line": 0.14655521893536677, "driven_lanedir_consec": 0.3773685489382188, "sim_compute_sim_state": 0.022099964378416076, "sim_compute_performance-ego": 0.006198302719944207, "sim_compute_robot_state-ego": 0.011478684669317202, "sim_compute_robot_state-npc0": 0.010366210641787034, "sim_compute_robot_state-npc1": 0.010925732841787413, "sim_compute_robot_state-npc2": 0.011114950327910194, "sim_compute_robot_state-npc3": 0.011007079782412034, "sim_compute_robot_state-parked0": 0.010794192321540774}, "udem1-sc7-0-ego": {"driven_any": 0.7559073026891169, "get_ui_image": 0.08307728075212048, "step_physics": 0.21422455003184657, "survival_time": 3.099999999999997, "driven_lanedir": 0.4608221788488507, "get_state_dump": 0.03584607185855988, "sim_render-ego": 0.009594978824738531, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.03980673897650934, "deviation-heading": 0.7680347148461596, "complete-iteration": 0.4824849405596333, "set_robot_commands": 0.007254423633698494, "deviation-center-line": 0.16403590159070516, "driven_lanedir_consec": 0.4608221788488507, "sim_compute_sim_state": 0.01936243810961323, "sim_compute_performance-ego": 0.00661190479032455, "sim_compute_robot_state-ego": 0.011399030685424805, "sim_compute_robot_state-npc0": 0.011364286945712182, "sim_compute_robot_state-npc1": 0.011056334741653935, "sim_compute_robot_state-npc2": 0.010894783081546906, "sim_compute_robot_state-npc3": 0.010943943454373268, "sim_compute_robot_state-parked0": 0.010759984293291646}, "udem1-sc8-0-ego": {"driven_any": 1.1398270212454358, "get_ui_image": 0.08785592374347505, "step_physics": 0.2207466278757368, "survival_time": 4.199999999999993, "driven_lanedir": 0.742873009350095, "get_state_dump": 0.034370161238170806, "sim_render-ego": 0.009085777260008311, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0377236491157895, "deviation-heading": 1.410815094214431, "complete-iteration": 0.4910852142742702, "set_robot_commands": 0.007430544921330043, "deviation-center-line": 0.23985922798974663, "driven_lanedir_consec": 0.742873009350095, "sim_compute_sim_state": 0.02058043934050061, "sim_compute_performance-ego": 0.006589469455537342, "sim_compute_robot_state-ego": 0.011230658917199998, "sim_compute_robot_state-npc0": 0.010827694620404924, "sim_compute_robot_state-npc1": 0.010810040292285735, "sim_compute_robot_state-npc2": 0.0109403928120931, "sim_compute_robot_state-npc3": 0.011454400562104724, "sim_compute_robot_state-parked0": 0.011148594674609956}, "udem1-sc9-0-ego": {"driven_any": 1.126243276273433, "get_ui_image": 0.08789963097799391, "step_physics": 0.2115857090268816, "survival_time": 4.199999999999993, "driven_lanedir": 0.5259372388577412, "get_state_dump": 0.0355600913365682, "sim_render-ego": 0.0088301868665786, "in-drivable-lane": 1.749999999999996, "agent_compute-ego": 0.03752530756450835, "deviation-heading": 1.3908170750771545, "complete-iteration": 0.4862555776323591, "set_robot_commands": 0.0077262066659473235, "deviation-center-line": 0.19609371504588025, "driven_lanedir_consec": 0.5259372388577412, "sim_compute_sim_state": 0.025544365247090656, "sim_compute_performance-ego": 0.0062871575355529785, "sim_compute_robot_state-ego": 0.011222950049809046, "sim_compute_robot_state-npc0": 0.010935885565621513, "sim_compute_robot_state-npc1": 0.010605786527906143, "sim_compute_robot_state-npc2": 0.010766148567199709, "sim_compute_robot_state-npc3": 0.01073176520211356, "sim_compute_robot_state-parked0": 0.010747708025432769}, "udem1-sc10-0-ego": {"driven_any": 2.09614918930093, "get_ui_image": 0.0903607939376312, "step_physics": 0.2095822914927995, "survival_time": 7.349999999999982, "driven_lanedir": 0.9349190577068568, "get_state_dump": 0.03513542162317808, "sim_render-ego": 0.008611878570245236, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.03690174647739956, "deviation-heading": 1.8040457191026116, "complete-iteration": 0.4825231088262026, "set_robot_commands": 0.006925399611596348, "deviation-center-line": 0.4232558823379271, "driven_lanedir_consec": 0.6337448409358444, "sim_compute_sim_state": 0.02331551240414989, "sim_compute_performance-ego": 0.007805397721374927, "sim_compute_robot_state-ego": 0.010812577747163318, "sim_compute_robot_state-npc0": 0.01050271631098118, "sim_compute_robot_state-npc1": 0.010469973492784564, "sim_compute_robot_state-npc2": 0.010904415935075202, "sim_compute_robot_state-npc3": 0.010528415238776175, "sim_compute_robot_state-parked0": 0.010393431397522388}, "udem1-sc11-0-ego": {"driven_any": 2.027859756067638, "get_ui_image": 0.07899513944879279, "step_physics": 0.1841745393259542, "survival_time": 7.149999999999983, "driven_lanedir": 0.7434324859041669, "get_state_dump": 0.036475493357731745, "sim_render-ego": 0.009396798127181048, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.03769503940235485, "deviation-heading": 0.6855668497147576, "complete-iteration": 0.45385296861608543, "set_robot_commands": 0.008032153536389757, "deviation-center-line": 0.18191782073823923, "driven_lanedir_consec": 0.734909773947732, "sim_compute_sim_state": 0.020673536754154655, "sim_compute_performance-ego": 0.006578602157272659, "sim_compute_robot_state-ego": 0.011788256518490664, "sim_compute_robot_state-npc0": 0.013299930345762026, "sim_compute_robot_state-npc1": 0.014013618856043249, "sim_compute_robot_state-npc2": 0.01098433407870206, "sim_compute_robot_state-npc3": 0.010660985133031032, "sim_compute_robot_state-parked0": 0.010800366635089154}, "udem1-sc12-0-ego": {"driven_any": 1.996940751356714, "get_ui_image": 0.08062337359336957, "step_physics": 0.1919788857028909, "survival_time": 7.299999999999982, "driven_lanedir": 0.6110360678506344, "get_state_dump": 0.035550186078842375, "sim_render-ego": 0.009007956883678695, "in-drivable-lane": 4.6499999999999835, "agent_compute-ego": 0.03705856734759187, "deviation-heading": 0.6762138652024774, "complete-iteration": 0.45600704950829074, "set_robot_commands": 0.007157208168343322, "deviation-center-line": 0.19757610975231177, "driven_lanedir_consec": 0.6110360678506344, "sim_compute_sim_state": 0.023579661160299224, "sim_compute_performance-ego": 0.006354999868837121, "sim_compute_robot_state-ego": 0.011789710554358075, "sim_compute_robot_state-npc0": 0.010678137818427936, "sim_compute_robot_state-npc1": 0.01058375018916718, "sim_compute_robot_state-npc2": 0.010641287450921046, "sim_compute_robot_state-npc3": 0.01021028218204028, "sim_compute_robot_state-parked0": 0.010495579406006697}, "udem1-sc13-0-ego": {"driven_any": 2.32121460845204, "get_ui_image": 0.08427515607891661, "step_physics": 0.17214181928923636, "survival_time": 8.249999999999982, "driven_lanedir": 0.7212658517166033, "get_state_dump": 0.036311984784675365, "sim_render-ego": 0.009692495519464666, "in-drivable-lane": 5.399999999999984, "agent_compute-ego": 0.03767006613991477, "deviation-heading": 0.5102454015443647, "complete-iteration": 0.4481339353503603, "set_robot_commands": 0.007401226506088719, "deviation-center-line": 0.2304623213973144, "driven_lanedir_consec": 0.7212658517166033, "sim_compute_sim_state": 0.02720562761480158, "sim_compute_performance-ego": 0.006717329314260772, "sim_compute_robot_state-ego": 0.011664851506551109, "sim_compute_robot_state-npc0": 0.01083777312076453, "sim_compute_robot_state-npc1": 0.010229158401489255, "sim_compute_robot_state-npc2": 0.01245779413165468, "sim_compute_robot_state-npc3": 0.010559554533524949, "sim_compute_robot_state-parked0": 0.01069422924157345}, "udem1-sc14-0-ego": {"driven_any": 3.556691939681581, "get_ui_image": 0.08198805334178973, "step_physics": 0.19157235193452077, "survival_time": 11.950000000000037, "driven_lanedir": 1.1405795818067217, "get_state_dump": 0.035446224851089544, "sim_render-ego": 0.008899220861650412, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.03667818053496932, "deviation-heading": 1.3887212892215537, "complete-iteration": 0.4520676904143648, "set_robot_commands": 0.007070953377121163, "deviation-center-line": 0.34193964715310377, "driven_lanedir_consec": 1.1405795818067217, "sim_compute_sim_state": 0.021317577761087458, "sim_compute_performance-ego": 0.006217082674034469, "sim_compute_robot_state-ego": 0.011356538309711792, "sim_compute_robot_state-npc0": 0.01041100913011878, "sim_compute_robot_state-npc1": 0.010404127911044964, "sim_compute_robot_state-npc2": 0.010060705400411056, "sim_compute_robot_state-npc3": 0.010165573662793786, "sim_compute_robot_state-parked0": 0.010213958668409531}}
set_robot_commands_max0.008032153536389757
set_robot_commands_mean0.007312612934208761
set_robot_commands_median0.007254423633698494
set_robot_commands_min0.006725806316346613
sim_compute_performance-ego_max0.007805397721374927
sim_compute_performance-ego_mean0.006525259516502642
sim_compute_performance-ego_median0.006396391812492819
sim_compute_performance-ego_min0.006162694295247396
sim_compute_robot_state-ego_max0.01305943489074707
sim_compute_robot_state-ego_mean0.011608851772439336
sim_compute_robot_state-ego_median0.011478684669317202
sim_compute_robot_state-ego_min0.010812577747163318
sim_compute_robot_state-npc0_max0.013299930345762026
sim_compute_robot_state-npc0_mean0.011087073123522204
sim_compute_robot_state-npc0_median0.01091169609743006
sim_compute_robot_state-npc0_min0.010303171536394658
sim_compute_robot_state-npc1_max0.014013618856043249
sim_compute_robot_state-npc1_mean0.01093374607904536
sim_compute_robot_state-npc1_median0.010810040292285735
sim_compute_robot_state-npc1_min0.010229158401489255
sim_compute_robot_state-npc2_max0.01245779413165468
sim_compute_robot_state-npc2_mean0.011052296008114608
sim_compute_robot_state-npc2_median0.0109403928120931
sim_compute_robot_state-npc2_min0.010060705400411056
sim_compute_robot_state-npc3_max0.011454400562104724
sim_compute_robot_state-npc3_mean0.010752241517407429
sim_compute_robot_state-npc3_median0.01073176520211356
sim_compute_robot_state-npc3_min0.010165573662793786
sim_compute_robot_state-parked0_max0.01124634061540876
sim_compute_robot_state-parked0_mean0.010697095538927706
sim_compute_robot_state-parked0_median0.010747708025432769
sim_compute_robot_state-parked0_min0.009915592106244035
sim_compute_sim_state_max0.02720562761480158
sim_compute_sim_state_mean0.022347542255469564
sim_compute_sim_state_median0.021562292375637376
sim_compute_sim_state_min0.019188897950308665
sim_render-ego_max0.009692495519464666
sim_render-ego_mean0.0091125643066572
sim_render-ego_median0.009007956883678695
sim_render-ego_min0.008606291909254235
simulation-passed1
step_physics_max0.2207466278757368
step_physics_mean0.19352314761940384
step_physics_median0.19157235193452077
step_physics_min0.17214181928923636
survival_time_max11.950000000000037
survival_time_mean6.19999999999999
survival_time_min3.099999999999997
No reset possible
361419969Bea Baselines 🐀template-pytorchaido5-LF-sim-testingLFt-simerrornoreg05-7d9c5d9f1ec5-10:01:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 45, in init
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 45, in init
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361379971Bea Baselines 🐀template-pytorchaido5-LFV-sim-testingLFVv-simerrornoreg05-7d9c5d9f1ec5-10:01:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 45, in init
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 45, in init
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361329974Bea Baselines 🐀template-pytorchaido5-LFVI-sim-testingLFVIt-simerrornoreg05-7d9c5d9f1ec5-10:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 45, in init
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 45, in init
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361289977Bea Baselines 🐀template-tensorflowaido5-LF-sim-validationLFv-simerrornoreg05-7d9c5d9f1ec5-10:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 32, in init
             ||     raise Exception(msg)
             || Exception: Could not find gpu device.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 32, in init
             || |     raise Exception(msg)
             || | Exception: Could not find gpu device.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361249979Bea Baselines 🐀template-tensorflowaido5-LFV-sim-validationLFVv-simerrornoreg05-7d9c5d9f1ec5-10:01:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 32, in init
             ||     raise Exception(msg)
             || Exception: Could not find gpu device.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 32, in init
             || |     raise Exception(msg)
             || | Exception: Could not find gpu device.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361219981Bea Baselines 🐀template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg05-7d9c5d9f1ec5-10:01:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
β”‚         k: observations
β”‚        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                                field jpg_data : bytes
β”‚                                       __doc__
β”‚                                                         An image in JPG format.
β”‚ 
β”‚                                                         jpg_data
β”‚             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                                field resolution_rad : float
β”‚                                field  axis_left_rad : float
β”‚                                field axis_right_rad : float
β”‚             field your_name : str
β”‚             field     state : dataclass aido_schemas.schemas.DTSimState
β”‚                                field t_effective : float
β”‚                                field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚             field  map_data : str
β”‚        v2: dataclass aido_schemas.schemas.DB20Observations
β”‚             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚                               field jpg_data : bytes
β”‚                                      __doc__
β”‚                                                        An image in JPG format.
β”‚ 
β”‚                                                        jpg_data
β”‚             field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚                               field resolution_rad : float
β”‚                               field  axis_left_rad : float
β”‚                               field axis_right_rad : float
β”‚         r: CanBeUsed
β”‚            β”‚ result: False
β”‚            β”‚ why:
β”‚            β”‚ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
β”‚            β”‚ | requires field "your_name"
β”‚            β”‚ |  of type <class 'str'>
β”‚            β”‚ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
β”‚            β”‚ M: Matches()
β”‚            β”‚ matches: {}
β”‚ p1_inputs: Dict[str,type][4]
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚            β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                     field jpg_data : bytes
β”‚            β”‚                            __doc__
β”‚            β”‚                                              An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                              jpg_data
β”‚            β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                     field resolution_rad : float
β”‚            β”‚                     field  axis_left_rad : float
β”‚            β”‚                     field axis_right_rad : float
β”‚            β”‚  field your_name : str
β”‚            β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚            β”‚                     field t_effective : float
β”‚            β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚            β”‚  field  map_data : str
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.
β”‚ p2_inputs: dict[4]
β”‚            β”‚ observations:
β”‚            β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚            β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚            β”‚                    field jpg_data : bytes
β”‚            β”‚                           __doc__
β”‚            β”‚                                             An image in JPG format.
β”‚            β”‚
β”‚            β”‚                                             jpg_data
β”‚            β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚            β”‚                    field resolution_rad : float
β”‚            β”‚                    field  axis_left_rad : float
β”‚            β”‚                    field axis_right_rad : float
β”‚            β”‚ seed: int
β”‚            β”‚ get_commands:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚            β”‚  field at_time : float
β”‚            β”‚ episode_start:
β”‚            β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚            β”‚  field episode_name : str
β”‚            β”‚             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
β”‚ p1: InteractionProtocol
β”‚     β”‚ description: Particularization for Duckiebot1 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ Dict[str,type][4]
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20ObservationsPlusState
β”‚     β”‚ β”‚  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                     field jpg_data : bytes
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                              jpg_data
β”‚     β”‚ β”‚  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                     field resolution_rad : float
β”‚     β”‚ β”‚                     field  axis_left_rad : float
β”‚     β”‚ β”‚                     field axis_right_rad : float
β”‚     β”‚ β”‚  field your_name : str
β”‚     β”‚ β”‚  field     state : dataclass aido_schemas.schemas.DTSimState
β”‚     β”‚ β”‚                     field t_effective : float
β”‚     β”‚ β”‚                     field  duckiebots : Dict[str,DTSimRobotInfo]
β”‚     β”‚ β”‚  field  map_data : str
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ Dict[str,type][1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.Duckiebot1Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
β”‚ p2: InteractionProtocol
β”‚     β”‚ description: Particularization for DB20 observations and commands.
β”‚     β”‚ inputs:
β”‚     β”‚ dict[4]
β”‚     β”‚ β”‚ observations:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Observations
β”‚     β”‚ β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
β”‚     β”‚ β”‚                    field jpg_data : bytes
β”‚     β”‚ β”‚                           __doc__
β”‚     β”‚ β”‚                                             An image in JPG format.
β”‚     β”‚ β”‚
β”‚     β”‚ β”‚                                             jpg_data
β”‚     β”‚ β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
β”‚     β”‚ β”‚                    field resolution_rad : float
β”‚     β”‚ β”‚                    field  axis_left_rad : float
β”‚     β”‚ β”‚                    field axis_right_rad : float
β”‚     β”‚ β”‚ seed: int
β”‚     β”‚ β”‚ get_commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.GetCommands
β”‚     β”‚ β”‚  field at_time : float
β”‚     β”‚ β”‚ episode_start:
β”‚     β”‚ β”‚ dataclass aido_schemas.protocol_agent.EpisodeStart
β”‚     β”‚ β”‚  field episode_name : str
β”‚     β”‚ β”‚             __doc__    Marker for the start of an episode.
β”‚     β”‚ outputs:
β”‚     β”‚ dict[1]
β”‚     β”‚ β”‚ commands:
β”‚     β”‚ β”‚ dataclass aido_schemas.schemas.DB20Commands
β”‚     β”‚ β”‚  field wheels : dataclass aido_schemas.schemas.PWMCommands
β”‚     β”‚ β”‚                  field  motor_left : float
β”‚     β”‚ β”‚                  field motor_right : float
β”‚     β”‚ β”‚                            __doc__
β”‚     β”‚ β”‚                                              PWM commands are floats between -1 and 1.
β”‚     β”‚ β”‚  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
β”‚     β”‚ β”‚                  field      center : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  front_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field front_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field   back_left : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ β”‚                  field  back_right : dataclass aido_schemas.schemas.RGB
β”‚     β”‚ β”‚                                       field       r : float
β”‚     β”‚ β”‚                                       field       g : float
β”‚     β”‚ β”‚                                       field       b : float
β”‚     β”‚ β”‚                                             __doc__    Values between 0, 1.
β”‚     β”‚ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7f73be2c9550>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361189982Bea Baselines 🐀template-tensorflowaido5-LFVI-sim-validationLFVIv-simerrornoreg05-7d9c5d9f1ec5-10:01:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 32, in init
             ||     raise Exception(msg)
             || Exception: Could not find gpu device.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 32, in init
             || |     raise Exception(msg)
             || | Exception: Could not find gpu device.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361129984Bea Baselines 🐀template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simsuccessnoreg05-7d9c5d9f1ec5-10:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3623381482247039
survival_time_median1.3000000000000005
deviation-center-line_median0.05518599556435223
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego0_max0.057117728086618275
agent_compute-ego0_mean0.057117728086618275
agent_compute-ego0_median0.057117728086618275
agent_compute-ego0_min0.057117728086618275
agent_compute-ego1_max0.05648837639735295
agent_compute-ego1_mean0.05648837639735296
agent_compute-ego1_median0.05648837639735295
agent_compute-ego1_min0.05648837639735295
agent_compute-ego2_max0.05373196418468769
agent_compute-ego2_mean0.053731964184687696
agent_compute-ego2_median0.05373196418468769
agent_compute-ego2_min0.05373196418468769
complete-iteration_max1.2800868657919078
complete-iteration_mean1.2800868657919078
complete-iteration_median1.2800868657919078
complete-iteration_min1.2800868657919078
deviation-center-line_max0.07947660183732067
deviation-center-line_mean0.061612022355700485
deviation-center-line_min0.05017346966542855
deviation-heading_max0.4632422385191386
deviation-heading_mean0.3296721749025366
deviation-heading_median0.31714975946091184
deviation-heading_min0.20862452672755924
driven_any_max0.4548746206446743
driven_any_mean0.3856130320392784
driven_any_median0.4432325550989046
driven_any_min0.2587319203742564
driven_lanedir_consec_max0.44110444731619447
driven_lanedir_consec_mean0.31124089685976336
driven_lanedir_consec_min0.13028009503839175
driven_lanedir_max0.44110444731619447
driven_lanedir_mean0.31124089685976336
driven_lanedir_median0.3623381482247039
driven_lanedir_min0.13028009503839175
get_state_dump_max0.04661187758812538
get_state_dump_mean0.04661187758812538
get_state_dump_median0.04661187758812538
get_state_dump_min0.04661187758812538
get_ui_image_max0.10943232132838322
get_ui_image_mean0.10943232132838322
get_ui_image_median0.10943232132838322
get_ui_image_min0.10943232132838322
in-drivable-lane_max0.30000000000000027
in-drivable-lane_mean0.15000000000000013
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego0": {"driven_any": 0.2587319203742564, "get_ui_image": 0.10943232132838322, "step_physics": 0.7389183319531955, "survival_time": 1.3000000000000005, "driven_lanedir": 0.13028009503839175, "get_state_dump": 0.04661187758812538, "sim_render-ego0": 0.009434773371769832, "sim_render-ego1": 0.009057100002582256, "sim_render-ego2": 0.00857090033017672, "in-drivable-lane": 0.30000000000000027, "deviation-heading": 0.4632422385191386, "agent_compute-ego0": 0.057117728086618275, "agent_compute-ego1": 0.05648837639735295, "agent_compute-ego2": 0.05373196418468769, "complete-iteration": 1.2800868657919078, "set_robot_commands": 0.0067026706842275765, "deviation-center-line": 0.05518599556435223, "driven_lanedir_consec": 0.13028009503839175, "sim_compute_sim_state": 0.052211642265319824, "sim_compute_performance-ego0": 0.007245779037475586, "sim_compute_performance-ego1": 0.0058098297852736255, "sim_compute_performance-ego2": 0.005950441727271447, "sim_compute_robot_state-ego0": 0.01153724010174091, "sim_compute_robot_state-ego1": 0.011355014947744517, "sim_compute_robot_state-ego2": 0.01034098405104417, "sim_compute_robot_state-parked0": 0.010714448415316068, "sim_compute_robot_state-parked1": 0.0114210293843196, "sim_compute_robot_state-parked2": 0.01130360823411208, "sim_compute_robot_state-parked3": 0.010557963297917292, "sim_compute_robot_state-parked4": 0.010450298969562236, "sim_compute_robot_state-parked5": 0.010156778188852165}, "udem1-sc0-0-ego1": {"driven_any": 0.4548746206446743, "get_ui_image": 0.10943232132838322, "step_physics": 0.7389183319531955, "survival_time": 1.3000000000000005, "driven_lanedir": 0.44110444731619447, "get_state_dump": 0.04661187758812538, "sim_render-ego0": 0.009434773371769832, "sim_render-ego1": 0.009057100002582256, "sim_render-ego2": 0.00857090033017672, "in-drivable-lane": 0.0, "deviation-heading": 0.20862452672755924, "agent_compute-ego0": 0.057117728086618275, "agent_compute-ego1": 0.05648837639735295, "agent_compute-ego2": 0.05373196418468769, "complete-iteration": 1.2800868657919078, "set_robot_commands": 0.0067026706842275765, "deviation-center-line": 0.05017346966542855, "driven_lanedir_consec": 0.44110444731619447, "sim_compute_sim_state": 0.052211642265319824, "sim_compute_performance-ego0": 0.007245779037475586, "sim_compute_performance-ego1": 0.0058098297852736255, "sim_compute_performance-ego2": 0.005950441727271447, "sim_compute_robot_state-ego0": 0.01153724010174091, "sim_compute_robot_state-ego1": 0.011355014947744517, "sim_compute_robot_state-ego2": 0.01034098405104417, "sim_compute_robot_state-parked0": 0.010714448415316068, "sim_compute_robot_state-parked1": 0.0114210293843196, "sim_compute_robot_state-parked2": 0.01130360823411208, "sim_compute_robot_state-parked3": 0.010557963297917292, "sim_compute_robot_state-parked4": 0.010450298969562236, "sim_compute_robot_state-parked5": 0.010156778188852165}, "udem1-sc0-0-ego2": {"driven_any": 0.4432325550989046, "get_ui_image": 0.10943232132838322, "step_physics": 0.7389183319531955, "survival_time": 1.3000000000000005, "driven_lanedir": 0.3623381482247039, "get_state_dump": 0.04661187758812538, "sim_render-ego0": 0.009434773371769832, "sim_render-ego1": 0.009057100002582256, "sim_render-ego2": 0.00857090033017672, "in-drivable-lane": 0.15000000000000013, "deviation-heading": 0.31714975946091184, "agent_compute-ego0": 0.057117728086618275, "agent_compute-ego1": 0.05648837639735295, "agent_compute-ego2": 0.05373196418468769, "complete-iteration": 1.2800868657919078, "set_robot_commands": 0.0067026706842275765, "deviation-center-line": 0.07947660183732067, "driven_lanedir_consec": 0.3623381482247039, "sim_compute_sim_state": 0.052211642265319824, "sim_compute_performance-ego0": 0.007245779037475586, "sim_compute_performance-ego1": 0.0058098297852736255, "sim_compute_performance-ego2": 0.005950441727271447, "sim_compute_robot_state-ego0": 0.01153724010174091, "sim_compute_robot_state-ego1": 0.011355014947744517, "sim_compute_robot_state-ego2": 0.01034098405104417, "sim_compute_robot_state-parked0": 0.010714448415316068, "sim_compute_robot_state-parked1": 0.0114210293843196, "sim_compute_robot_state-parked2": 0.01130360823411208, "sim_compute_robot_state-parked3": 0.010557963297917292, "sim_compute_robot_state-parked4": 0.010450298969562236, "sim_compute_robot_state-parked5": 0.010156778188852165}}
set_robot_commands_max0.0067026706842275765
set_robot_commands_mean0.006702670684227576
set_robot_commands_median0.0067026706842275765
set_robot_commands_min0.0067026706842275765
sim_compute_performance-ego0_max0.007245779037475586
sim_compute_performance-ego0_mean0.007245779037475586
sim_compute_performance-ego0_median0.007245779037475586
sim_compute_performance-ego0_min0.007245779037475586
sim_compute_performance-ego1_max0.0058098297852736255
sim_compute_performance-ego1_mean0.0058098297852736255
sim_compute_performance-ego1_median0.0058098297852736255
sim_compute_performance-ego1_min0.0058098297852736255
sim_compute_performance-ego2_max0.005950441727271447
sim_compute_performance-ego2_mean0.005950441727271448
sim_compute_performance-ego2_median0.005950441727271447
sim_compute_performance-ego2_min0.005950441727271447
sim_compute_robot_state-ego0_max0.01153724010174091
sim_compute_robot_state-ego0_mean0.01153724010174091
sim_compute_robot_state-ego0_median0.01153724010174091
sim_compute_robot_state-ego0_min0.01153724010174091
sim_compute_robot_state-ego1_max0.011355014947744517
sim_compute_robot_state-ego1_mean0.011355014947744517
sim_compute_robot_state-ego1_median0.011355014947744517
sim_compute_robot_state-ego1_min0.011355014947744517
sim_compute_robot_state-ego2_max0.01034098405104417
sim_compute_robot_state-ego2_mean0.01034098405104417
sim_compute_robot_state-ego2_median0.01034098405104417
sim_compute_robot_state-ego2_min0.01034098405104417
sim_compute_robot_state-parked0_max0.010714448415316068
sim_compute_robot_state-parked0_mean0.010714448415316068
sim_compute_robot_state-parked0_median0.010714448415316068
sim_compute_robot_state-parked0_min0.010714448415316068
sim_compute_robot_state-parked1_max0.0114210293843196
sim_compute_robot_state-parked1_mean0.011421029384319598
sim_compute_robot_state-parked1_median0.0114210293843196
sim_compute_robot_state-parked1_min0.0114210293843196
sim_compute_robot_state-parked2_max0.01130360823411208
sim_compute_robot_state-parked2_mean0.011303608234112078
sim_compute_robot_state-parked2_median0.01130360823411208
sim_compute_robot_state-parked2_min0.01130360823411208
sim_compute_robot_state-parked3_max0.010557963297917292
sim_compute_robot_state-parked3_mean0.010557963297917292
sim_compute_robot_state-parked3_median0.010557963297917292
sim_compute_robot_state-parked3_min0.010557963297917292
sim_compute_robot_state-parked4_max0.010450298969562236
sim_compute_robot_state-parked4_mean0.010450298969562238
sim_compute_robot_state-parked4_median0.010450298969562236
sim_compute_robot_state-parked4_min0.010450298969562236
sim_compute_robot_state-parked5_max0.010156778188852165
sim_compute_robot_state-parked5_mean0.010156778188852165
sim_compute_robot_state-parked5_median0.010156778188852165
sim_compute_robot_state-parked5_min0.010156778188852165
sim_compute_sim_state_max0.052211642265319824
sim_compute_sim_state_mean0.052211642265319824
sim_compute_sim_state_median0.052211642265319824
sim_compute_sim_state_min0.052211642265319824
sim_render-ego0_max0.009434773371769832
sim_render-ego0_mean0.009434773371769832
sim_render-ego0_median0.009434773371769832
sim_render-ego0_min0.009434773371769832
sim_render-ego1_max0.009057100002582256
sim_render-ego1_mean0.009057100002582256
sim_render-ego1_median0.009057100002582256
sim_render-ego1_min0.009057100002582256
sim_render-ego2_max0.00857090033017672
sim_render-ego2_mean0.00857090033017672
sim_render-ego2_median0.00857090033017672
sim_render-ego2_min0.00857090033017672
simulation-passed1
step_physics_max0.7389183319531955
step_physics_mean0.7389183319531955
step_physics_median0.7389183319531955
step_physics_min0.7389183319531955
survival_time_max1.3000000000000005
survival_time_mean1.3000000000000005
survival_time_min1.3000000000000005
No reset possible
3610710000Bea Baselines 🐀straightaido5-LFVI-sim-validationLFVIv-simsuccessnoreg05-7d9c5d9f1ec5-10:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6513468578527846
survival_time_median4.799999999999991
deviation-center-line_median0.37610532748657377
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03245196988185247
agent_compute-ego_mean0.03245196988185247
agent_compute-ego_median0.03245196988185247
agent_compute-ego_min0.03245196988185247
complete-iteration_max0.48745481421550113
complete-iteration_mean0.48745481421550113
complete-iteration_median0.48745481421550113
complete-iteration_min0.48745481421550113
deviation-center-line_max0.37610532748657377
deviation-center-line_mean0.37610532748657377
deviation-center-line_min0.37610532748657377
deviation-heading_max1.27909381029616
deviation-heading_mean1.27909381029616
deviation-heading_median1.27909381029616
deviation-heading_min1.27909381029616
driven_any_max0.7396640148032522
driven_any_mean0.7396640148032522
driven_any_median0.7396640148032522
driven_any_min0.7396640148032522
driven_lanedir_consec_max0.6513468578527846
driven_lanedir_consec_mean0.6513468578527846
driven_lanedir_consec_min0.6513468578527846
driven_lanedir_max0.6756516862014323
driven_lanedir_mean0.6756516862014323
driven_lanedir_median0.6756516862014323
driven_lanedir_min0.6756516862014323
get_state_dump_max0.029622311393419903
get_state_dump_mean0.029622311393419903
get_state_dump_median0.029622311393419903
get_state_dump_min0.029622311393419903
get_ui_image_max0.10818208009004592
get_ui_image_mean0.10818208009004592
get_ui_image_median0.10818208009004592
get_ui_image_min0.10818208009004592
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.7396640148032522, "get_ui_image": 0.10818208009004592, "step_physics": 0.22196154048045477, "survival_time": 4.799999999999991, "driven_lanedir": 0.6756516862014323, "get_state_dump": 0.029622311393419903, "sim_render-ego": 0.00793681542078654, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03245196988185247, "deviation-heading": 1.27909381029616, "complete-iteration": 0.48745481421550113, "set_robot_commands": 0.006268819173177083, "deviation-center-line": 0.37610532748657377, "driven_lanedir_consec": 0.6513468578527846, "sim_compute_sim_state": 0.019306006530920666, "sim_compute_performance-ego": 0.006164247790972392, "sim_compute_robot_state-ego": 0.009824834764003754, "sim_compute_robot_state-npc0": 0.009564335147539774, "sim_compute_robot_state-npc1": 0.00909429540236791, "sim_compute_robot_state-npc2": 0.008824703594048819, "sim_compute_robot_state-npc3": 0.00927424430847168, "sim_compute_robot_state-parked0": 0.008770426114400228}}
set_robot_commands_max0.006268819173177083
set_robot_commands_mean0.006268819173177083
set_robot_commands_median0.006268819173177083
set_robot_commands_min0.006268819173177083
sim_compute_performance-ego_max0.006164247790972392
sim_compute_performance-ego_mean0.006164247790972392
sim_compute_performance-ego_median0.006164247790972392
sim_compute_performance-ego_min0.006164247790972392
sim_compute_robot_state-ego_max0.009824834764003754
sim_compute_robot_state-ego_mean0.009824834764003754
sim_compute_robot_state-ego_median0.009824834764003754
sim_compute_robot_state-ego_min0.009824834764003754
sim_compute_robot_state-npc0_max0.009564335147539774
sim_compute_robot_state-npc0_mean0.009564335147539774
sim_compute_robot_state-npc0_median0.009564335147539774
sim_compute_robot_state-npc0_min0.009564335147539774
sim_compute_robot_state-npc1_max0.00909429540236791
sim_compute_robot_state-npc1_mean0.00909429540236791
sim_compute_robot_state-npc1_median0.00909429540236791
sim_compute_robot_state-npc1_min0.00909429540236791
sim_compute_robot_state-npc2_max0.008824703594048819
sim_compute_robot_state-npc2_mean0.008824703594048819
sim_compute_robot_state-npc2_median0.008824703594048819
sim_compute_robot_state-npc2_min0.008824703594048819
sim_compute_robot_state-npc3_max0.00927424430847168
sim_compute_robot_state-npc3_mean0.00927424430847168
sim_compute_robot_state-npc3_median0.00927424430847168
sim_compute_robot_state-npc3_min0.00927424430847168
sim_compute_robot_state-parked0_max0.008770426114400228
sim_compute_robot_state-parked0_mean0.008770426114400228
sim_compute_robot_state-parked0_median0.008770426114400228
sim_compute_robot_state-parked0_min0.008770426114400228
sim_compute_sim_state_max0.019306006530920666
sim_compute_sim_state_mean0.019306006530920666
sim_compute_sim_state_median0.019306006530920666
sim_compute_sim_state_min0.019306006530920666
sim_render-ego_max0.00793681542078654
sim_render-ego_mean0.00793681542078654
sim_render-ego_median0.00793681542078654
sim_render-ego_min0.00793681542078654
simulation-passed1
step_physics_max0.22196154048045477
step_physics_mean0.22196154048045477
step_physics_median0.22196154048045477
step_physics_min0.22196154048045477
survival_time_max4.799999999999991
survival_time_mean4.799999999999991
survival_time_min4.799999999999991
No reset possible