Duckietown Challenges Home Challenges Submissions

Evaluator 2335

ID2335
evaluatorreg02-b35ee35771a7-1
ownerI don't have one πŸ˜€
machineChudeQian-Sager-Duckietown
processreg02-b35ee35771a7-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success56 42772
# timeout
# failed7 42854
# error5 42760
# aborted1 43503
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4386711764Ayman ShamsΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013042678833007812
agent_compute-ego_mean0.012349868615468345
agent_compute-ego_median0.012251859108606974
agent_compute-ego_min0.011853077411651612
complete-iteration_max0.15514722983042398
complete-iteration_mean0.15068904876708983
complete-iteration_median0.15086989641189574
complete-iteration_min0.14586917241414388
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.9049644470214844e-06
get_duckie_state_mean1.7537673314412434e-06
get_duckie_state_median1.733700434366862e-06
get_duckie_state_min1.6427040100097655e-06
get_robot_state_max0.009933995405832926
get_robot_state_mean0.00971381664276123
get_robot_state_median0.009761016766230264
get_robot_state_min0.009399237632751464
get_state_dump_max0.008718364238739014
get_state_dump_mean0.008449412981669109
get_state_dump_median0.00855723261833191
get_state_dump_min0.0079648224512736
get_ui_image_max0.025280165672302245
get_ui_image_mean0.0246650222937266
get_ui_image_median0.024548566738764446
get_ui_image_min0.024282790025075277
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.025280165672302245, "step_physics": 0.06613343556722005, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.008718364238739014, "sim_render-ego": 0.004749549229939779, "get_robot_state": 0.009933995405832926, "get_duckie_state": 1.9049644470214844e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012528747717539469, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.15305534203847249, "set_robot_commands": 0.003859665393829346, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.018606480757395422, "sim_compute_performance-ego": 0.0031598830223083497}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.024282790025075277, "step_physics": 0.06166942834854126, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.008682739734649659, "sim_render-ego": 0.004620153109232585, "get_robot_state": 0.009708208243052165, "get_duckie_state": 1.6427040100097655e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013042678833007812, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.14586917241414388, "set_robot_commands": 0.003666058381398519, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.017048246065775555, "sim_compute_performance-ego": 0.0030632678667704264}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.02463342746098836, "step_physics": 0.06376547972361246, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.00843172550201416, "sim_render-ego": 0.004747819900512695, "get_robot_state": 0.009813825289408364, "get_duckie_state": 1.7698605855305989e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011853077411651612, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.148684450785319, "set_robot_commands": 0.003794889450073242, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.01849137624104818, "sim_compute_performance-ego": 0.0030672574043273926}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.024463706016540528, "step_physics": 0.06931411504745483, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.0079648224512736, "sim_render-ego": 0.004646140734354655, "get_robot_state": 0.009399237632751464, "get_duckie_state": 1.697540283203125e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01197497049967448, "deviation-heading": 0.486072248607516, "complete-iteration": 0.15514722983042398, "set_robot_commands": 0.0036841885248819982, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020562690099080405, "sim_compute_performance-ego": 0.0030528887112935385}}
set_robot_commands_max0.003859665393829346
set_robot_commands_mean0.003751200437545776
set_robot_commands_median0.00373953898747762
set_robot_commands_min0.003666058381398519
sim_compute_performance-ego_max0.0031598830223083497
sim_compute_performance-ego_mean0.003085824251174927
sim_compute_performance-ego_median0.0030652626355489095
sim_compute_performance-ego_min0.0030528887112935385
sim_compute_sim_state_max0.020562690099080405
sim_compute_sim_state_mean0.01867719829082489
sim_compute_sim_state_median0.0185489284992218
sim_compute_sim_state_min0.017048246065775555
sim_render-ego_max0.004749549229939779
sim_render-ego_mean0.004690915743509929
sim_render-ego_median0.004696980317433675
sim_render-ego_min0.004620153109232585
simulation-passed1
step_physics_max0.06931411504745483
step_physics_mean0.06522061467170714
step_physics_median0.06494945764541626
step_physics_min0.06166942834854126
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4386211764Ayman ShamsΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012850730419158936
agent_compute-ego_mean0.01273504118124644
agent_compute-ego_median0.012752947807312011
agent_compute-ego_min0.0125835386912028
complete-iteration_max0.15783205111821494
complete-iteration_mean0.14838224589824678
complete-iteration_median0.1462922815481822
complete-iteration_min0.1431123693784078
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.1881192525227865e-06
get_duckie_state_mean1.1368592580159506e-06
get_duckie_state_median1.145203908284505e-06
get_duckie_state_min1.0689099629720052e-06
get_robot_state_max0.009886460304260254
get_robot_state_mean0.00959512750307719
get_robot_state_median0.009598724444707236
get_robot_state_min0.009296600818634032
get_state_dump_max0.008565833568572998
get_state_dump_mean0.008325734337170917
get_state_dump_median0.008281680345535277
get_state_dump_min0.00817374308904012
get_ui_image_max0.024377702871958416
get_ui_image_mean0.024226588805516563
get_ui_image_median0.024291135470072427
get_ui_image_min0.023946381409962973
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.023946381409962973, "step_physics": 0.06180755933125814, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.00817374308904012, "sim_render-ego": 0.004534453550974528, "get_robot_state": 0.009296600818634032, "get_duckie_state": 1.0689099629720052e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012686978975931804, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.14472870190938314, "set_robot_commands": 0.003701061407725016, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.017487020492553712, "sim_compute_performance-ego": 0.0030127485593159993}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.024377702871958416, "step_physics": 0.059966917832692465, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.0082481582959493, "sim_render-ego": 0.004582046667734782, "get_robot_state": 0.009560417334238689, "get_duckie_state": 1.1881192525227865e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0125835386912028, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.1431123693784078, "set_robot_commands": 0.003666163285573324, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.016995051701863606, "sim_compute_performance-ego": 0.0030499760309855143}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.02432702620824178, "step_physics": 0.06312648932139078, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.008315202395121256, "sim_render-ego": 0.004683581988016764, "get_robot_state": 0.00963703155517578, "get_duckie_state": 1.102288564046224e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012850730419158936, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.1478558611869812, "set_robot_commands": 0.003643170197804769, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.018081274032592777, "sim_compute_performance-ego": 0.003107474644978841}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.024255244731903075, "step_physics": 0.07016718069712322, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.008565833568572998, "sim_render-ego": 0.004536031087239583, "get_robot_state": 0.009886460304260254, "get_duckie_state": 1.1881192525227865e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01281891663869222, "deviation-heading": 0.486072248607516, "complete-iteration": 0.15783205111821494, "set_robot_commands": 0.003706744511922201, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02077441374460856, "sim_compute_performance-ego": 0.0030358680089314777}}
set_robot_commands_max0.003706744511922201
set_robot_commands_mean0.003679284850756327
set_robot_commands_median0.00368361234664917
set_robot_commands_min0.003643170197804769
sim_compute_performance-ego_max0.003107474644978841
sim_compute_performance-ego_mean0.003051516811052958
sim_compute_performance-ego_median0.003042922019958496
sim_compute_performance-ego_min0.0030127485593159993
sim_compute_sim_state_max0.02077441374460856
sim_compute_sim_state_mean0.018334439992904666
sim_compute_sim_state_median0.01778414726257324
sim_compute_sim_state_min0.016995051701863606
sim_render-ego_max0.004683581988016764
sim_render-ego_mean0.004584028323491415
sim_render-ego_median0.004559038877487182
sim_render-ego_min0.004534453550974528
simulation-passed1
step_physics_max0.07016718069712322
step_physics_mean0.06376703679561616
step_physics_median0.06246702432632446
step_physics_min0.059966917832692465
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4385511762Olga (Ge Ya) XuΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6939710251323112
survival_time_median14.950000000000076
deviation-center-line_median0.284794954554794
in-drivable-lane_median11.02500000000008


other stats
agent_compute-ego_max0.016649761199951173
agent_compute-ego_mean0.01505116860071818
agent_compute-ego_median0.015527228514353435
agent_compute-ego_min0.01250045617421468
complete-iteration_max0.19160812934239704
complete-iteration_mean0.18179843485355376
complete-iteration_median0.1846832573413849
complete-iteration_min0.16621909538904825
deviation-center-line_max0.4738414082686597
deviation-center-line_mean0.2939855577699425
deviation-center-line_min0.13251091370152235
deviation-heading_max1.459933134154094
deviation-heading_mean1.11205624161887
deviation-heading_median1.1422033360617916
deviation-heading_min0.7038851601978022
driven_any_max3.2766605404841984
driven_any_mean3.080561815557366
driven_any_median3.062345460463928
driven_any_min2.9208958008174095
driven_lanedir_consec_max0.8542520708142312
driven_lanedir_consec_mean0.6669809279166291
driven_lanedir_consec_min0.4257295905876628
driven_lanedir_max0.8542520708142312
driven_lanedir_mean0.6669809279166291
driven_lanedir_median0.6939710251323112
driven_lanedir_min0.4257295905876628
get_duckie_state_max1.5743573506673175e-06
get_duckie_state_mean1.4873345692952474e-06
get_duckie_state_median1.5020370483398435e-06
get_duckie_state_min1.3709068298339844e-06
get_robot_state_max0.011871496041615803
get_robot_state_mean0.011442052324612937
get_robot_state_median0.011610068877538043
get_robot_state_min0.010676575501759848
get_state_dump_max0.009972019990285238
get_state_dump_mean0.009718892375628152
get_state_dump_median0.009720662037531537
get_state_dump_min0.009462225437164306
get_ui_image_max0.0312966505686442
get_ui_image_mean0.02974946618080139
get_ui_image_median0.03074055790901184
get_ui_image_min0.02622009833653768
in-drivable-lane_max12.250000000000078
in-drivable-lane_mean11.087500000000071
in-drivable-lane_min10.050000000000049
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9208958008174095, "get_ui_image": 0.0312966505686442, "step_physics": 0.08066151142120362, "survival_time": 14.950000000000076, "driven_lanedir": 0.4257295905876628, "get_state_dump": 0.00987685203552246, "sim_render-ego": 0.005534032980600993, "get_robot_state": 0.011719558238983154, "get_duckie_state": 1.5743573506673175e-06, "in-drivable-lane": 12.250000000000078, "agent_compute-ego": 0.015362253189086914, "deviation-heading": 0.7038851601978022, "complete-iteration": 0.18570913314819337, "set_robot_commands": 0.004603055318196615, "deviation-center-line": 0.13251091370152235, "driven_lanedir_consec": 0.4257295905876628, "sim_compute_sim_state": 0.022808948357899983, "sim_compute_performance-ego": 0.003736592928568522}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0362653334047303, "get_ui_image": 0.03087700525919596, "step_physics": 0.07940246343612671, "survival_time": 14.950000000000076, "driven_lanedir": 0.6365681000603955, "get_state_dump": 0.00956447203954061, "sim_render-ego": 0.005678616364796957, "get_robot_state": 0.011500579516092936, "get_duckie_state": 1.482963562011719e-06, "in-drivable-lane": 11.150000000000084, "agent_compute-ego": 0.015692203839619955, "deviation-heading": 1.1123452566636831, "complete-iteration": 0.1836573815345764, "set_robot_commands": 0.00482848326365153, "deviation-center-line": 0.23180380715739304, "driven_lanedir_consec": 0.6365681000603955, "sim_compute_sim_state": 0.022216713428497313, "sim_compute_performance-ego": 0.003784817854563395}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2766605404841984, "get_ui_image": 0.030604110558827717, "step_physics": 0.08221897840499878, "survival_time": 14.950000000000076, "driven_lanedir": 0.751373950204227, "get_state_dump": 0.009972019990285238, "sim_render-ego": 0.006042768955230713, "get_robot_state": 0.011871496041615803, "get_duckie_state": 1.5211105346679687e-06, "in-drivable-lane": 10.900000000000077, "agent_compute-ego": 0.016649761199951173, "deviation-heading": 1.459933134154094, "complete-iteration": 0.19160812934239704, "set_robot_commands": 0.0051676328976949055, "deviation-center-line": 0.3377861019521949, "driven_lanedir_consec": 0.751373950204227, "sim_compute_sim_state": 0.025082090695699055, "sim_compute_performance-ego": 0.0038836169242858886}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.088425587523126, "get_ui_image": 0.02622009833653768, "step_physics": 0.07198691129684448, "survival_time": 14.950000000000076, "driven_lanedir": 0.8542520708142312, "get_state_dump": 0.009462225437164306, "sim_render-ego": 0.0047486289342244465, "get_robot_state": 0.010676575501759848, "get_duckie_state": 1.3709068298339844e-06, "in-drivable-lane": 10.050000000000049, "agent_compute-ego": 0.01250045617421468, "deviation-heading": 1.1720614154599005, "complete-iteration": 0.16621909538904825, "set_robot_commands": 0.003987820943196615, "deviation-center-line": 0.4738414082686597, "driven_lanedir_consec": 0.8542520708142312, "sim_compute_sim_state": 0.023441816965738937, "sim_compute_performance-ego": 0.003095289866129557}}
set_robot_commands_max0.0051676328976949055
set_robot_commands_mean0.004646748105684917
set_robot_commands_median0.004715769290924073
set_robot_commands_min0.003987820943196615
sim_compute_performance-ego_max0.0038836169242858886
sim_compute_performance-ego_mean0.003625079393386841
sim_compute_performance-ego_median0.0037607053915659585
sim_compute_performance-ego_min0.003095289866129557
sim_compute_sim_state_max0.025082090695699055
sim_compute_sim_state_mean0.023387392361958824
sim_compute_sim_state_median0.02312538266181946
sim_compute_sim_state_min0.022216713428497313
sim_render-ego_max0.006042768955230713
sim_render-ego_mean0.005501011808713277
sim_render-ego_median0.005606324672698975
sim_render-ego_min0.0047486289342244465
simulation-passed1
step_physics_max0.08221897840499878
step_physics_mean0.0785674661397934
step_physics_median0.08003198742866516
step_physics_min0.07198691129684448
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4385011760Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.015049575964609782
agent_compute-ego_mean0.01478613595167796
agent_compute-ego_median0.014919469753901163
agent_compute-ego_min0.014256028334299724
complete-iteration_max0.1879804515838623
complete-iteration_mean0.17922699689865113
complete-iteration_median0.17782659808794657
complete-iteration_min0.17327433983484905
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.8215179443359376e-06
get_duckie_state_mean1.7595291137695312e-06
get_duckie_state_median1.760721206665039e-06
get_duckie_state_min1.6951560974121097e-06
get_robot_state_max0.014812204043070477
get_robot_state_mean0.013608075579007468
get_robot_state_median0.01340083638827006
get_robot_state_min0.012818425496419272
get_state_dump_max0.01226341406504313
get_state_dump_mean0.011387377977371216
get_state_dump_median0.01120297908782959
get_state_dump_min0.010880139668782552
get_ui_image_max0.027151337464650472
get_ui_image_mean0.02684281090895335
get_ui_image_median0.02699220895767212
get_ui_image_min0.026235488255818683
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.0270114008585612, "step_physics": 0.07279733737309774, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.010880139668782552, "sim_render-ego": 0.00554917573928833, "get_robot_state": 0.012818425496419272, "get_duckie_state": 1.7484029134114585e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014970106283823647, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.17470650434494017, "set_robot_commands": 0.004397718906402588, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022442676226298013, "sim_compute_performance-ego": 0.003728129069010417}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.027151337464650472, "step_physics": 0.07257499694824218, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.010916887124379476, "sim_render-ego": 0.005596039295196534, "get_robot_state": 0.013109018802642822, "get_duckie_state": 1.6951560974121097e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014256028334299724, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.17327433983484905, "set_robot_commands": 0.0044102311134338375, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02141440073649089, "sim_compute_performance-ego": 0.003732165495554606}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.02697301705678304, "step_physics": 0.0730559492111206, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.01226341406504313, "sim_render-ego": 0.005703162352244059, "get_robot_state": 0.014812204043070477, "get_duckie_state": 1.8215179443359376e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01486883322397868, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.18094669183095297, "set_robot_commands": 0.004410308996836344, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.024792733192443846, "sim_compute_performance-ego": 0.003950138092041016}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.026235488255818683, "step_physics": 0.08080146948496501, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.011489071051279704, "sim_render-ego": 0.005438830057779948, "get_robot_state": 0.0136926539738973, "get_duckie_state": 1.7730394999186198e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015049575964609782, "deviation-heading": 0.486072248607516, "complete-iteration": 0.1879804515838623, "set_robot_commands": 0.00438993771870931, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.026981045405069987, "sim_compute_performance-ego": 0.003788752555847168}}
set_robot_commands_max0.004410308996836344
set_robot_commands_mean0.00440204918384552
set_robot_commands_median0.004403975009918213
set_robot_commands_min0.00438993771870931
sim_compute_performance-ego_max0.003950138092041016
sim_compute_performance-ego_mean0.0037997963031133016
sim_compute_performance-ego_median0.003760459025700887
sim_compute_performance-ego_min0.003728129069010417
sim_compute_sim_state_max0.026981045405069987
sim_compute_sim_state_mean0.023907713890075684
sim_compute_sim_state_median0.02361770470937093
sim_compute_sim_state_min0.02141440073649089
sim_render-ego_max0.005703162352244059
sim_render-ego_mean0.005571801861127218
sim_render-ego_median0.005572607517242431
sim_render-ego_min0.005438830057779948
simulation-passed1
step_physics_max0.08080146948496501
step_physics_mean0.07480743825435639
step_physics_median0.07292664329210917
step_physics_min0.07257499694824218
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4383611756Ayman ShamsΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoreg02-b35ee35771a7-10:03:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 232 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4382611753Γ‰tienne BoucherΒ πŸ‡¨πŸ‡¦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4985132705616535
survival_time_median14.950000000000076
deviation-center-line_median0.7669970041641776
in-drivable-lane_median2.750000000000039


other stats
agent_compute-ego_max0.017381711800893148
agent_compute-ego_mean0.016864399711290997
agent_compute-ego_median0.01720361391703288
agent_compute-ego_min0.015668659210205077
complete-iteration_max0.19848869959513343
complete-iteration_mean0.19437883198261263
complete-iteration_median0.1937705945968628
complete-iteration_min0.19148543914159136
deviation-center-line_max1.435295645437472
deviation-center-line_mean0.7899110678100039
deviation-center-line_min0.1903546174741883
deviation-heading_max4.489811679178999
deviation-heading_mean2.7617675066783147
deviation-heading_median2.7203616479074473
deviation-heading_min1.116535051719366
driven_any_max1.9399258725105255
driven_any_mean1.938318917693784
driven_any_median1.939856980527801
driven_any_min1.933635837209009
driven_lanedir_consec_max1.7560947731750205
driven_lanedir_consec_mean1.322771292560009
driven_lanedir_consec_min0.5379638559417087
driven_lanedir_max1.7560947731750205
driven_lanedir_mean1.322771292560009
driven_lanedir_median1.4985132705616535
driven_lanedir_min0.5379638559417087
get_duckie_state_max2.277692159016927e-06
get_duckie_state_mean2.2457043329874676e-06
get_duckie_state_median2.248684565226237e-06
get_duckie_state_min2.2077560424804687e-06
get_robot_state_max0.012740012009938555
get_robot_state_mean0.012454671661059062
get_robot_state_median0.012378942171732583
get_robot_state_min0.01232079029083252
get_state_dump_max0.010541910330454507
get_state_dump_mean0.01036062240600586
get_state_dump_median0.010348978042602538
get_state_dump_min0.010202623208363851
get_ui_image_max0.032236538728078204
get_ui_image_mean0.031236059069633483
get_ui_image_median0.03183099309603373
get_ui_image_min0.029045711358388265
in-drivable-lane_max10.200000000000086
in-drivable-lane_mean4.050000000000043
in-drivable-lane_min0.5000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933635837209009, "get_ui_image": 0.032236538728078204, "step_physics": 0.0818275014559428, "survival_time": 14.950000000000076, "driven_lanedir": 1.6656025420674492, "get_state_dump": 0.010215750535329185, "sim_render-ego": 0.006075848738352457, "get_robot_state": 0.01232079029083252, "get_duckie_state": 2.277692159016927e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.017192206382751464, "deviation-heading": 2.642402740902712, "complete-iteration": 0.19366316000620523, "set_robot_commands": 0.005265076160430909, "deviation-center-line": 0.8983516917907707, "driven_lanedir_consec": 1.6656025420674492, "sim_compute_sim_state": 0.02434865474700928, "sim_compute_performance-ego": 0.004066462516784668}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.939895812169916, "get_ui_image": 0.031713889439900715, "step_physics": 0.08180021603902181, "survival_time": 14.950000000000076, "driven_lanedir": 1.7560947731750205, "get_state_dump": 0.010482205549875894, "sim_render-ego": 0.0060922725995381675, "get_robot_state": 0.012740012009938555, "get_duckie_state": 2.2331873575846355e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.017215021451314292, "deviation-heading": 4.489811679178999, "complete-iteration": 0.1938780291875203, "set_robot_commands": 0.005416555404663086, "deviation-center-line": 1.435295645437472, "driven_lanedir_consec": 1.7560947731750205, "sim_compute_sim_state": 0.024185247421264648, "sim_compute_performance-ego": 0.004110776583353679}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9398181488856856, "get_ui_image": 0.03194809675216675, "step_physics": 0.08741683721542358, "survival_time": 14.950000000000076, "driven_lanedir": 0.5379638559417087, "get_state_dump": 0.010202623208363851, "sim_render-ego": 0.006037107308705648, "get_robot_state": 0.01232457478841146, "get_duckie_state": 2.2641817728678384e-06, "in-drivable-lane": 10.200000000000086, "agent_compute-ego": 0.017381711800893148, "deviation-heading": 1.116535051719366, "complete-iteration": 0.19848869959513343, "set_robot_commands": 0.005273582140604655, "deviation-center-line": 0.1903546174741883, "driven_lanedir_consec": 0.5379638559417087, "sim_compute_sim_state": 0.02379078944524129, "sim_compute_performance-ego": 0.003997664451599121}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399258725105255, "get_ui_image": 0.029045711358388265, "step_physics": 0.08291088978449504, "survival_time": 14.950000000000076, "driven_lanedir": 1.331423999055858, "get_state_dump": 0.010541910330454507, "sim_render-ego": 0.0055424006779988605, "get_robot_state": 0.012433309555053711, "get_duckie_state": 2.2077560424804687e-06, "in-drivable-lane": 4.0500000000000576, "agent_compute-ego": 0.015668659210205077, "deviation-heading": 2.798320554912183, "complete-iteration": 0.19148543914159136, "set_robot_commands": 0.004892621040344238, "deviation-center-line": 0.6356423165375845, "driven_lanedir_consec": 1.331423999055858, "sim_compute_sim_state": 0.02658225138982137, "sim_compute_performance-ego": 0.003753320376078288}}
set_robot_commands_max0.005416555404663086
set_robot_commands_mean0.005211958686510722
set_robot_commands_median0.005269329150517782
set_robot_commands_min0.004892621040344238
sim_compute_performance-ego_max0.004110776583353679
sim_compute_performance-ego_mean0.003982055981953939
sim_compute_performance-ego_median0.004032063484191894
sim_compute_performance-ego_min0.003753320376078288
sim_compute_sim_state_max0.02658225138982137
sim_compute_sim_state_mean0.024726735750834148
sim_compute_sim_state_median0.024266951084136963
sim_compute_sim_state_min0.02379078944524129
sim_render-ego_max0.0060922725995381675
sim_render-ego_mean0.005936907331148784
sim_render-ego_median0.0060564780235290525
sim_render-ego_min0.0055424006779988605
simulation-passed1
step_physics_max0.08741683721542358
step_physics_mean0.08348886112372081
step_physics_median0.08236919562021891
step_physics_min0.08180021603902181
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4382011752Olga (Ge Ya) XuΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.258830952838702
survival_time_median14.950000000000076
deviation-center-line_median0.6592211311794476
in-drivable-lane_median6.525000000000052


other stats
agent_compute-ego_max0.01842092831929525
agent_compute-ego_mean0.017357009847958883
agent_compute-ego_median0.017235904932022095
agent_compute-ego_min0.016535301208496094
complete-iteration_max0.20838138739267983
complete-iteration_mean0.19998864094416305
complete-iteration_median0.20028673052787785
complete-iteration_min0.19099971532821655
deviation-center-line_max1.1485205304586803
deviation-center-line_mean0.7634778263576508
deviation-center-line_min0.5869485126130277
deviation-heading_max2.8877186743842533
deviation-heading_mean1.941092407788931
deviation-heading_median2.182875087331042
deviation-heading_min0.5109007821093873
driven_any_max4.136186347875609
driven_any_mean3.8556625131069
driven_any_median3.875445053312804
driven_any_min3.5355735979263843
driven_lanedir_consec_max2.900847011294354
driven_lanedir_consec_mean2.1939593769379253
driven_lanedir_consec_min1.357328590779944
driven_lanedir_max2.900847011294354
driven_lanedir_mean2.1939593769379253
driven_lanedir_median2.258830952838702
driven_lanedir_min1.357328590779944
get_duckie_state_max1.950263977050781e-06
get_duckie_state_mean1.7511844635009767e-06
get_duckie_state_median1.7372767130533855e-06
get_duckie_state_min1.5799204508463542e-06
get_robot_state_max0.013383223215738932
get_robot_state_mean0.01263670821984609
get_robot_state_median0.012463760375976563
get_robot_state_min0.0122360889116923
get_state_dump_max0.010914551417032877
get_state_dump_mean0.010345791975657144
get_state_dump_median0.01022786259651184
get_state_dump_min0.010012891292572022
get_ui_image_max0.03269064982732137
get_ui_image_mean0.03204343418280284
get_ui_image_median0.032058344284693396
get_ui_image_min0.03136639833450317
in-drivable-lane_max9.500000000000057
in-drivable-lane_mean6.412500000000051
in-drivable-lane_min3.100000000000044
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.038773796465169, "get_ui_image": 0.03269064982732137, "step_physics": 0.08909237305323282, "survival_time": 14.950000000000076, "driven_lanedir": 1.6900662753116713, "get_state_dump": 0.010914551417032877, "sim_render-ego": 0.006359935601552328, "get_robot_state": 0.013383223215738932, "get_duckie_state": 1.8135706583658856e-06, "in-drivable-lane": 9.500000000000057, "agent_compute-ego": 0.01842092831929525, "deviation-heading": 0.5109007821093873, "complete-iteration": 0.20838138739267983, "set_robot_commands": 0.00545290470123291, "deviation-center-line": 0.6200363150420696, "driven_lanedir_consec": 1.6900662753116713, "sim_compute_sim_state": 0.02781265656153361, "sim_compute_performance-ego": 0.004131666819254557}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.712116310160439, "get_ui_image": 0.03136639833450317, "step_physics": 0.08167160034179688, "survival_time": 14.950000000000076, "driven_lanedir": 2.8275956303657326, "get_state_dump": 0.010176183382670083, "sim_render-ego": 0.005915663242340088, "get_robot_state": 0.0122360889116923, "get_duckie_state": 1.950263977050781e-06, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.016535301208496094, "deviation-heading": 2.7068925597106177, "complete-iteration": 0.19099971532821655, "set_robot_commands": 0.005073120594024658, "deviation-center-line": 1.1485205304586803, "driven_lanedir_consec": 2.8275956303657326, "sim_compute_sim_state": 0.023909194469451903, "sim_compute_performance-ego": 0.003995457490285238}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5355735979263843, "get_ui_image": 0.03149096886316935, "step_physics": 0.08411006768544516, "survival_time": 14.950000000000076, "driven_lanedir": 1.357328590779944, "get_state_dump": 0.010012891292572022, "sim_render-ego": 0.0060142723719278975, "get_robot_state": 0.012339642842610675, "get_duckie_state": 1.5799204508463542e-06, "in-drivable-lane": 8.150000000000052, "agent_compute-ego": 0.01710400978724162, "deviation-heading": 2.8877186743842533, "complete-iteration": 0.19509688059488933, "set_robot_commands": 0.005312577088673909, "deviation-center-line": 0.5869485126130277, "driven_lanedir_consec": 1.357328590779944, "sim_compute_sim_state": 0.024720946153004963, "sim_compute_performance-ego": 0.003870236873626709}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.136186347875609, "get_ui_image": 0.03262571970621745, "step_physics": 0.08797944227854411, "survival_time": 14.950000000000076, "driven_lanedir": 2.900847011294354, "get_state_dump": 0.010279541810353596, "sim_render-ego": 0.00601735512415568, "get_robot_state": 0.012587877909342448, "get_duckie_state": 1.6609827677408854e-06, "in-drivable-lane": 4.900000000000051, "agent_compute-ego": 0.01736780007680257, "deviation-heading": 1.6588576149514664, "complete-iteration": 0.20547658046086628, "set_robot_commands": 0.005259122053782145, "deviation-center-line": 0.6984059473168255, "driven_lanedir_consec": 2.900847011294354, "sim_compute_sim_state": 0.029267079830169677, "sim_compute_performance-ego": 0.003928812344868978}}
set_robot_commands_max0.00545290470123291
set_robot_commands_mean0.005274431109428405
set_robot_commands_median0.005285849571228027
set_robot_commands_min0.005073120594024658
sim_compute_performance-ego_max0.004131666819254557
sim_compute_performance-ego_mean0.00398154338200887
sim_compute_performance-ego_median0.003962134917577108
sim_compute_performance-ego_min0.003870236873626709
sim_compute_sim_state_max0.029267079830169677
sim_compute_sim_state_mean0.02642746925354004
sim_compute_sim_state_median0.026266801357269286
sim_compute_sim_state_min0.023909194469451903
sim_render-ego_max0.006359935601552328
sim_render-ego_mean0.006076806584993998
sim_render-ego_median0.006015813748041788
sim_render-ego_min0.005915663242340088
simulation-passed1
step_physics_max0.08909237305323282
step_physics_mean0.08571337083975474
step_physics_median0.08604475498199463
step_physics_min0.08167160034179688
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4379011743Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2163751806292264
survival_time_median14.950000000000076
deviation-center-line_median0.6797313074444176
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.014794264634450277
agent_compute-ego_mean0.013542549014091493
agent_compute-ego_median0.013294630448023478
agent_compute-ego_min0.012786670525868734
complete-iteration_max0.16938794374465943
complete-iteration_mean0.15532740056514738
complete-iteration_median0.1522715441385905
complete-iteration_min0.14737857023874917
deviation-center-line_max1.3740151411956647
deviation-center-line_mean0.7424898753730145
deviation-center-line_min0.23648174540755823
deviation-heading_max2.87970390023247
deviation-heading_mean2.309227435553134
deviation-heading_median2.239698303081053
deviation-heading_min1.8778092358179592
driven_any_max2.3417450635286468
driven_any_mean2.1227351549410463
driven_any_median2.2640151270187285
driven_any_min1.6211653021980823
driven_lanedir_consec_max2.2784894126637605
driven_lanedir_consec_mean1.8358431963195163
driven_lanedir_consec_min0.6321330113558529
driven_lanedir_max2.2784894126637605
driven_lanedir_mean1.8358431963195163
driven_lanedir_median2.2163751806292264
driven_lanedir_min0.6321330113558529
get_duckie_state_max1.483758290608724e-06
get_duckie_state_mean1.2934207916259763e-06
get_duckie_state_median1.2389818827311195e-06
get_duckie_state_min1.2119611104329426e-06
get_robot_state_max0.0111980668703715
get_robot_state_mean0.010146671732266743
get_robot_state_median0.009861724774042766
get_robot_state_min0.009665170510609944
get_state_dump_max0.00964463472366333
get_state_dump_mean0.00887691875298818
get_state_dump_median0.008690258264541628
get_state_dump_min0.008482523759206136
get_ui_image_max0.028539518515268963
get_ui_image_mean0.02571229855219523
get_ui_image_median0.02492230971654256
get_ui_image_min0.02446505626042684
in-drivable-lane_max9.35000000000009
in-drivable-lane_mean2.3375000000000226
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2590705214998263, "get_ui_image": 0.028539518515268963, "step_physics": 0.07061563173929851, "survival_time": 14.950000000000076, "driven_lanedir": 2.2202965271413246, "get_state_dump": 0.00964463472366333, "sim_render-ego": 0.005230620702107747, "get_robot_state": 0.0111980668703715, "get_duckie_state": 1.483758290608724e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014794264634450277, "deviation-heading": 2.321141371951401, "complete-iteration": 0.16938794374465943, "set_robot_commands": 0.004417064189910888, "deviation-center-line": 0.5782765575861525, "driven_lanedir_consec": 2.2202965271413246, "sim_compute_sim_state": 0.021364405949910483, "sim_compute_performance-ego": 0.003484060764312744}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.2689597325376303, "get_ui_image": 0.024704020023345947, "step_physics": 0.061706327597300215, "survival_time": 14.950000000000076, "driven_lanedir": 2.2124538341171287, "get_state_dump": 0.008659663200378418, "sim_render-ego": 0.004578986962636312, "get_robot_state": 0.009843886693318683, "get_duckie_state": 1.2620290120442708e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012786670525868734, "deviation-heading": 2.87970390023247, "complete-iteration": 0.14737857023874917, "set_robot_commands": 0.0037755735715230302, "deviation-center-line": 0.7811860573026826, "driven_lanedir_consec": 2.2124538341171287, "sim_compute_sim_state": 0.018172782262166343, "sim_compute_performance-ego": 0.0030630811055501303}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.6211653021980823, "get_ui_image": 0.025140599409739176, "step_physics": 0.0633645764986674, "survival_time": 14.950000000000076, "driven_lanedir": 0.6321330113558529, "get_state_dump": 0.008482523759206136, "sim_render-ego": 0.004620192050933838, "get_robot_state": 0.009665170510609944, "get_duckie_state": 1.2119611104329426e-06, "in-drivable-lane": 9.35000000000009, "agent_compute-ego": 0.013731573422749836, "deviation-heading": 2.1582552342107046, "complete-iteration": 0.15015796820322672, "set_robot_commands": 0.0038883288701375327, "deviation-center-line": 0.23648174540755823, "driven_lanedir_consec": 0.6321330113558529, "sim_compute_sim_state": 0.01809812307357788, "sim_compute_performance-ego": 0.003077201048533122}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.3417450635286468, "get_ui_image": 0.02446505626042684, "step_physics": 0.06559281508127848, "survival_time": 14.950000000000076, "driven_lanedir": 2.2784894126637605, "get_state_dump": 0.008720853328704835, "sim_render-ego": 0.004478602409362793, "get_robot_state": 0.009879562854766846, "get_duckie_state": 1.2159347534179689e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01285768747329712, "deviation-heading": 1.8778092358179592, "complete-iteration": 0.15438512007395427, "set_robot_commands": 0.0038104112943013503, "deviation-center-line": 1.3740151411956647, "driven_lanedir_consec": 2.2784894126637605, "sim_compute_sim_state": 0.021543243726094563, "sim_compute_performance-ego": 0.002948172887166341}}
set_robot_commands_max0.004417064189910888
set_robot_commands_mean0.003972844481468201
set_robot_commands_median0.0038493700822194417
set_robot_commands_min0.0037755735715230302
sim_compute_performance-ego_max0.003484060764312744
sim_compute_performance-ego_mean0.003143128951390584
sim_compute_performance-ego_median0.003070141077041626
sim_compute_performance-ego_min0.002948172887166341
sim_compute_sim_state_max0.021543243726094563
sim_compute_sim_state_mean0.01979463875293732
sim_compute_sim_state_median0.019768594106038415
sim_compute_sim_state_min0.01809812307357788
sim_render-ego_max0.005230620702107747
sim_render-ego_mean0.004727100531260173
sim_render-ego_median0.004599589506785075
sim_render-ego_min0.004478602409362793
simulation-passed1
step_physics_max0.07061563173929851
step_physics_mean0.06531983772913616
step_physics_median0.06447869578997295
step_physics_min0.061706327597300215
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4377611740Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9214615638145305
survival_time_median14.950000000000076
deviation-center-line_median0.7955087295519836
in-drivable-lane_median1.250000000000013


other stats
agent_compute-ego_max0.016039540925001736
agent_compute-ego_mean0.015139763593270293
agent_compute-ego_median0.015606234073638916
agent_compute-ego_min0.013307045300801595
complete-iteration_max0.18040597378299927
complete-iteration_mean0.17624044343602235
complete-iteration_median0.1780642068386078
complete-iteration_min0.16842738628387452
deviation-center-line_max1.0787388604435328
deviation-center-line_mean0.7484207388406612
deviation-center-line_min0.3239266358151447
deviation-heading_max3.421343924529348
deviation-heading_mean2.684978337863627
deviation-heading_median2.733555137555262
deviation-heading_min1.8514591518146364
driven_any_max2.7462050094324626
driven_any_mean2.4179712228654333
driven_any_median2.513127961862531
driven_any_min1.8994239583042083
driven_lanedir_consec_max2.547585029752392
driven_lanedir_consec_mean1.7664773780606775
driven_lanedir_consec_min0.6754013548612576
driven_lanedir_max2.601770668369925
driven_lanedir_mean2.0068256501936976
driven_lanedir_median2.0285312184129545
driven_lanedir_min1.3684694955789565
get_duckie_state_max1.5769513125347002e-06
get_duckie_state_mean1.5044736781499513e-06
get_duckie_state_median1.5497207641601562e-06
get_duckie_state_min1.3415018717447915e-06
get_robot_state_max0.011613538265228271
get_robot_state_mean0.011154147688104014
get_robot_state_median0.011253229585395852
get_robot_state_min0.010496593316396078
get_state_dump_max0.009718089103698733
get_state_dump_mean0.009520689519327104
get_state_dump_median0.009660937134586212
get_state_dump_min0.009042794704437257
get_ui_image_max0.031842051347096764
get_ui_image_mean0.030616988012229937
get_ui_image_median0.03159246339208987
get_ui_image_min0.02744097391764323
in-drivable-lane_max5.900000000000022
in-drivable-lane_mean2.100000000000012
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8994239583042083, "get_ui_image": 0.031792208628000945, "step_physics": 0.07635679946938143, "survival_time": 9.850000000000003, "driven_lanedir": 1.3684694955789565, "get_state_dump": 0.009629930941586567, "sim_render-ego": 0.005412821842329151, "get_robot_state": 0.01105947058818062, "get_duckie_state": 1.5769513125347002e-06, "in-drivable-lane": 2.300000000000024, "agent_compute-ego": 0.016039540925001736, "deviation-heading": 1.8514591518146364, "complete-iteration": 0.18040597378299927, "set_robot_commands": 0.004561471454988276, "deviation-center-line": 0.3239266358151447, "driven_lanedir_consec": 1.3684694955789565, "sim_compute_sim_state": 0.021836962191586567, "sim_compute_performance-ego": 0.0036107198841075607}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.64806524267879, "get_ui_image": 0.03139271815617879, "step_physics": 0.07471797386805216, "survival_time": 14.950000000000076, "driven_lanedir": 2.547585029752392, "get_state_dump": 0.009691943327585856, "sim_render-ego": 0.005412400563557943, "get_robot_state": 0.011446988582611084, "get_duckie_state": 1.556078592936198e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015758501688639324, "deviation-heading": 3.421343924529348, "complete-iteration": 0.17845450083414713, "set_robot_commands": 0.004765628973642985, "deviation-center-line": 1.0787388604435328, "driven_lanedir_consec": 2.547585029752392, "sim_compute_sim_state": 0.02155865748723348, "sim_compute_performance-ego": 0.0036028393109639486}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.3781906810462723, "get_ui_image": 0.031842051347096764, "step_physics": 0.07436583042144776, "survival_time": 14.950000000000076, "driven_lanedir": 1.5094774070735175, "get_state_dump": 0.009718089103698733, "sim_render-ego": 0.005584274133046468, "get_robot_state": 0.011613538265228271, "get_duckie_state": 1.5433629353841146e-06, "in-drivable-lane": 5.900000000000022, "agent_compute-ego": 0.015453966458638509, "deviation-heading": 2.5548726506823174, "complete-iteration": 0.17767391284306844, "set_robot_commands": 0.004620256423950195, "deviation-center-line": 0.515379170009863, "driven_lanedir_consec": 0.6754013548612576, "sim_compute_sim_state": 0.020766719182332357, "sim_compute_performance-ego": 0.0036022090911865235}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7462050094324626, "get_ui_image": 0.02744097391764323, "step_physics": 0.07263193368911743, "survival_time": 14.950000000000076, "driven_lanedir": 2.601770668369925, "get_state_dump": 0.009042794704437257, "sim_render-ego": 0.004756588935852051, "get_robot_state": 0.010496593316396078, "get_duckie_state": 1.3415018717447915e-06, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.013307045300801595, "deviation-heading": 2.9122376244282053, "complete-iteration": 0.16842738628387452, "set_robot_commands": 0.004111931324005127, "deviation-center-line": 1.075638289094104, "driven_lanedir_consec": 2.4744536320501047, "sim_compute_sim_state": 0.02339245080947876, "sim_compute_performance-ego": 0.0031518228848775227}}
set_robot_commands_max0.004765628973642985
set_robot_commands_mean0.0045148220441466455
set_robot_commands_median0.004590863939469236
set_robot_commands_min0.004111931324005127
sim_compute_performance-ego_max0.0036107198841075607
sim_compute_performance-ego_mean0.0034918977927838888
sim_compute_performance-ego_median0.003602524201075236
sim_compute_performance-ego_min0.0031518228848775227
sim_compute_sim_state_max0.02339245080947876
sim_compute_sim_state_mean0.021888697417657792
sim_compute_sim_state_median0.021697809839410023
sim_compute_sim_state_min0.020766719182332357
sim_render-ego_max0.005584274133046468
sim_render-ego_mean0.005291521368696403
sim_render-ego_median0.005412611202943547
sim_render-ego_min0.004756588935852051
simulation-passed1
step_physics_max0.07635679946938143
step_physics_mean0.0745181343619997
step_physics_median0.07454190214474996
step_physics_min0.07263193368911743
survival_time_max14.950000000000076
survival_time_mean13.675000000000058
survival_time_min9.850000000000003
No reset possible
4376211735Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoreg02-b35ee35771a7-10:03:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 228 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4375011730Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6457625929890585
survival_time_median14.950000000000076
deviation-center-line_median0.5178400313687365
in-drivable-lane_median5.575000000000067


other stats
agent_compute-ego_max0.012664862473805744
agent_compute-ego_mean0.012308837101884084
agent_compute-ego_median0.012230365276336669
agent_compute-ego_min0.012109755381057252
complete-iteration_max0.15315248489379882
complete-iteration_mean0.15017055248016636
complete-iteration_median0.1505752459127609
complete-iteration_min0.1463792332013448
deviation-center-line_max0.6462841412064314
deviation-center-line_mean0.48426847461764655
deviation-center-line_min0.2551096945266819
deviation-heading_max2.7556739681593947
deviation-heading_mean2.1927878721463827
deviation-heading_median2.4307003490628616
deviation-heading_min1.154076822300412
driven_any_max3.834704862676021
driven_any_mean2.8209449175517194
driven_any_median2.7046032353480927
driven_any_min2.03986833683467
driven_lanedir_consec_max3.685382540943382
driven_lanedir_consec_mean1.9694938860938196
driven_lanedir_consec_min0.9010678174537792
driven_lanedir_max3.685382540943382
driven_lanedir_mean1.9694938860938196
driven_lanedir_median1.6457625929890585
driven_lanedir_min0.9010678174537792
get_duckie_state_max1.3684573238843109e-06
get_duckie_state_mean1.2941991901833173e-06
get_duckie_state_median1.275936762491862e-06
get_duckie_state_min1.2564659118652345e-06
get_robot_state_max0.010107087218053808
get_robot_state_mean0.009839852631908574
get_robot_state_median0.009795712232589722
get_robot_state_min0.009660898844401042
get_state_dump_max0.008847101638306222
get_state_dump_mean0.008621919182337583
get_state_dump_median0.008583734432856243
get_state_dump_min0.008473106225331624
get_ui_image_max0.02464153886385704
get_ui_image_mean0.02434159447885539
get_ui_image_median0.024411995410919183
get_ui_image_min0.023900848229726157
in-drivable-lane_max9.20000000000004
in-drivable-lane_mean5.225000000000043
in-drivable-lane_min0.5499999999999998
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.03986833683467, "get_ui_image": 0.02464153886385704, "step_physics": 0.06150588706203792, "survival_time": 10.95000000000002, "driven_lanedir": 1.329060419662046, "get_state_dump": 0.008847101638306222, "sim_render-ego": 0.004527268344408845, "get_robot_state": 0.010107087218053808, "get_duckie_state": 1.3684573238843109e-06, "in-drivable-lane": 3.6500000000000385, "agent_compute-ego": 0.012109755381057252, "deviation-heading": 2.3156575644505195, "complete-iteration": 0.14807049651124163, "set_robot_commands": 0.003848231546410687, "deviation-center-line": 0.530663689630153, "driven_lanedir_consec": 1.329060419662046, "sim_compute_sim_state": 0.019386769429733764, "sim_compute_performance-ego": 0.003010046536519647}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8847952897856577, "get_ui_image": 0.023900848229726157, "step_physics": 0.06212998628616333, "survival_time": 14.950000000000076, "driven_lanedir": 1.9624647663160708, "get_state_dump": 0.008473106225331624, "sim_render-ego": 0.004458754857381185, "get_robot_state": 0.009660898844401042, "get_duckie_state": 1.2882550557454427e-06, "in-drivable-lane": 7.500000000000096, "agent_compute-ego": 0.012298505306243896, "deviation-heading": 1.154076822300412, "complete-iteration": 0.1463792332013448, "set_robot_commands": 0.003859146436055501, "deviation-center-line": 0.2551096945266819, "driven_lanedir_consec": 1.9624647663160708, "sim_compute_sim_state": 0.01854443391164144, "sim_compute_performance-ego": 0.0029679369926452637}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.524411180910528, "get_ui_image": 0.024626178741455076, "step_physics": 0.06646376212437947, "survival_time": 14.950000000000076, "driven_lanedir": 0.9010678174537792, "get_state_dump": 0.00854366938273112, "sim_render-ego": 0.004602181911468506, "get_robot_state": 0.00984686533610026, "get_duckie_state": 1.2636184692382812e-06, "in-drivable-lane": 9.20000000000004, "agent_compute-ego": 0.012664862473805744, "deviation-heading": 2.7556739681593947, "complete-iteration": 0.15307999531428018, "set_robot_commands": 0.0038065234820048015, "deviation-center-line": 0.50501637310732, "driven_lanedir_consec": 0.9010678174537792, "sim_compute_sim_state": 0.01944632291793823, "sim_compute_performance-ego": 0.0029948321978251137}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.834704862676021, "get_ui_image": 0.0241978120803833, "step_physics": 0.06490213712056478, "survival_time": 14.950000000000076, "driven_lanedir": 3.685382540943382, "get_state_dump": 0.008623799482981365, "sim_render-ego": 0.00445883830388387, "get_robot_state": 0.009744559129079185, "get_duckie_state": 1.2564659118652345e-06, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.012162225246429443, "deviation-heading": 2.5457431336752037, "complete-iteration": 0.15315248489379882, "set_robot_commands": 0.003748431205749512, "deviation-center-line": 0.6462841412064314, "driven_lanedir_consec": 3.685382540943382, "sim_compute_sim_state": 0.022226035594940186, "sim_compute_performance-ego": 0.003001278241475423}}
set_robot_commands_max0.003859146436055501
set_robot_commands_mean0.003815583167555125
set_robot_commands_median0.003827377514207744
set_robot_commands_min0.003748431205749512
sim_compute_performance-ego_max0.003010046536519647
sim_compute_performance-ego_mean0.0029935234921163617
sim_compute_performance-ego_median0.0029980552196502684
sim_compute_performance-ego_min0.0029679369926452637
sim_compute_sim_state_max0.022226035594940186
sim_compute_sim_state_mean0.019900890463563404
sim_compute_sim_state_median0.019416546173835997
sim_compute_sim_state_min0.01854443391164144
sim_render-ego_max0.004602181911468506
sim_render-ego_mean0.0045117608542856015
sim_render-ego_median0.004493053324146358
sim_render-ego_min0.004458754857381185
simulation-passed1
step_physics_max0.06646376212437947
step_physics_mean0.06375044314828637
step_physics_median0.06351606170336405
step_physics_min0.06150588706203792
survival_time_max14.950000000000076
survival_time_mean13.950000000000063
survival_time_min10.95000000000002
No reset possible
4373511726Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.475741342258143
survival_time_median13.65000000000006
deviation-center-line_median0.7424561642968683
in-drivable-lane_median3.975000000000011


other stats
agent_compute-ego_max0.015447476614824674
agent_compute-ego_mean0.0133610551692487
agent_compute-ego_median0.01274040924790737
agent_compute-ego_min0.012515925566355389
complete-iteration_max0.18360633888707953
complete-iteration_mean0.1595701661907508
complete-iteration_median0.1518948436242767
complete-iteration_min0.1508846386273702
deviation-center-line_max0.906425489337432
deviation-center-line_mean0.6731024145705962
deviation-center-line_min0.30107184035121604
deviation-heading_max5.884157838265633
deviation-heading_mean4.824346862635411
deviation-heading_median5.723648803206198
deviation-heading_min1.9659320058636167
driven_any_max2.9370147595305083
driven_any_mean2.358160833688582
driven_any_median2.3493035069205757
driven_any_min1.7970215613826674
driven_lanedir_consec_max1.7472189445132065
driven_lanedir_consec_mean1.4238201260644172
driven_lanedir_consec_min0.9965788752281765
driven_lanedir_max1.7472189445132065
driven_lanedir_mean1.4238201260644172
driven_lanedir_median1.475741342258143
driven_lanedir_min0.9965788752281765
get_duckie_state_max1.4430598208778782e-06
get_duckie_state_mean1.4021890229427384e-06
get_duckie_state_median1.426004950021733e-06
get_duckie_state_min1.3136863708496091e-06
get_robot_state_max0.010888658554447808
get_robot_state_mean0.010393490255365812
get_robot_state_median0.010450010324948557
get_robot_state_min0.009785281817118326
get_state_dump_max0.009735594590504965
get_state_dump_mean0.00905135695959199
get_state_dump_median0.00892072692252042
get_state_dump_min0.008628379402822153
get_ui_image_max0.02983081485578406
get_ui_image_mean0.026143191447816357
get_ui_image_median0.02508772775846639
get_ui_image_min0.024566495418548585
in-drivable-lane_max4.950000000000039
in-drivable-lane_mean3.4250000000000185
in-drivable-lane_min0.8000000000000114
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.7970215613826674, "get_ui_image": 0.025322078969437264, "step_physics": 0.06410061968544314, "survival_time": 8.649999999999988, "driven_lanedir": 0.9965788752281765, "get_state_dump": 0.008628379402822153, "sim_render-ego": 0.004833173200574224, "get_robot_state": 0.01007890150037115, "get_duckie_state": 1.4167300538520592e-06, "in-drivable-lane": 3.599999999999998, "agent_compute-ego": 0.012895850087865928, "deviation-heading": 1.9659320058636167, "complete-iteration": 0.15247961689282014, "set_robot_commands": 0.004013670662234973, "deviation-center-line": 0.30107184035121604, "driven_lanedir_consec": 0.9965788752281765, "sim_compute_sim_state": 0.019389068460188848, "sim_compute_performance-ego": 0.003130397355625395}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.387403757006928, "get_ui_image": 0.024853376547495525, "step_physics": 0.06255539655685424, "survival_time": 14.950000000000076, "driven_lanedir": 1.2882126464860626, "get_state_dump": 0.009735594590504965, "sim_render-ego": 0.004644625186920166, "get_robot_state": 0.01082111914952596, "get_duckie_state": 1.435279846191406e-06, "in-drivable-lane": 4.950000000000039, "agent_compute-ego": 0.012584968407948812, "deviation-heading": 5.884157838265633, "complete-iteration": 0.15131007035573324, "set_robot_commands": 0.003917137781778972, "deviation-center-line": 0.7933243399377908, "driven_lanedir_consec": 1.2882126464860626, "sim_compute_sim_state": 0.01901047945022583, "sim_compute_performance-ego": 0.003097097873687744}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9370147595305083, "get_ui_image": 0.024566495418548585, "step_physics": 0.06505342324574788, "survival_time": 14.950000000000076, "driven_lanedir": 1.6632700380302234, "get_state_dump": 0.008725720246632894, "sim_render-ego": 0.00457123597462972, "get_robot_state": 0.009785281817118326, "get_duckie_state": 1.3136863708496091e-06, "in-drivable-lane": 4.350000000000025, "agent_compute-ego": 0.012515925566355389, "deviation-heading": 5.699134830680352, "complete-iteration": 0.1508846386273702, "set_robot_commands": 0.003822637399037679, "deviation-center-line": 0.6915879886559457, "driven_lanedir_consec": 1.6632700380302234, "sim_compute_sim_state": 0.01874535163243612, "sim_compute_performance-ego": 0.003011366526285807}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.311203256834224, "get_ui_image": 0.02983081485578406, "step_physics": 0.078969160072234, "survival_time": 12.35000000000004, "driven_lanedir": 1.7472189445132065, "get_state_dump": 0.009115733598407946, "sim_render-ego": 0.0054922055618965675, "get_robot_state": 0.010888658554447808, "get_duckie_state": 1.4430598208778782e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.015447476614824674, "deviation-heading": 5.748162775732045, "complete-iteration": 0.18360633888707953, "set_robot_commands": 0.004676340079983236, "deviation-center-line": 0.906425489337432, "driven_lanedir_consec": 1.7472189445132065, "sim_compute_sim_state": 0.025456498991622615, "sim_compute_performance-ego": 0.0036301998956966017}}
set_robot_commands_max0.004676340079983236
set_robot_commands_mean0.004107446480758715
set_robot_commands_median0.003965404222006972
set_robot_commands_min0.003822637399037679
sim_compute_performance-ego_max0.0036301998956966017
sim_compute_performance-ego_mean0.0032172654128238866
sim_compute_performance-ego_median0.0031137476146565696
sim_compute_performance-ego_min0.003011366526285807
sim_compute_sim_state_max0.025456498991622615
sim_compute_sim_state_mean0.02065034963361835
sim_compute_sim_state_median0.01919977395520734
sim_compute_sim_state_min0.01874535163243612
sim_render-ego_max0.0054922055618965675
sim_render-ego_mean0.0048853099810051695
sim_render-ego_median0.004738899193747195
sim_render-ego_min0.00457123597462972
simulation-passed1
step_physics_max0.078969160072234
step_physics_mean0.06766964989006981
step_physics_median0.06457702146559552
step_physics_min0.06255539655685424
survival_time_max14.950000000000076
survival_time_mean12.725000000000044
survival_time_min8.649999999999988
No reset possible
4372211723Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3369560770254885
survival_time_median14.950000000000076
deviation-center-line_median0.8223356992304622
in-drivable-lane_median1.4500000000000064


other stats
agent_compute-ego_max0.0167760960261027
agent_compute-ego_mean0.01472646951675415
agent_compute-ego_median0.014789005120595297
agent_compute-ego_min0.012551771799723306
complete-iteration_max0.19668051640192669
complete-iteration_mean0.17056589941183725
complete-iteration_median0.16912104686101276
complete-iteration_min0.1473409875233968
deviation-center-line_max0.8776685281866687
deviation-center-line_mean0.7000738399108284
deviation-center-line_min0.2779554329957206
deviation-heading_max3.791857977645249
deviation-heading_mean2.654910507761157
deviation-heading_median3.010073098009269
deviation-heading_min0.807637857380841
driven_any_max3.497301417989853
driven_any_mean2.6675678538212804
driven_any_median2.751874933336154
driven_any_min1.6692201306229582
driven_lanedir_consec_max3.428219983432672
driven_lanedir_consec_mean2.3697157568796827
driven_lanedir_consec_min1.376730890035082
driven_lanedir_max3.428219983432672
driven_lanedir_mean2.411835642146724
driven_lanedir_median2.421195847559572
driven_lanedir_min1.376730890035082
get_duckie_state_max1.641114552815755e-06
get_duckie_state_mean1.421968142191569e-06
get_duckie_state_median1.4209747314453125e-06
get_duckie_state_min1.204808553059896e-06
get_robot_state_max0.01185962677001953
get_robot_state_mean0.011000600854555766
get_robot_state_median0.011112516323725384
get_robot_state_min0.009917744000752769
get_state_dump_max0.0098653777440389
get_state_dump_mean0.009372592965761822
get_state_dump_median0.00950876792271932
get_state_dump_min0.008607458273569743
get_ui_image_max0.03100344737370809
get_ui_image_mean0.027685923178990685
get_ui_image_median0.02777181148529053
get_ui_image_min0.024196622371673585
in-drivable-lane_max2.0500000000000274
in-drivable-lane_mean1.23750000000001
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.6692201306229582, "get_ui_image": 0.024654939969380694, "step_physics": 0.06254505475362142, "survival_time": 7.499999999999981, "driven_lanedir": 1.376730890035082, "get_state_dump": 0.009532267252604167, "sim_render-ego": 0.004681267738342285, "get_robot_state": 0.010932386716206869, "get_duckie_state": 1.3128916422526042e-06, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.013603973388671874, "deviation-heading": 0.807637857380841, "complete-iteration": 0.1531077480316162, "set_robot_commands": 0.003945768674214681, "deviation-center-line": 0.2779554329957206, "driven_lanedir_consec": 1.376730890035082, "sim_compute_sim_state": 0.01992756366729736, "sim_compute_performance-ego": 0.0031922356287638347}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.497301417989853, "get_ui_image": 0.024196622371673585, "step_physics": 0.06127194801966349, "survival_time": 14.950000000000076, "driven_lanedir": 3.428219983432672, "get_state_dump": 0.008607458273569743, "sim_render-ego": 0.00458342711130778, "get_robot_state": 0.009917744000752769, "get_duckie_state": 1.204808553059896e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012551771799723306, "deviation-heading": 2.376730541108991, "complete-iteration": 0.1473409875233968, "set_robot_commands": 0.0038594921429951985, "deviation-center-line": 0.8158386062138994, "driven_lanedir_consec": 3.428219983432672, "sim_compute_sim_state": 0.019277983506520588, "sim_compute_performance-ego": 0.002985835870107015}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.456744579943867, "get_ui_image": 0.03088868300120036, "step_physics": 0.08086285591125489, "survival_time": 14.950000000000076, "driven_lanedir": 2.1470432006444335, "get_state_dump": 0.009485268592834472, "sim_render-ego": 0.005666410923004151, "get_robot_state": 0.011292645931243897, "get_duckie_state": 1.5290578206380208e-06, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.015974036852518716, "deviation-heading": 3.791857977645249, "complete-iteration": 0.18513434569040935, "set_robot_commands": 0.004790993531545004, "deviation-center-line": 0.8288327922470252, "driven_lanedir_consec": 2.1470432006444335, "sim_compute_sim_state": 0.02241404215494792, "sim_compute_performance-ego": 0.0036526862780253094}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0470052867284414, "get_ui_image": 0.03100344737370809, "step_physics": 0.08580501317977905, "survival_time": 14.950000000000076, "driven_lanedir": 2.6953484944747097, "get_state_dump": 0.0098653777440389, "sim_render-ego": 0.005774137179056804, "get_robot_state": 0.01185962677001953, "get_duckie_state": 1.641114552815755e-06, "in-drivable-lane": 2.0500000000000274, "agent_compute-ego": 0.0167760960261027, "deviation-heading": 3.643415654909546, "complete-iteration": 0.19668051640192669, "set_robot_commands": 0.004897364775339762, "deviation-center-line": 0.8776685281866687, "driven_lanedir_consec": 2.5268689534065434, "sim_compute_sim_state": 0.02676276445388794, "sim_compute_performance-ego": 0.0038274312019348144}}
set_robot_commands_max0.004897364775339762
set_robot_commands_mean0.0043734047810236615
set_robot_commands_median0.004368381102879843
set_robot_commands_min0.0038594921429951985
sim_compute_performance-ego_max0.0038274312019348144
sim_compute_performance-ego_mean0.003414547244707743
sim_compute_performance-ego_median0.003422460953394572
sim_compute_performance-ego_min0.002985835870107015
sim_compute_sim_state_max0.02676276445388794
sim_compute_sim_state_mean0.022095588445663453
sim_compute_sim_state_median0.02117080291112264
sim_compute_sim_state_min0.019277983506520588
sim_render-ego_max0.005774137179056804
sim_render-ego_mean0.005176310737927755
sim_render-ego_median0.0051738393306732175
sim_render-ego_min0.00458342711130778
simulation-passed1
step_physics_max0.08580501317977905
step_physics_mean0.07262121796607972
step_physics_median0.07170395533243815
step_physics_min0.06127194801966349
survival_time_max14.950000000000076
survival_time_mean13.087500000000052
survival_time_min7.499999999999981
No reset possible
4369811719Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simerrornoreg02-b35ee35771a7-10:01:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4366211708Mo KleitΒ πŸ‡¨πŸ‡¦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2494519169528804
survival_time_median14.950000000000076
deviation-center-line_median0.7624038023061425
in-drivable-lane_median2.00000000000002


other stats
agent_compute-ego_max0.018327678044637044
agent_compute-ego_mean0.01709013243516286
agent_compute-ego_median0.017726471026738484
agent_compute-ego_min0.014579909642537437
complete-iteration_max0.20709252675374348
complete-iteration_mean0.19776447474956513
complete-iteration_median0.20134778579076132
complete-iteration_min0.1812698006629944
deviation-center-line_max0.9829545455575374
deviation-center-line_mean0.8015167283346275
deviation-center-line_min0.6983047631686875
deviation-heading_max3.539033307995263
deviation-heading_mean2.8100315120075283
deviation-heading_median2.8670116395178233
deviation-heading_min1.967069460999205
driven_any_max3.879748157868032
driven_any_mean3.876474425222529
driven_any_median3.879562098290259
driven_any_min3.8670253464415674
driven_lanedir_consec_max3.5869162676689372
driven_lanedir_consec_mean3.112096952812862
driven_lanedir_consec_min2.362567709676751
driven_lanedir_max3.5869162676689372
driven_lanedir_mean3.112096952812862
driven_lanedir_median3.2494519169528804
driven_lanedir_min2.362567709676751
get_duckie_state_max2.5606155395507813e-06
get_duckie_state_mean2.370278040568034e-06
get_duckie_state_median2.3341178894042967e-06
get_duckie_state_min2.2522608439127605e-06
get_robot_state_max0.01333879868189494
get_robot_state_mean0.012828965981801351
get_robot_state_median0.012774537404378256
get_robot_state_min0.012427990436553954
get_state_dump_max0.011117740472157796
get_state_dump_mean0.010621231993039448
get_state_dump_median0.010575601657231648
get_state_dump_min0.010215984185536703
get_ui_image_max0.03415300846099854
get_ui_image_mean0.03163467645645142
get_ui_image_median0.03264098246892293
get_ui_image_min0.027103732426961263
in-drivable-lane_max5.050000000000047
in-drivable-lane_mean2.3875000000000233
in-drivable-lane_min0.5000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8670253464415674, "get_ui_image": 0.033430441220601397, "step_physics": 0.08794812997182211, "survival_time": 14.950000000000076, "driven_lanedir": 2.9859038072391058, "get_state_dump": 0.010575424035390218, "sim_render-ego": 0.005931642055511475, "get_robot_state": 0.012690300146738689, "get_duckie_state": 2.342859903971354e-06, "in-drivable-lane": 3.050000000000031, "agent_compute-ego": 0.018229095935821532, "deviation-heading": 1.967069460999205, "complete-iteration": 0.2042246683438619, "set_robot_commands": 0.0054254380861918135, "deviation-center-line": 0.6983047631686875, "driven_lanedir_consec": 2.9859038072391058, "sim_compute_sim_state": 0.02581915537516276, "sim_compute_performance-ego": 0.004056122303009033}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879697165601315, "get_ui_image": 0.03415300846099854, "step_physics": 0.08537356694539389, "survival_time": 14.950000000000076, "driven_lanedir": 3.5869162676689372, "get_state_dump": 0.010215984185536703, "sim_render-ego": 0.005945507685343424, "get_robot_state": 0.012427990436553954, "get_duckie_state": 2.2522608439127605e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.017223846117655435, "deviation-heading": 3.539033307995263, "complete-iteration": 0.19847090323766073, "set_robot_commands": 0.005265374978383382, "deviation-center-line": 0.7195342014919482, "driven_lanedir_consec": 3.5869162676689372, "sim_compute_sim_state": 0.02387284835179647, "sim_compute_performance-ego": 0.0038708249727884927}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.8794270309792034, "get_ui_image": 0.031851523717244465, "step_physics": 0.08990880012512208, "survival_time": 14.950000000000076, "driven_lanedir": 2.362567709676751, "get_state_dump": 0.01057577927907308, "sim_render-ego": 0.006371038754781087, "get_robot_state": 0.012858774662017822, "get_duckie_state": 2.3253758748372397e-06, "in-drivable-lane": 5.050000000000047, "agent_compute-ego": 0.018327678044637044, "deviation-heading": 3.022542418078109, "complete-iteration": 0.20709252675374348, "set_robot_commands": 0.005412404537200928, "deviation-center-line": 0.9829545455575374, "driven_lanedir_consec": 2.362567709676751, "sim_compute_sim_state": 0.02745709339777629, "sim_compute_performance-ego": 0.004197359879811605}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.879748157868032, "get_ui_image": 0.027103732426961263, "step_physics": 0.07358397881189982, "survival_time": 14.950000000000076, "driven_lanedir": 3.5130000266666546, "get_state_dump": 0.011117740472157796, "sim_render-ego": 0.005376020272572835, "get_robot_state": 0.01333879868189494, "get_duckie_state": 2.5606155395507813e-06, "in-drivable-lane": 0.9500000000000092, "agent_compute-ego": 0.014579909642537437, "deviation-heading": 2.711480860957537, "complete-iteration": 0.1812698006629944, "set_robot_commands": 0.004349656899770101, "deviation-center-line": 0.8052734031203367, "driven_lanedir_consec": 3.5130000266666546, "sim_compute_sim_state": 0.028199935754140214, "sim_compute_performance-ego": 0.0035056845347086587}}
set_robot_commands_max0.0054254380861918135
set_robot_commands_mean0.005113218625386556
set_robot_commands_median0.005338889757792155
set_robot_commands_min0.004349656899770101
sim_compute_performance-ego_max0.004197359879811605
sim_compute_performance-ego_mean0.003907497922579447
sim_compute_performance-ego_median0.003963473637898763
sim_compute_performance-ego_min0.0035056845347086587
sim_compute_sim_state_max0.028199935754140214
sim_compute_sim_state_mean0.026337258219718933
sim_compute_sim_state_median0.02663812438646952
sim_compute_sim_state_min0.02387284835179647
sim_render-ego_max0.006371038754781087
sim_render-ego_mean0.005906052192052205
sim_render-ego_median0.005938574870427449
sim_render-ego_min0.005376020272572835
simulation-passed1
step_physics_max0.08990880012512208
step_physics_mean0.08420361896355948
step_physics_median0.086660848458608
step_physics_min0.07358397881189982
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4365411706Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9182660653784893
survival_time_median14.950000000000076
deviation-center-line_median0.9537305995266678
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.016804279486338298
agent_compute-ego_mean0.01626130958398183
agent_compute-ego_median0.01653863549232483
agent_compute-ego_min0.015163687864939372
complete-iteration_max0.18696191072463988
complete-iteration_mean0.18344839890797932
complete-iteration_median0.18313755909601848
complete-iteration_min0.18055656671524048
deviation-center-line_max1.1076102002589945
deviation-center-line_mean0.9789321558772814
deviation-center-line_min0.9006572241967961
deviation-heading_max5.418781336868824
deviation-heading_mean5.021623148059389
deviation-heading_median5.089138951928918
deviation-heading_min4.489433351510897
driven_any_max3.3754367710771187
driven_any_mean3.210398548875969
driven_any_median3.206720072807119
driven_any_min3.05271727881252
driven_lanedir_consec_max3.0906552792992863
driven_lanedir_consec_mean2.9277277484597284
driven_lanedir_consec_min2.783723583782648
driven_lanedir_max3.0906552792992863
driven_lanedir_mean2.9277277484597284
driven_lanedir_median2.9182660653784893
driven_lanedir_min2.783723583782648
get_duckie_state_max2.5200843811035157e-06
get_duckie_state_mean2.4497509002685543e-06
get_duckie_state_median2.4648507436116535e-06
get_duckie_state_min2.349217732747396e-06
get_robot_state_max0.011981377601623535
get_robot_state_mean0.01157501498858134
get_robot_state_median0.011510095596313476
get_robot_state_min0.011298491160074867
get_state_dump_max0.010053671995798747
get_state_dump_mean0.009670260151227315
get_state_dump_median0.009562597274780274
get_state_dump_min0.009502174059549968
get_ui_image_max0.031322979132334394
get_ui_image_mean0.030795952677726748
get_ui_image_median0.030787405570348102
get_ui_image_min0.030286020437876385
in-drivable-lane_max0.25000000000000355
in-drivable-lane_mean0.06250000000000089
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.250929541658536, "get_ui_image": 0.03088086048762003, "step_physics": 0.07865166664123535, "survival_time": 14.950000000000076, "driven_lanedir": 2.9859844992318525, "get_state_dump": 0.010053671995798747, "sim_render-ego": 0.005659400622049967, "get_robot_state": 0.011981377601623535, "get_duckie_state": 2.5200843811035157e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016804279486338298, "deviation-heading": 4.855452729738989, "complete-iteration": 0.18696191072463988, "set_robot_commands": 0.00491815169652303, "deviation-center-line": 0.9793288554196032, "driven_lanedir_consec": 2.9859844992318525, "sim_compute_sim_state": 0.024072599411010743, "sim_compute_performance-ego": 0.003830648263295491}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.05271727881252, "get_ui_image": 0.031322979132334394, "step_physics": 0.07527973810831706, "survival_time": 14.950000000000076, "driven_lanedir": 2.783723583782648, "get_state_dump": 0.009604565302530925, "sim_render-ego": 0.005576789379119873, "get_robot_state": 0.011622376441955566, "get_duckie_state": 2.4628639221191406e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016446505387624103, "deviation-heading": 5.322825174118848, "complete-iteration": 0.18055656671524048, "set_robot_commands": 0.004746885299682617, "deviation-center-line": 0.9281323436337324, "driven_lanedir_consec": 2.783723583782648, "sim_compute_sim_state": 0.022172884941101076, "sim_compute_performance-ego": 0.00367647647857666}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.1625106039557016, "get_ui_image": 0.030286020437876385, "step_physics": 0.0766440995534261, "survival_time": 14.950000000000076, "driven_lanedir": 2.850547631525126, "get_state_dump": 0.009520629247029622, "sim_render-ego": 0.005648080507914225, "get_robot_state": 0.011397814750671389, "get_duckie_state": 2.4668375651041665e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016630765597025553, "deviation-heading": 5.418781336868824, "complete-iteration": 0.1817700552940369, "set_robot_commands": 0.00484566609064738, "deviation-center-line": 0.9006572241967961, "driven_lanedir_consec": 2.850547631525126, "sim_compute_sim_state": 0.0229810897509257, "sim_compute_performance-ego": 0.003706778685251872}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.3754367710771187, "get_ui_image": 0.03069395065307617, "step_physics": 0.0792252254486084, "survival_time": 14.950000000000076, "driven_lanedir": 3.0906552792992863, "get_state_dump": 0.009502174059549968, "sim_render-ego": 0.00527725617090861, "get_robot_state": 0.011298491160074867, "get_duckie_state": 2.349217732747396e-06, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.015163687864939372, "deviation-heading": 4.489433351510897, "complete-iteration": 0.1845050628980001, "set_robot_commands": 0.0043724942207336425, "deviation-center-line": 1.1076102002589945, "driven_lanedir_consec": 3.0906552792992863, "sim_compute_sim_state": 0.02536897182464599, "sim_compute_performance-ego": 0.003498948415120443}}
set_robot_commands_max0.00491815169652303
set_robot_commands_mean0.004720799326896667
set_robot_commands_median0.0047962756951649985
set_robot_commands_min0.0043724942207336425
sim_compute_performance-ego_max0.003830648263295491
sim_compute_performance-ego_mean0.003678212960561117
sim_compute_performance-ego_median0.003691627581914266
sim_compute_performance-ego_min0.003498948415120443
sim_compute_sim_state_max0.02536897182464599
sim_compute_sim_state_mean0.023648886481920876
sim_compute_sim_state_median0.023526844580968223
sim_compute_sim_state_min0.022172884941101076
sim_render-ego_max0.005659400622049967
sim_render-ego_mean0.005540381669998169
sim_render-ego_median0.005612434943517049
sim_render-ego_min0.00527725617090861
simulation-passed1
step_physics_max0.0792252254486084
step_physics_mean0.07745018243789673
step_physics_median0.07764788309733073
step_physics_min0.07527973810831706
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4363211699Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4399507163054417
survival_time_median14.950000000000076
deviation-center-line_median0.8455467719193377
in-drivable-lane_median2.0250000000000057


other stats
agent_compute-ego_max0.012523473103841146
agent_compute-ego_mean0.01237421684069176
agent_compute-ego_median0.012384453614552817
agent_compute-ego_min0.012204487029820271
complete-iteration_max0.1578659570380433
complete-iteration_mean0.15076799879879713
complete-iteration_median0.14919828295707702
complete-iteration_min0.14680947224299112
deviation-center-line_max1.2034996789478236
deviation-center-line_mean0.8211274843605456
deviation-center-line_min0.3899167146556835
deviation-heading_max3.784442067846708
deviation-heading_mean2.911518914832407
deviation-heading_median3.383396249417342
deviation-heading_min1.094841092648239
driven_any_max4.57939450772271
driven_any_mean3.9087363430058897
driven_any_median4.125691527122067
driven_any_min2.8041678100567147
driven_lanedir_consec_max4.313373106773438
driven_lanedir_consec_mean3.377932637600903
driven_lanedir_consec_min2.3184560110192898
driven_lanedir_max4.313373106773438
driven_lanedir_mean3.377932637600903
driven_lanedir_median3.4399507163054417
driven_lanedir_min2.3184560110192898
get_duckie_state_max1.2151400248209635e-06
get_duckie_state_mean1.162611730566852e-06
get_duckie_state_median1.1796221885506965e-06
get_duckie_state_min1.0760625203450522e-06
get_robot_state_max0.010419034957885742
get_robot_state_mean0.010170861961634735
get_robot_state_median0.010171350006643496
get_robot_state_min0.009921712875366213
get_state_dump_max0.009043438793861705
get_state_dump_mean0.008860562334866283
get_state_dump_median0.008882489204406738
get_state_dump_min0.008633832136789957
get_ui_image_max0.024154532750447592
get_ui_image_mean0.02403145192420646
get_ui_image_median0.024028282927595863
get_ui_image_min0.023914709091186523
in-drivable-lane_max3.000000000000042
in-drivable-lane_mean1.9125000000000156
in-drivable-lane_min0.6000000000000085
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.57939450772271, "get_ui_image": 0.023914709091186523, "step_physics": 0.06025511423746745, "survival_time": 14.950000000000076, "driven_lanedir": 3.927154354345209, "get_state_dump": 0.008738584518432617, "sim_render-ego": 0.0045100967089335125, "get_robot_state": 0.009921712875366213, "get_duckie_state": 1.2151400248209635e-06, "in-drivable-lane": 2.3500000000000174, "agent_compute-ego": 0.012278395493825277, "deviation-heading": 3.4510290066124223, "complete-iteration": 0.14680947224299112, "set_robot_commands": 0.003698406219482422, "deviation-center-line": 0.8674820718675603, "driven_lanedir_consec": 3.927154354345209, "sim_compute_sim_state": 0.020357022285461424, "sim_compute_performance-ego": 0.003052944342295329}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.575315101989946, "get_ui_image": 0.023991371790568036, "step_physics": 0.060771254698435466, "survival_time": 14.950000000000076, "driven_lanedir": 4.313373106773438, "get_state_dump": 0.00902639389038086, "sim_render-ego": 0.004630561669667562, "get_robot_state": 0.010419034957885742, "get_duckie_state": 1.178582509358724e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.012490511735280357, "deviation-heading": 3.784442067846708, "complete-iteration": 0.1489918009440104, "set_robot_commands": 0.0037525478998819985, "deviation-center-line": 1.2034996789478236, "driven_lanedir_consec": 4.313373106773438, "sim_compute_sim_state": 0.02076333443323771, "sim_compute_performance-ego": 0.0030625335375467936}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.6760679522541873, "get_ui_image": 0.024154532750447592, "step_physics": 0.06252376635869344, "survival_time": 14.950000000000076, "driven_lanedir": 2.9527470782656744, "get_state_dump": 0.008633832136789957, "sim_render-ego": 0.004588401317596436, "get_robot_state": 0.010009566942850748, "get_duckie_state": 1.0760625203450522e-06, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.012523473103841146, "deviation-heading": 3.3157634922222616, "complete-iteration": 0.14940476497014363, "set_robot_commands": 0.003738308747609456, "deviation-center-line": 0.8236114719711152, "driven_lanedir_consec": 2.9527470782656744, "sim_compute_sim_state": 0.020088775157928465, "sim_compute_performance-ego": 0.00306026299794515}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8041678100567147, "get_ui_image": 0.02406519406462369, "step_physics": 0.06789798605931949, "survival_time": 7.299999999999982, "driven_lanedir": 2.3184560110192898, "get_state_dump": 0.009043438793861705, "sim_render-ego": 0.004692685114194269, "get_robot_state": 0.010333133070436243, "get_duckie_state": 1.180661867742669e-06, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.012204487029820271, "deviation-heading": 1.094841092648239, "complete-iteration": 0.1578659570380433, "set_robot_commands": 0.003779590946354278, "deviation-center-line": 0.3899167146556835, "driven_lanedir_consec": 2.3184560110192898, "sim_compute_sim_state": 0.022704193036850184, "sim_compute_performance-ego": 0.003062096360611589}}
set_robot_commands_max0.003779590946354278
set_robot_commands_mean0.003742213453332039
set_robot_commands_median0.003745428323745728
set_robot_commands_min0.003698406219482422
sim_compute_performance-ego_max0.0030625335375467936
sim_compute_performance-ego_mean0.0030594593095997153
sim_compute_performance-ego_median0.0030611796792783695
sim_compute_performance-ego_min0.003052944342295329
sim_compute_sim_state_max0.022704193036850184
sim_compute_sim_state_mean0.020978331228369448
sim_compute_sim_state_median0.02056017835934957
sim_compute_sim_state_min0.020088775157928465
sim_render-ego_max0.004692685114194269
sim_render-ego_mean0.004605436202597945
sim_render-ego_median0.0046094814936319985
sim_render-ego_min0.0045100967089335125
simulation-passed1
step_physics_max0.06789798605931949
step_physics_mean0.06286203033847895
step_physics_median0.06164751052856446
step_physics_min0.06025511423746745
survival_time_max14.950000000000076
survival_time_mean13.037500000000056
survival_time_min7.299999999999982
No reset possible
4363011698Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.277290569345036
survival_time_median11.15000000000003
deviation-center-line_median0.4399785644764295
in-drivable-lane_median3.1000000000000028


other stats
agent_compute-ego_max0.01300759474436442
agent_compute-ego_mean0.01270094733659913
agent_compute-ego_median0.012716232789617008
agent_compute-ego_min0.012363729022798083
complete-iteration_max0.1582130055849244
complete-iteration_mean0.15182584658231324
complete-iteration_median0.1506419324874878
complete-iteration_min0.147806515769353
deviation-center-line_max0.7877650942775812
deviation-center-line_mean0.46698108390946974
deviation-center-line_min0.20020211240743851
deviation-heading_max4.392763555521675
deviation-heading_mean1.9647676488137311
deviation-heading_median1.625628170127177
deviation-heading_min0.21505069947889552
driven_any_max5.570163289622632
driven_any_mean3.499624907312147
driven_any_median3.520162429714505
driven_any_min1.3880114801969476
driven_lanedir_consec_max2.7990655771446833
driven_lanedir_consec_mean2.113366433659406
driven_lanedir_consec_min1.0998190188028687
driven_lanedir_max4.056981416195043
driven_lanedir_mean2.5935025771641587
driven_lanedir_median2.6086049368293613
driven_lanedir_min1.0998190188028687
get_duckie_state_max1.2230873107910156e-06
get_duckie_state_mean1.1527200404748895e-06
get_duckie_state_median1.142354779232657e-06
get_duckie_state_min1.1030832926432292e-06
get_robot_state_max0.010415578375057298
get_robot_state_mean0.010050030396638814
get_robot_state_median0.010026924212773642
get_robot_state_min0.009730694785950676
get_state_dump_max0.0093031205287596
get_state_dump_mean0.008894127726284555
get_state_dump_median0.008841313483223083
get_state_dump_min0.008590763409932454
get_ui_image_max0.02484413177248031
get_ui_image_mean0.024124532600108727
get_ui_image_median0.023935056495017745
get_ui_image_min0.023783885637919108
in-drivable-lane_max4.400000000000019
in-drivable-lane_mean2.8750000000000053
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.3880114801969476, "get_ui_image": 0.02484413177248031, "step_physics": 0.06110875568692646, "survival_time": 3.149999999999997, "driven_lanedir": 1.0998190188028687, "get_state_dump": 0.008795231107681517, "sim_render-ego": 0.004583547985742962, "get_robot_state": 0.009730694785950676, "get_duckie_state": 1.1656019422743056e-06, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.012363729022798083, "deviation-heading": 0.21505069947889552, "complete-iteration": 0.147806515769353, "set_robot_commands": 0.0038438373141818577, "deviation-center-line": 0.20020211240743851, "driven_lanedir_consec": 1.0998190188028687, "sim_compute_sim_state": 0.019346100943429128, "sim_compute_performance-ego": 0.0031023744552854506}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.570163289622632, "get_ui_image": 0.023783885637919108, "step_physics": 0.06485131422678629, "survival_time": 14.950000000000076, "driven_lanedir": 4.056981416195043, "get_state_dump": 0.008590763409932454, "sim_render-ego": 0.0046308247248331704, "get_robot_state": 0.010007884502410889, "get_duckie_state": 1.2230873107910156e-06, "in-drivable-lane": 4.100000000000013, "agent_compute-ego": 0.01300759474436442, "deviation-heading": 4.392763555521675, "complete-iteration": 0.15082415183385214, "set_robot_commands": 0.0037889337539672857, "deviation-center-line": 0.7877650942775812, "driven_lanedir_consec": 2.136436842176032, "sim_compute_sim_state": 0.018986970583597815, "sim_compute_performance-ego": 0.0030878535906473797}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.016605314138296, "get_ui_image": 0.024014271100362142, "step_physics": 0.06316235621770223, "survival_time": 14.950000000000076, "driven_lanedir": 2.7990655771446833, "get_state_dump": 0.008887395858764649, "sim_render-ego": 0.0046194219589233395, "get_robot_state": 0.010045963923136392, "get_duckie_state": 1.1030832926432292e-06, "in-drivable-lane": 4.400000000000019, "agent_compute-ego": 0.012657535870869955, "deviation-heading": 2.5128493691749525, "complete-iteration": 0.15045971314112344, "set_robot_commands": 0.003672150770823161, "deviation-center-line": 0.6384570741639393, "driven_lanedir_consec": 2.7990655771446833, "sim_compute_sim_state": 0.020287734667460124, "sim_compute_performance-ego": 0.0030231300989786783}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0237195452907137, "get_ui_image": 0.02385584188967335, "step_physics": 0.06699615270913052, "survival_time": 7.349999999999982, "driven_lanedir": 2.41814429651404, "get_state_dump": 0.0093031205287596, "sim_render-ego": 0.004544329481060002, "get_robot_state": 0.010415578375057298, "get_duckie_state": 1.1191076161910075e-06, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.01277492970836406, "deviation-heading": 0.7384069710794016, "complete-iteration": 0.1582130055849244, "set_robot_commands": 0.0037356120388524062, "deviation-center-line": 0.2415000547889198, "driven_lanedir_consec": 2.41814429651404, "sim_compute_sim_state": 0.023483083361671084, "sim_compute_performance-ego": 0.0030137049097593138}}
set_robot_commands_max0.0038438373141818577
set_robot_commands_mean0.0037601334694561776
set_robot_commands_median0.0037622728964098458
set_robot_commands_min0.003672150770823161
sim_compute_performance-ego_max0.0031023744552854506
sim_compute_performance-ego_mean0.003056765763667706
sim_compute_performance-ego_median0.003055491844813029
sim_compute_performance-ego_min0.0030137049097593138
sim_compute_sim_state_max0.023483083361671084
sim_compute_sim_state_mean0.02052597238903954
sim_compute_sim_state_median0.019816917805444624
sim_compute_sim_state_min0.018986970583597815
sim_render-ego_max0.0046308247248331704
sim_render-ego_mean0.004594531037639869
sim_render-ego_median0.004601484972333151
sim_render-ego_min0.004544329481060002
simulation-passed1
step_physics_max0.06699615270913052
step_physics_mean0.06402964471013638
step_physics_median0.06400683522224426
step_physics_min0.06110875568692646
survival_time_max14.950000000000076
survival_time_mean10.100000000000032
survival_time_min3.149999999999997
No reset possible
4361411697Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8008739620645833
survival_time_median14.950000000000076
deviation-center-line_median0.7892234142060024
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.015481893221537271
agent_compute-ego_mean0.014076040983200071
agent_compute-ego_median0.014286596775054932
agent_compute-ego_min0.012249077161153156
complete-iteration_max0.18687077442804972
complete-iteration_mean0.16724386950333914
complete-iteration_median0.16770721991856893
complete-iteration_min0.14669026374816896
deviation-center-line_max0.9797736251061544
deviation-center-line_mean0.8343483009949637
deviation-center-line_min0.7791727504616957
deviation-heading_max4.5867165589876295
deviation-heading_mean3.7262845840575096
deviation-heading_median3.5442220834432687
deviation-heading_min3.22997761035587
driven_any_max3.3437092553823424
driven_any_mean3.269001434130813
driven_any_median3.2548935216338135
driven_any_min3.2225094378732817
driven_lanedir_consec_max3.2177447432840527
driven_lanedir_consec_mean2.628801369442408
driven_lanedir_consec_min1.695712810356414
driven_lanedir_max3.2177447432840527
driven_lanedir_mean3.0213368213533074
driven_lanedir_median2.999715476397711
driven_lanedir_min2.868171589333756
get_duckie_state_max1.9526481628417968e-06
get_duckie_state_mean1.8310546875e-06
get_duckie_state_median1.8417835235595704e-06
get_duckie_state_min1.6880035400390623e-06
get_robot_state_max0.011099699338277182
get_robot_state_mean0.010475235978762308
get_robot_state_median0.010569657484690348
get_robot_state_min0.009661929607391356
get_state_dump_max0.00947125514348348
get_state_dump_mean0.008994525869687398
get_state_dump_median0.008997939030329387
get_state_dump_min0.00851097027460734
get_ui_image_max0.0299983016649882
get_ui_image_mean0.027907122174898782
get_ui_image_median0.02869522213935852
get_ui_image_min0.024239742755889897
in-drivable-lane_max1.9500000000000224
in-drivable-lane_mean0.662500000000005
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.284283502666172, "get_ui_image": 0.028394046624501547, "step_physics": 0.07085019588470459, "survival_time": 14.950000000000076, "driven_lanedir": 3.130781533182461, "get_state_dump": 0.009223554929097494, "sim_render-ego": 0.005264531771341959, "get_robot_state": 0.010825072129567464, "get_duckie_state": 1.9526481628417968e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014544522762298584, "deviation-heading": 3.6224429855013, "complete-iteration": 0.1689309549331665, "set_robot_commands": 0.004496475060780843, "deviation-center-line": 0.7791727504616957, "driven_lanedir_consec": 3.130781533182461, "sim_compute_sim_state": 0.021810975074768067, "sim_compute_performance-ego": 0.003421475092569987}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.3437092553823424, "get_ui_image": 0.024239742755889897, "step_physics": 0.06148022174835205, "survival_time": 14.950000000000076, "driven_lanedir": 3.2177447432840527, "get_state_dump": 0.00851097027460734, "sim_render-ego": 0.0046150024731953935, "get_robot_state": 0.009661929607391356, "get_duckie_state": 1.6880035400390623e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012249077161153156, "deviation-heading": 3.466001181385237, "complete-iteration": 0.14669026374816896, "set_robot_commands": 0.0038552093505859375, "deviation-center-line": 0.7859382325366945, "driven_lanedir_consec": 3.2177447432840527, "sim_compute_sim_state": 0.01891305923461914, "sim_compute_performance-ego": 0.00307480255762736}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2225094378732817, "get_ui_image": 0.028996397654215494, "step_physics": 0.07232414801915486, "survival_time": 14.950000000000076, "driven_lanedir": 2.868171589333756, "get_state_dump": 0.00877232313156128, "sim_render-ego": 0.005152285099029541, "get_robot_state": 0.010314242839813232, "get_duckie_state": 1.7619132995605468e-06, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.01402867078781128, "deviation-heading": 4.5867165589876295, "complete-iteration": 0.16648348490397136, "set_robot_commands": 0.004311737219492595, "deviation-center-line": 0.9797736251061544, "driven_lanedir_consec": 1.695712810356414, "sim_compute_sim_state": 0.01913188775380453, "sim_compute_performance-ego": 0.0033531800905863443}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.2255035406014545, "get_ui_image": 0.0299983016649882, "step_physics": 0.08189064900080363, "survival_time": 14.950000000000076, "driven_lanedir": 2.8686494196129613, "get_state_dump": 0.00947125514348348, "sim_render-ego": 0.005370623270670573, "get_robot_state": 0.011099699338277182, "get_duckie_state": 1.921653747558594e-06, "in-drivable-lane": 1.9500000000000224, "agent_compute-ego": 0.015481893221537271, "deviation-heading": 3.22997761035587, "complete-iteration": 0.18687077442804972, "set_robot_commands": 0.004672654469807943, "deviation-center-line": 0.7925085958753104, "driven_lanedir_consec": 2.4709663909467054, "sim_compute_sim_state": 0.025268609523773192, "sim_compute_performance-ego": 0.0035105109214782714}}
set_robot_commands_max0.004672654469807943
set_robot_commands_mean0.00433401902516683
set_robot_commands_median0.004404106140136719
set_robot_commands_min0.0038552093505859375
sim_compute_performance-ego_max0.0035105109214782714
sim_compute_performance-ego_mean0.003339992165565491
sim_compute_performance-ego_median0.0033873275915781657
sim_compute_performance-ego_min0.00307480255762736
sim_compute_sim_state_max0.025268609523773192
sim_compute_sim_state_mean0.02128113289674123
sim_compute_sim_state_median0.020471431414286295
sim_compute_sim_state_min0.01891305923461914
sim_render-ego_max0.005370623270670573
sim_render-ego_mean0.0051006106535593666
sim_render-ego_median0.00520840843518575
sim_render-ego_min0.0046150024731953935
simulation-passed1
step_physics_max0.08189064900080363
step_physics_mean0.07163630366325378
step_physics_median0.07158717195192973
step_physics_min0.06148022174835205
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4358911695Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simerrornoreg02-b35ee35771a7-10:06:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4358311694Mo KleitΒ πŸ‡¨πŸ‡¦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7693183913327015
survival_time_median14.950000000000076
deviation-center-line_median0.8212026000125983
in-drivable-lane_median2.3500000000000285


other stats
agent_compute-ego_max0.016161784331003824
agent_compute-ego_mean0.014709396759668984
agent_compute-ego_median0.014795681238174438
agent_compute-ego_min0.013084440231323245
complete-iteration_max0.1868417731920878
complete-iteration_mean0.17709112842877706
complete-iteration_median0.17706583937009177
complete-iteration_min0.16739106178283691
deviation-center-line_max1.06354374177562
deviation-center-line_mean0.7085575099108516
deviation-center-line_min0.12828109784259015
deviation-heading_max3.614612561640631
deviation-heading_mean2.4141253724779106
deviation-heading_median2.8162033178758437
deviation-heading_min0.40948229251932267
driven_any_max3.879710080308396
driven_any_mean3.8764101844381575
driven_any_median3.8794384880206834
driven_any_min3.8670536814028673
driven_lanedir_consec_max3.3198352476941806
driven_lanedir_consec_mean2.3518699520753317
driven_lanedir_consec_min0.5490077779417427
driven_lanedir_max3.3198352476941806
driven_lanedir_mean2.498564984200375
driven_lanedir_median3.0627084555827895
driven_lanedir_min0.5490077779417427
get_duckie_state_max2.063910166422526e-06
get_duckie_state_mean1.9598007202148435e-06
get_duckie_state_median1.963376998901367e-06
get_duckie_state_min1.8485387166341145e-06
get_robot_state_max0.011195764541625975
get_robot_state_mean0.01098298132419586
get_robot_state_median0.01105011820793152
get_robot_state_min0.010635924339294434
get_state_dump_max0.009388563632965087
get_state_dump_mean0.009302220145861307
get_state_dump_median0.00932625651359558
get_state_dump_min0.00916780392328898
get_ui_image_max0.031128353277842205
get_ui_image_mean0.0294858584801356
get_ui_image_median0.030181275208791096
get_ui_image_min0.026452530225118003
in-drivable-lane_max12.450000000000076
in-drivable-lane_mean4.712500000000036
in-drivable-lane_min1.7000000000000082
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8670536814028673, "get_ui_image": 0.031128353277842205, "step_physics": 0.07589736461639404, "survival_time": 14.950000000000076, "driven_lanedir": 3.3198352476941806, "get_state_dump": 0.009388563632965087, "sim_render-ego": 0.005359761714935303, "get_robot_state": 0.010952786604563397, "get_duckie_state": 1.978874206542969e-06, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.014692842165629069, "deviation-heading": 2.2904873876666594, "complete-iteration": 0.17784845511118572, "set_robot_commands": 0.004476542472839355, "deviation-center-line": 0.6780162669778336, "driven_lanedir_consec": 3.3198352476941806, "sim_compute_sim_state": 0.022303249835968018, "sim_compute_performance-ego": 0.00355169932047526}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879710080308396, "get_ui_image": 0.03004410187403361, "step_physics": 0.07531730095545451, "survival_time": 14.950000000000076, "driven_lanedir": 3.2746684506586687, "get_state_dump": 0.00932892084121704, "sim_render-ego": 0.005290758609771728, "get_robot_state": 0.011147449811299642, "get_duckie_state": 2.063910166422526e-06, "in-drivable-lane": 1.7000000000000082, "agent_compute-ego": 0.014898520310719808, "deviation-heading": 3.341919248085028, "complete-iteration": 0.1762832236289978, "set_robot_commands": 0.0045108588536580405, "deviation-center-line": 0.964388933047363, "driven_lanedir_consec": 3.2746684506586687, "sim_compute_sim_state": 0.02214207410812378, "sim_compute_performance-ego": 0.003501572608947754}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879314741421974, "get_ui_image": 0.030318448543548582, "step_physics": 0.08344249407450358, "survival_time": 14.950000000000076, "driven_lanedir": 0.5490077779417427, "get_state_dump": 0.009323592185974122, "sim_render-ego": 0.005435748100280762, "get_robot_state": 0.011195764541625975, "get_duckie_state": 1.9478797912597656e-06, "in-drivable-lane": 12.450000000000076, "agent_compute-ego": 0.016161784331003824, "deviation-heading": 0.40948229251932267, "complete-iteration": 0.1868417731920878, "set_robot_commands": 0.004844258626302084, "deviation-center-line": 0.12828109784259015, "driven_lanedir_consec": 0.5490077779417427, "sim_compute_sim_state": 0.022457189559936523, "sim_compute_performance-ego": 0.003560792605082194}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.8795622346193928, "get_ui_image": 0.026452530225118003, "step_physics": 0.07188398758570354, "survival_time": 14.950000000000076, "driven_lanedir": 2.85074846050691, "get_state_dump": 0.00916780392328898, "sim_render-ego": 0.004879717032114665, "get_robot_state": 0.010635924339294434, "get_duckie_state": 1.8485387166341145e-06, "in-drivable-lane": 3.000000000000033, "agent_compute-ego": 0.013084440231323245, "deviation-heading": 3.614612561640631, "complete-iteration": 0.16739106178283691, "set_robot_commands": 0.004169743061065673, "deviation-center-line": 1.06354374177562, "driven_lanedir_consec": 2.2639683320067348, "sim_compute_sim_state": 0.023820691108703617, "sim_compute_performance-ego": 0.003203430970509847}}
set_robot_commands_max0.004844258626302084
set_robot_commands_mean0.004500350753466288
set_robot_commands_median0.004493700663248698
set_robot_commands_min0.004169743061065673
sim_compute_performance-ego_max0.003560792605082194
sim_compute_performance-ego_mean0.003454373876253764
sim_compute_performance-ego_median0.003526635964711507
sim_compute_performance-ego_min0.003203430970509847
sim_compute_sim_state_max0.023820691108703617
sim_compute_sim_state_mean0.02268080115318298
sim_compute_sim_state_median0.022380219697952272
sim_compute_sim_state_min0.02214207410812378
sim_render-ego_max0.005435748100280762
sim_render-ego_mean0.005241496364275615
sim_render-ego_median0.005325260162353516
sim_render-ego_min0.004879717032114665
simulation-passed1
step_physics_max0.08344249407450358
step_physics_mean0.07663528680801392
step_physics_median0.07560733278592427
step_physics_min0.07188398758570354
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4355311690Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3554629688046704
survival_time_median14.950000000000076
deviation-center-line_median0.7590693545442377
in-drivable-lane_median1.2750000000000172


other stats
agent_compute-ego_max0.01542778491973877
agent_compute-ego_mean0.014250506361325582
agent_compute-ego_median0.014284197489420572
agent_compute-ego_min0.013005845546722412
complete-iteration_max0.18531377792358397
complete-iteration_mean0.16649632394313812
complete-iteration_median0.16445004105567934
complete-iteration_min0.15177143573760987
deviation-center-line_max1.020819938709806
deviation-center-line_mean0.8035832180834092
deviation-center-line_min0.6753742245353554
deviation-heading_max4.198982366713639
deviation-heading_mean3.72883894507245
deviation-heading_median3.736512373784135
deviation-heading_min3.2433486660078903
driven_any_max3.062980804572643
driven_any_mean3.0604059459128026
driven_any_median3.062879308979877
driven_any_min3.052884361118813
driven_lanedir_consec_max2.719424145733303
driven_lanedir_consec_mean2.381677095724552
driven_lanedir_consec_min2.0963582995555647
driven_lanedir_max2.719424145733303
driven_lanedir_mean2.531548270537989
driven_lanedir_median2.608990033557481
driven_lanedir_min2.1887888693036905
get_duckie_state_max1.5242894490559896e-06
get_duckie_state_mean1.3571977615356445e-06
get_duckie_state_median1.3776620229085286e-06
get_duckie_state_min1.1491775512695311e-06
get_robot_state_max0.011550208727518718
get_robot_state_mean0.010872816840807596
get_robot_state_median0.010969141324361165
get_robot_state_min0.01000277598698934
get_state_dump_max0.009722569783528643
get_state_dump_mean0.00933326204617818
get_state_dump_median0.009518203337987264
get_state_dump_min0.008574071725209555
get_ui_image_max0.02991340716679891
get_ui_image_mean0.02685124158859253
get_ui_image_median0.02655332088470459
get_ui_image_min0.02438491741816203
in-drivable-lane_max3.1500000000000172
in-drivable-lane_mean1.650000000000016
in-drivable-lane_min0.9000000000000128
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.052884361118813, "get_ui_image": 0.027610545953114827, "step_physics": 0.07105069160461426, "survival_time": 14.950000000000076, "driven_lanedir": 2.5221370683056508, "get_state_dump": 0.009722569783528643, "sim_render-ego": 0.005387888749440511, "get_robot_state": 0.011550208727518718, "get_duckie_state": 1.5242894490559896e-06, "in-drivable-lane": 1.5000000000000195, "agent_compute-ego": 0.01542778491973877, "deviation-heading": 4.198982366713639, "complete-iteration": 0.17114312648773194, "set_robot_commands": 0.004540677070617676, "deviation-center-line": 0.74091590571216, "driven_lanedir_consec": 2.5221370683056508, "sim_compute_sim_state": 0.02221152067184448, "sim_compute_performance-ego": 0.0035306549072265624}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.062980804572643, "get_ui_image": 0.02438491741816203, "step_physics": 0.0625229835510254, "survival_time": 14.950000000000076, "driven_lanedir": 2.719424145733303, "get_state_dump": 0.009654885133107504, "sim_render-ego": 0.0046905763943990075, "get_robot_state": 0.010819018681844076, "get_duckie_state": 1.3264020284016927e-06, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.013005845546722412, "deviation-heading": 3.2433486660078903, "complete-iteration": 0.15177143573760987, "set_robot_commands": 0.003753840923309326, "deviation-center-line": 0.6753742245353554, "driven_lanedir_consec": 2.719424145733303, "sim_compute_sim_state": 0.019759926001230877, "sim_compute_performance-ego": 0.003081648349761963}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0628394261280003, "get_ui_image": 0.02549609581629435, "step_physics": 0.06683267752329508, "survival_time": 14.950000000000076, "driven_lanedir": 2.1887888693036905, "get_state_dump": 0.008574071725209555, "sim_render-ego": 0.004833815097808838, "get_robot_state": 0.01000277598698934, "get_duckie_state": 1.1491775512695311e-06, "in-drivable-lane": 3.1500000000000172, "agent_compute-ego": 0.013326168060302734, "deviation-heading": 4.024718019913521, "complete-iteration": 0.1577569556236267, "set_robot_commands": 0.003935409386952718, "deviation-center-line": 1.020819938709806, "driven_lanedir_consec": 2.1887888693036905, "sim_compute_sim_state": 0.02141876538594564, "sim_compute_performance-ego": 0.003239555358886719}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.062919191831754, "get_ui_image": 0.02991340716679891, "step_physics": 0.08077334562937419, "survival_time": 14.950000000000076, "driven_lanedir": 2.6958429988093116, "get_state_dump": 0.009381521542867024, "sim_render-ego": 0.00526519775390625, "get_robot_state": 0.011119263966878255, "get_duckie_state": 1.4289220174153643e-06, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.015242226918538411, "deviation-heading": 3.4483067276547494, "complete-iteration": 0.18531377792358397, "set_robot_commands": 0.004651796817779541, "deviation-center-line": 0.7772228033763154, "driven_lanedir_consec": 2.0963582995555647, "sim_compute_sim_state": 0.02529794772466024, "sim_compute_performance-ego": 0.003557710647583008}}
set_robot_commands_max0.004651796817779541
set_robot_commands_mean0.004220431049664815
set_robot_commands_median0.004238043228785197
set_robot_commands_min0.003753840923309326
sim_compute_performance-ego_max0.003557710647583008
sim_compute_performance-ego_mean0.0033523923158645633
sim_compute_performance-ego_median0.0033851051330566406
sim_compute_performance-ego_min0.003081648349761963
sim_compute_sim_state_max0.02529794772466024
sim_compute_sim_state_mean0.02217203994592031
sim_compute_sim_state_median0.021815143028895066
sim_compute_sim_state_min0.019759926001230877
sim_render-ego_max0.005387888749440511
sim_render-ego_mean0.005044369498888652
sim_render-ego_median0.005049506425857544
sim_render-ego_min0.0046905763943990075
simulation-passed1
step_physics_max0.08077334562937419
step_physics_mean0.07029492457707723
step_physics_median0.06894168456395466
step_physics_min0.0625229835510254
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4352811688Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8657925064580572
survival_time_median14.950000000000076
deviation-center-line_median0.2973016901905795
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01507444143295288
agent_compute-ego_mean0.01318083961804708
agent_compute-ego_median0.01260389804840088
agent_compute-ego_min0.012441120942433674
complete-iteration_max0.17996381521224974
complete-iteration_mean0.15550735354423523
complete-iteration_median0.14835132559140524
complete-iteration_min0.1453629477818807
deviation-center-line_max0.7770755584443305
deviation-center-line_mean0.38970743324018503
deviation-center-line_min0.18715079413525065
deviation-heading_max3.663768461671723
deviation-heading_mean2.5980467445893565
deviation-heading_median2.8195154247397975
deviation-heading_min1.0893876672061076
driven_any_max1.939907313278023
driven_any_mean1.9364765121857677
driven_any_median1.939700375320101
driven_any_min1.9265979848248465
driven_lanedir_consec_max1.8931907008295017
driven_lanedir_consec_mean1.5200401368314722
driven_lanedir_consec_min0.4553848335802726
driven_lanedir_max1.8931907008295017
driven_lanedir_mean1.5200401368314722
driven_lanedir_median1.8657925064580572
driven_lanedir_min0.4553848335802726
get_duckie_state_max1.3796488444010418e-06
get_duckie_state_mean1.192291577657064e-06
get_duckie_state_median1.1603037516276045e-06
get_duckie_state_min1.0689099629720052e-06
get_robot_state_max0.010543262958526612
get_robot_state_mean0.010102403362592062
get_robot_state_median0.010159337123235064
get_robot_state_min0.0095476762453715
get_state_dump_max0.008945128122965496
get_state_dump_mean0.008718152840932209
get_state_dump_median0.00882958173751831
get_state_dump_min0.008268319765726725
get_ui_image_max0.029577120939890542
get_ui_image_mean0.02537171224753062
get_ui_image_median0.024112737973531088
get_ui_image_min0.02368425210316976
in-drivable-lane_max10.800000000000084
in-drivable-lane_mean2.700000000000021
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9265979848248465, "get_ui_image": 0.02368425210316976, "step_physics": 0.06089983145395915, "survival_time": 14.950000000000076, "driven_lanedir": 1.841529972117372, "get_state_dump": 0.008268319765726725, "sim_render-ego": 0.0045271778106689455, "get_robot_state": 0.0095476762453715, "get_duckie_state": 1.0689099629720052e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012474618752797444, "deviation-heading": 3.663768461671723, "complete-iteration": 0.1453629477818807, "set_robot_commands": 0.003646875222524007, "deviation-center-line": 0.7770755584443305, "driven_lanedir_consec": 1.841529972117372, "sim_compute_sim_state": 0.01921190897623698, "sim_compute_performance-ego": 0.003019452889760335}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9398948185123008, "get_ui_image": 0.024124048550923663, "step_physics": 0.06041432460149129, "survival_time": 14.950000000000076, "driven_lanedir": 1.8931907008295017, "get_state_dump": 0.008945128122965496, "sim_render-ego": 0.004559681415557861, "get_robot_state": 0.010132710138956703, "get_duckie_state": 1.1698404947916666e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012733177344004311, "deviation-heading": 2.9057067694580385, "complete-iteration": 0.1468404229482015, "set_robot_commands": 0.003682392438252767, "deviation-center-line": 0.2533953459422596, "driven_lanedir_consec": 1.8931907008295017, "sim_compute_sim_state": 0.019103098710378012, "sim_compute_performance-ego": 0.003062116305033366}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9395059321279011, "get_ui_image": 0.02410142739613851, "step_physics": 0.06363530953725179, "survival_time": 14.950000000000076, "driven_lanedir": 0.4553848335802726, "get_state_dump": 0.00874250332514445, "sim_render-ego": 0.0046343127886454265, "get_robot_state": 0.010185964107513427, "get_duckie_state": 1.1507670084635418e-06, "in-drivable-lane": 10.800000000000084, "agent_compute-ego": 0.012441120942433674, "deviation-heading": 1.0893876672061076, "complete-iteration": 0.14986222823460896, "set_robot_commands": 0.003660301367441813, "deviation-center-line": 0.18715079413525065, "driven_lanedir_consec": 0.4553848335802726, "sim_compute_sim_state": 0.019332261085510255, "sim_compute_performance-ego": 0.003043156464894613}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939907313278023, "get_ui_image": 0.029577120939890542, "step_physics": 0.07826573451360067, "survival_time": 14.950000000000076, "driven_lanedir": 1.8900550407987424, "get_state_dump": 0.008916660149892171, "sim_render-ego": 0.005322705109914144, "get_robot_state": 0.010543262958526612, "get_duckie_state": 1.3796488444010418e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01507444143295288, "deviation-heading": 2.7333240800215566, "complete-iteration": 0.17996381521224974, "set_robot_commands": 0.004556616942087809, "deviation-center-line": 0.34120803443889947, "driven_lanedir_consec": 1.8900550407987424, "sim_compute_sim_state": 0.024127965768178303, "sim_compute_performance-ego": 0.003481634457906087}}
set_robot_commands_max0.004556616942087809
set_robot_commands_mean0.0038865464925765983
set_robot_commands_median0.00367134690284729
set_robot_commands_min0.003646875222524007
sim_compute_performance-ego_max0.003481634457906087
sim_compute_performance-ego_mean0.0031515900293986004
sim_compute_performance-ego_median0.0030526363849639896
sim_compute_performance-ego_min0.003019452889760335
sim_compute_sim_state_max0.024127965768178303
sim_compute_sim_state_mean0.02044380863507589
sim_compute_sim_state_median0.019272085030873617
sim_compute_sim_state_min0.019103098710378012
sim_render-ego_max0.005322705109914144
sim_render-ego_mean0.004760969281196594
sim_render-ego_median0.004596997102101643
sim_render-ego_min0.0045271778106689455
simulation-passed1
step_physics_max0.07826573451360067
step_physics_mean0.06580380002657572
step_physics_median0.06226757049560547
step_physics_min0.06041432460149129
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4350311683Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simabortednoreg02-b35ee35771a7-10:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.835286865553166
survival_time_median14.950000000000076
deviation-center-line_median0.7159694620536206
in-drivable-lane_median1.8500000000000263


other stats
agent_compute-ego_max0.015127819379170735
agent_compute-ego_mean0.012969422539075216
agent_compute-ego_median0.012336612542470296
agent_compute-ego_min0.012076645692189535
complete-iteration_max0.1828064521153768
complete-iteration_mean0.15700931211312613
complete-iteration_median0.14926709095637003
complete-iteration_min0.1466966144243876
deviation-center-line_max0.8844499703761287
deviation-center-line_mean0.7330165429057097
deviation-center-line_min0.615677277139469
deviation-heading_max4.222474598328801
deviation-heading_mean3.452833192341985
deviation-heading_median3.4079597090485345
deviation-heading_min2.7729387529420713
driven_any_max3.5347475214317745
driven_any_mean3.1500850809759187
driven_any_median3.25302442647278
driven_any_min2.5595439495263403
driven_lanedir_consec_max3.462901182174326
driven_lanedir_consec_mean2.763857791131174
driven_lanedir_consec_min1.9219562512440391
driven_lanedir_max3.462901182174326
driven_lanedir_mean2.7950632076894566
driven_lanedir_median2.8976976986697305
driven_lanedir_min1.9219562512440391
get_duckie_state_max1.8191337585449216e-06
get_duckie_state_mean1.5099843343098958e-06
get_duckie_state_median1.4277299245198568e-06
get_duckie_state_min1.365343729654948e-06
get_robot_state_max0.01054498036702474
get_robot_state_mean0.01014194945494334
get_robot_state_median0.0101529328028361
get_robot_state_min0.009716951847076416
get_state_dump_max0.008895068963368735
get_state_dump_mean0.008819604913393658
get_state_dump_median0.008829317887624106
get_state_dump_min0.008724714914957682
get_ui_image_max0.02937549591064453
get_ui_image_mean0.025291056235631305
get_ui_image_median0.0240324862798055
get_ui_image_min0.023723756472269698
in-drivable-lane_max2.950000000000042
in-drivable-lane_mean1.6625000000000236
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.335308027704863, "get_ui_image": 0.0238716451327006, "step_physics": 0.06124903519948323, "survival_time": 14.950000000000076, "driven_lanedir": 3.156162211146137, "get_state_dump": 0.008790436585744223, "sim_render-ego": 0.004512745539347331, "get_robot_state": 0.009716951847076416, "get_duckie_state": 1.365343729654948e-06, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.012076645692189535, "deviation-heading": 3.2803753044745525, "complete-iteration": 0.1466966144243876, "set_robot_commands": 0.0037365301450093583, "deviation-center-line": 0.8019838696426047, "driven_lanedir_consec": 3.156162211146137, "sim_compute_sim_state": 0.01962167421976725, "sim_compute_performance-ego": 0.003038335641225179}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5347475214317745, "get_ui_image": 0.023723756472269698, "step_physics": 0.061768974463144936, "survival_time": 14.950000000000076, "driven_lanedir": 3.462901182174326, "get_state_dump": 0.008868199189503987, "sim_render-ego": 0.004724431832631429, "get_robot_state": 0.010285038948059082, "get_duckie_state": 1.4495849609375e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01220095952351888, "deviation-heading": 2.7729387529420713, "complete-iteration": 0.1482794507344564, "set_robot_commands": 0.003759357134501139, "deviation-center-line": 0.615677277139469, "driven_lanedir_consec": 3.462901182174326, "sim_compute_sim_state": 0.019816351731618245, "sim_compute_performance-ego": 0.0030472660064697265}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5595439495263403, "get_ui_image": 0.0241933274269104, "step_physics": 0.06288503249486288, "survival_time": 14.950000000000076, "driven_lanedir": 1.9219562512440391, "get_state_dump": 0.008724714914957682, "sim_render-ego": 0.004733209609985352, "get_robot_state": 0.01002082665761312, "get_duckie_state": 1.4058748881022135e-06, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.012472265561421713, "deviation-heading": 4.222474598328801, "complete-iteration": 0.1502547311782837, "set_robot_commands": 0.003761333624521891, "deviation-center-line": 0.6299550544646364, "driven_lanedir_consec": 1.9219562512440391, "sim_compute_sim_state": 0.020281565189361573, "sim_compute_performance-ego": 0.003096740245819092}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1707408252406974, "get_ui_image": 0.02937549591064453, "step_physics": 0.08107102473576863, "survival_time": 14.950000000000076, "driven_lanedir": 2.639233186193324, "get_state_dump": 0.008895068963368735, "sim_render-ego": 0.005330287615458171, "get_robot_state": 0.01054498036702474, "get_duckie_state": 1.8191337585449216e-06, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.015127819379170735, "deviation-heading": 3.535544113622516, "complete-iteration": 0.1828064521153768, "set_robot_commands": 0.004725776513417562, "deviation-center-line": 0.8844499703761287, "driven_lanedir_consec": 2.514411519960195, "sim_compute_sim_state": 0.02419744888941447, "sim_compute_performance-ego": 0.003437157471974691}}
set_robot_commands_max0.004725776513417562
set_robot_commands_mean0.003995749354362488
set_robot_commands_median0.003760345379511515
set_robot_commands_min0.0037365301450093583
sim_compute_performance-ego_max0.003437157471974691
sim_compute_performance-ego_mean0.003154874841372172
sim_compute_performance-ego_median0.0030720031261444094
sim_compute_performance-ego_min0.003038335641225179
sim_compute_sim_state_max0.02419744888941447
sim_compute_sim_state_mean0.020979260007540385
sim_compute_sim_state_median0.02004895846048991
sim_compute_sim_state_min0.01962167421976725
sim_render-ego_max0.005330287615458171
sim_render-ego_mean0.0048251686493555705
sim_render-ego_median0.0047288207213083905
sim_render-ego_min0.004512745539347331
simulation-passed1
step_physics_max0.08107102473576863
step_physics_mean0.06674351672331491
step_physics_median0.06232700347900391
step_physics_min0.06124903519948323
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4348011680Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012148523330688476
agent_compute-ego_mean0.011629478335380555
agent_compute-ego_median0.011532362699508669
agent_compute-ego_min0.011304664611816406
complete-iteration_max0.15401382128397623
complete-iteration_mean0.14464082638422648
complete-iteration_median0.14196049451828002
complete-iteration_min0.14062849521636964
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.2159347534179689e-06
get_duckie_state_mean1.163482666015625e-06
get_duckie_state_median1.165469487508138e-06
get_duckie_state_min1.1070569356282553e-06
get_robot_state_max0.01020552396774292
get_robot_state_mean0.009839171171188354
get_robot_state_median0.009835835695266724
get_robot_state_min0.009479489326477053
get_state_dump_max0.008958489100138346
get_state_dump_mean0.008622137109438578
get_state_dump_median0.008672033548355104
get_state_dump_min0.008185992240905762
get_ui_image_max0.024174216588338217
get_ui_image_mean0.02388455152511597
get_ui_image_median0.023938818375269573
get_ui_image_min0.023486352761586508
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.02395417054494222, "step_physics": 0.057931014696756995, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.008185992240905762, "sim_render-ego": 0.004607375462849935, "get_robot_state": 0.009479489326477053, "get_duckie_state": 1.1070569356282553e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011702618598937987, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.14062849521636964, "set_robot_commands": 0.003576813538869222, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.018057308197021484, "sim_compute_performance-ego": 0.0030469179153442385}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.023486352761586508, "step_physics": 0.05812331040700277, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.008958489100138346, "sim_render-ego": 0.004614036083221435, "get_robot_state": 0.01020552396774292, "get_duckie_state": 1.167456309000651e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012148523330688476, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.1420492704709371, "set_robot_commands": 0.003684861660003662, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01769572337468465, "sim_compute_performance-ego": 0.003041730721791585}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.02392346620559692, "step_physics": 0.05969398021697998, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.008432785669962565, "sim_render-ego": 0.0045703617731730145, "get_robot_state": 0.00954272985458374, "get_duckie_state": 1.2159347534179689e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011362106800079343, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.14187171856562297, "set_robot_commands": 0.003591736157735189, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.017659542560577394, "sim_compute_performance-ego": 0.0030053885777791343}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.024174216588338217, "step_physics": 0.06733378966649374, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.00891128142674764, "sim_render-ego": 0.004485156536102295, "get_robot_state": 0.010128941535949707, "get_duckie_state": 1.163482666015625e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011304664611816406, "deviation-heading": 0.486072248607516, "complete-iteration": 0.15401382128397623, "set_robot_commands": 0.0036420710881551106, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02095881621042887, "sim_compute_performance-ego": 0.0029815006256103515}}
set_robot_commands_max0.003684861660003662
set_robot_commands_mean0.003623870611190796
set_robot_commands_median0.0036169036229451498
set_robot_commands_min0.003576813538869222
sim_compute_performance-ego_max0.0030469179153442385
sim_compute_performance-ego_mean0.0030188844601313275
sim_compute_performance-ego_median0.0030235596497853595
sim_compute_performance-ego_min0.0029815006256103515
sim_compute_sim_state_max0.02095881621042887
sim_compute_sim_state_mean0.0185928475856781
sim_compute_sim_state_median0.017876515785853066
sim_compute_sim_state_min0.017659542560577394
sim_render-ego_max0.004614036083221435
sim_render-ego_mean0.00456923246383667
sim_render-ego_median0.004588868618011475
sim_render-ego_min0.004485156536102295
simulation-passed1
step_physics_max0.06733378966649374
step_physics_mean0.06077052374680837
step_physics_median0.05890864531199137
step_physics_min0.057931014696756995
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4347511679Yishu MalhotraΒ πŸ‡¨πŸ‡¦real-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5340010566833637
survival_time_median14.950000000000076
deviation-center-line_median0.7415041817499685
in-drivable-lane_median0.6000000000000085


other stats
agent_compute-ego_max0.012959330081939698
agent_compute-ego_mean0.0126418536901474
agent_compute-ego_median0.012582480907440186
agent_compute-ego_min0.01244312286376953
complete-iteration_max0.1573460284868876
complete-iteration_mean0.15249298691749572
complete-iteration_median0.15236645817756653
complete-iteration_min0.14789300282796225
deviation-center-line_max0.904335473393124
deviation-center-line_mean0.7003061357517795
deviation-center-line_min0.4138807061140571
deviation-heading_max4.6181552286311245
deviation-heading_mean4.01269968855636
deviation-heading_median4.2759337008854725
deviation-heading_min2.880776123823366
driven_any_max2.9174491016048067
driven_any_mean2.792864768290001
driven_any_median2.8587024700558925
driven_any_min2.536605031443414
driven_lanedir_consec_max2.7760679120798843
driven_lanedir_consec_mean2.271557996245324
driven_lanedir_consec_min1.242161959534686
driven_lanedir_max2.7760679120798843
driven_lanedir_mean2.288965099032387
driven_lanedir_median2.56881526225749
driven_lanedir_min1.242161959534686
get_duckie_state_max1.250902811686198e-06
get_duckie_state_mean1.2216965357462565e-06
get_duckie_state_median1.231829325358073e-06
get_duckie_state_min1.1722246805826824e-06
get_robot_state_max0.010541188716888429
get_robot_state_mean0.010108054280281067
get_robot_state_median0.010010461409886678
get_robot_state_min0.009870105584462484
get_state_dump_max0.009161640803019204
get_state_dump_mean0.008862583637237548
get_state_dump_median0.008811795711517334
get_state_dump_min0.008665102322896322
get_ui_image_max0.02430024782816569
get_ui_image_mean0.02416899462540944
get_ui_image_median0.024153868754704794
get_ui_image_min0.0240679931640625
in-drivable-lane_max6.850000000000097
in-drivable-lane_mean2.0125000000000286
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.8376748972311505, "get_ui_image": 0.02430024782816569, "step_physics": 0.06169913609822591, "survival_time": 14.950000000000076, "driven_lanedir": 2.63821930642676, "get_state_dump": 0.008665102322896322, "sim_render-ego": 0.004555119673411052, "get_robot_state": 0.009870105584462484, "get_duckie_state": 1.1722246805826824e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01244312286376953, "deviation-heading": 4.6181552286311245, "complete-iteration": 0.14789300282796225, "set_robot_commands": 0.003713615735371907, "deviation-center-line": 0.904335473393124, "driven_lanedir_consec": 2.63821930642676, "sim_compute_sim_state": 0.019519462585449215, "sim_compute_performance-ego": 0.0030429871877034505}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9174491016048067, "get_ui_image": 0.0240679931640625, "step_physics": 0.06186047712961833, "survival_time": 14.950000000000076, "driven_lanedir": 2.7760679120798843, "get_state_dump": 0.008861010074615478, "sim_render-ego": 0.004561231931050618, "get_robot_state": 0.009953959782918296, "get_duckie_state": 1.216729482014974e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012677929401397704, "deviation-heading": 3.97091053063827, "complete-iteration": 0.14842255194981893, "set_robot_commands": 0.00372862974802653, "deviation-center-line": 0.7137488233496114, "driven_lanedir_consec": 2.7760679120798843, "sim_compute_sim_state": 0.019608712991078695, "sim_compute_performance-ego": 0.0030182711283365886}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.536605031443414, "get_ui_image": 0.02410684823989868, "step_physics": 0.06887586434682211, "survival_time": 14.950000000000076, "driven_lanedir": 1.242161959534686, "get_state_dump": 0.009161640803019204, "sim_render-ego": 0.004661167462666829, "get_robot_state": 0.010541188716888429, "get_duckie_state": 1.250902811686198e-06, "in-drivable-lane": 6.850000000000097, "agent_compute-ego": 0.012959330081939698, "deviation-heading": 2.880776123823366, "complete-iteration": 0.1573460284868876, "set_robot_commands": 0.003787821928660075, "deviation-center-line": 0.4138807061140571, "driven_lanedir_consec": 1.242161959534686, "sim_compute_sim_state": 0.02011239290237427, "sim_compute_performance-ego": 0.003052354653676351}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8797300428806345, "get_ui_image": 0.024200889269510903, "step_physics": 0.0662274448076884, "survival_time": 14.950000000000076, "driven_lanedir": 2.499411218088219, "get_state_dump": 0.00876258134841919, "sim_render-ego": 0.004516234397888183, "get_robot_state": 0.010066963036855062, "get_duckie_state": 1.246929168701172e-06, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.012487032413482669, "deviation-heading": 4.580956871132676, "complete-iteration": 0.15631036440531412, "set_robot_commands": 0.0037418619791666666, "deviation-center-line": 0.7692595401503255, "driven_lanedir_consec": 2.429782806939967, "sim_compute_sim_state": 0.023224037488301597, "sim_compute_performance-ego": 0.0029978338877360024}}
set_robot_commands_max0.003787821928660075
set_robot_commands_mean0.0037429823478062943
set_robot_commands_median0.003735245863596598
set_robot_commands_min0.003713615735371907
sim_compute_performance-ego_max0.003052354653676351
sim_compute_performance-ego_mean0.0030278617143630984
sim_compute_performance-ego_median0.00303062915802002
sim_compute_performance-ego_min0.0029978338877360024
sim_compute_sim_state_max0.023224037488301597
sim_compute_sim_state_mean0.020616151491800943
sim_compute_sim_state_median0.01986055294672648
sim_compute_sim_state_min0.019519462585449215
sim_render-ego_max0.004661167462666829
sim_render-ego_mean0.00457343836625417
sim_render-ego_median0.004558175802230835
sim_render-ego_min0.004516234397888183
simulation-passed1
step_physics_max0.06887586434682211
step_physics_mean0.06466573059558868
step_physics_median0.06404396096865336
step_physics_min0.06169913609822591
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4347011677Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4955362003301147
survival_time_median14.950000000000076
deviation-center-line_median0.8615006774661218
in-drivable-lane_median3.4500000000000184


other stats
agent_compute-ego_max0.01249828884157084
agent_compute-ego_mean0.012321274253608143
agent_compute-ego_median0.012289217313130697
agent_compute-ego_min0.01220837354660034
complete-iteration_max0.15510875066121418
complete-iteration_mean0.1522114514934141
complete-iteration_median0.15223915974299113
complete-iteration_min0.14925873582646
deviation-center-line_max1.0229873326250667
deviation-center-line_mean0.8171673823276517
deviation-center-line_min0.5226808417532969
deviation-heading_max3.8651635964037423
deviation-heading_mean2.58687614984882
deviation-heading_median2.5161860601958272
deviation-heading_min1.4499688825998818
driven_any_max4.802432680842535
driven_any_mean4.267945360593534
driven_any_median4.457988759058185
driven_any_min3.353371243415231
driven_lanedir_consec_max3.646286411158452
driven_lanedir_consec_mean2.6675692926719163
driven_lanedir_consec_min2.032918358868982
driven_lanedir_max3.973527047782368
driven_lanedir_mean3.3450433044736645
driven_lanedir_median3.6868639056216543
driven_lanedir_min2.032918358868982
get_duckie_state_max1.2540817260742187e-06
get_duckie_state_mean1.1591823761072535e-06
get_duckie_state_median1.1485242574228404e-06
get_duckie_state_min1.0855992635091149e-06
get_robot_state_max0.010688223838806151
get_robot_state_mean0.0103412429424329
get_robot_state_median0.010407801455697098
get_robot_state_min0.00986114501953125
get_state_dump_max0.00962272882461548
get_state_dump_mean0.00901656943862721
get_state_dump_median0.008995896544160142
get_state_dump_min0.008451755841573079
get_ui_image_max0.02459881862004598
get_ui_image_mean0.02430269459209873
get_ui_image_median0.024353240728378293
get_ui_image_min0.023905478291592355
in-drivable-lane_max5.9500000000000455
in-drivable-lane_mean3.6500000000000217
in-drivable-lane_min1.7500000000000036
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.802432680842535, "get_ui_image": 0.02459881862004598, "step_physics": 0.06372378587722778, "survival_time": 14.950000000000076, "driven_lanedir": 3.7274414000848566, "get_state_dump": 0.00962272882461548, "sim_render-ego": 0.0046210296948750815, "get_robot_state": 0.010688223838806151, "get_duckie_state": 1.2540817260742187e-06, "in-drivable-lane": 2.3, "agent_compute-ego": 0.01220837354660034, "deviation-heading": 3.8651635964037423, "complete-iteration": 0.1532100780804952, "set_robot_commands": 0.0037812081972757976, "deviation-center-line": 0.8657920889882397, "driven_lanedir_consec": 2.222525656267685, "sim_compute_sim_state": 0.02083997885386149, "sim_compute_performance-ego": 0.0030403780937194825}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.353371243415231, "get_ui_image": 0.023905478291592355, "step_physics": 0.06075349298574157, "survival_time": 11.800000000000033, "driven_lanedir": 2.032918358868982, "get_state_dump": 0.009170349371635309, "sim_render-ego": 0.004662842063580529, "get_robot_state": 0.010573588185391183, "get_duckie_state": 1.1971441365904728e-06, "in-drivable-lane": 5.9500000000000455, "agent_compute-ego": 0.01249828884157084, "deviation-heading": 1.4499688825998818, "complete-iteration": 0.14925873582646, "set_robot_commands": 0.0037048772229986674, "deviation-center-line": 0.5226808417532969, "driven_lanedir_consec": 2.032918358868982, "sim_compute_sim_state": 0.02077558687177755, "sim_compute_performance-ego": 0.003126540426480568}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.346559073242004, "get_ui_image": 0.024555900891621907, "step_physics": 0.0644693120320638, "survival_time": 14.950000000000076, "driven_lanedir": 3.973527047782368, "get_state_dump": 0.008821443716684977, "sim_render-ego": 0.0046506810188293455, "get_robot_state": 0.010242014726003012, "get_duckie_state": 1.0999043782552083e-06, "in-drivable-lane": 1.7500000000000036, "agent_compute-ego": 0.012340138753255209, "deviation-heading": 2.9549483893868196, "complete-iteration": 0.15126824140548706, "set_robot_commands": 0.00384363333384196, "deviation-center-line": 1.0229873326250667, "driven_lanedir_consec": 2.768546744392544, "sim_compute_sim_state": 0.019166657924652095, "sim_compute_performance-ego": 0.003094131151835124}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.5694184448743655, "get_ui_image": 0.024150580565134683, "step_physics": 0.06500040769577026, "survival_time": 14.950000000000076, "driven_lanedir": 3.646286411158452, "get_state_dump": 0.008451755841573079, "sim_render-ego": 0.004619643688201904, "get_robot_state": 0.00986114501953125, "get_duckie_state": 1.0855992635091149e-06, "in-drivable-lane": 4.600000000000037, "agent_compute-ego": 0.012238295873006184, "deviation-heading": 2.077423731004835, "complete-iteration": 0.15510875066121418, "set_robot_commands": 0.0038243985176086423, "deviation-center-line": 0.857209265944004, "driven_lanedir_consec": 3.646286411158452, "sim_compute_sim_state": 0.02386883497238159, "sim_compute_performance-ego": 0.0030101990699768068}}
set_robot_commands_max0.00384363333384196
set_robot_commands_mean0.003788529317931267
set_robot_commands_median0.003802803357442221
set_robot_commands_min0.0037048772229986674
sim_compute_performance-ego_max0.003126540426480568
sim_compute_performance-ego_mean0.0030678121855029954
sim_compute_performance-ego_median0.003067254622777303
sim_compute_performance-ego_min0.0030101990699768068
sim_compute_sim_state_max0.02386883497238159
sim_compute_sim_state_mean0.02116276465566818
sim_compute_sim_state_median0.02080778286281952
sim_compute_sim_state_min0.019166657924652095
sim_render-ego_max0.004662842063580529
sim_render-ego_mean0.004638549116371715
sim_render-ego_median0.004635855356852214
sim_render-ego_min0.004619643688201904
simulation-passed1
step_physics_max0.06500040769577026
step_physics_mean0.06348674964770085
step_physics_median0.06409654895464578
step_physics_min0.06075349298574157
survival_time_max14.950000000000076
survival_time_mean14.162500000000064
survival_time_min11.800000000000033
No reset possible
4345911676Daniil Lisusreal-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2922297766541275
survival_time_median8.574999999999992
deviation-center-line_median0.2891627730655014
in-drivable-lane_median4.125000000000002


other stats
agent_compute-ego_max0.016575552047567166
agent_compute-ego_mean0.015729404759055057
agent_compute-ego_median0.015727481379800914
agent_compute-ego_min0.01488710422905124
complete-iteration_max0.1867565889747775
complete-iteration_mean0.18016217730060505
complete-iteration_median0.17979718207467532
complete-iteration_min0.1742977560782919
deviation-center-line_max0.39975281819417313
deviation-center-line_mean0.29507647726942693
deviation-center-line_min0.20222754475253177
deviation-heading_max1.5488353384188005
deviation-heading_mean1.0291107049933752
deviation-heading_median1.0033640467857714
deviation-heading_min0.5608793879831582
driven_any_max4.7124547157813605
driven_any_mean2.9702502969687408
driven_any_median2.79713279387296
driven_any_min1.574280884347684
driven_lanedir_consec_max1.5181848579064967
driven_lanedir_consec_mean1.2768341404577574
driven_lanedir_consec_min1.0046921506162776
driven_lanedir_max1.5181848579064967
driven_lanedir_mean1.2768341404577574
driven_lanedir_median1.2922297766541275
driven_lanedir_min1.0046921506162776
get_duckie_state_max1.605520857141373e-06
get_duckie_state_mean1.501227826212194e-06
get_duckie_state_median1.4876832767408725e-06
get_duckie_state_min1.424023894225659e-06
get_robot_state_max0.01172091859452268
get_robot_state_mean0.011105069146865114
get_robot_state_median0.011167161367377457
get_robot_state_min0.010365035258182864
get_state_dump_max0.009783333920417948
get_state_dump_mean0.00940168952032598
get_state_dump_median0.009457919216480384
get_state_dump_min0.008907585727925204
get_ui_image_max0.030655847925718138
get_ui_image_mean0.029633524788583755
get_ui_image_median0.030096515011625222
get_ui_image_min0.027685221205366414
in-drivable-lane_max10.500000000000083
in-drivable-lane_mean5.062500000000021
in-drivable-lane_min1.499999999999995
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.4133124102435124, "get_ui_image": 0.030655847925718138, "step_physics": 0.07536788862578724, "survival_time": 7.349999999999982, "driven_lanedir": 1.2986205377284166, "get_state_dump": 0.008907585727925204, "sim_render-ego": 0.005355007794438576, "get_robot_state": 0.010365035258182864, "get_duckie_state": 1.424023894225659e-06, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.01488710422905124, "deviation-heading": 0.5608793879831582, "complete-iteration": 0.1742977560782919, "set_robot_commands": 0.004540469370731691, "deviation-center-line": 0.20222754475253177, "driven_lanedir_consec": 1.2986205377284166, "sim_compute_sim_state": 0.020677972002094296, "sim_compute_performance-ego": 0.003436447000827919}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.574280884347684, "get_ui_image": 0.027685221205366414, "step_physics": 0.07368390610877504, "survival_time": 4.699999999999991, "driven_lanedir": 1.0046921506162776, "get_state_dump": 0.009783333920417948, "sim_render-ego": 0.006058512850010649, "get_robot_state": 0.01172091859452268, "get_duckie_state": 1.605520857141373e-06, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.016575552047567166, "deviation-heading": 0.7551701349144871, "complete-iteration": 0.1778057281007158, "set_robot_commands": 0.005022627242068027, "deviation-center-line": 0.2175720078501706, "driven_lanedir_consec": 1.0046921506162776, "sim_compute_sim_state": 0.023078530392748244, "sim_compute_performance-ego": 0.004082012683787244}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.7124547157813605, "get_ui_image": 0.030151713689168295, "step_physics": 0.07760494629542034, "survival_time": 14.950000000000076, "driven_lanedir": 1.2858390155798385, "get_state_dump": 0.009351099332173663, "sim_render-ego": 0.005430848598480225, "get_robot_state": 0.011114950180053712, "get_duckie_state": 1.4901161193847656e-06, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.01581278324127197, "deviation-heading": 1.2515579586570558, "complete-iteration": 0.18178863604863485, "set_robot_commands": 0.0046456694602966305, "deviation-center-line": 0.3607535382808323, "driven_lanedir_consec": 1.2858390155798385, "sim_compute_sim_state": 0.023979018529256185, "sim_compute_performance-ego": 0.0035843507448832194}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1809531775024067, "get_ui_image": 0.030041316334082156, "step_physics": 0.07988775019743005, "survival_time": 9.800000000000004, "driven_lanedir": 1.5181848579064967, "get_state_dump": 0.009564739100787104, "sim_render-ego": 0.005496039682505082, "get_robot_state": 0.011219372554701202, "get_duckie_state": 1.485250434096979e-06, "in-drivable-lane": 4.800000000000017, "agent_compute-ego": 0.015642179518329854, "deviation-heading": 1.5488353384188005, "complete-iteration": 0.1867565889747775, "set_robot_commands": 0.004832071917397636, "deviation-center-line": 0.39975281819417313, "driven_lanedir_consec": 1.5181848579064967, "sim_compute_sim_state": 0.026358973006812895, "sim_compute_performance-ego": 0.003602896417890276}}
set_robot_commands_max0.005022627242068027
set_robot_commands_mean0.004760209497623496
set_robot_commands_median0.004738870688847133
set_robot_commands_min0.004540469370731691
sim_compute_performance-ego_max0.004082012683787244
sim_compute_performance-ego_mean0.003676426711847165
sim_compute_performance-ego_median0.0035936235813867476
sim_compute_performance-ego_min0.003436447000827919
sim_compute_sim_state_max0.026358973006812895
sim_compute_sim_state_mean0.023523623482727903
sim_compute_sim_state_median0.023528774461002214
sim_compute_sim_state_min0.020677972002094296
sim_render-ego_max0.006058512850010649
sim_render-ego_mean0.0055851022313586325
sim_render-ego_median0.0054634441404926536
sim_render-ego_min0.005355007794438576
simulation-passed1
step_physics_max0.07988775019743005
step_physics_mean0.07663612280685317
step_physics_median0.07648641746060378
step_physics_min0.07368390610877504
survival_time_max14.950000000000076
survival_time_mean9.200000000000014
survival_time_min4.699999999999991
No reset possible
4343811671Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9801789710194655
survival_time_median14.325000000000069
deviation-center-line_median0.6070101218502404
in-drivable-lane_median5.775000000000013


other stats
agent_compute-ego_max0.01539163606880355
agent_compute-ego_mean0.014346459500530696
agent_compute-ego_median0.01493566264459236
agent_compute-ego_min0.01212287664413452
complete-iteration_max0.175585063704609
complete-iteration_mean0.1710074641443765
complete-iteration_median0.17503358584951917
complete-iteration_min0.15837762117385865
deviation-center-line_max1.215202936156647
deviation-center-line_mean0.6557400754790677
deviation-center-line_min0.19373712205914304
deviation-heading_max3.5720709920592184
deviation-heading_mean2.0603340179153236
deviation-heading_median1.9290002051078372
deviation-heading_min0.8112646693864008
driven_any_max5.032025295632935
driven_any_mean3.7644214114544
driven_any_median3.806113170801126
driven_any_min2.4134340085824144
driven_lanedir_consec_max3.767414476474748
driven_lanedir_consec_mean2.111031341252701
driven_lanedir_consec_min0.7163529464971253
driven_lanedir_max3.8391783886125976
driven_lanedir_mean2.1289723192871635
driven_lanedir_median1.9801789710194655
driven_lanedir_min0.7163529464971253
get_duckie_state_max2.000799131153816e-06
get_duckie_state_mean1.913250432018371e-06
get_duckie_state_median1.919713333575395e-06
get_duckie_state_min1.81277592976888e-06
get_robot_state_max0.011344406726586558
get_robot_state_mean0.010971789738943876
get_robot_state_median0.011068859797226924
get_robot_state_min0.010405032634735108
get_state_dump_max0.0094350176135989
get_state_dump_mean0.009332102241001198
get_state_dump_median0.00932340656692658
get_state_dump_min0.009246578216552734
get_ui_image_max0.030367573102315262
get_ui_image_mean0.02863663496061957
get_ui_image_median0.029656053413645352
get_ui_image_min0.02486685991287231
in-drivable-lane_max10.250000000000064
in-drivable-lane_mean5.862500000000027
in-drivable-lane_min1.650000000000019
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.4134340085824144, "get_ui_image": 0.029629640243760302, "step_physics": 0.07333806052279832, "survival_time": 9.950000000000006, "driven_lanedir": 1.3687363324072996, "get_state_dump": 0.009287019470828262, "sim_render-ego": 0.0054186552613224815, "get_robot_state": 0.011121631267681792, "get_duckie_state": 2.000799131153816e-06, "in-drivable-lane": 6.050000000000012, "agent_compute-ego": 0.015125233923370516, "deviation-heading": 0.8476772252269239, "complete-iteration": 0.1752043656967393, "set_robot_commands": 0.004591914277579916, "deviation-center-line": 0.23712658139710857, "driven_lanedir_consec": 1.3687363324072996, "sim_compute_sim_state": 0.02295739327243824, "sim_compute_performance-ego": 0.003629072227669721}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.032025295632935, "get_ui_image": 0.030367573102315262, "step_physics": 0.07367421547571817, "survival_time": 14.950000000000076, "driven_lanedir": 2.5916216096316314, "get_state_dump": 0.009359793663024902, "sim_render-ego": 0.005236196517944336, "get_robot_state": 0.011016088326772054, "get_duckie_state": 1.8668174743652344e-06, "in-drivable-lane": 5.500000000000013, "agent_compute-ego": 0.014746091365814208, "deviation-heading": 3.5720709920592184, "complete-iteration": 0.174862806002299, "set_robot_commands": 0.004498461087544759, "deviation-center-line": 0.9768936623033724, "driven_lanedir_consec": 2.5916216096316314, "sim_compute_sim_state": 0.022337551911671957, "sim_compute_performance-ego": 0.003520637353261312}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.4058706465467723, "get_ui_image": 0.0296824665835304, "step_physics": 0.07443440221521976, "survival_time": 13.70000000000006, "driven_lanedir": 0.7163529464971253, "get_state_dump": 0.0094350176135989, "sim_render-ego": 0.005391659527799509, "get_robot_state": 0.011344406726586558, "get_duckie_state": 1.9726091927855556e-06, "in-drivable-lane": 10.250000000000064, "agent_compute-ego": 0.01539163606880355, "deviation-heading": 0.8112646693864008, "complete-iteration": 0.175585063704609, "set_robot_commands": 0.0047004170661425065, "deviation-center-line": 0.19373712205914304, "driven_lanedir_consec": 0.7163529464971253, "sim_compute_sim_state": 0.021553396308509103, "sim_compute_performance-ego": 0.00354195250211841}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.206355695055479, "get_ui_image": 0.02486685991287231, "step_physics": 0.0662305482228597, "survival_time": 14.950000000000076, "driven_lanedir": 3.8391783886125976, "get_state_dump": 0.009246578216552734, "sim_render-ego": 0.00465221643447876, "get_robot_state": 0.010405032634735108, "get_duckie_state": 1.81277592976888e-06, "in-drivable-lane": 1.650000000000019, "agent_compute-ego": 0.01212287664413452, "deviation-heading": 3.01032318498875, "complete-iteration": 0.15837762117385865, "set_robot_commands": 0.00385835329691569, "deviation-center-line": 1.215202936156647, "driven_lanedir_consec": 3.767414476474748, "sim_compute_sim_state": 0.02375706990559896, "sim_compute_performance-ego": 0.0031419094403584797}}
set_robot_commands_max0.0047004170661425065
set_robot_commands_mean0.004412286432045718
set_robot_commands_median0.004545187682562337
set_robot_commands_min0.00385835329691569
sim_compute_performance-ego_max0.003629072227669721
sim_compute_performance-ego_mean0.003458392880851981
sim_compute_performance-ego_median0.0035312949276898606
sim_compute_performance-ego_min0.0031419094403584797
sim_compute_sim_state_max0.02375706990559896
sim_compute_sim_state_mean0.02265135284955457
sim_compute_sim_state_median0.0226474725920551
sim_compute_sim_state_min0.021553396308509103
sim_render-ego_max0.0054186552613224815
sim_render-ego_mean0.0051746819353862715
sim_render-ego_median0.005313928022871922
sim_render-ego_min0.00465221643447876
simulation-passed1
step_physics_max0.07443440221521976
step_physics_mean0.071919306609149
step_physics_median0.07350613799925824
step_physics_min0.0662305482228597
survival_time_max14.950000000000076
survival_time_mean13.387500000000056
survival_time_min9.950000000000006
No reset possible
4341411671Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.261407773174475
survival_time_median14.950000000000076
deviation-center-line_median0.77315237114404
in-drivable-lane_median2.1749999999999923


other stats
agent_compute-ego_max0.016359885533650715
agent_compute-ego_mean0.0138395615418752
agent_compute-ego_median0.013444785277048746
agent_compute-ego_min0.012108790079752603
complete-iteration_max0.1782670876918695
complete-iteration_mean0.16283625338322075
complete-iteration_median0.16095654368400575
complete-iteration_min0.1511648384730021
deviation-center-line_max1.060098567486949
deviation-center-line_mean0.701716081116899
deviation-center-line_min0.20046101469256689
deviation-heading_max2.986924533160021
deviation-heading_mean2.1935720607275098
deviation-heading_median2.407475284013655
deviation-heading_min0.9724131417227092
driven_any_max4.671188013623215
driven_any_mean3.753212157618297
driven_any_median4.032064420005051
driven_any_min2.2775317768398695
driven_lanedir_consec_max4.290992894995451
driven_lanedir_consec_mean2.9642505102241894
driven_lanedir_consec_min1.043193599552357
driven_lanedir_max4.290992894995451
driven_lanedir_mean2.9642505102241894
driven_lanedir_median3.261407773174475
driven_lanedir_min1.043193599552357
get_duckie_state_max2.606302245050414e-06
get_duckie_state_mean2.0437413810664778e-06
get_duckie_state_median1.9013881683349609e-06
get_duckie_state_min1.7658869425455728e-06
get_robot_state_max0.01177520018357497
get_robot_state_mean0.0108454624353311
get_robot_state_median0.01079184055328369
get_robot_state_min0.010022968451182048
get_state_dump_max0.009897082646687826
get_state_dump_mean0.00930860773111001
get_state_dump_median0.009247367687714406
get_state_dump_min0.008842612902323405
get_ui_image_max0.02950119360899314
get_ui_image_mean0.026605700911619727
get_ui_image_median0.026227878332138063
get_ui_image_min0.024465853373209636
in-drivable-lane_max4.1000000000000085
in-drivable-lane_mean2.112499999999998
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2775317768398695, "get_ui_image": 0.02950119360899314, "step_physics": 0.07234959317068769, "survival_time": 5.849999999999987, "driven_lanedir": 1.043193599552357, "get_state_dump": 0.009499176954611754, "sim_render-ego": 0.005756826482267462, "get_robot_state": 0.01177520018357497, "get_duckie_state": 2.606302245050414e-06, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.016359885533650715, "deviation-heading": 0.9724131417227092, "complete-iteration": 0.1782670876918695, "set_robot_commands": 0.004833111396202674, "deviation-center-line": 0.20046101469256689, "driven_lanedir_consec": 1.043193599552357, "sim_compute_sim_state": 0.024162895659096226, "sim_compute_performance-ego": 0.003919621818086021}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.656490376945298, "get_ui_image": 0.027762931187947593, "step_physics": 0.06837419668833415, "survival_time": 14.950000000000076, "driven_lanedir": 3.2607553331233357, "get_state_dump": 0.009897082646687826, "sim_render-ego": 0.0050993990898132325, "get_robot_state": 0.01125969092051188, "get_duckie_state": 2.00192133585612e-06, "in-drivable-lane": 4.1000000000000085, "agent_compute-ego": 0.0144377064704895, "deviation-heading": 2.449418090569434, "complete-iteration": 0.1667083732287089, "set_robot_commands": 0.004336756070454915, "deviation-center-line": 0.654106910666592, "driven_lanedir_consec": 3.2607553331233357, "sim_compute_sim_state": 0.02207299629847209, "sim_compute_performance-ego": 0.0033655754725138345}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.4076384630648056, "get_ui_image": 0.02469282547632853, "step_physics": 0.06371317068735759, "survival_time": 14.950000000000076, "driven_lanedir": 3.2620602132256145, "get_state_dump": 0.008842612902323405, "sim_render-ego": 0.0046731098492940265, "get_robot_state": 0.010022968451182048, "get_duckie_state": 1.7658869425455728e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012451864083607992, "deviation-heading": 2.986924533160021, "complete-iteration": 0.1511648384730021, "set_robot_commands": 0.003889079093933106, "deviation-center-line": 1.060098567486949, "driven_lanedir_consec": 3.2620602132256145, "sim_compute_sim_state": 0.019726421038309735, "sim_compute_performance-ego": 0.0030607946713765463}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.671188013623215, "get_ui_image": 0.024465853373209636, "step_physics": 0.06381478945414225, "survival_time": 14.950000000000076, "driven_lanedir": 4.290992894995451, "get_state_dump": 0.008995558420817057, "sim_render-ego": 0.004636522134145101, "get_robot_state": 0.0103239901860555, "get_duckie_state": 1.8008550008138022e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.012108790079752603, "deviation-heading": 2.365532477457876, "complete-iteration": 0.15520471413930256, "set_robot_commands": 0.003739684422810872, "deviation-center-line": 0.8921978316214879, "driven_lanedir_consec": 4.290992894995451, "sim_compute_sim_state": 0.02406188488006592, "sim_compute_performance-ego": 0.0029688032468159994}}
set_robot_commands_max0.004833111396202674
set_robot_commands_mean0.004199657745850392
set_robot_commands_median0.004112917582194011
set_robot_commands_min0.003739684422810872
sim_compute_performance-ego_max0.003919621818086021
sim_compute_performance-ego_mean0.0033286988021981
sim_compute_performance-ego_median0.0032131850719451906
sim_compute_performance-ego_min0.0029688032468159994
sim_compute_sim_state_max0.024162895659096226
sim_compute_sim_state_mean0.02250604946898599
sim_compute_sim_state_median0.023067440589269003
sim_compute_sim_state_min0.019726421038309735
sim_render-ego_max0.005756826482267462
sim_render-ego_mean0.005041464388879956
sim_render-ego_median0.00488625446955363
sim_render-ego_min0.004636522134145101
simulation-passed1
step_physics_max0.07234959317068769
step_physics_mean0.06706293750013043
step_physics_median0.0660944930712382
step_physics_min0.06371317068735759
survival_time_max14.950000000000076
survival_time_mean12.675000000000054
survival_time_min5.849999999999987
No reset possible
4339711667Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.7242501311603142
survival_time_median14.950000000000076
deviation-center-line_median0.8418809947877084
in-drivable-lane_median1.4749999999999948


other stats
agent_compute-ego_max0.01534246361773947
agent_compute-ego_mean0.01386232514312302
agent_compute-ego_median0.013997814655303954
agent_compute-ego_min0.012111207644144696
complete-iteration_max0.17621399323145548
complete-iteration_mean0.16705543648505558
complete-iteration_median0.1686364919206371
complete-iteration_min0.15473476886749268
deviation-center-line_max1.353499063390482
deviation-center-line_mean0.8229491455849982
deviation-center-line_min0.2545355293740943
deviation-heading_max2.8123086504733923
deviation-heading_mean2.0791707721338906
deviation-heading_median2.343080357140453
deviation-heading_min0.8182137237812643
driven_any_max4.576705248276193
driven_any_mean3.738990401181101
driven_any_median4.065171940557319
driven_any_min2.248912475333573
driven_lanedir_consec_max4.299014266132037
driven_lanedir_consec_mean3.274744513403033
driven_lanedir_consec_min1.3514635251594678
driven_lanedir_max4.299014266132037
driven_lanedir_mean3.274744513403033
driven_lanedir_median3.7242501311603142
driven_lanedir_min1.3514635251594678
get_duckie_state_max1.552830571713655e-06
get_duckie_state_mean1.375459242558134e-06
get_duckie_state_median1.4030933380126953e-06
get_duckie_state_min1.1428197224934895e-06
get_robot_state_max0.011270002696825113
get_robot_state_mean0.010776223583497864
get_robot_state_median0.010761327346165975
get_robot_state_min0.010312236944834392
get_state_dump_max0.0095025808914848
get_state_dump_mean0.00915809987247854
get_state_dump_median0.009229898055394491
get_state_dump_min0.00867002248764038
get_ui_image_max0.029933601220448813
get_ui_image_mean0.027258054000743923
get_ui_image_median0.027585596208987023
get_ui_image_min0.023927422364552815
in-drivable-lane_max3.300000000000023
in-drivable-lane_mean1.562500000000003
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.248912475333573, "get_ui_image": 0.02892253709876019, "step_physics": 0.07416435531947924, "survival_time": 5.749999999999988, "driven_lanedir": 1.3514635251594678, "get_state_dump": 0.0095025808914848, "sim_render-ego": 0.0054177823274031926, "get_robot_state": 0.011270002696825113, "get_duckie_state": 1.552830571713655e-06, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.01534246361773947, "deviation-heading": 0.8182137237812643, "complete-iteration": 0.1759651577990988, "set_robot_commands": 0.004648055200991423, "deviation-center-line": 0.2545355293740943, "driven_lanedir_consec": 1.3514635251594678, "sim_compute_sim_state": 0.02294184643289317, "sim_compute_performance-ego": 0.0036512810250987175}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.576705248276193, "get_ui_image": 0.029933601220448813, "step_physics": 0.07590706904729207, "survival_time": 14.950000000000076, "driven_lanedir": 4.299014266132037, "get_state_dump": 0.00922699213027954, "sim_render-ego": 0.005267336368560791, "get_robot_state": 0.010951204299926758, "get_duckie_state": 1.475811004638672e-06, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.014824479420979818, "deviation-heading": 2.8123086504733923, "complete-iteration": 0.17621399323145548, "set_robot_commands": 0.004552256266276041, "deviation-center-line": 0.8052175567055027, "driven_lanedir_consec": 4.299014266132037, "sim_compute_sim_state": 0.022023565769195556, "sim_compute_performance-ego": 0.003424673875172933}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.619306243494093, "get_ui_image": 0.026248655319213863, "step_physics": 0.06841715017954508, "survival_time": 14.950000000000076, "driven_lanedir": 3.5297553424477215, "get_state_dump": 0.00923280398050944, "sim_render-ego": 0.0049324433008829755, "get_robot_state": 0.010571450392405191, "get_duckie_state": 1.3303756713867188e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013171149889628092, "deviation-heading": 2.4588087854455334, "complete-iteration": 0.1613078260421753, "set_robot_commands": 0.004073686599731445, "deviation-center-line": 1.353499063390482, "driven_lanedir_consec": 3.5297553424477215, "sim_compute_sim_state": 0.021269865036010745, "sim_compute_performance-ego": 0.0032935102780659994}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.511037637620544, "get_ui_image": 0.023927422364552815, "step_physics": 0.06417728026707967, "survival_time": 14.950000000000076, "driven_lanedir": 3.918744919872908, "get_state_dump": 0.00867002248764038, "sim_render-ego": 0.004487778345743815, "get_robot_state": 0.010312236944834392, "get_duckie_state": 1.1428197224934895e-06, "in-drivable-lane": 3.300000000000023, "agent_compute-ego": 0.012111207644144696, "deviation-heading": 2.2273519288353727, "complete-iteration": 0.15473476886749268, "set_robot_commands": 0.0038068755467732746, "deviation-center-line": 0.878544432869914, "driven_lanedir_consec": 3.918744919872908, "sim_compute_sim_state": 0.02418534835179647, "sim_compute_performance-ego": 0.002969688574473063}}
set_robot_commands_max0.004648055200991423
set_robot_commands_mean0.004270218403443046
set_robot_commands_median0.004312971433003743
set_robot_commands_min0.0038068755467732746
sim_compute_performance-ego_max0.0036512810250987175
sim_compute_performance-ego_mean0.003334788438202678
sim_compute_performance-ego_median0.003359092076619466
sim_compute_performance-ego_min0.002969688574473063
sim_compute_sim_state_max0.02418534835179647
sim_compute_sim_state_mean0.022605156397473986
sim_compute_sim_state_median0.022482706101044365
sim_compute_sim_state_min0.021269865036010745
sim_render-ego_max0.0054177823274031926
sim_render-ego_mean0.005026335085647694
sim_render-ego_median0.0050998898347218834
sim_render-ego_min0.004487778345743815
simulation-passed1
step_physics_max0.07590706904729207
step_physics_mean0.070666463703349
step_physics_median0.07129075274951216
step_physics_min0.06417728026707967
survival_time_max14.950000000000076
survival_time_mean12.650000000000055
survival_time_min5.749999999999988
No reset possible
4337111666Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7075948554645732
survival_time_median14.950000000000076
deviation-center-line_median0.58022164091762
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.015548420747121176
agent_compute-ego_mean0.01432355006535848
agent_compute-ego_median0.014848597447077432
agent_compute-ego_min0.012048584620157878
complete-iteration_max0.1815039030710856
complete-iteration_mean0.1738554306825002
complete-iteration_median0.1770241363843282
complete-iteration_min0.15986954689025878
deviation-center-line_max0.7127278913950902
deviation-center-line_mean0.5801752549780181
deviation-center-line_min0.4475298466817428
deviation-heading_max3.5314805275562815
deviation-heading_mean2.748874979388783
deviation-heading_median2.617277505352662
deviation-heading_min2.2294643792935256
driven_any_max3.1531115921559416
driven_any_mean2.863722981247479
driven_any_median2.9317569082300015
driven_any_min2.4382665163739707
driven_lanedir_consec_max3.085282128101323
driven_lanedir_consec_mean2.664638191020625
driven_lanedir_consec_min2.1580809250520288
driven_lanedir_max3.085282128101323
driven_lanedir_mean2.7749097821871604
driven_lanedir_median2.8140797534313595
driven_lanedir_min2.3861974937845973
get_duckie_state_max1.5473365783691409e-06
get_duckie_state_mean1.4573335647583007e-06
get_duckie_state_median1.504818598429362e-06
get_duckie_state_min1.2723604838053386e-06
get_robot_state_max0.011522568066914877
get_robot_state_mean0.011218605438868203
get_robot_state_median0.011397008498509723
get_robot_state_min0.010557836691538492
get_state_dump_max0.009612464904785156
get_state_dump_mean0.009494474132855734
get_state_dump_median0.009520200888315835
get_state_dump_min0.009325029850006104
get_ui_image_max0.02994315544764201
get_ui_image_mean0.02844480832417806
get_ui_image_median0.02935340444246928
get_ui_image_min0.025129268964131674
in-drivable-lane_max0.6500000000000092
in-drivable-lane_mean0.1625000000000023
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.1531115921559416, "get_ui_image": 0.02994315544764201, "step_physics": 0.07421847025553385, "survival_time": 14.950000000000076, "driven_lanedir": 3.085282128101323, "get_state_dump": 0.009553039073944091, "sim_render-ego": 0.0052288961410522465, "get_robot_state": 0.011299297014872232, "get_duckie_state": 1.5473365783691409e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014271630446116129, "deviation-heading": 2.6715006249244, "complete-iteration": 0.17470802466074625, "set_robot_commands": 0.0045928891499837235, "deviation-center-line": 0.7127278913950902, "driven_lanedir_consec": 3.085282128101323, "sim_compute_sim_state": 0.02196923971176147, "sim_compute_performance-ego": 0.0035297862688700356}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.070958270794932, "get_ui_image": 0.0293682599067688, "step_physics": 0.07604620456695557, "survival_time": 14.950000000000076, "driven_lanedir": 3.028992217144549, "get_state_dump": 0.00948736270268758, "sim_render-ego": 0.0057298970222473145, "get_robot_state": 0.011494719982147216, "get_duckie_state": 1.5401840209960935e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015548420747121176, "deviation-heading": 2.2294643792935256, "complete-iteration": 0.17934024810791016, "set_robot_commands": 0.0049423424402872725, "deviation-center-line": 0.5434814964422292, "driven_lanedir_consec": 3.028992217144549, "sim_compute_sim_state": 0.02280560811360677, "sim_compute_performance-ego": 0.0038111567497253417}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4382665163739707, "get_ui_image": 0.02933854897816976, "step_physics": 0.07805509408315023, "survival_time": 14.950000000000076, "driven_lanedir": 2.3861974937845973, "get_state_dump": 0.009612464904785156, "sim_render-ego": 0.005650319258371989, "get_robot_state": 0.011522568066914877, "get_duckie_state": 1.4694531758626302e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015425564448038736, "deviation-heading": 2.5630543857809243, "complete-iteration": 0.1815039030710856, "set_robot_commands": 0.004731194972991943, "deviation-center-line": 0.4475298466817428, "driven_lanedir_consec": 2.3861974937845973, "sim_compute_sim_state": 0.02323224226633708, "sim_compute_performance-ego": 0.003828686078389486}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7925555456650715, "get_ui_image": 0.025129268964131674, "step_physics": 0.0676856263478597, "survival_time": 14.950000000000076, "driven_lanedir": 2.59916728971817, "get_state_dump": 0.009325029850006104, "sim_render-ego": 0.0046576150258382165, "get_robot_state": 0.010557836691538492, "get_duckie_state": 1.2723604838053386e-06, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.012048584620157878, "deviation-heading": 3.5314805275562815, "complete-iteration": 0.15986954689025878, "set_robot_commands": 0.003908384641011556, "deviation-center-line": 0.6169617853930106, "driven_lanedir_consec": 2.1580809250520288, "sim_compute_sim_state": 0.02336945613225301, "sim_compute_performance-ego": 0.003093584378560384}}
set_robot_commands_max0.0049423424402872725
set_robot_commands_mean0.004543702801068624
set_robot_commands_median0.004662042061487834
set_robot_commands_min0.003908384641011556
sim_compute_performance-ego_max0.003828686078389486
sim_compute_performance-ego_mean0.003565803368886312
sim_compute_performance-ego_median0.003670471509297689
sim_compute_performance-ego_min0.003093584378560384
sim_compute_sim_state_max0.02336945613225301
sim_compute_sim_state_mean0.022844136555989585
sim_compute_sim_state_median0.023018925189971923
sim_compute_sim_state_min0.02196923971176147
sim_render-ego_max0.0057298970222473145
sim_render-ego_mean0.005316681861877442
sim_render-ego_median0.005439607699712117
sim_render-ego_min0.0046576150258382165
simulation-passed1
step_physics_max0.07805509408315023
step_physics_mean0.07400134881337483
step_physics_median0.07513233741124471
step_physics_min0.0676856263478597
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4334511662Mo KleitΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8285175811242629
survival_time_median14.950000000000076
deviation-center-line_median0.43683244300984514
in-drivable-lane_median3.675000000000042


other stats
agent_compute-ego_max0.015482211112976074
agent_compute-ego_mean0.014511163738684926
agent_compute-ego_median0.014997617403666178
agent_compute-ego_min0.012567209034431271
complete-iteration_max0.18477026065190633
complete-iteration_mean0.17284275056385412
complete-iteration_median0.1780219825108846
complete-iteration_min0.15055677658174096
deviation-center-line_max0.6555925421785656
deviation-center-line_mean0.4348166295932294
deviation-center-line_min0.21000909017466152
deviation-heading_max2.2500964935826944
deviation-heading_mean1.5305170319358343
deviation-heading_median1.7140522119972692
deviation-heading_min0.4438672101661057
driven_any_max3.879762329610781
driven_any_mean3.156203165526155
driven_any_median3.8794479210399784
driven_any_min0.9861544904138826
driven_lanedir_consec_max3.498216557912098
driven_lanedir_consec_mean1.9559503247185963
driven_lanedir_consec_min0.6685495787137627
driven_lanedir_max3.498216557912098
driven_lanedir_mean1.9559503247185963
driven_lanedir_median1.8285175811242629
driven_lanedir_min0.6685495787137627
get_duckie_state_max1.5934308369954428e-06
get_duckie_state_mean1.4778705147223743e-06
get_duckie_state_median1.5091896057128906e-06
get_duckie_state_min1.2996720104682736e-06
get_robot_state_max0.011200438340504965
get_robot_state_mean0.010660619154209044
get_robot_state_median0.010591456492741902
get_robot_state_min0.010259125290847406
get_state_dump_max0.009685493310292562
get_state_dump_mean0.00908484421609863
get_state_dump_median0.008979996840159099
get_state_dump_min0.008693889873783762
get_ui_image_max0.03149880091349284
get_ui_image_mean0.029047410333059662
get_ui_image_median0.029893214702606204
get_ui_image_min0.02490441101353343
in-drivable-lane_max8.600000000000039
in-drivable-lane_mean4.262500000000035
in-drivable-lane_min1.1000000000000156
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.9861544904138826, "get_ui_image": 0.02490441101353343, "step_physics": 0.0637977908297283, "survival_time": 4.099999999999993, "driven_lanedir": 0.6685495787137627, "get_state_dump": 0.008693889873783762, "sim_render-ego": 0.00457030680121445, "get_robot_state": 0.010259125290847406, "get_duckie_state": 1.2996720104682736e-06, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.012567209034431271, "deviation-heading": 0.4438672101661057, "complete-iteration": 0.15055677658174096, "set_robot_commands": 0.003787779226535704, "deviation-center-line": 0.21000909017466152, "driven_lanedir_consec": 0.6685495787137627, "sim_compute_sim_state": 0.01882053875341648, "sim_compute_performance-ego": 0.003066717124566799}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879762329610781, "get_ui_image": 0.029162061214447026, "step_physics": 0.074291512966156, "survival_time": 14.950000000000076, "driven_lanedir": 3.498216557912098, "get_state_dump": 0.008889806270599366, "sim_render-ego": 0.005128995577494303, "get_robot_state": 0.01031499703725179, "get_duckie_state": 1.448790232340495e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.014875377813975016, "deviation-heading": 2.2500964935826944, "complete-iteration": 0.1715634306271871, "set_robot_commands": 0.0045236492156982425, "deviation-center-line": 0.4310729437780376, "driven_lanedir_consec": 3.498216557912098, "sim_compute_sim_state": 0.02087666591008504, "sim_compute_performance-ego": 0.0034012881914774577}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.8791702056112376, "get_ui_image": 0.03149880091349284, "step_physics": 0.0815798807144165, "survival_time": 14.950000000000076, "driven_lanedir": 1.5215143650913112, "get_state_dump": 0.009685493310292562, "sim_render-ego": 0.00552383025487264, "get_robot_state": 0.011200438340504965, "get_duckie_state": 1.5695889790852864e-06, "in-drivable-lane": 8.600000000000039, "agent_compute-ego": 0.015482211112976074, "deviation-heading": 1.486406816569522, "complete-iteration": 0.18448053439458212, "set_robot_commands": 0.004600988229115804, "deviation-center-line": 0.6555925421785656, "driven_lanedir_consec": 1.5215143650913112, "sim_compute_sim_state": 0.02112709999084473, "sim_compute_performance-ego": 0.0036751842498779297}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.87972563646872, "get_ui_image": 0.03062436819076538, "step_physics": 0.08070484161376953, "survival_time": 14.950000000000076, "driven_lanedir": 2.135520797157214, "get_state_dump": 0.009070187409718832, "sim_render-ego": 0.00538105567296346, "get_robot_state": 0.010867915948232014, "get_duckie_state": 1.5934308369954428e-06, "in-drivable-lane": 6.200000000000088, "agent_compute-ego": 0.01511985699335734, "deviation-heading": 1.941697607425016, "complete-iteration": 0.18477026065190633, "set_robot_commands": 0.004691781997680664, "deviation-center-line": 0.4425919422416528, "driven_lanedir_consec": 2.135520797157214, "sim_compute_sim_state": 0.024734816551208495, "sim_compute_performance-ego": 0.003469281196594238}}
set_robot_commands_max0.004691781997680664
set_robot_commands_mean0.004401049667257603
set_robot_commands_median0.004562318722407023
set_robot_commands_min0.003787779226535704
sim_compute_performance-ego_max0.0036751842498779297
sim_compute_performance-ego_mean0.003403117690629106
sim_compute_performance-ego_median0.003435284694035848
sim_compute_performance-ego_min0.003066717124566799
sim_compute_sim_state_max0.024734816551208495
sim_compute_sim_state_mean0.02138978030138868
sim_compute_sim_state_median0.021001882950464883
sim_compute_sim_state_min0.01882053875341648
sim_render-ego_max0.00552383025487264
sim_render-ego_mean0.005151047076636214
sim_render-ego_median0.005255025625228882
sim_render-ego_min0.00457030680121445
simulation-passed1
step_physics_max0.0815798807144165
step_physics_mean0.0750935065310176
step_physics_median0.07749817728996278
step_physics_min0.0637977908297283
survival_time_max14.950000000000076
survival_time_mean12.237500000000058
survival_time_min4.099999999999993
No reset possible
4333611661Dishank BansalΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5641445775523146
survival_time_median14.950000000000076
deviation-center-line_median0.5831649803229306
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012741260528564452
agent_compute-ego_mean0.012383299867312111
agent_compute-ego_median0.012339247067769368
agent_compute-ego_min0.012113444805145264
complete-iteration_max0.16148205518722533
complete-iteration_mean0.15061692158381146
complete-iteration_median0.14771188696225485
complete-iteration_min0.14556185722351075
deviation-center-line_max0.6666327510603647
deviation-center-line_mean0.6007521391342129
deviation-center-line_min0.5700458448306256
deviation-heading_max3.7665115523939754
deviation-heading_mean2.9053264389054783
deviation-heading_median2.7854321970707856
deviation-heading_min2.2839298090863673
driven_any_max2.967338078642414
driven_any_mean2.7127269949686146
driven_any_median2.751110442814565
driven_any_min2.3813490156029147
driven_lanedir_consec_max2.9225871052372066
driven_lanedir_consec_mean2.5691809900278515
driven_lanedir_consec_min2.22584769976957
driven_lanedir_max2.9225871052372066
driven_lanedir_mean2.5882962449984404
driven_lanedir_median2.5745166005253504
driven_lanedir_min2.2815646737058533
get_duckie_state_max1.685619354248047e-06
get_duckie_state_mean1.6518433888753254e-06
get_duckie_state_median1.6589959462483723e-06
get_duckie_state_min1.6037623087565104e-06
get_robot_state_max0.01023850123087565
get_robot_state_mean0.009972935716311138
get_robot_state_median0.00993530829747518
get_robot_state_min0.00978262503941854
get_state_dump_max0.00894217570622762
get_state_dump_mean0.008718452056248983
get_state_dump_median0.008731666008631388
get_state_dump_min0.008468300501505533
get_ui_image_max0.02547130823135376
get_ui_image_mean0.02444368799527486
get_ui_image_median0.024263659715652468
get_ui_image_min0.023776124318440756
in-drivable-lane_max1.900000000000027
in-drivable-lane_mean0.4750000000000067
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.967338078642414, "get_ui_image": 0.023776124318440756, "step_physics": 0.06047630548477173, "survival_time": 14.950000000000076, "driven_lanedir": 2.9225871052372066, "get_state_dump": 0.00870851198832194, "sim_render-ego": 0.00452796220779419, "get_robot_state": 0.009822736581166586, "get_duckie_state": 1.685619354248047e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01220191478729248, "deviation-heading": 2.2839298090863673, "complete-iteration": 0.14556185722351075, "set_robot_commands": 0.003671154181162516, "deviation-center-line": 0.5902167179170095, "driven_lanedir_consec": 2.9225871052372066, "sim_compute_sim_state": 0.019283824761708576, "sim_compute_performance-ego": 0.0030049967765808107}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.924055949663714, "get_ui_image": 0.024554850260416667, "step_physics": 0.060643943150838216, "survival_time": 14.950000000000076, "driven_lanedir": 2.846724481398776, "get_state_dump": 0.00894217570622762, "sim_render-ego": 0.004563310941060384, "get_robot_state": 0.010047880013783771, "get_duckie_state": 1.6037623087565104e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012113444805145264, "deviation-heading": 3.005208198773686, "complete-iteration": 0.1470376745859782, "set_robot_commands": 0.003693682352701823, "deviation-center-line": 0.6666327510603647, "driven_lanedir_consec": 2.846724481398776, "sim_compute_sim_state": 0.019364957809448243, "sim_compute_performance-ego": 0.0030233510335286456}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.3813490156029147, "get_ui_image": 0.023972469170888265, "step_physics": 0.06259174505869547, "survival_time": 14.950000000000076, "driven_lanedir": 2.2815646737058533, "get_state_dump": 0.008468300501505533, "sim_render-ego": 0.004619245529174805, "get_robot_state": 0.00978262503941854, "get_duckie_state": 1.6395250956217449e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012476579348246256, "deviation-heading": 3.7665115523939754, "complete-iteration": 0.1483860993385315, "set_robot_commands": 0.003706541856129964, "deviation-center-line": 0.5761132427288518, "driven_lanedir_consec": 2.2815646737058533, "sim_compute_sim_state": 0.019649209181467692, "sim_compute_performance-ego": 0.0030291287104288736}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.578164935965416, "get_ui_image": 0.02547130823135376, "step_physics": 0.06877105792363485, "survival_time": 14.950000000000076, "driven_lanedir": 2.302308719651925, "get_state_dump": 0.008754820028940836, "sim_render-ego": 0.0046943036715189615, "get_robot_state": 0.01023850123087565, "get_duckie_state": 1.678466796875e-06, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.012741260528564452, "deviation-heading": 2.5656561953678847, "complete-iteration": 0.16148205518722533, "set_robot_commands": 0.003762497107187907, "deviation-center-line": 0.5700458448306256, "driven_lanedir_consec": 2.22584769976957, "sim_compute_sim_state": 0.023820571899414063, "sim_compute_performance-ego": 0.003133069674173991}}
set_robot_commands_max0.003762497107187907
set_robot_commands_mean0.003708468874295553
set_robot_commands_median0.0037001121044158937
set_robot_commands_min0.003671154181162516
sim_compute_performance-ego_max0.003133069674173991
sim_compute_performance-ego_mean0.00304763654867808
sim_compute_performance-ego_median0.0030262398719787596
sim_compute_performance-ego_min0.0030049967765808107
sim_compute_sim_state_max0.023820571899414063
sim_compute_sim_state_mean0.02052964091300964
sim_compute_sim_state_median0.019507083495457968
sim_compute_sim_state_min0.019283824761708576
sim_render-ego_max0.0046943036715189615
sim_render-ego_mean0.004601205587387086
sim_render-ego_median0.0045912782351175945
sim_render-ego_min0.00452796220779419
simulation-passed1
step_physics_max0.06877105792363485
step_physics_mean0.06312076290448507
step_physics_median0.06161784410476684
step_physics_min0.06047630548477173
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4331211658Philippe ReddyΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3330326968189863
survival_time_median14.950000000000076
deviation-center-line_median0.6913043494298943
in-drivable-lane_median3.425000000000031


other stats
agent_compute-ego_max0.01651471694310506
agent_compute-ego_mean0.014680658578872682
agent_compute-ego_median0.014661145607630412
agent_compute-ego_min0.012885626157124836
complete-iteration_max0.18887041489283243
complete-iteration_mean0.16785919288794202
complete-iteration_median0.16737191637357077
complete-iteration_min0.14782252391179404
deviation-center-line_max0.8364256891278881
deviation-center-line_mean0.6904708679847936
deviation-center-line_min0.542849083951498
deviation-heading_max4.116455039634804
deviation-heading_mean3.2338637990040913
deviation-heading_median3.7322548268343896
deviation-heading_min1.3544905027127812
driven_any_max4.849518059745508
driven_any_mean4.845272159689912
driven_any_median4.849023674894145
driven_any_min4.833523229225854
driven_lanedir_consec_max3.7963268692446577
driven_lanedir_consec_mean3.129712012151742
driven_lanedir_consec_min2.056455785724338
driven_lanedir_max3.7963268692446577
driven_lanedir_mean3.129712012151742
driven_lanedir_median3.3330326968189863
driven_lanedir_min2.056455785724338
get_duckie_state_max1.6268094380696614e-06
get_duckie_state_mean1.4535586039225265e-06
get_duckie_state_median1.453558603922526e-06
get_duckie_state_min1.2803077697753909e-06
get_robot_state_max0.011136935551961264
get_robot_state_mean0.01047086238861084
get_robot_state_median0.010573585033416748
get_robot_state_min0.0095993439356486
get_state_dump_max0.009200928211212158
get_state_dump_mean0.008933793902397156
get_state_dump_median0.009101362228393556
get_state_dump_min0.008331522941589356
get_ui_image_max0.030440060297648112
get_ui_image_mean0.027353762984275817
get_ui_image_median0.027509732643763225
get_ui_image_min0.02395552635192871
in-drivable-lane_max8.150000000000095
in-drivable-lane_mean4.362500000000048
in-drivable-lane_min2.450000000000035
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.833523229225854, "get_ui_image": 0.02395552635192871, "step_physics": 0.06144412835439046, "survival_time": 14.950000000000076, "driven_lanedir": 3.599784802570696, "get_state_dump": 0.008331522941589356, "sim_render-ego": 0.004633746941884359, "get_robot_state": 0.0095993439356486, "get_duckie_state": 1.2898445129394532e-06, "in-drivable-lane": 2.7000000000000233, "agent_compute-ego": 0.012885626157124836, "deviation-heading": 4.077649424133566, "complete-iteration": 0.14782252391179404, "set_robot_commands": 0.003864787419637045, "deviation-center-line": 0.7066792572268029, "driven_lanedir_consec": 3.599784802570696, "sim_compute_sim_state": 0.019989381631215417, "sim_compute_performance-ego": 0.0030296810468037924}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.849518059745508, "get_ui_image": 0.025043226877848303, "step_physics": 0.06492186466852824, "survival_time": 14.950000000000076, "driven_lanedir": 3.7963268692446577, "get_state_dump": 0.009025601545969646, "sim_render-ego": 0.004866565068562825, "get_robot_state": 0.010274790128072102, "get_duckie_state": 1.2803077697753909e-06, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.0138460636138916, "deviation-heading": 3.3868602295352135, "complete-iteration": 0.15642077684402467, "set_robot_commands": 0.003958146572113037, "deviation-center-line": 0.6759294416329855, "driven_lanedir_consec": 3.7963268692446577, "sim_compute_sim_state": 0.021113296349843345, "sim_compute_performance-ego": 0.00327743132909139}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.848764980305144, "get_ui_image": 0.02997623840967814, "step_physics": 0.07642517487208049, "survival_time": 14.950000000000076, "driven_lanedir": 3.0662805910672764, "get_state_dump": 0.009177122910817464, "sim_render-ego": 0.005411051114400228, "get_robot_state": 0.010872379938761391, "get_duckie_state": 1.6268094380696614e-06, "in-drivable-lane": 4.1500000000000385, "agent_compute-ego": 0.015476227601369222, "deviation-heading": 4.116455039634804, "complete-iteration": 0.17832305590311687, "set_robot_commands": 0.004705327351888021, "deviation-center-line": 0.8364256891278881, "driven_lanedir_consec": 3.0662805910672764, "sim_compute_sim_state": 0.022653609911600748, "sim_compute_performance-ego": 0.003518416881561279}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.849282369483147, "get_ui_image": 0.030440060297648112, "step_physics": 0.08126095453898112, "survival_time": 14.950000000000076, "driven_lanedir": 2.056455785724338, "get_state_dump": 0.009200928211212158, "sim_render-ego": 0.005621905326843262, "get_robot_state": 0.011136935551961264, "get_duckie_state": 1.617272694905599e-06, "in-drivable-lane": 8.150000000000095, "agent_compute-ego": 0.01651471694310506, "deviation-heading": 1.3544905027127812, "complete-iteration": 0.18887041489283243, "set_robot_commands": 0.004941779772440593, "deviation-center-line": 0.542849083951498, "driven_lanedir_consec": 2.056455785724338, "sim_compute_sim_state": 0.025945007006327313, "sim_compute_performance-ego": 0.003696926434834798}}
set_robot_commands_max0.004941779772440593
set_robot_commands_mean0.0043675102790196735
set_robot_commands_median0.004331736962000529
set_robot_commands_min0.003864787419637045
sim_compute_performance-ego_max0.003696926434834798
sim_compute_performance-ego_mean0.003380613923072815
sim_compute_performance-ego_median0.0033979241053263345
sim_compute_performance-ego_min0.0030296810468037924
sim_compute_sim_state_max0.025945007006327313
sim_compute_sim_state_mean0.022425323724746704
sim_compute_sim_state_median0.021883453130722045
sim_compute_sim_state_min0.019989381631215417
sim_render-ego_max0.005621905326843262
sim_render-ego_mean0.005133317112922669
sim_render-ego_median0.005138808091481527
sim_render-ego_min0.004633746941884359
simulation-passed1
step_physics_max0.08126095453898112
step_physics_mean0.07101303060849508
step_physics_median0.07067351977030437
step_physics_min0.06144412835439046
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4328711654Dishank BansalΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3206770866138027
survival_time_median14.950000000000076
deviation-center-line_median0.651114386046127
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01611993392308553
agent_compute-ego_mean0.014567404389381408
agent_compute-ego_median0.014683410326639812
agent_compute-ego_min0.012782862981160482
complete-iteration_max0.1812571930885315
complete-iteration_mean0.17352457761764525
complete-iteration_median0.17488958716392516
complete-iteration_min0.16306194305419922
deviation-center-line_max0.7771724192499587
deviation-center-line_mean0.644519734357075
deviation-center-line_min0.4986777460860872
deviation-heading_max2.9729291464049004
deviation-heading_mean2.052097227338699
deviation-heading_median1.796656752534041
deviation-heading_min1.6421462578818131
driven_any_max2.427312288944917
driven_any_mean2.3145591783863915
driven_any_median2.3459474187066753
driven_any_min2.139029587187298
driven_lanedir_consec_max2.3981896417819657
driven_lanedir_consec_mean2.2783588999716655
driven_lanedir_consec_min2.0738917848770915
driven_lanedir_max2.3981896417819657
driven_lanedir_mean2.2783588999716655
driven_lanedir_median2.3206770866138027
driven_lanedir_min2.0738917848770915
get_duckie_state_max2.11636225382487e-06
get_duckie_state_mean2.005894978841146e-06
get_duckie_state_median2.082188924153646e-06
get_duckie_state_min1.7428398132324218e-06
get_robot_state_max0.011558601061503092
get_robot_state_mean0.011018129785855611
get_robot_state_median0.011089998881022136
get_robot_state_min0.01033392031987508
get_state_dump_max0.009607062339782715
get_state_dump_mean0.009405337770779927
get_state_dump_median0.009383090337117511
get_state_dump_min0.009248108069101969
get_ui_image_max0.030294222036997477
get_ui_image_mean0.028480438788731893
get_ui_image_median0.029191790024439494
get_ui_image_min0.025243953069051108
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.375579739740904, "get_ui_image": 0.030294222036997477, "step_physics": 0.07477181037267049, "survival_time": 14.950000000000076, "driven_lanedir": 2.349225374960723, "get_state_dump": 0.009314412275950116, "sim_render-ego": 0.005292202631632487, "get_robot_state": 0.01094098170598348, "get_duckie_state": 2.0647048950195313e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014354054133097332, "deviation-heading": 1.6421462578818131, "complete-iteration": 0.1745625138282776, "set_robot_commands": 0.004518223603566488, "deviation-center-line": 0.6597527107172644, "driven_lanedir_consec": 2.349225374960723, "sim_compute_sim_state": 0.0214827299118042, "sim_compute_performance-ego": 0.0034981449445088703}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.427312288944917, "get_ui_image": 0.03008775234222412, "step_physics": 0.07401671250661214, "survival_time": 14.950000000000076, "driven_lanedir": 2.3981896417819657, "get_state_dump": 0.009451768398284911, "sim_render-ego": 0.005441543261210124, "get_robot_state": 0.01123901605606079, "get_duckie_state": 2.0996729532877604e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015012766520182292, "deviation-heading": 1.8698369321735857, "complete-iteration": 0.17521666049957274, "set_robot_commands": 0.004553435643513997, "deviation-center-line": 0.6424760613749896, "driven_lanedir_consec": 2.3981896417819657, "sim_compute_sim_state": 0.02165434996287028, "sim_compute_performance-ego": 0.00365829070409139}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.139029587187298, "get_ui_image": 0.028295827706654866, "step_physics": 0.07775462150573731, "survival_time": 14.950000000000076, "driven_lanedir": 2.0738917848770915, "get_state_dump": 0.009607062339782715, "sim_render-ego": 0.0058091560999552405, "get_robot_state": 0.011558601061503092, "get_duckie_state": 2.11636225382487e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01611993392308553, "deviation-heading": 2.9729291464049004, "complete-iteration": 0.1812571930885315, "set_robot_commands": 0.004922608534495036, "deviation-center-line": 0.4986777460860872, "driven_lanedir_consec": 2.0738917848770915, "sim_compute_sim_state": 0.02327694018681844, "sim_compute_performance-ego": 0.003808290163675944}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.3163150976724465, "get_ui_image": 0.025243953069051108, "step_physics": 0.07035809755325317, "survival_time": 14.950000000000076, "driven_lanedir": 2.2921287982668823, "get_state_dump": 0.009248108069101969, "sim_render-ego": 0.004725829760233561, "get_robot_state": 0.01033392031987508, "get_duckie_state": 1.7428398132324218e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012782862981160482, "deviation-heading": 1.723476572894496, "complete-iteration": 0.16306194305419922, "set_robot_commands": 0.003860730330149333, "deviation-center-line": 0.7771724192499587, "driven_lanedir_consec": 2.2921287982668823, "sim_compute_sim_state": 0.023221333026885987, "sim_compute_performance-ego": 0.003197745482126872}}
set_robot_commands_max0.004922608534495036
set_robot_commands_mean0.004463749527931213
set_robot_commands_median0.004535829623540242
set_robot_commands_min0.003860730330149333
sim_compute_performance-ego_max0.003808290163675944
sim_compute_performance-ego_mean0.003540617823600769
sim_compute_performance-ego_median0.00357821782430013
sim_compute_performance-ego_min0.003197745482126872
sim_compute_sim_state_max0.02327694018681844
sim_compute_sim_state_mean0.02240883827209473
sim_compute_sim_state_median0.02243784149487813
sim_compute_sim_state_min0.0214827299118042
sim_render-ego_max0.0058091560999552405
sim_render-ego_mean0.0053171829382578535
sim_render-ego_median0.005366872946421306
sim_render-ego_min0.004725829760233561
simulation-passed1
step_physics_max0.07775462150573731
step_physics_mean0.07422531048456828
step_physics_median0.07439426143964131
step_physics_min0.07035809755325317
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4326711652Philippe ReddyΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.772253742436644
survival_time_median14.950000000000076
deviation-center-line_median0.7787929267745555
in-drivable-lane_median3.3250000000000224


other stats
agent_compute-ego_max0.013138760725657145
agent_compute-ego_mean0.012939579685529072
agent_compute-ego_median0.012940449714660645
agent_compute-ego_min0.012738658587137856
complete-iteration_max0.15406754970550535
complete-iteration_mean0.14967897156874338
complete-iteration_median0.1497247032324473
complete-iteration_min0.14519893010457358
deviation-center-line_max0.8209154876768359
deviation-center-line_mean0.7101108961200535
deviation-center-line_min0.4619422432542669
deviation-heading_max3.535361836487241
deviation-heading_mean2.8549828655181884
deviation-heading_median3.2871709760793877
deviation-heading_min1.3102276734267382
driven_any_max3.879798496611634
driven_any_mean3.876516205518111
driven_any_median3.879595674966613
driven_any_min3.8670749755275846
driven_lanedir_consec_max3.4198310628866744
driven_lanedir_consec_mean2.7651624561202905
driven_lanedir_consec_min2.0963112767212
driven_lanedir_max3.4198310628866744
driven_lanedir_mean2.7651624561202905
driven_lanedir_median2.772253742436644
driven_lanedir_min2.0963112767212
get_duckie_state_max1.327196756998698e-06
get_duckie_state_mean1.2268622716267905e-06
get_duckie_state_median1.2111663818359375e-06
get_duckie_state_min1.1579195658365885e-06
get_robot_state_max0.01060889720916748
get_robot_state_mean0.009950684110323588
get_robot_state_median0.009781412283579509
get_robot_state_min0.009631014664967855
get_state_dump_max0.009217680295308431
get_state_dump_mean0.008693845669428508
get_state_dump_median0.008569085995356242
get_state_dump_min0.008419530391693115
get_ui_image_max0.024022616545359293
get_ui_image_mean0.023890580733617148
get_ui_image_median0.023978693485260008
get_ui_image_min0.023582319418589275
in-drivable-lane_max6.500000000000092
in-drivable-lane_mean3.562500000000034
in-drivable-lane_min1.1000000000000023
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8670749755275846, "get_ui_image": 0.024018699328104656, "step_physics": 0.06104895830154419, "survival_time": 14.950000000000076, "driven_lanedir": 3.127497873043528, "get_state_dump": 0.008553597132364909, "sim_render-ego": 0.0045304083824157714, "get_robot_state": 0.009816664854685466, "get_duckie_state": 1.1579195658365885e-06, "in-drivable-lane": 2.1000000000000103, "agent_compute-ego": 0.012876213391621908, "deviation-heading": 3.195044683993627, "complete-iteration": 0.14747439622879027, "set_robot_commands": 0.0037691148122151697, "deviation-center-line": 0.7953197003723064, "driven_lanedir_consec": 3.127497873043528, "sim_compute_sim_state": 0.019767902692159015, "sim_compute_performance-ego": 0.003007496992746989}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.8797638435062343, "get_ui_image": 0.023582319418589275, "step_physics": 0.0608607029914856, "survival_time": 14.950000000000076, "driven_lanedir": 3.4198310628866744, "get_state_dump": 0.008584574858347575, "sim_render-ego": 0.0044953759511311845, "get_robot_state": 0.009631014664967855, "get_duckie_state": 1.2421607971191406e-06, "in-drivable-lane": 1.1000000000000023, "agent_compute-ego": 0.012738658587137856, "deviation-heading": 3.379297268165149, "complete-iteration": 0.14519893010457358, "set_robot_commands": 0.0036928923924764, "deviation-center-line": 0.7622661531768045, "driven_lanedir_consec": 3.4198310628866744, "sim_compute_sim_state": 0.018548535505930584, "sim_compute_performance-ego": 0.0029778567949930827}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.8794275064269903, "get_ui_image": 0.023938687642415364, "step_physics": 0.062491323153177895, "survival_time": 14.950000000000076, "driven_lanedir": 2.417009611829759, "get_state_dump": 0.009217680295308431, "sim_render-ego": 0.004615836938222249, "get_robot_state": 0.01060889720916748, "get_duckie_state": 1.327196756998698e-06, "in-drivable-lane": 4.5500000000000345, "agent_compute-ego": 0.013138760725657145, "deviation-heading": 3.535361836487241, "complete-iteration": 0.15197501023610432, "set_robot_commands": 0.0037617667516072592, "deviation-center-line": 0.8209154876768359, "driven_lanedir_consec": 2.417009611829759, "sim_compute_sim_state": 0.02104249080022176, "sim_compute_performance-ego": 0.0030692370732625326}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.879798496611634, "get_ui_image": 0.024022616545359293, "step_physics": 0.06437440236409506, "survival_time": 14.950000000000076, "driven_lanedir": 2.0963112767212, "get_state_dump": 0.008419530391693115, "sim_render-ego": 0.004611372152964274, "get_robot_state": 0.009746159712473551, "get_duckie_state": 1.1801719665527344e-06, "in-drivable-lane": 6.500000000000092, "agent_compute-ego": 0.01300468603769938, "deviation-heading": 1.3102276734267382, "complete-iteration": 0.15406754970550535, "set_robot_commands": 0.003757840792338054, "deviation-center-line": 0.4619422432542669, "driven_lanedir_consec": 2.0963112767212, "sim_compute_sim_state": 0.022928798993428548, "sim_compute_performance-ego": 0.003113104502360026}}
set_robot_commands_max0.0037691148122151697
set_robot_commands_mean0.00374540368715922
set_robot_commands_median0.003759803771972656
set_robot_commands_min0.0036928923924764
sim_compute_performance-ego_max0.003113104502360026
sim_compute_performance-ego_mean0.0030419238408406577
sim_compute_performance-ego_median0.0030383670330047605
sim_compute_performance-ego_min0.0029778567949930827
sim_compute_sim_state_max0.022928798993428548
sim_compute_sim_state_mean0.02057193199793498
sim_compute_sim_state_median0.020405196746190388
sim_compute_sim_state_min0.018548535505930584
sim_render-ego_max0.004615836938222249
sim_render-ego_mean0.00456324835618337
sim_render-ego_median0.004570890267690022
sim_render-ego_min0.0044953759511311845
simulation-passed1
step_physics_max0.06437440236409506
step_physics_mean0.06219384670257569
step_physics_median0.06177014072736105
step_physics_min0.0608607029914856
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4324611646Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.267115769662499
survival_time_median14.950000000000076
deviation-center-line_median0.7935210701346753
in-drivable-lane_median1.400000000000016


other stats
agent_compute-ego_max0.012417047023773194
agent_compute-ego_mean0.01222817897796631
agent_compute-ego_median0.012207098801930744
agent_compute-ego_min0.01208147128423055
complete-iteration_max0.15325817664464314
complete-iteration_mean0.14791429062684378
complete-iteration_median0.14674672762552898
complete-iteration_min0.144905530611674
deviation-center-line_max0.8586494432460708
deviation-center-line_mean0.7630964435325194
deviation-center-line_min0.6066941906146562
deviation-heading_max4.388663917171468
deviation-heading_mean3.307228377589345
deviation-heading_median3.0273868592066866
deviation-heading_min2.7854758747725397
driven_any_max3.0826806313725696
driven_any_mean2.966304403388856
driven_any_median3.0157938657366774
driven_any_min2.7509492507094992
driven_lanedir_consec_max2.81934484428192
driven_lanedir_consec_mean2.2724958941226365
driven_lanedir_consec_min1.736407192883627
driven_lanedir_max2.81934484428192
driven_lanedir_mean2.4592355076636334
driven_lanedir_median2.6405949967444933
driven_lanedir_min1.736407192883627
get_duckie_state_max1.1412302652994793e-06
get_duckie_state_mean1.0925531387329105e-06
get_duckie_state_median1.0919570922851565e-06
get_duckie_state_min1.045068105061849e-06
get_robot_state_max0.00990397055943807
get_robot_state_mean0.009593595465024312
get_robot_state_median0.009545686642328898
get_robot_state_min0.009379038016001384
get_state_dump_max0.008756806055704752
get_state_dump_mean0.008392003774642944
get_state_dump_median0.008401620785395305
get_state_dump_min0.008007967472076416
get_ui_image_max0.024360179901123047
get_ui_image_mean0.02414490719636281
get_ui_image_median0.024123339653015136
get_ui_image_min0.023972769578297932
in-drivable-lane_max3.8500000000000343
in-drivable-lane_mean1.8625000000000191
in-drivable-lane_min0.8000000000000114
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9669935337859297, "get_ui_image": 0.024360179901123047, "step_physics": 0.060190676053365075, "survival_time": 14.950000000000076, "driven_lanedir": 2.5058816155927204, "get_state_dump": 0.008576544920603434, "sim_render-ego": 0.004556456406911214, "get_robot_state": 0.009626912275950111, "get_duckie_state": 1.1412302652994793e-06, "in-drivable-lane": 1.8000000000000176, "agent_compute-ego": 0.01223087231318156, "deviation-heading": 2.7854758747725397, "complete-iteration": 0.14610663016637165, "set_robot_commands": 0.003781011899312337, "deviation-center-line": 0.8336919198258658, "driven_lanedir_consec": 2.5058816155927204, "sim_compute_sim_state": 0.019652726650238036, "sim_compute_performance-ego": 0.0030492750803629556}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0645941976874256, "get_ui_image": 0.02423539638519287, "step_physics": 0.06050033728281657, "survival_time": 14.950000000000076, "driven_lanedir": 2.81934484428192, "get_state_dump": 0.008007967472076416, "sim_render-ego": 0.004523410002390544, "get_robot_state": 0.009379038016001384, "get_duckie_state": 1.0927518208821614e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.012183325290679932, "deviation-heading": 3.026449257568388, "complete-iteration": 0.144905530611674, "set_robot_commands": 0.0037168558438618977, "deviation-center-line": 0.753350220443485, "driven_lanedir_consec": 2.81934484428192, "sim_compute_sim_state": 0.019223608175913492, "sim_compute_performance-ego": 0.0030543200174967446}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7509492507094992, "get_ui_image": 0.023972769578297932, "step_physics": 0.06219444672266642, "survival_time": 14.950000000000076, "driven_lanedir": 1.736407192883627, "get_state_dump": 0.008226696650187175, "sim_render-ego": 0.004675066471099854, "get_robot_state": 0.009464461008707684, "get_duckie_state": 1.0911623636881511e-06, "in-drivable-lane": 3.8500000000000343, "agent_compute-ego": 0.012417047023773194, "deviation-heading": 4.388663917171468, "complete-iteration": 0.14738682508468628, "set_robot_commands": 0.003670822779337565, "deviation-center-line": 0.8586494432460708, "driven_lanedir_consec": 1.736407192883627, "sim_compute_sim_state": 0.01961571216583252, "sim_compute_performance-ego": 0.0030675911903381347}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0826806313725696, "get_ui_image": 0.0240112829208374, "step_physics": 0.06452629009882609, "survival_time": 14.950000000000076, "driven_lanedir": 2.7753083778962657, "get_state_dump": 0.008756806055704752, "sim_render-ego": 0.004548310438791911, "get_robot_state": 0.00990397055943807, "get_duckie_state": 1.045068105061849e-06, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.01208147128423055, "deviation-heading": 3.0283244608449853, "complete-iteration": 0.15325817664464314, "set_robot_commands": 0.0036609347661336264, "deviation-center-line": 0.6066941906146562, "driven_lanedir_consec": 2.0283499237322777, "sim_compute_sim_state": 0.02265033562978109, "sim_compute_performance-ego": 0.0030350430806477865}}
set_robot_commands_max0.003781011899312337
set_robot_commands_mean0.003707406322161357
set_robot_commands_median0.0036938393115997312
set_robot_commands_min0.0036609347661336264
sim_compute_performance-ego_max0.0030675911903381347
sim_compute_performance-ego_mean0.003051557342211406
sim_compute_performance-ego_median0.00305179754892985
sim_compute_performance-ego_min0.0030350430806477865
sim_compute_sim_state_max0.02265033562978109
sim_compute_sim_state_mean0.02028559565544128
sim_compute_sim_state_median0.019634219408035277
sim_compute_sim_state_min0.019223608175913492
sim_render-ego_max0.004675066471099854
sim_render-ego_mean0.004575810829798381
sim_render-ego_median0.004552383422851563
sim_render-ego_min0.004523410002390544
simulation-passed1
step_physics_max0.06452629009882609
step_physics_mean0.061852937539418534
step_physics_median0.061347392002741495
step_physics_min0.060190676053365075
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4321511637Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.011341312096347
survival_time_median14.950000000000076
deviation-center-line_median0.3800365313572702
in-drivable-lane_median5.5000000000000675


other stats
agent_compute-ego_max0.017299149831136066
agent_compute-ego_mean0.01666847894887556
agent_compute-ego_median0.01662256181836981
agent_compute-ego_min0.016129642327626547
complete-iteration_max0.19123881022135417
complete-iteration_mean0.18687114036219657
complete-iteration_median0.18744504046712993
complete-iteration_min0.1813556702931722
deviation-center-line_max0.69985806194183
deviation-center-line_mean0.43044419721092336
deviation-center-line_min0.2618456641873229
deviation-heading_max2.566832520026486
deviation-heading_mean1.7893946660101607
deviation-heading_median1.6951281052360714
deviation-heading_min1.2004899335420145
driven_any_max3.710632069168595
driven_any_mean3.146416902122988
driven_any_median3.1300348875081134
driven_any_min2.614965764307131
driven_lanedir_consec_max3.0717483456109114
driven_lanedir_consec_mean1.9516905973225975
driven_lanedir_consec_min0.7123314194867862
driven_lanedir_max3.0717483456109114
driven_lanedir_mean1.9516905973225975
driven_lanedir_median2.011341312096347
driven_lanedir_min0.7123314194867862
get_duckie_state_max1.6578038533528643e-06
get_duckie_state_mean1.6452792035322503e-06
get_duckie_state_median1.651828040039761e-06
get_duckie_state_min1.6196568806966145e-06
get_robot_state_max0.011884114261348873
get_robot_state_mean0.011558108010858254
get_robot_state_median0.0115701429049174
get_robot_state_min0.011208031972249347
get_state_dump_max0.009689587752024331
get_state_dump_mean0.009581246630146097
get_state_dump_median0.00966964891710677
get_state_dump_min0.009296100934346517
get_ui_image_max0.03232798973719279
get_ui_image_mean0.030515541798396516
get_ui_image_median0.030489898920059204
get_ui_image_min0.028754379616274858
in-drivable-lane_max10.80000000000007
in-drivable-lane_mean6.137500000000057
in-drivable-lane_min2.7500000000000275
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.710632069168595, "get_ui_image": 0.03232798973719279, "step_physics": 0.0820303209622701, "survival_time": 14.950000000000076, "driven_lanedir": 3.0717483456109114, "get_state_dump": 0.009689587752024331, "sim_render-ego": 0.005630330244700114, "get_robot_state": 0.011563783486684165, "get_duckie_state": 1.6578038533528643e-06, "in-drivable-lane": 2.7500000000000275, "agent_compute-ego": 0.017299149831136066, "deviation-heading": 2.566832520026486, "complete-iteration": 0.19123881022135417, "set_robot_commands": 0.004976669947306315, "deviation-center-line": 0.69985806194183, "driven_lanedir_consec": 3.0717483456109114, "sim_compute_sim_state": 0.02381144126256307, "sim_compute_performance-ego": 0.003788145383199056}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1366577589392666, "get_ui_image": 0.03141207456588745, "step_physics": 0.07686491250991821, "survival_time": 14.950000000000076, "driven_lanedir": 2.0201110956681942, "get_state_dump": 0.009296100934346517, "sim_render-ego": 0.005582645734151204, "get_robot_state": 0.011208031972249347, "get_duckie_state": 1.656214396158854e-06, "in-drivable-lane": 7.050000000000084, "agent_compute-ego": 0.016129642327626547, "deviation-heading": 1.2420752639901458, "complete-iteration": 0.1813556702931722, "set_robot_commands": 0.004808889230092366, "deviation-center-line": 0.4354277250889462, "driven_lanedir_consec": 2.0201110956681942, "sim_compute_sim_state": 0.02227265199025472, "sim_compute_performance-ego": 0.0036548932393391928}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.12341201607696, "get_ui_image": 0.02956772327423096, "step_physics": 0.08318942626317342, "survival_time": 14.950000000000076, "driven_lanedir": 0.7123314194867862, "get_state_dump": 0.009656805197397868, "sim_render-ego": 0.005552403132120768, "get_robot_state": 0.011576502323150635, "get_duckie_state": 1.6196568806966145e-06, "in-drivable-lane": 10.80000000000007, "agent_compute-ego": 0.016747225125630698, "deviation-heading": 2.1481809464819968, "complete-iteration": 0.18791971604029337, "set_robot_commands": 0.004857672055562337, "deviation-center-line": 0.2618456641873229, "driven_lanedir_consec": 0.7123314194867862, "sim_compute_sim_state": 0.022904260953267416, "sim_compute_performance-ego": 0.003745958010355631}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.614965764307131, "get_ui_image": 0.028754379616274858, "step_physics": 0.07781918570719051, "survival_time": 11.65000000000003, "driven_lanedir": 2.0025715285244994, "get_state_dump": 0.009682492636815672, "sim_render-ego": 0.005796876588092853, "get_robot_state": 0.011884114261348873, "get_duckie_state": 1.647441683920668e-06, "in-drivable-lane": 3.95000000000005, "agent_compute-ego": 0.016497898511108923, "deviation-heading": 1.2004899335420145, "complete-iteration": 0.18697036489396648, "set_robot_commands": 0.004945903376959936, "deviation-center-line": 0.32464533762559417, "driven_lanedir_consec": 2.0025715285244994, "sim_compute_sim_state": 0.027506326912810363, "sim_compute_performance-ego": 0.0039616040405797345}}
set_robot_commands_max0.004976669947306315
set_robot_commands_mean0.004897283652480239
set_robot_commands_median0.004901787716261137
set_robot_commands_min0.004808889230092366
sim_compute_performance-ego_max0.0039616040405797345
sim_compute_performance-ego_mean0.003787650168368404
sim_compute_performance-ego_median0.003767051696777344
sim_compute_performance-ego_min0.0036548932393391928
sim_compute_sim_state_max0.027506326912810363
sim_compute_sim_state_mean0.024123670279723893
sim_compute_sim_state_median0.023357851107915245
sim_compute_sim_state_min0.02227265199025472
sim_render-ego_max0.005796876588092853
sim_render-ego_mean0.005640563924766235
sim_render-ego_median0.005606487989425659
sim_render-ego_min0.005552403132120768
simulation-passed1
step_physics_max0.08318942626317342
step_physics_mean0.07997596136063806
step_physics_median0.07992475333473031
step_physics_min0.07686491250991821
survival_time_max14.950000000000076
survival_time_mean14.125000000000068
survival_time_min11.65000000000003
No reset possible
4319811630Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6595000317863828
survival_time_median13.875000000000062
deviation-center-line_median0.2639388987997444
in-drivable-lane_median1.4750000000000174


other stats
agent_compute-ego_max0.01415225863456726
agent_compute-ego_mean0.013792974926881342
agent_compute-ego_median0.013831352944875456
agent_compute-ego_min0.013356935183207196
complete-iteration_max0.17996261920779943
complete-iteration_mean0.16670396588211442
complete-iteration_median0.16397844673003126
complete-iteration_min0.1588963508605957
deviation-center-line_max0.7176927725337021
deviation-center-line_mean0.3547916147351357
deviation-center-line_min0.17359588880735197
deviation-heading_max5.818148035667721
deviation-heading_mean2.6003916964619025
deviation-heading_median1.971697881050213
deviation-heading_min0.6400229880794639
driven_any_max3.3011232025529127
driven_any_mean2.4935126188453856
driven_any_median2.679041561484515
driven_any_min1.3148441498595995
driven_lanedir_consec_max2.3891522001712864
driven_lanedir_consec_mean1.6018431059644311
driven_lanedir_consec_min0.6992201601136716
driven_lanedir_max2.3891522001712864
driven_lanedir_mean1.6018431059644311
driven_lanedir_median1.6595000317863828
driven_lanedir_min0.6992201601136716
get_duckie_state_max1.6596168279647827e-06
get_duckie_state_mean1.582500526902393e-06
get_duckie_state_median1.606029152070116e-06
get_duckie_state_min1.4583269755045572e-06
get_robot_state_max0.013466950505971909
get_robot_state_mean0.012013422203494
get_robot_state_median0.01172058957801836
get_robot_state_min0.011145559151967369
get_state_dump_max0.01144940499216318
get_state_dump_mean0.010185032908927642
get_state_dump_median0.009973519475134694
get_state_dump_min0.009343687693277996
get_ui_image_max0.02595853805541992
get_ui_image_mean0.025616105577556347
get_ui_image_median0.025548378589169293
get_ui_image_min0.02540912707646688
in-drivable-lane_max11.350000000000083
in-drivable-lane_mean3.5750000000000295
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.3148441498595995, "get_ui_image": 0.025495517973931844, "step_physics": 0.06619061079601314, "survival_time": 7.449999999999981, "driven_lanedir": 1.1468944680516044, "get_state_dump": 0.010274240634585386, "sim_render-ego": 0.004897074411379411, "get_robot_state": 0.012059861381581966, "get_duckie_state": 1.633727310487888e-06, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.013594435365408058, "deviation-heading": 1.9319428586983929, "complete-iteration": 0.1620041155975137, "set_robot_commands": 0.003996327419409016, "deviation-center-line": 0.20258159081649313, "driven_lanedir_consec": 1.1468944680516044, "sim_compute_sim_state": 0.022106676293699532, "sim_compute_performance-ego": 0.003288848288107238}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.6630722890636185, "get_ui_image": 0.02560123920440674, "step_physics": 0.06665953954060873, "survival_time": 14.950000000000076, "driven_lanedir": 2.3891522001712864, "get_state_dump": 0.009343687693277996, "sim_render-ego": 0.004916990598042806, "get_robot_state": 0.011145559151967369, "get_duckie_state": 1.4583269755045572e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013356935183207196, "deviation-heading": 5.818148035667721, "complete-iteration": 0.1588963508605957, "set_robot_commands": 0.003964414596557617, "deviation-center-line": 0.7176927725337021, "driven_lanedir_consec": 2.3891522001712864, "sim_compute_sim_state": 0.0205282465616862, "sim_compute_performance-ego": 0.0032776379585266113}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.3011232025529127, "get_ui_image": 0.02540912707646688, "step_physics": 0.071742156346639, "survival_time": 14.950000000000076, "driven_lanedir": 0.6992201601136716, "get_state_dump": 0.009672798315684, "sim_render-ego": 0.00490865707397461, "get_robot_state": 0.011381317774454752, "get_duckie_state": 1.5783309936523438e-06, "in-drivable-lane": 11.350000000000083, "agent_compute-ego": 0.014068270524342856, "deviation-heading": 0.6400229880794639, "complete-iteration": 0.16595277786254883, "set_robot_commands": 0.003965424696604411, "deviation-center-line": 0.17359588880735197, "driven_lanedir_consec": 0.6992201601136716, "sim_compute_sim_state": 0.02149021625518799, "sim_compute_performance-ego": 0.0032120498021443685}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6950108339054117, "get_ui_image": 0.02595853805541992, "step_physics": 0.07525564916431904, "survival_time": 12.800000000000049, "driven_lanedir": 2.1721055955211614, "get_state_dump": 0.01144940499216318, "sim_render-ego": 0.005011783912777901, "get_robot_state": 0.013466950505971909, "get_duckie_state": 1.6596168279647827e-06, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.01415225863456726, "deviation-heading": 2.011452903402033, "complete-iteration": 0.17996261920779943, "set_robot_commands": 0.0040500592440366745, "deviation-center-line": 0.3252962067829957, "driven_lanedir_consec": 2.1721055955211614, "sim_compute_sim_state": 0.027096635662019253, "sim_compute_performance-ego": 0.003412999212741852}}
set_robot_commands_max0.0040500592440366745
set_robot_commands_mean0.00399405648915193
set_robot_commands_median0.0039808760580067135
set_robot_commands_min0.003964414596557617
sim_compute_performance-ego_max0.003412999212741852
sim_compute_performance-ego_mean0.0032978838153800176
sim_compute_performance-ego_median0.0032832431233169247
sim_compute_performance-ego_min0.0032120498021443685
sim_compute_sim_state_max0.027096635662019253
sim_compute_sim_state_mean0.02280544369314824
sim_compute_sim_state_median0.02179844627444376
sim_compute_sim_state_min0.0205282465616862
sim_render-ego_max0.005011783912777901
sim_render-ego_mean0.004933626499043681
sim_render-ego_median0.004912823836008708
sim_render-ego_min0.004897074411379411
simulation-passed1
step_physics_max0.07525564916431904
step_physics_mean0.06996198896189498
step_physics_median0.06920084794362386
step_physics_min0.06619061079601314
survival_time_max14.950000000000076
survival_time_mean12.537500000000046
survival_time_min7.449999999999981
No reset possible
4319511630Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:09:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.426767999012019
survival_time_median14.950000000000076
deviation-center-line_median0.7216233191523839
in-drivable-lane_median0.8750000000000102


other stats
agent_compute-ego_max0.01952369133631388
agent_compute-ego_mean0.01692908267180125
agent_compute-ego_median0.017155717213948568
agent_compute-ego_min0.013881204922993978
complete-iteration_max0.2184896731376648
complete-iteration_mean0.19613303502400717
complete-iteration_median0.19596527099609376
complete-iteration_min0.17411192496617636
deviation-center-line_max0.8262482540689515
deviation-center-line_mean0.6338105029325893
deviation-center-line_min0.2657471193566384
deviation-heading_max5.073501345050549
deviation-heading_mean4.2786307142576225
deviation-heading_median4.509558537702381
deviation-heading_min3.021904436575179
driven_any_max3.254706695903892
driven_any_mean2.950092889067784
driven_any_median2.898237733848698
driven_any_min2.749189392669849
driven_lanedir_consec_max2.5441851463822314
driven_lanedir_consec_mean2.086918204380984
driven_lanedir_consec_min0.949951673117668
driven_lanedir_max2.965944406142223
driven_lanedir_mean2.192358019320982
driven_lanedir_median2.426767999012019
driven_lanedir_min0.949951673117668
get_duckie_state_max1.8294652303059897e-06
get_duckie_state_mean1.6832351684570312e-06
get_duckie_state_median1.661380132039388e-06
get_duckie_state_min1.5807151794433591e-06
get_robot_state_max0.013647851943969726
get_robot_state_mean0.012941198150316876
get_robot_state_median0.013003334204355876
get_robot_state_min0.012110272248586018
get_state_dump_max0.011053003470102948
get_state_dump_mean0.01064668357372284
get_state_dump_median0.01070907433827718
get_state_dump_min0.01011558214823405
get_ui_image_max0.03665768146514893
get_ui_image_mean0.03087085982163747
get_ui_image_median0.03051767388979594
get_ui_image_min0.025790410041809084
in-drivable-lane_max8.600000000000092
in-drivable-lane_mean2.587500000000028
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.749189392669849, "get_ui_image": 0.0325873327255249, "step_physics": 0.08801245053609212, "survival_time": 14.950000000000076, "driven_lanedir": 2.5267630898712556, "get_state_dump": 0.011053003470102948, "sim_render-ego": 0.006435620784759522, "get_robot_state": 0.013448938528696696, "get_duckie_state": 1.7078717549641929e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01856991688410441, "deviation-heading": 4.786532706229454, "complete-iteration": 0.20646728515625, "set_robot_commands": 0.005675622622172038, "deviation-center-line": 0.8262482540689515, "driven_lanedir_consec": 2.5267630898712556, "sim_compute_sim_state": 0.026234197616577148, "sim_compute_performance-ego": 0.00432642936706543}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.7914656846586734, "get_ui_image": 0.03665768146514893, "step_physics": 0.09460060834884644, "survival_time": 14.950000000000076, "driven_lanedir": 2.326772908152782, "get_state_dump": 0.01093937873840332, "sim_render-ego": 0.006549087365468343, "get_robot_state": 0.013647851943969726, "get_duckie_state": 1.8294652303059897e-06, "in-drivable-lane": 1.300000000000014, "agent_compute-ego": 0.01952369133631388, "deviation-heading": 5.073501345050549, "complete-iteration": 0.2184896731376648, "set_robot_commands": 0.005812045733133952, "deviation-center-line": 0.7434262953272239, "driven_lanedir_consec": 2.326772908152782, "sim_compute_sim_state": 0.02626002788543701, "sim_compute_performance-ego": 0.004374214013417562}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0050097830387226, "get_ui_image": 0.028448015054066977, "step_physics": 0.08132361968358358, "survival_time": 14.950000000000076, "driven_lanedir": 0.949951673117668, "get_state_dump": 0.01011558214823405, "sim_render-ego": 0.005747925440470377, "get_robot_state": 0.012110272248586018, "get_duckie_state": 1.5807151794433591e-06, "in-drivable-lane": 8.600000000000092, "agent_compute-ego": 0.015741517543792726, "deviation-heading": 3.021904436575179, "complete-iteration": 0.1854632568359375, "set_robot_commands": 0.004778412183125814, "deviation-center-line": 0.2657471193566384, "driven_lanedir_consec": 0.949951673117668, "sim_compute_sim_state": 0.023322139581044513, "sim_compute_performance-ego": 0.0037620862325032554}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.254706695903892, "get_ui_image": 0.025790410041809084, "step_physics": 0.07233661095301311, "survival_time": 14.950000000000076, "driven_lanedir": 2.965944406142223, "get_state_dump": 0.010478769938151042, "sim_render-ego": 0.005097207228342692, "get_robot_state": 0.012557729880015056, "get_duckie_state": 1.6148885091145834e-06, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.013881204922993978, "deviation-heading": 4.232584369175307, "complete-iteration": 0.17411192496617636, "set_robot_commands": 0.00406521479288737, "deviation-center-line": 0.6998203429775438, "driven_lanedir_consec": 2.5441851463822314, "sim_compute_sim_state": 0.02637943983078003, "sim_compute_performance-ego": 0.003417081038157145}}
set_robot_commands_max0.005812045733133952
set_robot_commands_mean0.005082823832829793
set_robot_commands_median0.005227017402648926
set_robot_commands_min0.00406521479288737
sim_compute_performance-ego_max0.004374214013417562
sim_compute_performance-ego_mean0.0039699526627858485
sim_compute_performance-ego_median0.004044257799784343
sim_compute_performance-ego_min0.003417081038157145
sim_compute_sim_state_max0.02637943983078003
sim_compute_sim_state_mean0.025548951228459675
sim_compute_sim_state_median0.02624711275100708
sim_compute_sim_state_min0.023322139581044513
sim_render-ego_max0.006549087365468343
sim_render-ego_mean0.0059574602047602334
sim_render-ego_median0.0060917731126149495
sim_render-ego_min0.005097207228342692
simulation-passed1
step_physics_max0.09460060834884644
step_physics_mean0.08406832238038381
step_physics_median0.08466803510983785
step_physics_min0.07233661095301311
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4318111627Philippe ReddyΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6630309648876973
survival_time_median14.950000000000076
deviation-center-line_median0.6496719584465935
in-drivable-lane_median0.350000000000005


other stats
agent_compute-ego_max0.01660000960032145
agent_compute-ego_mean0.01458096444606781
agent_compute-ego_median0.01494593381881714
agent_compute-ego_min0.01183198054631551
complete-iteration_max0.1943356450398763
complete-iteration_mean0.1736930493513743
complete-iteration_median0.17666492144266766
complete-iteration_min0.14710670948028565
deviation-center-line_max1.0127790044568448
deviation-center-line_mean0.6850143221988376
deviation-center-line_min0.4279343674453187
deviation-heading_max4.492565769078368
deviation-heading_mean3.6981014517280033
deviation-heading_median3.805859928937569
deviation-heading_min2.688120179958508
driven_any_max1.9399154984311704
driven_any_mean1.9382412737365695
driven_any_median1.9398026791288776
driven_any_min1.9334442382573525
driven_lanedir_consec_max1.890519544869244
driven_lanedir_consec_mean1.621953962452431
driven_lanedir_consec_min1.2712343751650854
driven_lanedir_max1.890519544869244
driven_lanedir_mean1.728368230065619
driven_lanedir_median1.7636046394353555
driven_lanedir_min1.49574409652252
get_duckie_state_max1.6887982686360676e-06
get_duckie_state_mean1.5399853388468424e-06
get_duckie_state_median1.6466776529947916e-06
get_duckie_state_min1.1777877807617188e-06
get_robot_state_max0.01215360959370931
get_robot_state_mean0.01106968899567922
get_robot_state_median0.011320249636967976
get_robot_state_min0.009484647115071614
get_state_dump_max0.010151179631551106
get_state_dump_mean0.00940617839495341
get_state_dump_median0.00950213630994161
get_state_dump_min0.008469261328379314
get_ui_image_max0.03130301554997762
get_ui_image_mean0.028336680332819626
get_ui_image_median0.02894187251726786
get_ui_image_min0.024159960746765137
in-drivable-lane_max2.199999999999992
in-drivable-lane_mean0.7250000000000005
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9334442382573525, "get_ui_image": 0.024159960746765137, "step_physics": 0.06341103871663412, "survival_time": 14.950000000000076, "driven_lanedir": 1.6968914456178366, "get_state_dump": 0.008469261328379314, "sim_render-ego": 0.004493772188822428, "get_robot_state": 0.009484647115071614, "get_duckie_state": 1.1777877807617188e-06, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.01183198054631551, "deviation-heading": 4.492565769078368, "complete-iteration": 0.14710670948028565, "set_robot_commands": 0.003708865642547608, "deviation-center-line": 0.7591858560620653, "driven_lanedir_consec": 1.2712343751650854, "sim_compute_sim_state": 0.01846251885096232, "sim_compute_performance-ego": 0.002996056079864502}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9398634420557204, "get_ui_image": 0.02670596758524577, "step_physics": 0.06955755472183228, "survival_time": 14.950000000000076, "driven_lanedir": 1.830317833252875, "get_state_dump": 0.00908263365427653, "sim_render-ego": 0.0051494002342224125, "get_robot_state": 0.01084910790125529, "get_duckie_state": 1.6276041666666668e-06, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.013581376075744628, "deviation-heading": 3.519613089314093, "complete-iteration": 0.16259363094965618, "set_robot_commands": 0.004220123291015625, "deviation-center-line": 0.5401580608311218, "driven_lanedir_consec": 1.830317833252875, "sim_compute_sim_state": 0.019879046281178793, "sim_compute_performance-ego": 0.0034610962867736815}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9397419162020344, "get_ui_image": 0.031177777449289956, "step_physics": 0.08279084046681721, "survival_time": 14.950000000000076, "driven_lanedir": 1.49574409652252, "get_state_dump": 0.010151179631551106, "sim_render-ego": 0.005803438027699789, "get_robot_state": 0.01215360959370931, "get_duckie_state": 1.6887982686360676e-06, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.01660000960032145, "deviation-heading": 4.0921067685610435, "complete-iteration": 0.1907362119356791, "set_robot_commands": 0.005078940391540527, "deviation-center-line": 1.0127790044568448, "driven_lanedir_consec": 1.49574409652252, "sim_compute_sim_state": 0.02306260108947754, "sim_compute_performance-ego": 0.003794554869333903}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399154984311704, "get_ui_image": 0.03130301554997762, "step_physics": 0.08479793945948283, "survival_time": 14.950000000000076, "driven_lanedir": 1.890519544869244, "get_state_dump": 0.00992163896560669, "sim_render-ego": 0.005671636263529459, "get_robot_state": 0.011791391372680664, "get_duckie_state": 1.6657511393229166e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01631049156188965, "deviation-heading": 2.688120179958508, "complete-iteration": 0.1943356450398763, "set_robot_commands": 0.005074095726013183, "deviation-center-line": 0.4279343674453187, "driven_lanedir_consec": 1.890519544869244, "sim_compute_sim_state": 0.025656874179840087, "sim_compute_performance-ego": 0.00368945042292277}}
set_robot_commands_max0.005078940391540527
set_robot_commands_mean0.0045205062627792355
set_robot_commands_median0.004647109508514404
set_robot_commands_min0.003708865642547608
sim_compute_performance-ego_max0.003794554869333903
sim_compute_performance-ego_mean0.0034852894147237145
sim_compute_performance-ego_median0.003575273354848226
sim_compute_performance-ego_min0.002996056079864502
sim_compute_sim_state_max0.025656874179840087
sim_compute_sim_state_mean0.021765260100364683
sim_compute_sim_state_median0.02147082368532817
sim_compute_sim_state_min0.01846251885096232
sim_render-ego_max0.005803438027699789
sim_render-ego_mean0.005279561678568522
sim_render-ego_median0.005410518248875936
sim_render-ego_min0.004493772188822428
simulation-passed1
step_physics_max0.08479793945948283
step_physics_mean0.07513934334119161
step_physics_median0.07617419759432476
step_physics_min0.06341103871663412
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4316811624Anthony CourchesneΒ πŸ‡¨πŸ‡¦TNetR1aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.915604314542562
survival_time_median5.5999999999999925
deviation-center-line_median0.535058221697215
in-drivable-lane_median0.5250000000000026


other stats
agent_compute-ego_max0.04807634173699145
agent_compute-ego_mean0.03792619778830235
agent_compute-ego_median0.03537649317094457
agent_compute-ego_min0.03287546307432885
complete-iteration_max0.19873793170137224
complete-iteration_mean0.1879678257213105
complete-iteration_median0.1893741338294849
complete-iteration_min0.17438510352489994
deviation-center-line_max0.9272689547881078
deviation-center-line_mean0.5432878140136649
deviation-center-line_min0.175765857872122
deviation-heading_max3.5446339651091416
deviation-heading_mean1.5203871397908308
deviation-heading_median1.037002945532269
deviation-heading_min0.4629087029896437
driven_any_max2.9182304494250557
driven_any_mean1.3592664274006825
driven_any_median1.0435187222488105
driven_any_min0.4317978156800528
driven_lanedir_consec_max2.4948435686534074
driven_lanedir_consec_mean1.1608711274907988
driven_lanedir_consec_min0.31743231222466406
driven_lanedir_max2.4948435686534074
driven_lanedir_mean1.1608711274907988
driven_lanedir_median0.915604314542562
driven_lanedir_min0.31743231222466406
get_duckie_state_max1.610120137532552e-06
get_duckie_state_mean1.539671107922666e-06
get_duckie_state_median1.5707135950244449e-06
get_duckie_state_min1.407137104109222e-06
get_robot_state_max0.011257152557373046
get_robot_state_mean0.010868432940593463
get_robot_state_median0.01085929990347858
get_robot_state_min0.010497979398043651
get_state_dump_max0.009552404880523682
get_state_dump_mean0.00930767360933311
get_state_dump_median0.009301843534928234
get_state_dump_min0.009074602486952296
get_ui_image_max0.02973476445899819
get_ui_image_mean0.028452314619389855
get_ui_image_median0.02938424445732295
get_ui_image_min0.025306005103915345
in-drivable-lane_max1.4500000000000206
in-drivable-lane_mean0.750000000000006
in-drivable-lane_min0.4999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.46520094251865823, "get_ui_image": 0.02973476445899819, "step_physics": 0.06983040413766536, "survival_time": 2.6499999999999986, "driven_lanedir": 0.34422781131711044, "get_state_dump": 0.009074602486952296, "sim_render-ego": 0.004996880045476949, "get_robot_state": 0.010497979398043651, "get_duckie_state": 1.5519699960384728e-06, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.04807634173699145, "deviation-heading": 0.5529083350204786, "complete-iteration": 0.19873793170137224, "set_robot_commands": 0.003828898915704691, "deviation-center-line": 0.175765857872122, "driven_lanedir_consec": 0.34422781131711044, "sim_compute_sim_state": 0.01925998813701126, "sim_compute_performance-ego": 0.003344175950536188}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.6218365019789622, "get_ui_image": 0.029527565192060862, "step_physics": 0.06800880069621125, "survival_time": 8.549999999999986, "driven_lanedir": 1.4869808177680133, "get_state_dump": 0.009246131830048144, "sim_render-ego": 0.005239655399880214, "get_robot_state": 0.010647287145692704, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.034714726676717836, "deviation-heading": 1.521097556044059, "complete-iteration": 0.1847648495122006, "set_robot_commands": 0.003996722182335212, "deviation-center-line": 0.9272689547881078, "driven_lanedir_consec": 1.4869808177680133, "sim_compute_sim_state": 0.01990437786481534, "sim_compute_performance-ego": 0.0033806192944621483}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9182304494250557, "get_ui_image": 0.02924092372258504, "step_physics": 0.07269113620122274, "survival_time": 14.950000000000076, "driven_lanedir": 2.4948435686534074, "get_state_dump": 0.009552404880523682, "sim_render-ego": 0.0053873403867085775, "get_robot_state": 0.011257152557373046, "get_duckie_state": 1.610120137532552e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.0360382596651713, "deviation-heading": 3.5446339651091416, "complete-iteration": 0.1939834181467692, "set_robot_commands": 0.004107957681020101, "deviation-center-line": 0.8715568479748614, "driven_lanedir_consec": 2.4948435686534074, "sim_compute_sim_state": 0.02204909086227417, "sim_compute_performance-ego": 0.0035566989580790203}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.4317978156800528, "get_ui_image": 0.025306005103915345, "step_physics": 0.06149926372602874, "survival_time": 2.549999999999999, "driven_lanedir": 0.31743231222466406, "get_state_dump": 0.009357555239808326, "sim_render-ego": 0.00472872864966299, "get_robot_state": 0.011071312661264456, "get_duckie_state": 1.407137104109222e-06, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.03287546307432885, "deviation-heading": 0.4629087029896437, "complete-iteration": 0.17438510352489994, "set_robot_commands": 0.0033992692535998775, "deviation-center-line": 0.1985595954195684, "driven_lanedir_consec": 0.31743231222466406, "sim_compute_sim_state": 0.02254314516104904, "sim_compute_performance-ego": 0.003515150032791437}}
set_robot_commands_max0.004107957681020101
set_robot_commands_mean0.0038332120081649703
set_robot_commands_median0.003912810549019952
set_robot_commands_min0.0033992692535998775
sim_compute_performance-ego_max0.0035566989580790203
sim_compute_performance-ego_mean0.0034491610589671984
sim_compute_performance-ego_median0.0034478846636267924
sim_compute_performance-ego_min0.003344175950536188
sim_compute_sim_state_max0.02254314516104904
sim_compute_sim_state_mean0.020939150506287453
sim_compute_sim_state_median0.020976734363544754
sim_compute_sim_state_min0.01925998813701126
sim_render-ego_max0.0053873403867085775
sim_render-ego_mean0.005088151120432182
sim_render-ego_median0.005118267722678581
sim_render-ego_min0.00472872864966299
simulation-passed1
step_physics_max0.07269113620122274
step_physics_mean0.06800740119028204
step_physics_median0.06891960241693831
step_physics_min0.06149926372602874
survival_time_max14.950000000000076
survival_time_mean7.175000000000015
survival_time_min2.549999999999999
No reset possible
4315911623Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.520214461286712
survival_time_median14.950000000000076
deviation-center-line_median0.737976029278186
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.016202476024627686
agent_compute-ego_mean0.015611441135406494
agent_compute-ego_median0.015560593207677206
agent_compute-ego_min0.01512210210164388
complete-iteration_max0.19363736311594645
complete-iteration_mean0.18322252651055657
complete-iteration_median0.1838143726189931
complete-iteration_min0.17162399768829345
deviation-center-line_max0.8741430759404502
deviation-center-line_mean0.739878326723389
deviation-center-line_min0.6094181723967343
deviation-heading_max5.57092822455786
deviation-heading_mean4.744746269470808
deviation-heading_median4.915184859483622
deviation-heading_min3.5776871343581256
driven_any_max3.021180212925161
driven_any_mean2.85420690468666
driven_any_median2.8123736278495337
driven_any_min2.77090015012241
driven_lanedir_consec_max2.8844933513219235
driven_lanedir_consec_mean2.4066099467244997
driven_lanedir_consec_min1.7015175130026503
driven_lanedir_max2.8844933513219235
driven_lanedir_mean2.4066099467244997
driven_lanedir_median2.520214461286712
driven_lanedir_min1.7015175130026503
get_duckie_state_max1.5004475911458333e-06
get_duckie_state_mean1.4317035675048828e-06
get_duckie_state_median1.4567375183105467e-06
get_duckie_state_min1.3128916422526042e-06
get_robot_state_max0.0116381041208903
get_robot_state_mean0.011062854528427124
get_robot_state_median0.011334874629974366
get_robot_state_min0.009943564732869468
get_state_dump_max0.009693984985351562
get_state_dump_mean0.009318180680274964
get_state_dump_median0.0095405912399292
get_state_dump_min0.008497555255889893
get_ui_image_max0.032240042686462404
get_ui_image_mean0.030733553767204286
get_ui_image_median0.03092349926630656
get_ui_image_min0.028847173849741618
in-drivable-lane_max4.700000000000052
in-drivable-lane_mean1.175000000000013
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.8045679811935336, "get_ui_image": 0.028847173849741618, "step_physics": 0.07576840162277222, "survival_time": 14.950000000000076, "driven_lanedir": 2.54329477162869, "get_state_dump": 0.008497555255889893, "sim_render-ego": 0.005059960683186849, "get_robot_state": 0.009943564732869468, "get_duckie_state": 1.3128916422526042e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01512210210164388, "deviation-heading": 5.366837451556478, "complete-iteration": 0.17162399768829345, "set_robot_commands": 0.004395496845245361, "deviation-center-line": 0.7791690486412989, "driven_lanedir_consec": 2.54329477162869, "sim_compute_sim_state": 0.02049550533294678, "sim_compute_performance-ego": 0.003395729064941406}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.77090015012241, "get_ui_image": 0.032240042686462404, "step_physics": 0.0775096853574117, "survival_time": 14.950000000000076, "driven_lanedir": 2.4971341509447336, "get_state_dump": 0.00950329303741455, "sim_render-ego": 0.005350748697916667, "get_robot_state": 0.011248263518015543, "get_duckie_state": 1.445611317952474e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015599831740061442, "deviation-heading": 5.57092822455786, "complete-iteration": 0.18089925130208337, "set_robot_commands": 0.004514636993408203, "deviation-center-line": 0.696783009915073, "driven_lanedir_consec": 2.4971341509447336, "sim_compute_sim_state": 0.021223125457763673, "sim_compute_performance-ego": 0.003599099318186442}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.820179274505534, "get_ui_image": 0.030468398729960124, "step_physics": 0.08117911815643311, "survival_time": 14.950000000000076, "driven_lanedir": 1.7015175130026503, "get_state_dump": 0.009577889442443848, "sim_render-ego": 0.005687475999196371, "get_robot_state": 0.0116381041208903, "get_duckie_state": 1.5004475911458333e-06, "in-drivable-lane": 4.700000000000052, "agent_compute-ego": 0.016202476024627686, "deviation-heading": 4.463532267410767, "complete-iteration": 0.1867294939359029, "set_robot_commands": 0.004640077749888102, "deviation-center-line": 0.6094181723967343, "driven_lanedir_consec": 1.7015175130026503, "sim_compute_sim_state": 0.02346684694290161, "sim_compute_performance-ego": 0.0037572026252746583}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.021180212925161, "get_ui_image": 0.03137859980265299, "step_physics": 0.08641030391057332, "survival_time": 14.950000000000076, "driven_lanedir": 2.8844933513219235, "get_state_dump": 0.009693984985351562, "sim_render-ego": 0.0052837554613749185, "get_robot_state": 0.011421485741933189, "get_duckie_state": 1.4678637186686197e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.015521354675292968, "deviation-heading": 3.5776871343581256, "complete-iteration": 0.19363736311594645, "set_robot_commands": 0.004543000857035319, "deviation-center-line": 0.8741430759404502, "driven_lanedir_consec": 2.8844933513219235, "sim_compute_sim_state": 0.02581865628560384, "sim_compute_performance-ego": 0.003455483913421631}}
set_robot_commands_max0.004640077749888102
set_robot_commands_mean0.0045233031113942465
set_robot_commands_median0.004528818925221761
set_robot_commands_min0.004395496845245361
sim_compute_performance-ego_max0.0037572026252746583
sim_compute_performance-ego_mean0.0035518787304560343
sim_compute_performance-ego_median0.0035272916158040363
sim_compute_performance-ego_min0.003395729064941406
sim_compute_sim_state_max0.02581865628560384
sim_compute_sim_state_mean0.022751033504803973
sim_compute_sim_state_median0.022344986200332644
sim_compute_sim_state_min0.02049550533294678
sim_render-ego_max0.005687475999196371
sim_render-ego_mean0.005345485210418701
sim_render-ego_median0.005317252079645793
sim_render-ego_min0.005059960683186849
simulation-passed1
step_physics_max0.08641030391057332
step_physics_mean0.08021687726179759
step_physics_median0.07934440175692241
step_physics_min0.07576840162277222
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4314611619Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoreg02-b35ee35771a7-10:06:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4314511618Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.117524516496335
survival_time_median14.950000000000076
deviation-center-line_median0.5238240071447053
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012468790213267009
agent_compute-ego_mean0.012351048176806273
agent_compute-ego_median0.012402448625010451
agent_compute-ego_min0.012130505243937174
complete-iteration_max0.1547452539478967
complete-iteration_mean0.14810993855881766
complete-iteration_median0.14686785856882734
complete-iteration_min0.14395878314971924
deviation-center-line_max0.6210853865278103
deviation-center-line_mean0.5344643626980028
deviation-center-line_min0.46912404997479035
deviation-heading_max2.2685230292408867
deviation-heading_mean1.4480637148438606
deviation-heading_median1.350024650370874
deviation-heading_min0.8236825293928073
driven_any_max3.563351884477075
driven_any_mean3.131657506959358
driven_any_median3.1585388822080604
driven_any_min2.6462003789442377
driven_lanedir_consec_max3.548981578360011
driven_lanedir_consec_mean3.0469479932518384
driven_lanedir_consec_min2.403761361654671
driven_lanedir_max3.548981578360011
driven_lanedir_mean3.0469479932518384
driven_lanedir_median3.117524516496335
driven_lanedir_min2.403761361654671
get_duckie_state_max1.2747446695963542e-06
get_duckie_state_mean1.2684524606127258e-06
get_duckie_state_median1.2709022661961546e-06
get_duckie_state_min1.2572606404622396e-06
get_robot_state_max0.009546715418497722
get_robot_state_mean0.00932616204296777
get_robot_state_median0.00932373226235766
get_robot_state_min0.00911046822865804
get_state_dump_max0.008457561333974203
get_state_dump_mean0.008155818169634642
get_state_dump_median0.008124284715098342
get_state_dump_min0.007917141914367676
get_ui_image_max0.02418329079945882
get_ui_image_mean0.024025173303913263
get_ui_image_median0.02402352992183207
get_ui_image_min0.02387034257253011
in-drivable-lane_max1.1500000000000163
in-drivable-lane_mean0.2875000000000041
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.399472263186191, "get_ui_image": 0.02387034257253011, "step_physics": 0.06220435698827108, "survival_time": 14.950000000000076, "driven_lanedir": 3.3678313946084324, "get_state_dump": 0.007917141914367676, "sim_render-ego": 0.004561801751454671, "get_robot_state": 0.00911046822865804, "get_duckie_state": 1.2747446695963542e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012130505243937174, "deviation-heading": 1.5274026444296354, "complete-iteration": 0.14556788523991904, "set_robot_commands": 0.003758567969004313, "deviation-center-line": 0.5752244330034743, "driven_lanedir_consec": 3.3678313946084324, "sim_compute_sim_state": 0.018942836920420328, "sim_compute_performance-ego": 0.00298356294631958}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.563351884477075, "get_ui_image": 0.0241723362604777, "step_physics": 0.06057270447413127, "survival_time": 14.950000000000076, "driven_lanedir": 3.548981578360011, "get_state_dump": 0.008030589421590168, "sim_render-ego": 0.004481527805328369, "get_robot_state": 0.009238977432250975, "get_duckie_state": 1.2731552124023435e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012452381451924642, "deviation-heading": 1.1726466563121127, "complete-iteration": 0.14395878314971924, "set_robot_commands": 0.00372769832611084, "deviation-center-line": 0.4724235812859363, "driven_lanedir_consec": 3.548981578360011, "sim_compute_sim_state": 0.018221205870310467, "sim_compute_performance-ego": 0.002972257137298584}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.91760550122993, "get_ui_image": 0.02418329079945882, "step_physics": 0.06323513269424438, "survival_time": 14.950000000000076, "driven_lanedir": 2.867217638384238, "get_state_dump": 0.008457561333974203, "sim_render-ego": 0.004525283972422282, "get_robot_state": 0.009546715418497722, "get_duckie_state": 1.2572606404622396e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012468790213267009, "deviation-heading": 2.2685230292408867, "complete-iteration": 0.1481678318977356, "set_robot_commands": 0.003761343955993652, "deviation-center-line": 0.6210853865278103, "driven_lanedir_consec": 2.867217638384238, "sim_compute_sim_state": 0.01888672033945719, "sim_compute_performance-ego": 0.0030100639661153157}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6462003789442377, "get_ui_image": 0.023874723583186437, "step_physics": 0.06806708366499034, "survival_time": 10.90000000000002, "driven_lanedir": 2.403761361654671, "get_state_dump": 0.008217980008606516, "sim_render-ego": 0.0044901874087272435, "get_robot_state": 0.009408487092464342, "get_duckie_state": 1.2686493199899656e-06, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.012352515798096262, "deviation-heading": 0.8236825293928073, "complete-iteration": 0.1547452539478967, "set_robot_commands": 0.003684078881499964, "deviation-center-line": 0.46912404997479035, "driven_lanedir_consec": 2.403761361654671, "sim_compute_sim_state": 0.02159233924445756, "sim_compute_performance-ego": 0.002965629647631164}}
set_robot_commands_max0.003761343955993652
set_robot_commands_mean0.003732922283152192
set_robot_commands_median0.003743133147557577
set_robot_commands_min0.003684078881499964
sim_compute_performance-ego_max0.0030100639661153157
sim_compute_performance-ego_mean0.0029828784243411607
sim_compute_performance-ego_median0.0029779100418090816
sim_compute_performance-ego_min0.002965629647631164
sim_compute_sim_state_max0.02159233924445756
sim_compute_sim_state_mean0.01941077559366139
sim_compute_sim_state_median0.01891477862993876
sim_compute_sim_state_min0.018221205870310467
sim_render-ego_max0.004561801751454671
sim_render-ego_mean0.004514700234483141
sim_render-ego_median0.004507735690574763
sim_render-ego_min0.004481527805328369
simulation-passed1
step_physics_max0.06806708366499034
step_physics_mean0.06351981945540927
step_physics_median0.06271974484125772
step_physics_min0.06057270447413127
survival_time_max14.950000000000076
survival_time_mean13.937500000000064
survival_time_min10.90000000000002
No reset possible
4314011617Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6761154755158836
survival_time_median14.950000000000076
deviation-center-line_median0.2834884162433958
in-drivable-lane_median1.625000000000023


other stats
agent_compute-ego_max0.01264268477757772
agent_compute-ego_mean0.012156508366266888
agent_compute-ego_median0.012041105429331464
agent_compute-ego_min0.011901137828826904
complete-iteration_max0.15290296951929727
complete-iteration_mean0.14703227003415426
complete-iteration_median0.1462930730978648
complete-iteration_min0.14263996442159016
deviation-center-line_max0.3702177503722064
deviation-center-line_mean0.2643359064396852
deviation-center-line_min0.12014904289974268
deviation-heading_max2.4652375591250917
deviation-heading_mean1.92023933126281
deviation-heading_median1.909601899409283
deviation-heading_min1.3965159671075813
driven_any_max1.9399661501788383
driven_any_mean1.938342590102796
driven_any_median1.9398901301362823
driven_any_min1.9336239499597816
driven_lanedir_consec_max1.9233925669898455
driven_lanedir_consec_mean1.437264632064744
driven_lanedir_consec_min0.4734350102373639
driven_lanedir_max1.9233925669898455
driven_lanedir_mean1.437264632064744
driven_lanedir_median1.6761154755158836
driven_lanedir_min0.4734350102373639
get_duckie_state_max1.098314921061198e-06
get_duckie_state_mean1.0679165522257486e-06
get_duckie_state_median1.0605653127034505e-06
get_duckie_state_min1.0522206624348958e-06
get_robot_state_max0.009368849595387778
get_robot_state_mean0.009313011566797893
get_robot_state_median0.00931459108988444
get_robot_state_min0.009254014492034912
get_state_dump_max0.008215835094451904
get_state_dump_mean0.008092905481656393
get_state_dump_median0.008074808915456137
get_state_dump_min0.008006169001261393
get_ui_image_max0.02455121914545695
get_ui_image_mean0.02417190750439962
get_ui_image_median0.024069389104843138
get_ui_image_min0.02399763266245524
in-drivable-lane_max10.600000000000083
in-drivable-lane_mean3.4625000000000328
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336239499597816, "get_ui_image": 0.02399763266245524, "step_physics": 0.06055110216140747, "survival_time": 14.950000000000076, "driven_lanedir": 1.446838620286924, "get_state_dump": 0.008215835094451904, "sim_render-ego": 0.004496533075968425, "get_robot_state": 0.009353593190511067, "get_duckie_state": 1.098314921061198e-06, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.011969339847564698, "deviation-heading": 2.4652375591250917, "complete-iteration": 0.1439966368675232, "set_robot_commands": 0.0037908053398132326, "deviation-center-line": 0.3255719957277996, "driven_lanedir_consec": 1.446838620286924, "sim_compute_sim_state": 0.018528358936309816, "sim_compute_performance-ego": 0.003003501892089844}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.939945591101223, "get_ui_image": 0.02408446073532105, "step_physics": 0.06048270225524902, "survival_time": 14.950000000000076, "driven_lanedir": 1.905392330744843, "get_state_dump": 0.008017729918162029, "sim_render-ego": 0.004477154413859049, "get_robot_state": 0.009254014492034912, "get_duckie_state": 1.0609626770019532e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012112871011098226, "deviation-heading": 2.4216053030389686, "complete-iteration": 0.14263996442159016, "set_robot_commands": 0.003705618381500244, "deviation-center-line": 0.2414048367589921, "driven_lanedir_consec": 1.905392330744843, "sim_compute_sim_state": 0.01744824727376302, "sim_compute_performance-ego": 0.002966192563374837}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939834669171341, "get_ui_image": 0.024054317474365233, "step_physics": 0.06522743781407674, "survival_time": 14.950000000000076, "driven_lanedir": 0.4734350102373639, "get_state_dump": 0.008131887912750244, "sim_render-ego": 0.004516431490580241, "get_robot_state": 0.009275588989257812, "get_duckie_state": 1.0522206624348958e-06, "in-drivable-lane": 10.600000000000083, "agent_compute-ego": 0.01264268477757772, "deviation-heading": 1.3965159671075813, "complete-iteration": 0.1485895093282064, "set_robot_commands": 0.00372648557027181, "deviation-center-line": 0.12014904289974268, "driven_lanedir_consec": 0.4734350102373639, "sim_compute_sim_state": 0.01794829289118449, "sim_compute_performance-ego": 0.0029732147852579755}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399661501788383, "get_ui_image": 0.02455121914545695, "step_physics": 0.06599473555882772, "survival_time": 14.950000000000076, "driven_lanedir": 1.9233925669898455, "get_state_dump": 0.008006169001261393, "sim_render-ego": 0.004489131768544515, "get_robot_state": 0.009368849595387778, "get_duckie_state": 1.0601679484049478e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011901137828826904, "deviation-heading": 1.397598495779597, "complete-iteration": 0.15290296951929727, "set_robot_commands": 0.0037525026003519695, "deviation-center-line": 0.3702177503722064, "driven_lanedir_consec": 1.9233925669898455, "sim_compute_sim_state": 0.02178883155186971, "sim_compute_performance-ego": 0.002958858807881673}}
set_robot_commands_max0.0037908053398132326
set_robot_commands_mean0.003743852972984314
set_robot_commands_median0.00373949408531189
set_robot_commands_min0.003705618381500244
sim_compute_performance-ego_max0.003003501892089844
sim_compute_performance-ego_mean0.0029754420121510822
sim_compute_performance-ego_median0.0029697036743164063
sim_compute_performance-ego_min0.002958858807881673
sim_compute_sim_state_max0.02178883155186971
sim_compute_sim_state_mean0.01892843266328176
sim_compute_sim_state_median0.01823832591374715
sim_compute_sim_state_min0.01744824727376302
sim_render-ego_max0.004516431490580241
sim_render-ego_mean0.004494812687238057
sim_render-ego_median0.00449283242225647
sim_render-ego_min0.004477154413859049
simulation-passed1
step_physics_max0.06599473555882772
step_physics_mean0.06306399444739023
step_physics_median0.06288926998774211
step_physics_min0.06048270225524902
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4311811609Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4849452664599356
survival_time_median14.950000000000076
deviation-center-line_median0.850461022975254
in-drivable-lane_median0.7250000000000023


other stats
agent_compute-ego_max0.014454871813456217
agent_compute-ego_mean0.014214310844739278
agent_compute-ego_median0.01429969588915507
agent_compute-ego_min0.013802979787190755
complete-iteration_max0.17890643914540608
complete-iteration_mean0.17736572662989297
complete-iteration_median0.17814513206481933
complete-iteration_min0.17426620324452718
deviation-center-line_max0.957285270005531
deviation-center-line_mean0.7067881768322887
deviation-center-line_min0.16894539137311576
deviation-heading_max4.576256842251936
deviation-heading_mean3.401581808412811
deviation-heading_median4.073370556933558
deviation-heading_min0.8833292775321936
driven_any_max3.044272317338368
driven_any_mean2.619022394074497
driven_any_median2.8954680477081354
driven_any_min1.6408811635433502
driven_lanedir_consec_max2.843507744151452
driven_lanedir_consec_mean2.2690486799539964
driven_lanedir_consec_min1.2627964427446623
driven_lanedir_max2.843507744151452
driven_lanedir_mean2.270818481381636
driven_lanedir_median2.488484869315215
driven_lanedir_min1.2627964427446623
get_duckie_state_max3.772576649983724e-06
get_duckie_state_mean2.3280580838521324e-06
get_duckie_state_median1.8622477849324544e-06
get_duckie_state_min1.815160115559896e-06
get_robot_state_max0.014571752548217774
get_robot_state_mean0.013757953246434527
get_robot_state_median0.013887004852294922
get_robot_state_min0.012686050732930502
get_state_dump_max0.012151708602905271
get_state_dump_mean0.011479694545269013
get_state_dump_median0.011528711120287576
get_state_dump_min0.010709647337595624
get_ui_image_max0.027254297733306884
get_ui_image_mean0.02688133845726649
get_ui_image_median0.026780549883842465
get_ui_image_min0.026709956328074137
in-drivable-lane_max2.550000000000036
in-drivable-lane_mean1.0000000000000102
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.6408811635433502, "get_ui_image": 0.026844372351964314, "step_physics": 0.06903617779413859, "survival_time": 5.999999999999987, "driven_lanedir": 1.2627964427446623, "get_state_dump": 0.011588730414708455, "sim_render-ego": 0.005423792203267415, "get_robot_state": 0.013772861162821452, "get_duckie_state": 1.8974145253499348e-06, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.014328185717264812, "deviation-heading": 0.8833292775321936, "complete-iteration": 0.17426620324452718, "set_robot_commands": 0.004572274287541708, "deviation-center-line": 0.16894539137311576, "driven_lanedir_consec": 1.2627964427446623, "sim_compute_sim_state": 0.024839009841283163, "sim_compute_performance-ego": 0.003753920396169027}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.044272317338368, "get_ui_image": 0.026709956328074137, "step_physics": 0.07031012932459513, "survival_time": 14.950000000000076, "driven_lanedir": 2.843507744151452, "get_state_dump": 0.012151708602905271, "sim_render-ego": 0.005417852401733398, "get_robot_state": 0.014571752548217774, "get_duckie_state": 1.815160115559896e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014271206061045328, "deviation-heading": 4.576256842251936, "complete-iteration": 0.1778296184539795, "set_robot_commands": 0.0044918100039164225, "deviation-center-line": 0.8955279012495792, "driven_lanedir_consec": 2.843507744151452, "sim_compute_sim_state": 0.026032039324442546, "sim_compute_performance-ego": 0.003755955696105957}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8846636229297205, "get_ui_image": 0.02671672741572062, "step_physics": 0.0721329148610433, "survival_time": 14.950000000000076, "driven_lanedir": 2.6550571386444086, "get_state_dump": 0.0114686918258667, "sim_render-ego": 0.005549584229787191, "get_robot_state": 0.014001148541768392, "get_duckie_state": 1.827081044514974e-06, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.014454871813456217, "deviation-heading": 3.9701659768572632, "complete-iteration": 0.17846064567565917, "set_robot_commands": 0.004468940099080404, "deviation-center-line": 0.957285270005531, "driven_lanedir_consec": 2.6550571386444086, "sim_compute_sim_state": 0.025752506256103515, "sim_compute_performance-ego": 0.0037964328130086263}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9062724724865503, "get_ui_image": 0.027254297733306884, "step_physics": 0.07580744743347168, "survival_time": 14.950000000000076, "driven_lanedir": 2.321912599986022, "get_state_dump": 0.010709647337595624, "sim_render-ego": 0.005224391619364421, "get_robot_state": 0.012686050732930502, "get_duckie_state": 3.772576649983724e-06, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.013802979787190755, "deviation-heading": 4.176575137009852, "complete-iteration": 0.17890643914540608, "set_robot_commands": 0.004302812417348226, "deviation-center-line": 0.8053941447009288, "driven_lanedir_consec": 2.314833394275462, "sim_compute_sim_state": 0.025522013505299885, "sim_compute_performance-ego": 0.0034860714276631673}}
set_robot_commands_max0.004572274287541708
set_robot_commands_mean0.0044589592019716896
set_robot_commands_median0.004480375051498413
set_robot_commands_min0.004302812417348226
sim_compute_performance-ego_max0.0037964328130086263
sim_compute_performance-ego_mean0.003698095083236694
sim_compute_performance-ego_median0.003754938046137492
sim_compute_performance-ego_min0.0034860714276631673
sim_compute_sim_state_max0.026032039324442546
sim_compute_sim_state_mean0.025536392231782275
sim_compute_sim_state_median0.0256372598807017
sim_compute_sim_state_min0.024839009841283163
sim_render-ego_max0.005549584229787191
sim_render-ego_mean0.0054039051135381065
sim_render-ego_median0.005420822302500407
sim_render-ego_min0.005224391619364421
simulation-passed1
step_physics_max0.07580744743347168
step_physics_mean0.07182166735331218
step_physics_median0.0712215220928192
step_physics_min0.06903617779413859
survival_time_max14.950000000000076
survival_time_mean12.712500000000055
survival_time_min5.999999999999987
No reset possible
4309111605Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.718999867298613
survival_time_median12.25000000000004
deviation-center-line_median0.33995552377260235
in-drivable-lane_median3.950000000000023


other stats
agent_compute-ego_max0.019638206958770752
agent_compute-ego_mean0.019060823374148966
agent_compute-ego_median0.01900337984791748
agent_compute-ego_min0.018598326841990153
complete-iteration_max0.22856472924117643
complete-iteration_mean0.223714757776581
complete-iteration_median0.22409925421079
complete-iteration_min0.2180957934435676
deviation-center-line_max0.678024465290741
deviation-center-line_mean0.3836937931796776
deviation-center-line_min0.17683965988276434
deviation-heading_max3.4170826270605947
deviation-heading_mean2.0065650976788314
deviation-heading_median1.972682185382601
deviation-heading_min0.6638133928895273
driven_any_max4.594563494491103
driven_any_mean3.391901415100498
driven_any_median3.7379156008642695
driven_any_min1.4972109641823488
driven_lanedir_consec_max2.8115816256539663
driven_lanedir_consec_mean1.725071946789026
driven_lanedir_consec_min0.6507064269049105
driven_lanedir_max2.8115816256539663
driven_lanedir_mean1.725071946789026
driven_lanedir_median1.718999867298613
driven_lanedir_min0.6507064269049105
get_duckie_state_max2.934137980143229e-06
get_duckie_state_mean1.9978397546785223e-06
get_duckie_state_median1.695314210954969e-06
get_duckie_state_min1.6665926166609222e-06
get_robot_state_max0.014285993576049804
get_robot_state_mean0.013774356789907604
get_robot_state_median0.013842156915103689
get_robot_state_min0.013127119753373231
get_state_dump_max0.012429148356119793
get_state_dump_mean0.011641681005903098
get_state_dump_median0.011577827156281495
get_state_dump_min0.010981921354929609
get_ui_image_max0.0387520162264506
get_ui_image_mean0.0378006169504361
get_ui_image_median0.03800678678832128
get_ui_image_min0.03643687799865125
in-drivable-lane_max8.650000000000041
in-drivable-lane_mean4.70000000000002
in-drivable-lane_min2.249999999999992
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.579215172231458, "get_ui_image": 0.0381047773361206, "step_physics": 0.09681043227513632, "survival_time": 14.950000000000076, "driven_lanedir": 2.8115816256539663, "get_state_dump": 0.010981921354929609, "sim_render-ego": 0.006482865810394287, "get_robot_state": 0.01384516716003418, "get_duckie_state": 2.934137980143229e-06, "in-drivable-lane": 4.6500000000000306, "agent_compute-ego": 0.019638206958770752, "deviation-heading": 3.4170826270605947, "complete-iteration": 0.22438604911168417, "set_robot_commands": 0.005735070705413819, "deviation-center-line": 0.678024465290741, "driven_lanedir_consec": 2.8115816256539663, "sim_compute_sim_state": 0.02842095931371053, "sim_compute_performance-ego": 0.004244338671366373}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.4972109641823488, "get_ui_image": 0.03643687799865125, "step_physics": 0.09344096043530632, "survival_time": 5.09999999999999, "driven_lanedir": 0.6507064269049105, "get_state_dump": 0.011596422569424496, "sim_render-ego": 0.0063394939198213466, "get_robot_state": 0.013839146670173197, "get_duckie_state": 1.6665926166609222e-06, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.019327444188735065, "deviation-heading": 1.3412346772866253, "complete-iteration": 0.2180957934435676, "set_robot_commands": 0.005550211551142674, "deviation-center-line": 0.17683965988276434, "driven_lanedir_consec": 0.6507064269049105, "sim_compute_sim_state": 0.027062014037487554, "sim_compute_performance-ego": 0.004378421633851295}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.594563494491103, "get_ui_image": 0.0387520162264506, "step_physics": 0.0966855223973592, "survival_time": 14.950000000000076, "driven_lanedir": 1.583358417161744, "get_state_dump": 0.012429148356119793, "sim_render-ego": 0.0065659244855244955, "get_robot_state": 0.014285993576049804, "get_duckie_state": 1.670519510904948e-06, "in-drivable-lane": 8.650000000000041, "agent_compute-ego": 0.018598326841990153, "deviation-heading": 2.604129693478577, "complete-iteration": 0.22381245930989585, "set_robot_commands": 0.005786929925282796, "deviation-center-line": 0.4015578892400155, "driven_lanedir_consec": 1.583358417161744, "sim_compute_sim_state": 0.02618489185969035, "sim_compute_performance-ego": 0.004397855599721273}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8966160294970806, "get_ui_image": 0.03790879624052197, "step_physics": 0.09934751151119851, "survival_time": 9.55, "driven_lanedir": 1.8546413174354823, "get_state_dump": 0.011559231743138498, "sim_render-ego": 0.006366084383420295, "get_robot_state": 0.013127119753373231, "get_duckie_state": 1.7201089110049902e-06, "in-drivable-lane": 3.250000000000015, "agent_compute-ego": 0.018679315507099892, "deviation-heading": 0.6638133928895273, "complete-iteration": 0.22856472924117643, "set_robot_commands": 0.005335847744766954, "deviation-center-line": 0.27835315830518914, "driven_lanedir_consec": 1.8546413174354823, "sim_compute_sim_state": 0.03204999669060033, "sim_compute_performance-ego": 0.004068427060911169}}
set_robot_commands_max0.005786929925282796
set_robot_commands_mean0.005602014981651561
set_robot_commands_median0.005642641128278246
set_robot_commands_min0.005335847744766954
sim_compute_performance-ego_max0.004397855599721273
sim_compute_performance-ego_mean0.004272260741462527
sim_compute_performance-ego_median0.004311380152608834
sim_compute_performance-ego_min0.004068427060911169
sim_compute_sim_state_max0.03204999669060033
sim_compute_sim_state_mean0.028429465475372187
sim_compute_sim_state_median0.02774148667559904
sim_compute_sim_state_min0.02618489185969035
sim_render-ego_max0.0065659244855244955
sim_render-ego_mean0.006438592149790106
sim_render-ego_median0.006424475096907291
sim_render-ego_min0.0063394939198213466
simulation-passed1
step_physics_max0.09934751151119851
step_physics_mean0.09657110665475008
step_physics_median0.09674797733624776
step_physics_min0.09344096043530632
survival_time_max14.950000000000076
survival_time_mean11.137500000000037
survival_time_min5.09999999999999
No reset possible
4306611597Francois Hebertreal-exercise-2aido5-LF-sim-validationLFv-simerrornoreg02-b35ee35771a7-10:02:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4304211590Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013018856048583985
agent_compute-ego_mean0.01218263288338979
agent_compute-ego_median0.01206202228864034
agent_compute-ego_min0.0115876309076945
complete-iteration_max0.1579455812772115
complete-iteration_mean0.1483335812886556
complete-iteration_median0.14758257468541464
complete-iteration_min0.14022359450658162
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.7436345418294271e-06
get_duckie_state_mean1.644293467203776e-06
get_duckie_state_median1.633167266845703e-06
get_duckie_state_min1.5672047932942708e-06
get_robot_state_max0.010169613361358642
get_robot_state_mean0.00952191412448883
get_robot_state_median0.009451873302459717
get_robot_state_min0.009014296531677244
get_state_dump_max0.008651752471923829
get_state_dump_mean0.008274649182955424
get_state_dump_median0.008287598689397175
get_state_dump_min0.007871646881103516
get_ui_image_max0.02711725950241089
get_ui_image_mean0.02497999350229899
get_ui_image_median0.02436945994695028
get_ui_image_min0.02406379461288452
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.02406379461288452, "step_physics": 0.05902137517929077, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.007871646881103516, "sim_render-ego": 0.0044716183344523115, "get_robot_state": 0.009014296531677244, "get_duckie_state": 1.5672047932942708e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01200814406077067, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.14022359450658162, "set_robot_commands": 0.003567983309427897, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.017181886831919353, "sim_compute_performance-ego": 0.0029382928212483726}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.024145154158274333, "step_physics": 0.05897657076517741, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.008107821941375732, "sim_render-ego": 0.004546341101328532, "get_robot_state": 0.009171004295349122, "get_duckie_state": 1.6109148661295571e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012115900516510007, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.14036215702692667, "set_robot_commands": 0.003710854053497314, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.016495721340179445, "sim_compute_performance-ego": 0.003006619612375895}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.02711725950241089, "step_physics": 0.06744601726531982, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.008651752471923829, "sim_render-ego": 0.005016486644744873, "get_robot_state": 0.010169613361358642, "get_duckie_state": 1.7436345418294271e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013018856048583985, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.1579455812772115, "set_robot_commands": 0.004058945178985596, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.019057748317718507, "sim_compute_performance-ego": 0.003315322399139404}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.02459376573562622, "step_physics": 0.06815102577209473, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.00846737543741862, "sim_render-ego": 0.004577097892761231, "get_robot_state": 0.009732742309570311, "get_duckie_state": 1.655419667561849e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0115876309076945, "deviation-heading": 0.486072248607516, "complete-iteration": 0.1548029923439026, "set_robot_commands": 0.00371018648147583, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020886385440826417, "sim_compute_performance-ego": 0.003008236885070801}}
set_robot_commands_max0.004058945178985596
set_robot_commands_mean0.00376199225584666
set_robot_commands_median0.003710520267486572
set_robot_commands_min0.003567983309427897
sim_compute_performance-ego_max0.003315322399139404
sim_compute_performance-ego_mean0.003067117929458618
sim_compute_performance-ego_median0.003007428248723348
sim_compute_performance-ego_min0.0029382928212483726
sim_compute_sim_state_max0.020886385440826417
sim_compute_sim_state_mean0.01840543548266093
sim_compute_sim_state_median0.018119817574818932
sim_compute_sim_state_min0.016495721340179445
sim_render-ego_max0.005016486644744873
sim_render-ego_mean0.004652885993321737
sim_render-ego_median0.0045617194970448815
sim_render-ego_min0.0044716183344523115
simulation-passed1
step_physics_max0.06815102577209473
step_physics_mean0.06339874724547068
step_physics_median0.06323369622230529
step_physics_min0.05897657076517741
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4302911587Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoreg02-b35ee35771a7-10:03:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 102 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4302111585Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoreg02-b35ee35771a7-10:03:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 150 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4300011582Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simfailednoreg02-b35ee35771a7-10:07:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 737 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4299211579Olga (Ge Ya) XuΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.32004333264108
survival_time_median14.950000000000076
deviation-center-line_median0.4062654385251622
in-drivable-lane_median7.625000000000039


other stats
agent_compute-ego_max0.012473857402801514
agent_compute-ego_mean0.012260310493764422
agent_compute-ego_median0.012224909549667722
agent_compute-ego_min0.012117565472920736
complete-iteration_max0.15662665111677987
complete-iteration_mean0.15219673967077618
complete-iteration_median0.1518780219554901
complete-iteration_min0.14840426365534465
deviation-center-line_max0.4877452478718057
deviation-center-line_mean0.3874985662248851
deviation-center-line_min0.24971813997741013
deviation-heading_max3.153172482457239
deviation-heading_mean2.5403872424432516
deviation-heading_median2.563995698186822
deviation-heading_min1.8803850909421231
driven_any_max3.506963599712769
driven_any_mean3.291961585014417
driven_any_median3.351913304379294
driven_any_min2.9570561315863104
driven_lanedir_consec_max1.3842890438960842
driven_lanedir_consec_mean1.1601453843902
driven_lanedir_consec_min0.6162058283825554
driven_lanedir_max1.3842890438960842
driven_lanedir_mean1.1601453843902
driven_lanedir_median1.32004333264108
driven_lanedir_min0.6162058283825554
get_duckie_state_max1.7563501993815103e-06
get_duckie_state_mean1.665765330905006e-06
get_duckie_state_median1.66018803914388e-06
get_duckie_state_min1.5863350459507531e-06
get_robot_state_max0.010611032644907634
get_robot_state_mean0.009993452628453574
get_robot_state_median0.009918715556462608
get_robot_state_min0.009525346755981445
get_state_dump_max0.009093316396077472
get_state_dump_mean0.00874559162628083
get_state_dump_median0.008789658546447754
get_state_dump_min0.008309733016150338
get_ui_image_max0.024917909304300944
get_ui_image_mean0.024480437948590235
get_ui_image_median0.024460829723448978
get_ui_image_min0.02408218304316203
in-drivable-lane_max10.05000000000005
in-drivable-lane_mean8.150000000000041
in-drivable-lane_min7.30000000000004
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.315268995971098, "get_ui_image": 0.02408218304316203, "step_physics": 0.06301294326782227, "survival_time": 14.950000000000076, "driven_lanedir": 1.269853695914538, "get_state_dump": 0.008630260626475017, "sim_render-ego": 0.004485273361206054, "get_robot_state": 0.009773344993591308, "get_duckie_state": 1.644293467203776e-06, "in-drivable-lane": 7.800000000000031, "agent_compute-ego": 0.012117565472920736, "deviation-heading": 2.2288976445780206, "complete-iteration": 0.14840426365534465, "set_robot_commands": 0.0036809643109639487, "deviation-center-line": 0.4033102640213326, "driven_lanedir_consec": 1.269853695914538, "sim_compute_sim_state": 0.01957934538523356, "sim_compute_performance-ego": 0.0029593793551127116}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.506963599712769, "get_ui_image": 0.02459433873494466, "step_physics": 0.06376722733179728, "survival_time": 14.950000000000076, "driven_lanedir": 1.370232969367622, "get_state_dump": 0.008949056466420491, "sim_render-ego": 0.004572295347849528, "get_robot_state": 0.010064086119333904, "get_duckie_state": 1.6760826110839844e-06, "in-drivable-lane": 7.450000000000048, "agent_compute-ego": 0.012187662919362388, "deviation-heading": 3.153172482457239, "complete-iteration": 0.1505735421180725, "set_robot_commands": 0.003780379295349121, "deviation-center-line": 0.4877452478718057, "driven_lanedir_consec": 1.370232969367622, "sim_compute_sim_state": 0.019578002293904623, "sim_compute_performance-ego": 0.002993823687235514}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.3885576127874892, "get_ui_image": 0.024917909304300944, "step_physics": 0.06349165042241414, "survival_time": 14.950000000000076, "driven_lanedir": 1.3842890438960842, "get_state_dump": 0.009093316396077472, "sim_render-ego": 0.004665826956431071, "get_robot_state": 0.010611032644907634, "get_duckie_state": 1.7563501993815103e-06, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.012473857402801514, "deviation-heading": 2.8990937517956232, "complete-iteration": 0.1531825017929077, "set_robot_commands": 0.003872512181599935, "deviation-center-line": 0.4092206130289919, "driven_lanedir_consec": 1.3842890438960842, "sim_compute_sim_state": 0.02090382973353068, "sim_compute_performance-ego": 0.0030651108423868814}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9570561315863104, "get_ui_image": 0.024327320711953294, "step_physics": 0.06841600707599095, "survival_time": 14.000000000000064, "driven_lanedir": 0.6162058283825554, "get_state_dump": 0.008309733016150338, "sim_render-ego": 0.004604755980627877, "get_robot_state": 0.009525346755981445, "get_duckie_state": 1.5863350459507531e-06, "in-drivable-lane": 10.05000000000005, "agent_compute-ego": 0.012262156179973055, "deviation-heading": 1.8803850909421231, "complete-iteration": 0.15662665111677987, "set_robot_commands": 0.0037674895354679657, "deviation-center-line": 0.24971813997741013, "driven_lanedir_consec": 0.6162058283825554, "sim_compute_sim_state": 0.022345755781446184, "sim_compute_performance-ego": 0.0029817070279802593}}
set_robot_commands_max0.003872512181599935
set_robot_commands_mean0.0037753363308452425
set_robot_commands_median0.003773934415408543
set_robot_commands_min0.0036809643109639487
sim_compute_performance-ego_max0.0030651108423868814
sim_compute_performance-ego_mean0.0030000052281788417
sim_compute_performance-ego_median0.0029877653576078867
sim_compute_performance-ego_min0.0029593793551127116
sim_compute_sim_state_max0.022345755781446184
sim_compute_sim_state_mean0.02060173329852876
sim_compute_sim_state_median0.02024158755938212
sim_compute_sim_state_min0.019578002293904623
sim_render-ego_max0.004665826956431071
sim_render-ego_mean0.004582037911528633
sim_render-ego_median0.004588525664238703
sim_render-ego_min0.004485273361206054
simulation-passed1
step_physics_max0.06841600707599095
step_physics_mean0.06467195702450616
step_physics_median0.0636294388771057
step_physics_min0.06301294326782227
survival_time_max14.950000000000076
survival_time_mean14.712500000000077
survival_time_min14.000000000000064
No reset possible
4296811574Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.745675433675259
survival_time_median14.950000000000076
deviation-center-line_median1.03429267808107
in-drivable-lane_median3.8000000000000167


other stats
agent_compute-ego_max0.01568851391474406
agent_compute-ego_mean0.014830201864242554
agent_compute-ego_median0.015267884731292723
agent_compute-ego_min0.013096524079640707
complete-iteration_max0.17787567218144734
complete-iteration_mean0.16820004681746165
complete-iteration_median0.17046500523885091
complete-iteration_min0.15399450461069744
deviation-center-line_max1.254049156822492
deviation-center-line_mean0.955855088445061
deviation-center-line_min0.500785840795612
deviation-heading_max2.6481914725723215
deviation-heading_mean2.28749090122524
deviation-heading_median2.3951905370680637
deviation-heading_min1.7113910581925131
driven_any_max5.407480401557125
driven_any_mean4.345749789519349
driven_any_median4.758411459298178
driven_any_min2.4586958379239148
driven_lanedir_consec_max4.185033449738983
driven_lanedir_consec_mean3.2878364950816725
driven_lanedir_consec_min1.4749616632371887
driven_lanedir_max4.185033449738983
driven_lanedir_mean3.2878364950816725
driven_lanedir_median3.745675433675259
driven_lanedir_min1.4749616632371887
get_duckie_state_max1.4583269755045572e-06
get_duckie_state_mean1.3911724090576172e-06
get_duckie_state_median1.424551010131836e-06
get_duckie_state_min1.2572606404622396e-06
get_robot_state_max0.011057502428690592
get_robot_state_mean0.010615500807762149
get_robot_state_median0.0107716170946757
get_robot_state_min0.009861266613006592
get_state_dump_max0.00925122102101644
get_state_dump_mean0.009097824692726134
get_state_dump_median0.009177334308624267
get_state_dump_min0.008785409132639567
get_ui_image_max0.029467235406239828
get_ui_image_mean0.028011840184529624
get_ui_image_median0.028471769094467164
get_ui_image_min0.025636587142944336
in-drivable-lane_max10.100000000000088
in-drivable-lane_mean5.200000000000033
in-drivable-lane_min3.100000000000012
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.233086853382301, "get_ui_image": 0.025636587142944336, "step_physics": 0.06445144494374593, "survival_time": 14.950000000000076, "driven_lanedir": 4.185033449738983, "get_state_dump": 0.008785409132639567, "sim_render-ego": 0.004764222304026286, "get_robot_state": 0.009861266613006592, "get_duckie_state": 1.2572606404622396e-06, "in-drivable-lane": 3.300000000000024, "agent_compute-ego": 0.013096524079640707, "deviation-heading": 2.1595516254466816, "complete-iteration": 0.15399450461069744, "set_robot_commands": 0.0036324604352315263, "deviation-center-line": 1.0626978495534054, "driven_lanedir_consec": 4.185033449738983, "sim_compute_sim_state": 0.02051115910212199, "sim_compute_performance-ego": 0.003168792724609375}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.4586958379239148, "get_ui_image": 0.02766322612762451, "step_physics": 0.07064966360727946, "survival_time": 14.950000000000076, "driven_lanedir": 1.4749616632371887, "get_state_dump": 0.009215583006540934, "sim_render-ego": 0.005399362246195475, "get_robot_state": 0.011057502428690592, "get_duckie_state": 1.4583269755045572e-06, "in-drivable-lane": 10.100000000000088, "agent_compute-ego": 0.01560442845026652, "deviation-heading": 1.7113910581925131, "complete-iteration": 0.16911474466323853, "set_robot_commands": 0.004045267899831136, "deviation-center-line": 0.500785840795612, "driven_lanedir_consec": 1.4749616632371887, "sim_compute_sim_state": 0.02189016819000244, "sim_compute_performance-ego": 0.0034848984082539876}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.283736065214055, "get_ui_image": 0.029467235406239828, "step_physics": 0.07301923592885336, "survival_time": 14.950000000000076, "driven_lanedir": 3.6059084489183526, "get_state_dump": 0.00925122102101644, "sim_render-ego": 0.005222732226053873, "get_robot_state": 0.010786900520324707, "get_duckie_state": 1.403490702311198e-06, "in-drivable-lane": 3.100000000000012, "agent_compute-ego": 0.01493134101231893, "deviation-heading": 2.6481914725723215, "complete-iteration": 0.1718152658144633, "set_robot_commands": 0.004015316168467203, "deviation-center-line": 1.254049156822492, "driven_lanedir_consec": 3.6059084489183526, "sim_compute_sim_state": 0.02158662557601929, "sim_compute_performance-ego": 0.0034341001510620117}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.407480401557125, "get_ui_image": 0.029280312061309818, "step_physics": 0.07368644793828329, "survival_time": 14.950000000000076, "driven_lanedir": 3.8854424184321665, "get_state_dump": 0.0091390856107076, "sim_render-ego": 0.005432040691375733, "get_robot_state": 0.010756333669026692, "get_duckie_state": 1.445611317952474e-06, "in-drivable-lane": 4.30000000000001, "agent_compute-ego": 0.01568851391474406, "deviation-heading": 2.630829448689446, "complete-iteration": 0.17787567218144734, "set_robot_commands": 0.004079759915669759, "deviation-center-line": 1.0058875066087345, "driven_lanedir_consec": 3.8854424184321665, "sim_compute_sim_state": 0.026210983594258625, "sim_compute_performance-ego": 0.0034998313585917155}}
set_robot_commands_max0.004079759915669759
set_robot_commands_mean0.003943201104799907
set_robot_commands_median0.004030292034149169
set_robot_commands_min0.0036324604352315263
sim_compute_performance-ego_max0.0034998313585917155
sim_compute_performance-ego_mean0.0033969056606292726
sim_compute_performance-ego_median0.003459499279657999
sim_compute_performance-ego_min0.003168792724609375
sim_compute_sim_state_max0.026210983594258625
sim_compute_sim_state_mean0.022549734115600583
sim_compute_sim_state_median0.021738396883010862
sim_compute_sim_state_min0.02051115910212199
sim_render-ego_max0.005432040691375733
sim_render-ego_mean0.005204589366912842
sim_render-ego_median0.005311047236124675
sim_render-ego_min0.004764222304026286
simulation-passed1
step_physics_max0.07368644793828329
step_physics_mean0.07045169810454051
step_physics_median0.07183444976806641
step_physics_min0.06445144494374593
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4296011573Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2700497264860355
survival_time_median7.700000000000006
deviation-center-line_median0.22536076096820903
in-drivable-lane_median3.0750000000000144


other stats
agent_compute-ego_max0.012196147441864012
agent_compute-ego_mean0.011864289719341297
agent_compute-ego_median0.011826067622162394
agent_compute-ego_min0.011608876191176376
complete-iteration_max0.15119801097446017
complete-iteration_mean0.14737236870411757
complete-iteration_median0.14704073137555285
complete-iteration_min0.14421000109090434
deviation-center-line_max0.4490050534295502
deviation-center-line_mean0.2739554193606154
deviation-center-line_min0.19609510207649303
deviation-heading_max1.3918105890706685
deviation-heading_mean1.0629749362639374
deviation-heading_median1.1278481533486908
deviation-heading_min0.6043928492876999
driven_any_max4.082375153926364
driven_any_mean2.215241030756975
driven_any_median1.9606109169772623
driven_any_min0.857367135147012
driven_lanedir_consec_max1.4466238511220697
driven_lanedir_consec_mean1.1789154454695678
driven_lanedir_consec_min0.7289384777841308
driven_lanedir_max1.4466238511220697
driven_lanedir_mean1.1789154454695678
driven_lanedir_median1.2700497264860355
driven_lanedir_min0.7289384777841308
get_duckie_state_max1.148744062943892e-06
get_duckie_state_mean1.0972927326113663e-06
get_duckie_state_median1.091427273220486e-06
get_duckie_state_min1.0575723210606009e-06
get_robot_state_max0.00983587106068929
get_robot_state_mean0.0094659552493577
get_robot_state_median0.00943948140122191
get_robot_state_min0.009148987134297688
get_state_dump_max0.008595234155654908
get_state_dump_mean0.008167957748437005
get_state_dump_median0.008134253790903245
get_state_dump_min0.007808089256286621
get_ui_image_max0.02491592431997324
get_ui_image_mean0.024162145917703663
get_ui_image_median0.02398050129413605
get_ui_image_min0.02377165676256932
in-drivable-lane_max7.15000000000001
in-drivable-lane_mean3.3750000000000098
in-drivable-lane_min0.1999999999999993
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.662416091691892, "get_ui_image": 0.02377165676256932, "step_physics": 0.06138454227272524, "survival_time": 10.90000000000002, "driven_lanedir": 1.4466238511220697, "get_state_dump": 0.008167731652566053, "sim_render-ego": 0.004506489552489114, "get_robot_state": 0.00936411389517128, "get_duckie_state": 1.0575723210606009e-06, "in-drivable-lane": 5.90000000000003, "agent_compute-ego": 0.011738393284858914, "deviation-heading": 0.6043928492876999, "complete-iteration": 0.14526144298938437, "set_robot_commands": 0.0037720389322403376, "deviation-center-line": 0.19609510207649303, "driven_lanedir_consec": 1.4466238511220697, "sim_compute_sim_state": 0.01953742372880288, "sim_compute_performance-ego": 0.002939368606707372}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.857367135147012, "get_ui_image": 0.02491592431997324, "step_physics": 0.06090630803789411, "survival_time": 3.8499999999999943, "driven_lanedir": 0.7289384777841308, "get_state_dump": 0.008100775929240437, "sim_render-ego": 0.0045772156158050935, "get_robot_state": 0.009514848907272538, "get_duckie_state": 1.148744062943892e-06, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.011608876191176376, "deviation-heading": 1.2098823230396956, "complete-iteration": 0.14421000109090434, "set_robot_commands": 0.003739985552701083, "deviation-center-line": 0.20280112488184732, "driven_lanedir_consec": 0.7289384777841308, "sim_compute_sim_state": 0.01772039586847479, "sim_compute_performance-ego": 0.0030464290024398207}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.082375153926364, "get_ui_image": 0.0241622269153595, "step_physics": 0.06154218216737111, "survival_time": 12.000000000000036, "driven_lanedir": 1.413331143981718, "get_state_dump": 0.008595234155654908, "sim_render-ego": 0.0045674095551172895, "get_robot_state": 0.00983587106068929, "get_duckie_state": 1.1046727498372397e-06, "in-drivable-lane": 7.15000000000001, "agent_compute-ego": 0.012196147441864012, "deviation-heading": 1.3918105890706685, "complete-iteration": 0.1488200197617213, "set_robot_commands": 0.0037049084901809694, "deviation-center-line": 0.4490050534295502, "driven_lanedir_consec": 1.413331143981718, "sim_compute_sim_state": 0.021103435754776, "sim_compute_performance-ego": 0.003029346466064453}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.258805742262633, "get_ui_image": 0.0237987756729126, "step_physics": 0.06635608408186171, "survival_time": 4.499999999999992, "driven_lanedir": 1.1267683089903533, "get_state_dump": 0.007808089256286621, "sim_render-ego": 0.0044507794910007056, "get_robot_state": 0.009148987134297688, "get_duckie_state": 1.0781817966037326e-06, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.011913741959465877, "deviation-heading": 1.045813983657686, "complete-iteration": 0.15119801097446017, "set_robot_commands": 0.003809335496690538, "deviation-center-line": 0.24792039705457083, "driven_lanedir_consec": 1.1267683089903533, "sim_compute_sim_state": 0.02090264691246881, "sim_compute_performance-ego": 0.00292661190032959}}
set_robot_commands_max0.003809335496690538
set_robot_commands_mean0.003756567117953232
set_robot_commands_median0.0037560122424707106
set_robot_commands_min0.0037049084901809694
sim_compute_performance-ego_max0.0030464290024398207
sim_compute_performance-ego_mean0.0029854389938853087
sim_compute_performance-ego_median0.002984357536385912
sim_compute_performance-ego_min0.00292661190032959
sim_compute_sim_state_max0.021103435754776
sim_compute_sim_state_mean0.01981597556613062
sim_compute_sim_state_median0.02022003532063584
sim_compute_sim_state_min0.01772039586847479
sim_render-ego_max0.0045772156158050935
sim_render-ego_mean0.004525473553603051
sim_render-ego_median0.004536949553803201
sim_render-ego_min0.0044507794910007056
simulation-passed1
step_physics_max0.06635608408186171
step_physics_mean0.06254727913996304
step_physics_median0.061463362220048175
step_physics_min0.06090630803789411
survival_time_max12.000000000000036
survival_time_mean7.812500000000011
survival_time_min3.8499999999999943
No reset possible
4295111570Bhavya PatwaΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.410348682590114
survival_time_median14.950000000000076
deviation-center-line_median0.19270978108582712
in-drivable-lane_median10.475000000000083


other stats
agent_compute-ego_max0.015224719842274984
agent_compute-ego_mean0.01476992716864934
agent_compute-ego_median0.014940536230329484
agent_compute-ego_min0.013973916371663411
complete-iteration_max0.17353960037231445
complete-iteration_mean0.17135792511796194
complete-iteration_median0.17112839416852071
complete-iteration_min0.16963531176249186
deviation-center-line_max0.22137802474825655
deviation-center-line_mean0.192790402985917
deviation-center-line_min0.16436402502375716
deviation-heading_max1.2948714894399247
deviation-heading_mean1.1210905518071197
deviation-heading_median1.089666255222557
deviation-heading_min1.0101582073434396
driven_any_max1.9399929346132532
driven_any_mean1.6512910328552004
driven_any_median1.9368357076220069
driven_any_min0.7914997815635344
driven_lanedir_consec_max0.5183363221013346
driven_lanedir_consec_mean0.4085351354799917
driven_lanedir_consec_min0.2951068546384039
driven_lanedir_max0.5183363221013346
driven_lanedir_mean0.4085351354799917
driven_lanedir_median0.410348682590114
driven_lanedir_min0.2951068546384039
get_duckie_state_max1.9431114196777345e-06
get_duckie_state_mean1.8776882262456983e-06
get_duckie_state_median1.875559488932292e-06
get_duckie_state_min1.816522507440476e-06
get_robot_state_max0.010925587813059488
get_robot_state_mean0.010797185093637496
get_robot_state_median0.010859523197961232
get_robot_state_min0.010544106165568034
get_state_dump_max0.00938321034113566
get_state_dump_mean0.009237889183892144
get_state_dump_median0.009284704393810695
get_state_dump_min0.008998937606811523
get_ui_image_max0.03101374421800886
get_ui_image_mean0.02935938307217189
get_ui_image_median0.029693020582199095
get_ui_image_min0.027037746906280517
in-drivable-lane_max12.00000000000008
in-drivable-lane_mean9.11250000000006
in-drivable-lane_min3.4999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336790041430012, "get_ui_image": 0.0300057315826416, "step_physics": 0.07531147956848144, "survival_time": 14.950000000000076, "driven_lanedir": 0.5115935599073274, "get_state_dump": 0.008998937606811523, "sim_render-ego": 0.005299451351165771, "get_robot_state": 0.010544106165568034, "get_duckie_state": 1.9431114196777345e-06, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.014854058424631757, "deviation-heading": 1.070421102652542, "complete-iteration": 0.17353960037231445, "set_robot_commands": 0.00448546568552653, "deviation-center-line": 0.20614696960322595, "driven_lanedir_consec": 0.5115935599073274, "sim_compute_sim_state": 0.020530848503112792, "sim_compute_performance-ego": 0.003412726720174154}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399929346132532, "get_ui_image": 0.02938030958175659, "step_physics": 0.07259525934855143, "survival_time": 14.950000000000076, "driven_lanedir": 0.5183363221013346, "get_state_dump": 0.009193902810414632, "sim_render-ego": 0.005242128372192383, "get_robot_state": 0.010829292933146158, "get_duckie_state": 1.9017855326334635e-06, "in-drivable-lane": 10.450000000000085, "agent_compute-ego": 0.015224719842274984, "deviation-heading": 1.2948714894399247, "complete-iteration": 0.17005315860112508, "set_robot_commands": 0.004473243554433187, "deviation-center-line": 0.22137802474825655, "driven_lanedir_consec": 0.5183363221013346, "sim_compute_sim_state": 0.019517608483632407, "sim_compute_performance-ego": 0.0034990612665812175}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.7914997815635344, "get_ui_image": 0.03101374421800886, "step_physics": 0.0724586324086265, "survival_time": 6.299999999999986, "driven_lanedir": 0.2951068546384039, "get_state_dump": 0.00937550597720676, "sim_render-ego": 0.005286245119004022, "get_robot_state": 0.010889753462776304, "get_duckie_state": 1.816522507440476e-06, "in-drivable-lane": 3.4999999999999876, "agent_compute-ego": 0.015027014036027212, "deviation-heading": 1.0101582073434396, "complete-iteration": 0.17220362973591638, "set_robot_commands": 0.00459939336019849, "deviation-center-line": 0.16436402502375716, "driven_lanedir_consec": 0.2951068546384039, "sim_compute_sim_state": 0.01996357857234894, "sim_compute_performance-ego": 0.003491475468590146}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399924111010125, "get_ui_image": 0.027037746906280517, "step_physics": 0.0725689721107483, "survival_time": 14.950000000000076, "driven_lanedir": 0.3091038052729007, "get_state_dump": 0.00938321034113566, "sim_render-ego": 0.0049795571962992355, "get_robot_state": 0.010925587813059488, "get_duckie_state": 1.84933344523112e-06, "in-drivable-lane": 12.00000000000008, "agent_compute-ego": 0.013973916371663411, "deviation-heading": 1.1089114077925717, "complete-iteration": 0.16963531176249186, "set_robot_commands": 0.004089540640513103, "deviation-center-line": 0.17927259256842829, "driven_lanedir_consec": 0.3091038052729007, "sim_compute_sim_state": 0.023243438402811685, "sim_compute_performance-ego": 0.0033387160301208496}}
set_robot_commands_max0.00459939336019849
set_robot_commands_mean0.004411910810167828
set_robot_commands_median0.004479354619979859
set_robot_commands_min0.004089540640513103
sim_compute_performance-ego_max0.0034990612665812175
sim_compute_performance-ego_mean0.0034354948713665916
sim_compute_performance-ego_median0.0034521010943821496
sim_compute_performance-ego_min0.0033387160301208496
sim_compute_sim_state_max0.023243438402811685
sim_compute_sim_state_mean0.020813868490476457
sim_compute_sim_state_median0.020247213537730867
sim_compute_sim_state_min0.019517608483632407
sim_render-ego_max0.005299451351165771
sim_render-ego_mean0.005201845509665353
sim_render-ego_median0.005264186745598203
sim_render-ego_min0.0049795571962992355
simulation-passed1
step_physics_max0.07531147956848144
step_physics_mean0.07323358585910192
step_physics_median0.07258211572964987
step_physics_min0.0724586324086265
survival_time_max14.950000000000076
survival_time_mean12.787500000000056
survival_time_min6.299999999999986
No reset possible
4293511566Olga (Ge Ya) XuΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9492910459508
survival_time_median14.950000000000076
deviation-center-line_median0.7879020646882955
in-drivable-lane_median4.62500000000003


other stats
agent_compute-ego_max0.012717014948527018
agent_compute-ego_mean0.012649842103322349
agent_compute-ego_median0.012682900826136273
agent_compute-ego_min0.012516551812489828
complete-iteration_max0.15829426447550457
complete-iteration_mean0.15278489549954732
complete-iteration_median0.15211084206899006
complete-iteration_min0.14862363338470458
deviation-center-line_max1.1581814742201335
deviation-center-line_mean0.8062128932080229
deviation-center-line_min0.490865969235367
deviation-heading_max2.513569275267679
deviation-heading_mean1.9154570743596384
deviation-heading_median2.128523265674713
deviation-heading_min0.8912124908214485
driven_any_max4.020591039480404
driven_any_mean3.7200604265358033
driven_any_median3.7256806751652745
driven_any_min3.4082893163322607
driven_lanedir_consec_max3.403022625830531
driven_lanedir_consec_mean2.663034025619374
driven_lanedir_consec_min1.350531384745366
driven_lanedir_max3.403022625830531
driven_lanedir_mean2.663034025619374
driven_lanedir_median2.9492910459508
driven_lanedir_min1.350531384745366
get_duckie_state_max1.916090647379558e-06
get_duckie_state_mean1.8715858459472655e-06
get_duckie_state_median1.863241195678711e-06
get_duckie_state_min1.8437703450520831e-06
get_robot_state_max0.01066848357518514
get_robot_state_mean0.010312429666519166
get_robot_state_median0.010356714725494385
get_robot_state_min0.009867805639902753
get_state_dump_max0.009286044438680013
get_state_dump_mean0.008944542407989501
get_state_dump_median0.008950652281443278
get_state_dump_min0.00859082063039144
get_ui_image_max0.024488943417867025
get_ui_image_mean0.024387354056040447
get_ui_image_median0.02444495995839437
get_ui_image_min0.024170552889506022
in-drivable-lane_max8.25000000000007
in-drivable-lane_mean4.787500000000039
in-drivable-lane_min1.6500000000000234
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.789834831891244, "get_ui_image": 0.024488943417867025, "step_physics": 0.06241209904352824, "survival_time": 14.950000000000076, "driven_lanedir": 3.403022625830531, "get_state_dump": 0.009189151128133136, "sim_render-ego": 0.004584867159525554, "get_robot_state": 0.010601996580759684, "get_duckie_state": 1.8660227457682293e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.01267395814259847, "deviation-heading": 2.513569275267679, "complete-iteration": 0.15146611452102662, "set_robot_commands": 0.003849615255991618, "deviation-center-line": 1.1581814742201335, "driven_lanedir_consec": 3.403022625830531, "sim_compute_sim_state": 0.02057477076848348, "sim_compute_performance-ego": 0.0030028637250264487}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.020591039480404, "get_ui_image": 0.024444315433502197, "step_physics": 0.06235411087671916, "survival_time": 14.950000000000076, "driven_lanedir": 3.239931781246995, "get_state_dump": 0.00859082063039144, "sim_render-ego": 0.004533959229787191, "get_robot_state": 0.009867805639902753, "get_duckie_state": 1.8437703450520831e-06, "in-drivable-lane": 4.100000000000014, "agent_compute-ego": 0.012516551812489828, "deviation-heading": 1.9315957136165705, "complete-iteration": 0.14862363338470458, "set_robot_commands": 0.003720351854960124, "deviation-center-line": 0.7951887202029456, "driven_lanedir_consec": 3.239931781246995, "sim_compute_sim_state": 0.01951199293136597, "sim_compute_performance-ego": 0.0029941240946451822}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.4082893163322607, "get_ui_image": 0.02444560448328654, "step_physics": 0.0633548617362976, "survival_time": 14.950000000000076, "driven_lanedir": 1.350531384745366, "get_state_dump": 0.009286044438680013, "sim_render-ego": 0.004655310312906901, "get_robot_state": 0.01066848357518514, "get_duckie_state": 1.916090647379558e-06, "in-drivable-lane": 8.25000000000007, "agent_compute-ego": 0.012717014948527018, "deviation-heading": 2.3254508177328557, "complete-iteration": 0.15275556961695352, "set_robot_commands": 0.0037617023785909017, "deviation-center-line": 0.490865969235367, "driven_lanedir_consec": 1.350531384745366, "sim_compute_sim_state": 0.02073512633641561, "sim_compute_performance-ego": 0.0030397415161132813}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.6615265184393047, "get_ui_image": 0.024170552889506022, "step_physics": 0.06799811124801636, "survival_time": 14.950000000000076, "driven_lanedir": 2.658650310654605, "get_state_dump": 0.008712153434753418, "sim_render-ego": 0.004510688781738281, "get_robot_state": 0.010111432870229083, "get_duckie_state": 1.8604596455891928e-06, "in-drivable-lane": 5.1500000000000465, "agent_compute-ego": 0.012691843509674072, "deviation-heading": 0.8912124908214485, "complete-iteration": 0.15829426447550457, "set_robot_commands": 0.003796427249908447, "deviation-center-line": 0.7806154091736454, "driven_lanedir_consec": 2.658650310654605, "sim_compute_sim_state": 0.02316273053487142, "sim_compute_performance-ego": 0.0030498258272806805}}
set_robot_commands_max0.003849615255991618
set_robot_commands_mean0.003782024184862773
set_robot_commands_median0.0037790648142496746
set_robot_commands_min0.003720351854960124
sim_compute_performance-ego_max0.0030498258272806805
sim_compute_performance-ego_mean0.003021638790766398
sim_compute_performance-ego_median0.003021302620569865
sim_compute_performance-ego_min0.0029941240946451822
sim_compute_sim_state_max0.02316273053487142
sim_compute_sim_state_mean0.02099615514278412
sim_compute_sim_state_median0.020654948552449544
sim_compute_sim_state_min0.01951199293136597
sim_render-ego_max0.004655310312906901
sim_render-ego_mean0.004571206370989482
sim_render-ego_median0.004559413194656373
sim_render-ego_min0.004510688781738281
simulation-passed1
step_physics_max0.06799811124801636
step_physics_mean0.06402979572614034
step_physics_median0.06288348038991293
step_physics_min0.06235411087671916
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4292111563Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoreg02-b35ee35771a7-10:03:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 162 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4291811562Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01327239751815796
agent_compute-ego_mean0.012990192969640097
agent_compute-ego_median0.012936049302419029
agent_compute-ego_min0.012816275755564372
complete-iteration_max0.16721535444259644
complete-iteration_mean0.1597387925783793
complete-iteration_median0.15848169604937234
complete-iteration_min0.1547764237721761
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.7682711283365886e-06
get_duckie_state_mean1.6679366429646808e-06
get_duckie_state_median1.666545867919922e-06
get_duckie_state_min1.5703837076822915e-06
get_robot_state_max0.013551931381225586
get_robot_state_mean0.012731374700864157
get_robot_state_median0.012683395942052204
get_robot_state_min0.012006775538126627
get_state_dump_max0.012354950904846193
get_state_dump_mean0.011950888633728028
get_state_dump_median0.012145769198735556
get_state_dump_min0.011157065232594809
get_ui_image_max0.025226582686106364
get_ui_image_mean0.02479161600271861
get_ui_image_median0.02483589728673299
get_ui_image_min0.024268086751302084
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.024738614559173585, "step_physics": 0.061499045689900715, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012354950904846193, "sim_render-ego": 0.004766983985900879, "get_robot_state": 0.013551931381225586, "get_duckie_state": 1.7682711283365886e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01327239751815796, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.15868987401326498, "set_robot_commands": 0.003924083709716797, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02116435130437215, "sim_compute_performance-ego": 0.003309884866078695}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.024268086751302084, "step_physics": 0.06090841213862101, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01228734572728475, "sim_render-ego": 0.004832541942596436, "get_robot_state": 0.01267952044804891, "get_duckie_state": 1.7364819844563802e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012816275755564372, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.1547764237721761, "set_robot_commands": 0.0039111725489298504, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.019629822572072343, "sim_compute_performance-ego": 0.0033374857902526856}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.025226582686106364, "step_physics": 0.0628683614730835, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.01200419267018636, "sim_render-ego": 0.004786624113718669, "get_robot_state": 0.0126872714360555, "get_duckie_state": 1.5966097513834637e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01302077372868856, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.15827351808547974, "set_robot_commands": 0.003812053203582763, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.020490283171335857, "sim_compute_performance-ego": 0.0032706642150878906}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.0249331800142924, "step_physics": 0.0716317868232727, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.011157065232594809, "sim_render-ego": 0.004717733065287272, "get_robot_state": 0.012006775538126627, "get_duckie_state": 1.5703837076822915e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012851324876149496, "deviation-heading": 0.486072248607516, "complete-iteration": 0.16721535444259644, "set_robot_commands": 0.0038268621762593586, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02278452873229981, "sim_compute_performance-ego": 0.0031991132100423177}}
set_robot_commands_max0.003924083709716797
set_robot_commands_mean0.0038685429096221927
set_robot_commands_median0.003869017362594604
set_robot_commands_min0.003812053203582763
sim_compute_performance-ego_max0.0033374857902526856
sim_compute_performance-ego_mean0.0032792870203653974
sim_compute_performance-ego_median0.0032902745405832927
sim_compute_performance-ego_min0.0031991132100423177
sim_compute_sim_state_max0.02278452873229981
sim_compute_sim_state_mean0.02101724644502004
sim_compute_sim_state_median0.020827317237854005
sim_compute_sim_state_min0.019629822572072343
sim_render-ego_max0.004832541942596436
sim_render-ego_mean0.004775970776875815
sim_render-ego_median0.0047768040498097734
sim_render-ego_min0.004717733065287272
simulation-passed1
step_physics_max0.0716317868232727
step_physics_mean0.06422690153121949
step_physics_median0.06218370358149211
step_physics_min0.06090841213862101
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4285911549Himanshu AroraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:09:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.462399772313468
survival_time_median14.950000000000076
deviation-center-line_median0.987128459840708
in-drivable-lane_median0.3249999999999992


other stats
agent_compute-ego_max0.016204243501027425
agent_compute-ego_mean0.015232750177383424
agent_compute-ego_median0.015639036893844604
agent_compute-ego_min0.013448683420817058
complete-iteration_max0.19494529247283937
complete-iteration_mean0.18010097086429594
complete-iteration_median0.1823059554894765
complete-iteration_min0.16084668000539143
deviation-center-line_max1.3822512108872678
deviation-center-line_mean1.0231003160965175
deviation-center-line_min0.7358931338173873
deviation-heading_max3.1987456372620455
deviation-heading_mean2.6979808385167576
deviation-heading_median2.6077318191350964
deviation-heading_min2.377714078534793
driven_any_max3.9586391297544288
driven_any_mean3.4400242450307146
driven_any_median3.575760853165926
driven_any_min2.6499361440365763
driven_lanedir_consec_max3.704041539486679
driven_lanedir_consec_mean3.3049526544866397
driven_lanedir_consec_min2.5909695338329435
driven_lanedir_max3.704041539486679
driven_lanedir_mean3.3049526544866397
driven_lanedir_median3.462399772313468
driven_lanedir_min2.5909695338329435
get_duckie_state_max2.17437744140625e-06
get_duckie_state_mean2.0245711008707683e-06
get_duckie_state_median2.0623207092285153e-06
get_duckie_state_min1.7992655436197915e-06
get_robot_state_max0.011527268091837566
get_robot_state_mean0.011030227541923524
get_robot_state_median0.011374505758285525
get_robot_state_min0.009844630559285484
get_state_dump_max0.009689300855000816
get_state_dump_mean0.009257494211196898
get_state_dump_median0.009453711907068889
get_state_dump_min0.008433252175649008
get_ui_image_max0.0309174648920695
get_ui_image_mean0.02974720239639282
get_ui_image_median0.03067554990450541
get_ui_image_min0.026720244884490967
in-drivable-lane_max0.7500000000000107
in-drivable-lane_mean0.35000000000000225
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.6925189957412248, "get_ui_image": 0.026720244884490967, "step_physics": 0.0699133054415385, "survival_time": 14.950000000000076, "driven_lanedir": 3.6240696743838674, "get_state_dump": 0.008433252175649008, "sim_render-ego": 0.0048434829711914065, "get_robot_state": 0.009844630559285484, "get_duckie_state": 1.7992655436197915e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013448683420817058, "deviation-heading": 2.377714078534793, "complete-iteration": 0.16084668000539143, "set_robot_commands": 0.004106613794962565, "deviation-center-line": 0.8238812665307427, "driven_lanedir_consec": 3.6240696743838674, "sim_compute_sim_state": 0.02022781451543172, "sim_compute_performance-ego": 0.0032122047742207845}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.459002710590628, "get_ui_image": 0.030697515805562337, "step_physics": 0.07560790061950684, "survival_time": 14.950000000000076, "driven_lanedir": 3.3007298702430687, "get_state_dump": 0.0094850222269694, "sim_render-ego": 0.005550383726755778, "get_robot_state": 0.011364753246307374, "get_duckie_state": 2.0821889241536456e-06, "in-drivable-lane": 0.6499999999999984, "agent_compute-ego": 0.015125128428141276, "deviation-heading": 2.6932917596289765, "complete-iteration": 0.1779888685544332, "set_robot_commands": 0.004498258431752522, "deviation-center-line": 0.7358931338173873, "driven_lanedir_consec": 3.3007298702430687, "sim_compute_sim_state": 0.021834057172139487, "sim_compute_performance-ego": 0.0037130268414815263}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.6499361440365763, "get_ui_image": 0.03065358400344849, "step_physics": 0.08225675741831462, "survival_time": 14.950000000000076, "driven_lanedir": 2.5909695338329435, "get_state_dump": 0.009422401587168377, "sim_render-ego": 0.005494989554087321, "get_robot_state": 0.011384258270263672, "get_duckie_state": 2.0424524943033858e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016204243501027425, "deviation-heading": 2.5221718786412164, "complete-iteration": 0.18662304242451985, "set_robot_commands": 0.0048220157623291016, "deviation-center-line": 1.3822512108872678, "driven_lanedir_consec": 2.5909695338329435, "sim_compute_sim_state": 0.022596704959869384, "sim_compute_performance-ego": 0.003672210375467936}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.9586391297544288, "get_ui_image": 0.0309174648920695, "step_physics": 0.08475518226623535, "survival_time": 14.950000000000076, "driven_lanedir": 3.704041539486679, "get_state_dump": 0.009689300855000816, "sim_render-ego": 0.005677518844604493, "get_robot_state": 0.011527268091837566, "get_duckie_state": 2.17437744140625e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.01615294535954793, "deviation-heading": 3.1987456372620455, "complete-iteration": 0.19494529247283937, "set_robot_commands": 0.004968890349070231, "deviation-center-line": 1.1503756531506737, "driven_lanedir_consec": 3.704041539486679, "sim_compute_sim_state": 0.02732598066329956, "sim_compute_performance-ego": 0.003814130624135335}}
set_robot_commands_max0.004968890349070231
set_robot_commands_mean0.004598944584528605
set_robot_commands_median0.004660137097040812
set_robot_commands_min0.004106613794962565
sim_compute_performance-ego_max0.003814130624135335
sim_compute_performance-ego_mean0.003602893153826395
sim_compute_performance-ego_median0.003692618608474731
sim_compute_performance-ego_min0.0032122047742207845
sim_compute_sim_state_max0.02732598066329956
sim_compute_sim_state_mean0.02299613932768504
sim_compute_sim_state_median0.022215381066004437
sim_compute_sim_state_min0.02022781451543172
sim_render-ego_max0.005677518844604493
sim_render-ego_mean0.005391593774159749
sim_render-ego_median0.00552268664042155
sim_render-ego_min0.0048434829711914065
simulation-passed1
step_physics_max0.08475518226623535
step_physics_mean0.07813328643639883
step_physics_median0.07893232901891073
step_physics_min0.0699133054415385
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4285411547Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simfailednoreg02-b35ee35771a7-10:03:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 114 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4285011546Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.021777450826644
survival_time_median14.950000000000076
deviation-center-line_median1.0787074086376265
in-drivable-lane_median1.4499999999999966


other stats
agent_compute-ego_max0.012252318064371744
agent_compute-ego_mean0.012080497543017068
agent_compute-ego_median0.012060895363489784
agent_compute-ego_min0.01194788138071696
complete-iteration_max0.15369240045547486
complete-iteration_mean0.14932857672373454
complete-iteration_median0.1489453637599945
complete-iteration_min0.1457311789194743
deviation-center-line_max1.1527816228997751
deviation-center-line_mean1.0321301919098909
deviation-center-line_min0.8183243274645351
deviation-heading_max3.857076008356262
deviation-heading_mean3.2817363239996817
deviation-heading_median3.176896914771822
deviation-heading_min2.9160754580988217
driven_any_max4.9295853602243
driven_any_mean4.415969773599509
driven_any_median4.533767309446681
driven_any_min3.666759115280378
driven_lanedir_consec_max4.231683073575914
driven_lanedir_consec_mean3.7762426775335816
driven_lanedir_consec_min2.8297327349051233
driven_lanedir_max4.231683073575914
driven_lanedir_mean3.7762426775335816
driven_lanedir_median4.021777450826644
driven_lanedir_min2.8297327349051233
get_duckie_state_max1.224676767985026e-06
get_duckie_state_mean1.193682352701823e-06
get_duckie_state_median1.189708709716797e-06
get_duckie_state_min1.170635223388672e-06
get_robot_state_max0.009861138661702474
get_robot_state_mean0.009700137575467428
get_robot_state_median0.009735820690790813
get_robot_state_min0.009467770258585612
get_state_dump_max0.008585587342580159
get_state_dump_mean0.008496100703875225
get_state_dump_median0.008504066069920858
get_state_dump_min0.00839068333307902
get_ui_image_max0.02478835662206014
get_ui_image_mean0.024446653127670286
get_ui_image_median0.02449125329653422
get_ui_image_min0.02401574929555257
in-drivable-lane_max3.049999999999989
in-drivable-lane_mean1.5749999999999968
in-drivable-lane_min0.350000000000005
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.23767873334047, "get_ui_image": 0.02401574929555257, "step_physics": 0.062126957575480146, "survival_time": 14.950000000000076, "driven_lanedir": 4.055443058396315, "get_state_dump": 0.008585587342580159, "sim_render-ego": 0.004496268431345622, "get_robot_state": 0.009861138661702474, "get_duckie_state": 1.170635223388672e-06, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.012151853243509928, "deviation-heading": 2.9160754580988217, "complete-iteration": 0.14802249431610107, "set_robot_commands": 0.0037459500630696615, "deviation-center-line": 1.1527816228997751, "driven_lanedir_consec": 4.055443058396315, "sim_compute_sim_state": 0.01999780813852946, "sim_compute_performance-ego": 0.002956400712331136}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.9295853602243, "get_ui_image": 0.024381514390309653, "step_physics": 0.060836883385976155, "survival_time": 14.950000000000076, "driven_lanedir": 4.231683073575914, "get_state_dump": 0.00839068333307902, "sim_render-ego": 0.004464577833811442, "get_robot_state": 0.009467770258585612, "get_duckie_state": 1.224676767985026e-06, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.011969937483469644, "deviation-heading": 3.857076008356262, "complete-iteration": 0.1457311789194743, "set_robot_commands": 0.003747368653615315, "deviation-center-line": 1.088330107988321, "driven_lanedir_consec": 4.231683073575914, "sim_compute_sim_state": 0.0194392991065979, "sim_compute_performance-ego": 0.0029468290011088055}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.666759115280378, "get_ui_image": 0.024600992202758788, "step_physics": 0.0637721045811971, "survival_time": 14.950000000000076, "driven_lanedir": 2.8297327349051233, "get_state_dump": 0.00843032439549764, "sim_render-ego": 0.0044757397969563805, "get_robot_state": 0.009734613100687664, "get_duckie_state": 1.2000401814778646e-06, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.012252318064371744, "deviation-heading": 3.109978725069254, "complete-iteration": 0.14986823320388795, "set_robot_commands": 0.003722982406616211, "deviation-center-line": 0.8183243274645351, "driven_lanedir_consec": 2.8297327349051233, "sim_compute_sim_state": 0.0197814416885376, "sim_compute_performance-ego": 0.003009664217631022}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.829855885552891, "get_ui_image": 0.02478835662206014, "step_physics": 0.06496381044387817, "survival_time": 14.950000000000076, "driven_lanedir": 3.9881118432569735, "get_state_dump": 0.008577807744344076, "sim_render-ego": 0.004430515766143799, "get_robot_state": 0.00973702828089396, "get_duckie_state": 1.179377237955729e-06, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.01194788138071696, "deviation-heading": 3.2438151044743897, "complete-iteration": 0.15369240045547486, "set_robot_commands": 0.003675797780354818, "deviation-center-line": 1.0690847092869322, "driven_lanedir_consec": 3.9881118432569735, "sim_compute_sim_state": 0.022523105144500732, "sim_compute_performance-ego": 0.002961142063140869}}
set_robot_commands_max0.003747368653615315
set_robot_commands_mean0.0037230247259140018
set_robot_commands_median0.003734466234842936
set_robot_commands_min0.003675797780354818
sim_compute_performance-ego_max0.003009664217631022
sim_compute_performance-ego_mean0.0029685089985529585
sim_compute_performance-ego_median0.002958771387736003
sim_compute_performance-ego_min0.0029468290011088055
sim_compute_sim_state_max0.022523105144500732
sim_compute_sim_state_mean0.020435413519541423
sim_compute_sim_state_median0.019889624913533528
sim_compute_sim_state_min0.0194392991065979
sim_render-ego_max0.004496268431345622
sim_render-ego_mean0.004466775457064311
sim_render-ego_median0.0044701588153839115
sim_render-ego_min0.004430515766143799
simulation-passed1
step_physics_max0.06496381044387817
step_physics_mean0.06292493899663289
step_physics_median0.06294953107833862
step_physics_min0.060836883385976155
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4283511538Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5041824389512686
survival_time_median13.80000000000006
deviation-center-line_median0.3393089569850863
in-drivable-lane_median1.7250000000000048


other stats
agent_compute-ego_max0.0134204363822937
agent_compute-ego_mean0.012967262260998664
agent_compute-ego_median0.01302888034360682
agent_compute-ego_min0.012390851974487305
complete-iteration_max0.1594093569119771
complete-iteration_mean0.15295653388378155
complete-iteration_median0.1516712852271963
complete-iteration_min0.14907420816875638
deviation-center-line_max0.9183132723059356
deviation-center-line_mean0.4203815414985479
deviation-center-line_min0.08459497971808314
deviation-heading_max3.7482913924899934
deviation-heading_mean1.9828150345757167
deviation-heading_median1.6514392741238857
deviation-heading_min0.8800901975651025
driven_any_max4.59436565241452
driven_any_mean3.399587802978253
driven_any_median4.225148223668959
driven_any_min0.5536891121605764
driven_lanedir_consec_max4.157961676488107
driven_lanedir_consec_mean1.8247927563328492
driven_lanedir_consec_min0.13284447094075347
driven_lanedir_max4.157961676488107
driven_lanedir_mean1.833798096844695
driven_lanedir_median1.516112130705852
driven_lanedir_min0.14500644947896912
get_duckie_state_max1.5076001485188802e-06
get_duckie_state_mean1.4195157470573886e-06
get_duckie_state_median1.4068737959830342e-06
get_duckie_state_min1.3567152477446057e-06
get_robot_state_max0.010351394947338482
get_robot_state_mean0.010223942063811942
get_robot_state_median0.010252515929085868
get_robot_state_min0.01003934144973755
get_state_dump_max0.00936734676361084
get_state_dump_mean0.009012970289851052
get_state_dump_median0.009040458522766474
get_state_dump_min0.008603617350260417
get_ui_image_max0.025123777843656995
get_ui_image_mean0.024884470767632012
get_ui_image_median0.024885771274566648
get_ui_image_min0.02464256267773775
in-drivable-lane_max13.700000000000076
in-drivable-lane_mean4.4625000000000234
in-drivable-lane_min0.7000000000000082
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8562507016638823, "get_ui_image": 0.02464256267773775, "step_physics": 0.06302546700941244, "survival_time": 12.650000000000045, "driven_lanedir": 2.874972256148947, "get_state_dump": 0.008963928863465078, "sim_render-ego": 0.004690149556035581, "get_robot_state": 0.010351394947338482, "get_duckie_state": 1.422972547206954e-06, "in-drivable-lane": 2.6000000000000094, "agent_compute-ego": 0.013003947706561788, "deviation-heading": 2.3948621061084836, "complete-iteration": 0.15227846383106097, "set_robot_commands": 0.003968379243089276, "deviation-center-line": 0.5897296205763707, "driven_lanedir_consec": 2.874972256148947, "sim_compute_sim_state": 0.020387200027586445, "sim_compute_performance-ego": 0.0031466908134490604}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.59436565241452, "get_ui_image": 0.024824353059132893, "step_physics": 0.06288583596547445, "survival_time": 14.950000000000076, "driven_lanedir": 4.157961676488107, "get_state_dump": 0.008603617350260417, "sim_render-ego": 0.0046439917882283525, "get_robot_state": 0.01003934144973755, "get_duckie_state": 1.5076001485188802e-06, "in-drivable-lane": 0.7000000000000082, "agent_compute-ego": 0.013053812980651856, "deviation-heading": 3.7482913924899934, "complete-iteration": 0.1510641066233317, "set_robot_commands": 0.0040212726593017575, "deviation-center-line": 0.9183132723059356, "driven_lanedir_consec": 4.157961676488107, "sim_compute_sim_state": 0.0198506236076355, "sim_compute_performance-ego": 0.003046410083770752}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.5536891121605764, "get_ui_image": 0.025123777843656995, "step_physics": 0.06232460339864095, "survival_time": 2.1000000000000005, "driven_lanedir": 0.1572520052627573, "get_state_dump": 0.00936734676361084, "sim_render-ego": 0.004555321875072661, "get_robot_state": 0.010229553495134628, "get_duckie_state": 1.3567152477446057e-06, "in-drivable-lane": 0.8500000000000001, "agent_compute-ego": 0.012390851974487305, "deviation-heading": 0.8800901975651025, "complete-iteration": 0.14907420816875638, "set_robot_commands": 0.003883662677946545, "deviation-center-line": 0.08459497971808314, "driven_lanedir_consec": 0.13339262175359, "sim_compute_sim_state": 0.01811227344331287, "sim_compute_performance-ego": 0.002991750126793271}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.594045745674035, "get_ui_image": 0.024947189490000406, "step_physics": 0.06789361874262492, "survival_time": 14.950000000000076, "driven_lanedir": 0.14500644947896912, "get_state_dump": 0.00911698818206787, "sim_render-ego": 0.00464801549911499, "get_robot_state": 0.01027547836303711, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 13.700000000000076, "agent_compute-ego": 0.0134204363822937, "deviation-heading": 0.9080164421392878, "complete-iteration": 0.1594093569119771, "set_robot_commands": 0.004005257288614909, "deviation-center-line": 0.0888882933938019, "driven_lanedir_consec": 0.13284447094075347, "sim_compute_sim_state": 0.02193605343500773, "sim_compute_performance-ego": 0.003071295420328776}}
set_robot_commands_max0.0040212726593017575
set_robot_commands_mean0.003969642967238122
set_robot_commands_median0.0039868182658520926
set_robot_commands_min0.003883662677946545
sim_compute_performance-ego_max0.0031466908134490604
sim_compute_performance-ego_mean0.0030640366110854652
sim_compute_performance-ego_median0.003058852752049764
sim_compute_performance-ego_min0.002991750126793271
sim_compute_sim_state_max0.02193605343500773
sim_compute_sim_state_mean0.020071537628385636
sim_compute_sim_state_median0.02011891181761097
sim_compute_sim_state_min0.01811227344331287
sim_render-ego_max0.004690149556035581
sim_render-ego_mean0.0046343696796128965
sim_render-ego_median0.004646003643671671
sim_render-ego_min0.004555321875072661
simulation-passed1
step_physics_max0.06789361874262492
step_physics_mean0.0640323812790382
step_physics_median0.06295565148744345
step_physics_min0.06232460339864095
survival_time_max14.950000000000076
survival_time_mean11.162500000000051
survival_time_min2.1000000000000005
No reset possible
4280811537Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.20302670478364
survival_time_median14.950000000000076
deviation-center-line_median0.9533666833924086
in-drivable-lane_median1.1000000000000068


other stats
agent_compute-ego_max0.017100321451822918
agent_compute-ego_mean0.01547858456770579
agent_compute-ego_median0.016133586168289187
agent_compute-ego_min0.012546844482421876
complete-iteration_max0.1942356499036153
complete-iteration_mean0.18153940359751383
complete-iteration_median0.18690339843432108
complete-iteration_min0.15811516761779784
deviation-center-line_max1.0070337425584983
deviation-center-line_mean0.7484112644912609
deviation-center-line_min0.07987794862172815
deviation-heading_max3.876971656566954
deviation-heading_mean2.495561209396832
deviation-heading_median2.779950769303988
deviation-heading_min0.5453716424123984
driven_any_max3.0629773512675538
driven_any_mean2.342509676723085
driven_any_median3.057972198543625
driven_any_min0.19111695853753616
driven_lanedir_consec_max2.7743694771359277
driven_lanedir_consec_mean1.816323102659924
driven_lanedir_consec_min0.08486952393648917
driven_lanedir_max2.7743694771359277
driven_lanedir_mean1.816323102659924
driven_lanedir_median2.20302670478364
driven_lanedir_min0.08486952393648917
get_duckie_state_max1.614093780517578e-06
get_duckie_state_mean1.503626505533854e-06
get_duckie_state_median1.580317815144857e-06
get_duckie_state_min1.239776611328125e-06
get_robot_state_max0.01221514145533244
get_robot_state_mean0.011454904675483704
get_robot_state_median0.011836556593577068
get_robot_state_min0.009931364059448245
get_state_dump_max0.009908825556437174
get_state_dump_mean0.009659679929415386
get_state_dump_median0.00979230761528015
get_state_dump_min0.009145278930664065
get_ui_image_max0.0329844856262207
get_ui_image_mean0.030439672072728474
get_ui_image_median0.031654361883799234
get_ui_image_min0.025465478897094728
in-drivable-lane_max5.30000000000002
in-drivable-lane_mean1.9375000000000084
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0530436829288874, "get_ui_image": 0.031665664513905845, "step_physics": 0.08074405829111735, "survival_time": 14.950000000000076, "driven_lanedir": 2.689691812260418, "get_state_dump": 0.00972038984298706, "sim_render-ego": 0.005752662022908529, "get_robot_state": 0.011701165040334064, "get_duckie_state": 1.583099365234375e-06, "in-drivable-lane": 1.400000000000002, "agent_compute-ego": 0.01612545410792033, "deviation-heading": 2.1634275375421677, "complete-iteration": 0.1872054656346639, "set_robot_commands": 0.005111629168192545, "deviation-center-line": 1.0070337425584983, "driven_lanedir_consec": 2.689691812260418, "sim_compute_sim_state": 0.022474761009216308, "sim_compute_performance-ego": 0.0038006885846455897}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0629773512675538, "get_ui_image": 0.0329844856262207, "step_physics": 0.07798079967498779, "survival_time": 14.950000000000076, "driven_lanedir": 2.7743694771359277, "get_state_dump": 0.009908825556437174, "sim_render-ego": 0.005761515299479166, "get_robot_state": 0.011971948146820068, "get_duckie_state": 1.5775362650553384e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.01614171822865804, "deviation-heading": 3.3964740010658083, "complete-iteration": 0.18660133123397823, "set_robot_commands": 0.004931449890136719, "deviation-center-line": 0.9268426814795726, "driven_lanedir_consec": 2.7743694771359277, "sim_compute_sim_state": 0.022939966519673664, "sim_compute_performance-ego": 0.003863688309987386}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.062900714158362, "get_ui_image": 0.031643059253692624, "step_physics": 0.08464969476064046, "survival_time": 14.950000000000076, "driven_lanedir": 1.7163615973068616, "get_state_dump": 0.009864225387573242, "sim_render-ego": 0.005788009961446126, "get_robot_state": 0.01221514145533244, "get_duckie_state": 1.614093780517578e-06, "in-drivable-lane": 5.30000000000002, "agent_compute-ego": 0.017100321451822918, "deviation-heading": 3.876971656566954, "complete-iteration": 0.1942356499036153, "set_robot_commands": 0.004917296568552653, "deviation-center-line": 0.9798906853052444, "driven_lanedir_consec": 1.7163615973068616, "sim_compute_sim_state": 0.02404165029525757, "sim_compute_performance-ego": 0.003888717492421468}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.19111695853753616, "get_ui_image": 0.025465478897094728, "step_physics": 0.0695845890045166, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08486952393648917, "get_state_dump": 0.009145278930664065, "sim_render-ego": 0.004654245376586914, "get_robot_state": 0.009931364059448245, "get_duckie_state": 1.239776611328125e-06, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.012546844482421876, "deviation-heading": 0.5453716424123984, "complete-iteration": 0.15811516761779784, "set_robot_commands": 0.004075212478637695, "deviation-center-line": 0.07987794862172815, "driven_lanedir_consec": 0.08486952393648917, "sim_compute_sim_state": 0.01949223518371582, "sim_compute_performance-ego": 0.0031238555908203124}}
set_robot_commands_max0.005111629168192545
set_robot_commands_mean0.004758897026379903
set_robot_commands_median0.004924373229344686
set_robot_commands_min0.004075212478637695
sim_compute_performance-ego_max0.003888717492421468
sim_compute_performance-ego_mean0.003669237494468689
sim_compute_performance-ego_median0.003832188447316488
sim_compute_performance-ego_min0.0031238555908203124
sim_compute_sim_state_max0.02404165029525757
sim_compute_sim_state_mean0.02223715325196584
sim_compute_sim_state_median0.022707363764444988
sim_compute_sim_state_min0.01949223518371582
sim_render-ego_max0.005788009961446126
sim_render-ego_mean0.005489108165105184
sim_render-ego_median0.005757088661193848
sim_render-ego_min0.004654245376586914
simulation-passed1
step_physics_max0.08464969476064046
step_physics_mean0.07823978543281555
step_physics_median0.07936242898305257
step_physics_min0.0695845890045166
survival_time_max14.950000000000076
survival_time_mean11.52500000000006
survival_time_min1.2500000000000004
No reset possible
4279111537Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9616852377450935
survival_time_median14.950000000000076
deviation-center-line_median1.0100372667218758
in-drivable-lane_median4.0000000000000115


other stats
agent_compute-ego_max0.017021907170613606
agent_compute-ego_mean0.015810820857683816
agent_compute-ego_median0.016401304006576536
agent_compute-ego_min0.013418768246968587
complete-iteration_max0.1877756667137146
complete-iteration_mean0.18045745531717935
complete-iteration_median0.1871217401822408
complete-iteration_min0.15981067419052125
deviation-center-line_max1.0977019964764796
deviation-center-line_mean0.82361084549078
deviation-center-line_min0.17666685204288846
deviation-heading_max4.318080831446916
deviation-heading_mean3.186635615550278
deviation-heading_median3.582065222413083
deviation-heading_min1.2643311859280304
driven_any_max3.06291030926712
driven_any_mean3.0604116041529696
driven_any_median3.0628286820661166
driven_any_min3.053078743212524
driven_lanedir_consec_max2.396462284237341
driven_lanedir_consec_mean1.9294282381789216
driven_lanedir_consec_min1.3978801929881577
driven_lanedir_max2.5778014164835508
driven_lanedir_mean2.005531052557677
driven_lanedir_median2.023221300379499
driven_lanedir_min1.3978801929881577
get_duckie_state_max1.5505154927571614e-06
get_duckie_state_mean1.4309088389078777e-06
get_duckie_state_median1.5143553415934245e-06
get_duckie_state_min1.1444091796875e-06
get_robot_state_max0.011965425809224446
get_robot_state_mean0.011534716089566547
get_robot_state_median0.011782269875208536
get_robot_state_min0.010608898798624674
get_state_dump_max0.010051631132761637
get_state_dump_mean0.009715931018193562
get_state_dump_median0.009735760688781738
get_state_dump_min0.009340571562449137
get_ui_image_max0.03229179302851359
get_ui_image_mean0.02986999074618022
get_ui_image_median0.030832730929056806
get_ui_image_min0.02552270809809367
in-drivable-lane_max7.600000000000096
in-drivable-lane_mean4.20000000000003
in-drivable-lane_min1.2000000000000033
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.053078743212524, "get_ui_image": 0.03074443817138672, "step_physics": 0.07987928628921509, "survival_time": 14.950000000000076, "driven_lanedir": 1.3978801929881577, "get_state_dump": 0.009778565565745035, "sim_render-ego": 0.005772286256154378, "get_robot_state": 0.011965425809224446, "get_duckie_state": 1.5505154927571614e-06, "in-drivable-lane": 7.600000000000096, "agent_compute-ego": 0.017021907170613606, "deviation-heading": 1.2643311859280304, "complete-iteration": 0.1877756667137146, "set_robot_commands": 0.004978659152984619, "deviation-center-line": 0.17666685204288846, "driven_lanedir_consec": 1.3978801929881577, "sim_compute_sim_state": 0.02370578765869141, "sim_compute_performance-ego": 0.0038173246383666993}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.06291030926712, "get_ui_image": 0.03229179302851359, "step_physics": 0.07922581354777018, "survival_time": 14.950000000000076, "driven_lanedir": 1.63019864670919, "get_state_dump": 0.00969295581181844, "sim_render-ego": 0.005748265584309895, "get_robot_state": 0.011887808640797934, "get_duckie_state": 1.5409787495930989e-06, "in-drivable-lane": 6.100000000000026, "agent_compute-ego": 0.016809419790903727, "deviation-heading": 2.9100399427239365, "complete-iteration": 0.18724642992019652, "set_robot_commands": 0.004969596862792969, "deviation-center-line": 0.97354900476763, "driven_lanedir_consec": 1.63019864670919, "sim_compute_sim_state": 0.02256330966949463, "sim_compute_performance-ego": 0.0039508891105651854}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0628974652354812, "get_ui_image": 0.03092102368672689, "step_physics": 0.08283846696217854, "survival_time": 14.950000000000076, "driven_lanedir": 2.416243954049809, "get_state_dump": 0.010051631132761637, "sim_render-ego": 0.005497824350992838, "get_robot_state": 0.01167673110961914, "get_duckie_state": 1.48773193359375e-06, "in-drivable-lane": 1.8999999999999968, "agent_compute-ego": 0.01599318822224935, "deviation-heading": 4.25409050210223, "complete-iteration": 0.18699705044428508, "set_robot_commands": 0.004628883202870687, "deviation-center-line": 1.0465255286761217, "driven_lanedir_consec": 2.2931718287809972, "sim_compute_sim_state": 0.021498619715372723, "sim_compute_performance-ego": 0.003787487347920736}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.062759898896752, "get_ui_image": 0.02552270809809367, "step_physics": 0.06760949214299519, "survival_time": 14.950000000000076, "driven_lanedir": 2.5778014164835508, "get_state_dump": 0.009340571562449137, "sim_render-ego": 0.0048526612917582194, "get_robot_state": 0.010608898798624674, "get_duckie_state": 1.1444091796875e-06, "in-drivable-lane": 1.2000000000000033, "agent_compute-ego": 0.013418768246968587, "deviation-heading": 4.318080831446916, "complete-iteration": 0.15981067419052125, "set_robot_commands": 0.00402917226155599, "deviation-center-line": 1.0977019964764796, "driven_lanedir_consec": 2.396462284237341, "sim_compute_sim_state": 0.02109971364339193, "sim_compute_performance-ego": 0.0032357056935628254}}
set_robot_commands_max0.004978659152984619
set_robot_commands_mean0.0046515778700510655
set_robot_commands_median0.004799240032831827
set_robot_commands_min0.00402917226155599
sim_compute_performance-ego_max0.0039508891105651854
sim_compute_performance-ego_mean0.0036978516976038617
sim_compute_performance-ego_median0.0038024059931437175
sim_compute_performance-ego_min0.0032357056935628254
sim_compute_sim_state_max0.02370578765869141
sim_compute_sim_state_mean0.022216857671737672
sim_compute_sim_state_median0.022030964692433676
sim_compute_sim_state_min0.02109971364339193
sim_render-ego_max0.005772286256154378
sim_render-ego_mean0.005467759370803833
sim_render-ego_median0.005623044967651367
sim_render-ego_min0.0048526612917582194
simulation-passed1
step_physics_max0.08283846696217854
step_physics_mean0.07738826473553975
step_physics_median0.07955254991849264
step_physics_min0.06760949214299519
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4277211534Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessnoreg02-b35ee35771a7-10:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.126964611689533
survival_time_median14.325000000000069
deviation-center-line_median0.8862018202422248
in-drivable-lane_median2.000000000000004


other stats
agent_compute-ego_max0.012928602074374672
agent_compute-ego_mean0.012709806050889935
agent_compute-ego_median0.012777018149693809
agent_compute-ego_min0.012356585829797453
complete-iteration_max0.1623099572467108
complete-iteration_mean0.15764726840520368
complete-iteration_median0.15759249448776247
complete-iteration_min0.15309412739857906
deviation-center-line_max0.9676941968807544
deviation-center-line_mean0.7498342397054504
deviation-center-line_min0.2592391214565975
deviation-heading_max3.791116284255681
deviation-heading_mean2.7510875689097496
deviation-heading_median3.1603595505737507
deviation-heading_min0.8925148902358165
driven_any_max4.687288416831727
driven_any_mean3.810224534600388
driven_any_median4.156687560069905
driven_any_min2.240234601430014
driven_lanedir_consec_max3.635705610918112
driven_lanedir_consec_mean2.8097391207797164
driven_lanedir_consec_min1.349321648821688
driven_lanedir_max3.635705610918112
driven_lanedir_mean2.997336600220376
driven_lanedir_median3.5021595705708513
driven_lanedir_min1.349321648821688
get_duckie_state_max1.5306472778320312e-06
get_duckie_state_mean1.4380385215711074e-06
get_duckie_state_median1.442580327500392e-06
get_duckie_state_min1.336346153451615e-06
get_robot_state_max0.011189550558725992
get_robot_state_mean0.01078043993015042
get_robot_state_median0.01105502745820948
get_robot_state_min0.009822154245456727
get_state_dump_max0.010040375391642252
get_state_dump_mean0.009395561955383096
get_state_dump_median0.009619742179439016
get_state_dump_min0.008302388071012096
get_ui_image_max0.02553731253167161
get_ui_image_mean0.02528195931288526
get_ui_image_median0.02531774721876548
get_ui_image_min0.02495503028233846
in-drivable-lane_max2.8000000000000043
in-drivable-lane_mean1.8250000000000024
in-drivable-lane_min0.4999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.240234601430014, "get_ui_image": 0.02553731253167161, "step_physics": 0.06419404614873293, "survival_time": 5.949999999999987, "driven_lanedir": 1.349321648821688, "get_state_dump": 0.008302388071012096, "sim_render-ego": 0.004779999997435498, "get_robot_state": 0.009822154245456727, "get_duckie_state": 1.336346153451615e-06, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.012928602074374672, "deviation-heading": 0.8925148902358165, "complete-iteration": 0.15309412739857906, "set_robot_commands": 0.004176290095353327, "deviation-center-line": 0.2592391214565975, "driven_lanedir_consec": 1.349321648821688, "sim_compute_sim_state": 0.020069498975737756, "sim_compute_performance-ego": 0.0031941918765797336}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.687288416831727, "get_ui_image": 0.02495503028233846, "step_physics": 0.06566150188446045, "survival_time": 14.950000000000076, "driven_lanedir": 3.5479452694306883, "get_state_dump": 0.010040375391642252, "sim_render-ego": 0.0047861011823018395, "get_robot_state": 0.011189550558725992, "get_duckie_state": 1.5306472778320312e-06, "in-drivable-lane": 2.8000000000000043, "agent_compute-ego": 0.01284204880396525, "deviation-heading": 3.6260234718328017, "complete-iteration": 0.158141082127889, "set_robot_commands": 0.004019993940989177, "deviation-center-line": 0.9201048146064564, "driven_lanedir_consec": 2.7975553516680516, "sim_compute_sim_state": 0.021353551546732585, "sim_compute_performance-ego": 0.0031981404622395833}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.9118670071942714, "get_ui_image": 0.02527672529220581, "step_physics": 0.0655156413714091, "survival_time": 14.950000000000076, "driven_lanedir": 3.635705610918112, "get_state_dump": 0.009433577060699465, "sim_render-ego": 0.004762052694956461, "get_robot_state": 0.011003467241923014, "get_duckie_state": 1.4328956604003906e-06, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.012711987495422364, "deviation-heading": 3.791116284255681, "complete-iteration": 0.15704390684763592, "set_robot_commands": 0.0038469123840332033, "deviation-center-line": 0.9676941968807544, "driven_lanedir_consec": 3.635705610918112, "sim_compute_sim_state": 0.02124724229176839, "sim_compute_performance-ego": 0.0031543787320454917}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.401508112945538, "get_ui_image": 0.02535876914532515, "step_physics": 0.06764725786055961, "survival_time": 13.70000000000006, "driven_lanedir": 3.456373871711014, "get_state_dump": 0.009805907298178568, "sim_render-ego": 0.004792427494578118, "get_robot_state": 0.011106587674495948, "get_duckie_state": 1.4522649946003934e-06, "in-drivable-lane": 2.000000000000015, "agent_compute-ego": 0.012356585829797453, "deviation-heading": 2.6946956293146997, "complete-iteration": 0.1623099572467108, "set_robot_commands": 0.0039475799477013355, "deviation-center-line": 0.8522988258779932, "driven_lanedir_consec": 3.456373871711014, "sim_compute_sim_state": 0.024052900119419515, "sim_compute_performance-ego": 0.003148959500946268}}
set_robot_commands_max0.004176290095353327
set_robot_commands_mean0.003997694092019261
set_robot_commands_median0.003983786944345256
set_robot_commands_min0.0038469123840332033
sim_compute_performance-ego_max0.0031981404622395833
sim_compute_performance-ego_mean0.003173917642952769
sim_compute_performance-ego_median0.0031742853043126126
sim_compute_performance-ego_min0.003148959500946268
sim_compute_sim_state_max0.024052900119419515
sim_compute_sim_state_mean0.021680798233414563
sim_compute_sim_state_median0.021300396919250487
sim_compute_sim_state_min0.020069498975737756
sim_render-ego_max0.004792427494578118
sim_render-ego_mean0.004780145342317979
sim_render-ego_median0.004783050589868668
sim_render-ego_min0.004762052694956461
simulation-passed1
step_physics_max0.06764725786055961
step_physics_mean0.06575461181629053
step_physics_median0.06558857162793477
step_physics_min0.06419404614873293
survival_time_max14.950000000000076
survival_time_mean12.387500000000047
survival_time_min5.949999999999987
No reset possible
4276011530Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerrornoreg02-b35ee35771a7-10:07:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible