Evaluator 1854

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

33413

6834

Melisande Teng

exercise_ros_template

aido5-LF-sim-validation

LFv-sim

success

reg09

2020-10-18 03:47:49+00:00

2020-10-18 04:11:13+00:00

0:23:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.4054131312023622
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.031116453011830646
agent_compute-ego_mean	0.030444730997085567
agent_compute-ego_median	0.030307443539301555
agent_compute-ego_min	0.03001386324564616
complete-iteration_max	0.2834372321764628
complete-iteration_mean	0.2649391584396362
complete-iteration_median	0.2629490749041239
complete-iteration_min	0.2553950921694438
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.41778364329376794
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.8869656519179927
deviation-heading_median	1.6198720948235377
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	8.215966626878722e-14
driven_any_median	1.3278267374516872e-13
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	3.564357757568359e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	3.564357757568359e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.02069123824437459
get_state_dump_mean	0.02057846705118815
get_state_dump_median	0.02058410326639811
get_state_dump_min	0.020467246373494462
get_ui_image_max	0.04701636791229248
get_ui_image_mean	0.04654527672131856
get_ui_image_median	0.04655288060506185
get_ui_image_min	0.04589431206385294
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04698106368382772, "step_physics": 0.0883854071299235, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02066066344579061, "sim_render-ego": 0.007615268230438232, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03054733435312907, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2576785929997762, "set_robot_commands": 0.006633079846700032, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02830653190612793, "sim_compute_performance-ego": 0.006398563385009766, "sim_compute_robot_state-ego": 0.0107871413230896, "sim_compute_robot_state-parked0": 0.011121995449066162}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.046463882128397624, "step_physics": 0.0884489401181539, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02048331340154012, "sim_render-ego": 0.007633958657582601, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03034032185872396, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.25694613456726073, "set_robot_commands": 0.006585249900817871, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02856794754664103, "sim_compute_performance-ego": 0.006321242650349935, "sim_compute_robot_state-ego": 0.010542483329772949, "sim_compute_robot_state-parked0": 0.011319268544514972}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.046752184232076006, "step_physics": 0.08794785976409912, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02069123824437459, "sim_render-ego": 0.008341437975565592, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030136862595876057, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.263652396996816, "set_robot_commands": 0.00835723082224528, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02850597381591797, "sim_compute_performance-ego": 0.0072376815478007, "sim_compute_robot_state-ego": 0.012939944267272949, "sim_compute_robot_state-parked0": 0.012501748402913413}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04589431206385294, "step_physics": 0.08710750579833984, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020529891649882, "sim_render-ego": 0.007680991490681966, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03001386324564616, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2553950921694438, "set_robot_commands": 0.00676092783610026, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02824261744817098, "sim_compute_performance-ego": 0.00647960901260376, "sim_compute_robot_state-ego": 0.01096061865488688, "sim_compute_robot_state-parked0": 0.01148446242014567}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.0463769809405009, "step_physics": 0.08856994152069092, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020467246373494462, "sim_render-ego": 0.007640600204467773, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031116453011830646, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2573061752319336, "set_robot_commands": 0.00654834270477295, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.028184429009755457, "sim_compute_performance-ego": 0.006283919811248779, "sim_compute_robot_state-ego": 0.01048464298248291, "sim_compute_robot_state-parked0": 0.011393723487854003}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.0, "get_ui_image": 0.04701636791229248, "step_physics": 0.0904403567314148, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020518213113149008, "sim_render-ego": 0.008555232683817545, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031100287437438964, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.26682581265767413, "set_robot_commands": 0.008197364012400309, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.02836403449376424, "sim_compute_performance-ego": 0.0071897204717000325, "sim_compute_robot_state-ego": 0.012618692715962727, "sim_compute_robot_state-parked0": 0.01258541186650594}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04627315123875936, "step_physics": 0.10884007294972738, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02061065753300985, "sim_render-ego": 0.008203292687733968, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03027456521987915, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2834372321764628, "set_robot_commands": 0.008236647446950277, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02858706553777059, "sim_compute_performance-ego": 0.007110558350880941, "sim_compute_robot_state-ego": 0.012721495628356934, "sim_compute_robot_state-parked0": 0.012338871161142986}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04638788143793742, "step_physics": 0.11020154158274333, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02057136058807373, "sim_render-ego": 0.00804573694864909, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03058090448379517, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2820825282732646, "set_robot_commands": 0.007402026653289795, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028359148502349853, "sim_compute_performance-ego": 0.006713059743245443, "sim_compute_robot_state-ego": 0.011656619707743327, "sim_compute_robot_state-parked0": 0.011921990712483723}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.046641879081726074, "step_physics": 0.08773870944976807, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020655240217844647, "sim_render-ego": 0.008341727256774902, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03020612398783366, "deviation-heading": 2.800123339068113, "complete-iteration": 0.2638218665122986, "set_robot_commands": 0.008538366158803304, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028487340609232584, "sim_compute_performance-ego": 0.007264151573181153, "sim_compute_robot_state-ego": 0.013077540397644045, "sim_compute_robot_state-parked0": 0.012629860242207844}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.046665064493815106, "step_physics": 0.08804442167282105, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020596845944722497, "sim_render-ego": 0.008197963237762451, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03013059377670288, "deviation-heading": 2.800123339068113, "complete-iteration": 0.26224575281143186, "set_robot_commands": 0.008115766048431396, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028391444683074953, "sim_compute_performance-ego": 0.006988003253936768, "sim_compute_robot_state-ego": 0.012382019360860188, "sim_compute_robot_state-parked0": 0.012493954499562582}}
set_robot_commands_max	0.008538366158803304
set_robot_commands_mean	0.007537500143051147
set_robot_commands_median	0.007758896350860595
set_robot_commands_min	0.00654834270477295
sim_compute_performance-ego_max	0.007264151573181153
sim_compute_performance-ego_mean	0.0067986509799957285
sim_compute_performance-ego_median	0.006850531498591106
sim_compute_performance-ego_min	0.006283919811248779
sim_compute_robot_state-ego_max	0.013077540397644045
sim_compute_robot_state-ego_mean	0.01181711983680725
sim_compute_robot_state-ego_median	0.012019319534301758
sim_compute_robot_state-ego_min	0.01048464298248291
sim_compute_robot_state-parked0_max	0.012629860242207844
sim_compute_robot_state-parked0_mean	0.01197912867863973
sim_compute_robot_state-parked0_median	0.012130430936813354
sim_compute_robot_state-parked0_min	0.011121995449066162
sim_compute_sim_state_max	0.02858706553777059
sim_compute_sim_state_mean	0.02839965335528056
sim_compute_sim_state_median	0.028377739588419597
sim_compute_sim_state_min	0.028184429009755457
sim_render-ego_max	0.008555232683817545
sim_render-ego_mean	0.008025620937347412
sim_render-ego_median	0.00812185009320577
sim_render-ego_min	0.007615268230438232
simulation-passed	1
step_physics_max	0.11020154158274333
step_physics_mean	0.09257247567176818
step_physics_median	0.0884171736240387
step_physics_min	0.08710750579833984
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

33406

6830

Himanshu Arora 🇨🇦

exercise_ros_template

aido5-LF-sim-validation

LFv-sim

success

reg09

2020-10-18 01:04:59+00:00

2020-10-18 01:28:46+00:00

0:23:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.4054131312023622
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.030960164864857993
agent_compute-ego_mean	0.029936233599980676
agent_compute-ego_median	0.029888743956883748
agent_compute-ego_min	0.02937272866566976
complete-iteration_max	0.28047792514165243
complete-iteration_mean	0.26443346699078873
complete-iteration_median	0.2609435180823008
complete-iteration_min	0.2562419160207113
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.41778364329376794
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.8869656519179927
deviation-heading_median	1.6198720948235377
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	8.215966626878722e-14
driven_any_median	1.3278267374516872e-13
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	3.564357757568359e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	3.564357757568359e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.020629170735677084
get_state_dump_mean	0.02034736943244934
get_state_dump_median	0.020329423348108926
get_state_dump_min	0.020119781494140624
get_ui_image_max	0.04778616031010945
get_ui_image_mean	0.04622995432217916
get_ui_image_median	0.0460773754119873
get_ui_image_min	0.04500285704930623
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04500285704930623, "step_physics": 0.08625150760014852, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020262457529703775, "sim_render-ego": 0.007952523231506348, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029992724259694417, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2562419160207113, "set_robot_commands": 0.007684207757314046, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028104538122812908, "sim_compute_performance-ego": 0.006726137002309163, "sim_compute_robot_state-ego": 0.012047374248504638, "sim_compute_robot_state-parked0": 0.011984612941741943}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04566466808319092, "step_physics": 0.08728198369344076, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020119781494140624, "sim_render-ego": 0.007930764357248942, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02937272866566976, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.258261411190033, "set_robot_commands": 0.0079010009765625, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028403501510620117, "sim_compute_performance-ego": 0.006960074106852214, "sim_compute_robot_state-ego": 0.012336456775665285, "sim_compute_robot_state-parked0": 0.012060006459554035}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.046210511525472, "step_physics": 0.08741452217102051, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020629170735677084, "sim_render-ego": 0.008275358676910401, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029917611281077068, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2620794860521952, "set_robot_commands": 0.008338940938313803, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02854125181833903, "sim_compute_performance-ego": 0.007283623218536377, "sim_compute_robot_state-ego": 0.012868141333262126, "sim_compute_robot_state-parked0": 0.012360288302103678}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.046361701488494875, "step_physics": 0.08771208127339682, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02046363512674967, "sim_render-ego": 0.007961450417836507, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02986675500869751, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2598075501124064, "set_robot_commands": 0.007625681559244792, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028536978562672937, "sim_compute_performance-ego": 0.00683819055557251, "sim_compute_robot_state-ego": 0.012012600898742676, "sim_compute_robot_state-parked0": 0.012186920642852784}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04778616031010945, "step_physics": 0.09031258821487428, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.02050216277440389, "sim_render-ego": 0.008271487553914388, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030960164864857993, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2664505346616109, "set_robot_commands": 0.008102919260660807, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.02846772829691569, "sim_compute_performance-ego": 0.007026829719543457, "sim_compute_robot_state-ego": 0.012540611426035565, "sim_compute_robot_state-parked0": 0.012235345045725503}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.0, "get_ui_image": 0.047310028870900474, "step_physics": 0.09089493989944458, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020566537380218505, "sim_render-ego": 0.008312081495920817, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03076639652252197, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.26702799161275226, "set_robot_commands": 0.008194305102030437, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.028290377457936604, "sim_compute_performance-ego": 0.007195847829182943, "sim_compute_robot_state-ego": 0.012697687943776449, "sim_compute_robot_state-parked0": 0.012555632591247558}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.0459442392985026, "step_physics": 0.10887783447901409, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02021638552347819, "sim_render-ego": 0.007958900133768718, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029464279810587565, "deviation-heading": 0.486072248607516, "complete-iteration": 0.27902332464853924, "set_robot_commands": 0.007619223594665527, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028081014156341552, "sim_compute_performance-ego": 0.006654543876647949, "sim_compute_robot_state-ego": 0.011965697606404622, "sim_compute_robot_state-parked0": 0.01200510581334432}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04567392905553182, "step_physics": 0.10918402274449666, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02039638916651408, "sim_render-ego": 0.007993506590525308, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029431021213531493, "deviation-heading": 0.486072248607516, "complete-iteration": 0.28047792514165243, "set_robot_commands": 0.007869141896565755, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02843589782714844, "sim_compute_performance-ego": 0.006831188201904297, "sim_compute_robot_state-ego": 0.012242438793182374, "sim_compute_robot_state-parked0": 0.012183842658996582}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04574253559112549, "step_physics": 0.08704893191655477, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020158063570658365, "sim_render-ego": 0.007954537868499756, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029679921468098957, "deviation-heading": 2.800123339068113, "complete-iteration": 0.25788336992263794, "set_robot_commands": 0.007740966478983561, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028387386004130044, "sim_compute_performance-ego": 0.006680997212727865, "sim_compute_robot_state-ego": 0.012059810161590577, "sim_compute_robot_state-parked0": 0.012193357944488526}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.046602911949157715, "step_physics": 0.08891271909077962, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02015911102294922, "sim_render-ego": 0.007735713322957357, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029910732905069987, "deviation-heading": 2.800123339068113, "complete-iteration": 0.25708116054534913, "set_robot_commands": 0.006620883941650391, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028519591490427657, "sim_compute_performance-ego": 0.006258954207102457, "sim_compute_robot_state-ego": 0.010582930246988932, "sim_compute_robot_state-parked0": 0.011536977291107175}}
set_robot_commands_max	0.008338940938313803
set_robot_commands_mean	0.007769727150599162
set_robot_commands_median	0.007805054187774658
set_robot_commands_min	0.006620883941650391
sim_compute_performance-ego_max	0.007283623218536377
sim_compute_performance-ego_mean	0.006845638593037923
sim_compute_performance-ego_median	0.006834689378738403
sim_compute_performance-ego_min	0.006258954207102457
sim_compute_robot_state-ego_max	0.012868141333262126
sim_compute_robot_state-ego_mean	0.012135374943415324
sim_compute_robot_state-ego_median	0.012151124477386477
sim_compute_robot_state-ego_min	0.010582930246988932
sim_compute_robot_state-parked0_max	0.012555632591247558
sim_compute_robot_state-parked0_mean	0.01213020896911621
sim_compute_robot_state-parked0_median	0.012185381650924684
sim_compute_robot_state-parked0_min	0.011536977291107175
sim_compute_sim_state_max	0.02854125181833903
sim_compute_sim_state_mean	0.028376826524734493
sim_compute_sim_state_median	0.028419699668884277
sim_compute_sim_state_min	0.028081014156341552
sim_render-ego_max	0.008312081495920817
sim_render-ego_mean	0.008034632364908855
sim_render-ego_median	0.007960175275802613
sim_render-ego_min	0.007735713322957357
simulation-passed	1
step_physics_max	0.10918402274449666
step_physics_mean	0.09238911310831709
step_physics_median	0.08831240018208822
step_physics_min	0.08625150760014852
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

33380

6814

Anthony Courchesne 🇨🇦

exercise_ros_template

aido5-LF-sim-validation

LFv-sim

success

reg09

2020-10-16 17:31:23+00:00

2020-10-16 17:55:32+00:00

0:24:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.4054131312023622
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.03082276741663615
agent_compute-ego_mean	0.030238380670547488
agent_compute-ego_median	0.030104146003723145
agent_compute-ego_min	0.029680774211883545
complete-iteration_max	0.2868857932090759
complete-iteration_mean	0.2668067430655162
complete-iteration_median	0.26449349959691365
complete-iteration_min	0.25663397391637166
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.41778364329376794
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.8869656519179927
deviation-heading_median	1.6198720948235377
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	8.215966626878722e-14
driven_any_median	1.3278267374516872e-13
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	3.564357757568359e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	3.564357757568359e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.020843786398569743
get_state_dump_mean	0.020416496912638343
get_state_dump_median	0.020344998836517338
get_state_dump_min	0.02016747792561849
get_ui_image_max	0.04696932713190714
get_ui_image_mean	0.04667729671796163
get_ui_image_median	0.046718720197677616
get_ui_image_min	0.046242462793986
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04680345773696899, "step_physics": 0.0891959818204244, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020500330130259196, "sim_render-ego": 0.008487475713094076, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03010899543762207, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2652584719657898, "set_robot_commands": 0.008434489568074544, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028635130723317463, "sim_compute_performance-ego": 0.007215491930643718, "sim_compute_robot_state-ego": 0.012976927757263184, "sim_compute_robot_state-parked0": 0.012666650613149009}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04651719649632772, "step_physics": 0.08891819874445597, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020285214583079025, "sim_render-ego": 0.007618121306101481, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03004076878229777, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.25663397391637166, "set_robot_commands": 0.006548664569854736, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02839294115702311, "sim_compute_performance-ego": 0.006191901365915934, "sim_compute_robot_state-ego": 0.010573144753774006, "sim_compute_robot_state-parked0": 0.01131404161453247}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.0466618800163269, "step_physics": 0.08944312413533528, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02064704100290934, "sim_render-ego": 0.00818203051884969, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030087231794993084, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.262707945505778, "set_robot_commands": 0.007653074264526367, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028601132233937582, "sim_compute_performance-ego": 0.006955787340799968, "sim_compute_robot_state-ego": 0.012040597597757975, "sim_compute_robot_state-parked0": 0.012201550801595053}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04672887643178304, "step_physics": 0.08981622060139974, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02016747792561849, "sim_render-ego": 0.008194517294565837, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029680774211883545, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2641222008069356, "set_robot_commands": 0.008356958230336508, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02845086177190145, "sim_compute_performance-ego": 0.007172464529673258, "sim_compute_robot_state-ego": 0.012906493345896403, "sim_compute_robot_state-parked0": 0.012415331999460856}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.046882554690043134, "step_physics": 0.09066948652267456, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.02024304469426473, "sim_render-ego": 0.008318178653717041, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030814037322998047, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.26659170786539715, "set_robot_commands": 0.00845652182896932, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.02831192493438721, "sim_compute_performance-ego": 0.0071661861737569174, "sim_compute_robot_state-ego": 0.01307391881942749, "sim_compute_robot_state-parked0": 0.01242406447728475}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.0, "get_ui_image": 0.04673590660095215, "step_physics": 0.09042192538579304, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020404783089955646, "sim_render-ego": 0.008280537923177083, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03082276741663615, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2648647983868917, "set_robot_commands": 0.007861927350362142, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.028261574904123943, "sim_compute_performance-ego": 0.007081679503122966, "sim_compute_robot_state-ego": 0.01236996332804362, "sim_compute_robot_state-parked0": 0.01238768180211385}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04670856396357218, "step_physics": 0.11100828965504964, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020843786398569743, "sim_render-ego": 0.008362046082814534, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030485046704610188, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2868857932090759, "set_robot_commands": 0.00818990151087443, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028575984636942543, "sim_compute_performance-ego": 0.007130630811055501, "sim_compute_robot_state-ego": 0.012735939025878908, "sim_compute_robot_state-parked0": 0.012607337633768718}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.046242462793986, "step_physics": 0.11003957986831664, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.0202649188041687, "sim_render-ego": 0.007680720488230388, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03035568157831828, "deviation-heading": 0.486072248607516, "complete-iteration": 0.27739704529444376, "set_robot_commands": 0.0065316541989644365, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028146873315175375, "sim_compute_performance-ego": 0.006268918514251709, "sim_compute_robot_state-ego": 0.010337340037027994, "sim_compute_robot_state-parked0": 0.011290046374003092}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04652274131774902, "step_physics": 0.08870449463526407, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02059185266494751, "sim_render-ego": 0.008383614222208659, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03009929656982422, "deviation-heading": 2.800123339068113, "complete-iteration": 0.2634220838546753, "set_robot_commands": 0.008181718985239665, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0283577561378479, "sim_compute_performance-ego": 0.007081454594930013, "sim_compute_robot_state-ego": 0.012770749727884927, "sim_compute_robot_state-parked0": 0.01249243418375651}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04696932713190714, "step_physics": 0.0882883890469869, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020216519832611083, "sim_render-ego": 0.008069780667622884, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029889206886291503, "deviation-heading": 2.800123339068113, "complete-iteration": 0.26018340984980265, "set_robot_commands": 0.007541632652282715, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028258989651997884, "sim_compute_performance-ego": 0.0068503578503926596, "sim_compute_robot_state-ego": 0.011860113143920898, "sim_compute_robot_state-parked0": 0.012004416783650716}}
set_robot_commands_max	0.00845652182896932
set_robot_commands_mean	0.007775654315948488
set_robot_commands_median	0.008021823167800902
set_robot_commands_min	0.0065316541989644365
sim_compute_performance-ego_max	0.007215491930643718
sim_compute_performance-ego_mean	0.0069114872614542645
sim_compute_performance-ego_median	0.00708156704902649
sim_compute_performance-ego_min	0.006191901365915934
sim_compute_robot_state-ego_max	0.01307391881942749
sim_compute_robot_state-ego_mean	0.01216451875368754
sim_compute_robot_state-ego_median	0.012552951176961265
sim_compute_robot_state-ego_min	0.010337340037027994
sim_compute_robot_state-parked0_max	0.012666650613149009
sim_compute_robot_state-parked0_mean	0.012180355628331502
sim_compute_robot_state-parked0_median	0.012401506900787354
sim_compute_robot_state-parked0_min	0.011290046374003092
sim_compute_sim_state_max	0.028635130723317463
sim_compute_sim_state_mean	0.02839931694666544
sim_compute_sim_state_median	0.028375348647435503
sim_compute_sim_state_min	0.028146873315175375
sim_render-ego_max	0.008487475713094076
sim_render-ego_mean	0.008157702287038167
sim_render-ego_median	0.00823752760887146
sim_render-ego_min	0.007618121306101481
simulation-passed	1
step_physics_max	0.11100828965504964
step_physics_mean	0.09365056904157004
step_physics_median	0.08962967236836751
step_physics_min	0.0882883890469869
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

33365

6806

Anthony Courchesne 🇨🇦

baseline-duckietown

aido5-LF-sim-validation

LFv-sim

success

reg09

2020-10-14 21:09:45+00:00

2020-10-14 21:17:50+00:00

0:08:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3779614325037599
survival_time_median	3.324999999999996
deviation-center-line_median	0.2512291229945154
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.031213099306279964
agent_compute-ego_mean	0.02944712659750915
agent_compute-ego_median	0.029431217081406537
agent_compute-ego_min	0.027959394454956057
complete-iteration_max	0.27923761505678474
complete-iteration_mean	0.2674284682036558
complete-iteration_median	0.26540828863779703
complete-iteration_min	0.2571721076965332
deviation-center-line_max	0.4359954898526317
deviation-center-line_mean	0.29610686139604797
deviation-center-line_min	0.1976220429196164
deviation-heading_max	2.286581164642681
deviation-heading_mean	1.07288114246569
deviation-heading_median	0.8187349528959728
deviation-heading_min	0.6619984625395918
driven_any_max	0.7848624465560211
driven_any_mean	0.4529593274252224
driven_any_median	0.39333939708839494
driven_any_min	0.28695965996455974
driven_lanedir_consec_max	0.6802395853288715
driven_lanedir_consec_mean	0.4200814296448714
driven_lanedir_consec_min	0.27347748091279467
driven_lanedir_max	0.6802395853288715
driven_lanedir_mean	0.4200814296448714
driven_lanedir_median	0.3779614325037599
driven_lanedir_min	0.27347748091279467
get_state_dump_max	0.02113418436762112
get_state_dump_mean	0.02042892711459083
get_state_dump_median	0.020516629219055175
get_state_dump_min	0.019515185356140136
get_ui_image_max	0.048325996398925784
get_ui_image_mean	0.04686956876644606
get_ui_image_median	0.04680625259693199
get_ui_image_min	0.045955693543846925
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.3934999890991786, "get_ui_image": 0.045955693543846925, "step_physics": 0.08882343591149174, "survival_time": 3.349999999999996, "driven_lanedir": 0.3781075339199065, "get_state_dump": 0.02113418436762112, "sim_render-ego": 0.007612783517410506, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031204707586943214, "deviation-heading": 0.8218240116725859, "complete-iteration": 0.2586602737654501, "set_robot_commands": 0.006699444642707483, "deviation-center-line": 0.25178734328466934, "driven_lanedir_consec": 0.3781075339199065, "sim_compute_sim_state": 0.028873294147092905, "sim_compute_performance-ego": 0.006306399160356664, "sim_compute_robot_state-ego": 0.010798447167695456, "sim_compute_robot_state-parked0": 0.01100410276384496}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.3931788050776113, "get_ui_image": 0.046759110508543075, "step_physics": 0.08853916688398882, "survival_time": 3.2999999999999963, "driven_lanedir": 0.37781533108761334, "get_state_dump": 0.02097019643494577, "sim_render-ego": 0.007804913954301314, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031213099306279964, "deviation-heading": 0.8156458941193596, "complete-iteration": 0.26171096165974933, "set_robot_commands": 0.006984699856151234, "deviation-center-line": 0.25067090270436143, "driven_lanedir_consec": 0.37781533108761334, "sim_compute_sim_state": 0.030984889377247204, "sim_compute_performance-ego": 0.006100210276517001, "sim_compute_robot_state-ego": 0.011244437911293724, "sim_compute_robot_state-parked0": 0.01085664647998232}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.046862644307753616, "step_physics": 0.08861571199753705, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.021065207088694853, "sim_render-ego": 0.007678340463077321, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02983695852990244, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.2582833392947328, "set_robot_commands": 0.006876795899634268, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.0286561975292131, "sim_compute_performance-ego": 0.006521734536862841, "sim_compute_robot_state-ego": 0.01078658010445389, "sim_compute_robot_state-parked0": 0.011115723965214748}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.04680836434457816, "step_physics": 0.08870294982311773, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.020644459069943895, "sim_render-ego": 0.007350491542442173, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029661332859712487, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.2571721076965332, "set_robot_commands": 0.006695036794625076, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.02925719934351304, "sim_compute_performance-ego": 0.006006731706507066, "sim_compute_robot_state-ego": 0.01051940637476304, "sim_compute_robot_state-parked0": 0.011271902159148571}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.046988962173461914, "step_physics": 0.09420070457458496, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.0205338134765625, "sim_render-ego": 0.008572635650634765, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029948047637939453, "deviation-heading": 2.286581164642681, "complete-iteration": 0.2752455520629883, "set_robot_commands": 0.007823204040527344, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.03478055572509765, "sim_compute_performance-ego": 0.007205772399902344, "sim_compute_robot_state-ego": 0.012705114364624024, "sim_compute_robot_state-parked0": 0.012230239868164062}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.048325996398925784, "step_physics": 0.09710294723510744, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.02049944496154785, "sim_render-ego": 0.00852467155456543, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029201101303100583, "deviation-heading": 2.286581164642681, "complete-iteration": 0.2787663631439209, "set_robot_commands": 0.007958768844604492, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.034391984939575196, "sim_compute_performance-ego": 0.007520633697509766, "sim_compute_robot_state-ego": 0.01284501838684082, "sim_compute_robot_state-parked0": 0.012144155502319336}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.046687042856790935, "step_physics": 0.10841410993093469, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.02007624901920916, "sim_render-ego": 0.007911624678646225, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028815114354512776, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.27923761505678474, "set_robot_commands": 0.007342103015945618, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.029505249965621764, "sim_compute_performance-ego": 0.006912001644272402, "sim_compute_robot_state-ego": 0.0119788531797478, "sim_compute_robot_state-parked0": 0.011346883084400593}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.046804140849285816, "step_physics": 0.10741563877427436, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.020154662879116565, "sim_render-ego": 0.008064746856689453, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028627912682223033, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.2775609407080225, "set_robot_commands": 0.006905975111995835, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.030167981802699077, "sim_compute_performance-ego": 0.00666177703673581, "sim_compute_robot_state-ego": 0.011365623359220572, "sim_compute_robot_state-parked0": 0.011150541075740952}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.04743097305297852, "step_physics": 0.09683064460754394, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.019695868492126463, "sim_render-ego": 0.00809593677520752, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02800359725952149, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.26910561561584473, "set_robot_commands": 0.007688064575195313, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.02885045051574707, "sim_compute_performance-ego": 0.007232880592346192, "sim_compute_robot_state-ego": 0.012614011764526367, "sim_compute_robot_state-parked0": 0.01241812229156494}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.0460727596282959, "step_physics": 0.0936055374145508, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.019515185356140136, "sim_render-ego": 0.00749199390411377, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027959394454956057, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.2585419130325317, "set_robot_commands": 0.00668342113494873, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.0291815185546875, "sim_compute_performance-ego": 0.0061470699310302735, "sim_compute_robot_state-ego": 0.010685081481933596, "sim_compute_robot_state-parked0": 0.010967273712158204}}
set_robot_commands_max	0.007958768844604492
set_robot_commands_mean	0.007165751391633539
set_robot_commands_median	0.006945337484073534
set_robot_commands_min	0.00668342113494873
sim_compute_performance-ego_max	0.007520633697509766
sim_compute_performance-ego_mean	0.006661521098204036
sim_compute_performance-ego_median	0.006591755786799326
sim_compute_performance-ego_min	0.006006731706507066
sim_compute_robot_state-ego_max	0.01284501838684082
sim_compute_robot_state-ego_mean	0.011554257409509928
sim_compute_robot_state-ego_median	0.01130503063525715
sim_compute_robot_state-ego_min	0.01051940637476304
sim_compute_robot_state-parked0_max	0.01241812229156494
sim_compute_robot_state-parked0_mean	0.01145055909025387
sim_compute_robot_state-parked0_median	0.011211221617444762
sim_compute_robot_state-parked0_min	0.01085664647998232
sim_compute_sim_state_max	0.03478055572509765
sim_compute_sim_state_mean	0.03046493219004945
sim_compute_sim_state_median	0.0293812246545674
sim_compute_sim_state_min	0.0286561975292131
sim_render-ego_max	0.008572635650634765
sim_render-ego_mean	0.007910813889708847
sim_render-ego_median	0.00785826931647377
sim_render-ego_min	0.007350491542442173
simulation-passed	1
step_physics_max	0.10841410993093469
step_physics_mean	0.09522508471531316
step_physics_median	0.09390312099456788
step_physics_min	0.08853916688398882
survival_time_max	6.249999999999986
survival_time_mean	3.7549999999999946
survival_time_min	2.499999999999999

No reset possible

33360

6803

Anthony Courchesne 🇨🇦

baseline-duckietown

aido5-LF-sim-validation

LFv-sim

failed

reg09

2020-10-14 18:28:51+00:00

2020-10-14 18:32:04+00:00

0:03:13

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 43, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33359

6802

Anthony Courchesne 🇨🇦

baseline-duckietown

aido5-LF-sim-validation

LFv-sim

failed

reg09

2020-10-14 18:21:24+00:00

2020-10-14 18:22:29+00:00

0:01:05

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 66, in on_received_get_commands
             ||     context.write('commands', commands)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 99, in write
             ||     self._write(topic, data, timing, with_schema)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 112, in _write
             ||     check_isinstance(data, klass)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 13, in check_isinstance
             ||     raise_type_mismatch(ob, expected, **kwargs)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 25, in raise_type_mismatch
             ||     raise ZValueError(msg, expected=expected, obtained=type(ob), **kwargs)
             || zuper_commons.types.exceptions.ZValueError: Object not of expected type:
             || │ expected: dataclass aido_schemas.schemas.Duckiebot1Commands
             || │            field  wheels : dataclass aido_schemas.schemas.PWMCommands
             || │                             field  motor_left : float
             || │                             field motor_right : float
             || │                                       __doc__
             || │                                                         PWM commands are floats between -1 and 1.
             || │            field    LEDS : dataclass aido_schemas.schemas.LEDSCommands
             || │                             field      center : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field  front_left : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field front_right : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field   back_left : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                             field  back_right : dataclass aido_schemas.schemas.RGB
             || │                                                  field       r : float
             || │                                                  field       g : float
             || │                                                  field       b : float
             || │                                                        __doc__   RGB(r: float, g: float, b: float)
             || │                                       __doc__   LEDSCommands(center: aido_schemas.schemas.RGB, fro
             || │                  __doc__   Duckiebot1Commands(wheels: aido_schemas.schemas.PW
             || │ obtained: dict
             || │   object: dict[2]
             || │           │ wheels: {motor_left: 0.0, motor_right: 0.0}
             || │           │ LEDS:
             || │           │ dict[5]
             || │           │ │ center: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ front_left: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ front_right: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ back_left: {r: 0.5, g: 0.5, b: 0.5}
             || │           │ │ back_right: {r: 0.5, g: 0.5, b: 0.5}
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 43, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33334

6788

Andrej Studer 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

reg09

2020-10-11 14:56:32+00:00

2020-10-11 14:56:59+00:00

0:00:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1188181064064066
error_L2	0.020296000957420533

No reset possible

ID	1854
evaluator	`reg09`
owner	I don't have one 😀
machine	archimede
process	reg09
version	d-c:6.0.31;d-c-r:6.0.15
first heard	2020-10-08 10:05:55+00:00
last heard	2020-10-18 19:06:19+00:00
status	inactive
# evaluating
# success	5 `33334`
# timeout
# failed	2 `33359`
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator 1854

Evaluator jobs