Duckietown Challenges Home Challenges Submissions

Evaluator 1615

ID1615
evaluatorip-172-31-35-218-10490
ownerI don't have one 😀
machineip-172-31-35-218
processip-172-31-35-218-10490
versiond-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success190 25229
# timeout
# failed12 25279
# error40 25273
# aborted9 26117
# host-error13 25200
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
308026325Lisa Rangosch 🇩🇪challenge-aido_LF-template-randomaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01550690694288774
agent_compute-ego_mean0.014581731401031722
agent_compute-ego_median0.014496362209320069
agent_compute-ego_min0.013958405045902029
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.06285369396209717, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.007929393878349891, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.01468815253331111, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.0058409342399010295, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0030588736900916467, "sim_compute_performance-ego": 0.004754845912639911, "sim_compute_robot_state-ego": 0.005546455199901874}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06070605516433716, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.007522797584533692, "in-drivable-lane": 0, "agent_compute-ego": 0.014496362209320069, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.005421006679534912, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.0029807686805725098, "sim_compute_performance-ego": 0.004198503494262695, "sim_compute_robot_state-ego": 0.0053000330924987795}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.06016807696398567, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.007475677658529843, "in-drivable-lane": 0, "agent_compute-ego": 0.013958405045902029, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.005349096129922306, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.003040762508616728, "sim_compute_performance-ego": 0.0042652803308823525, "sim_compute_robot_state-ego": 0.005302317002240349}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.05920755276914503, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.007482798373112913, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.014258830273737672, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.005290684152822025, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.003019794088895204, "sim_compute_performance-ego": 0.004179966254312484, "sim_compute_robot_state-ego": 0.005085823965854332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06193040717731823, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.007892456921664152, "in-drivable-lane": 0, "agent_compute-ego": 0.01550690694288774, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.005393169142983176, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.0030563744631680574, "sim_compute_performance-ego": 0.004241748289628463, "sim_compute_robot_state-ego": 0.005232399160211737}}
set_robot_commands_max0.0058409342399010295
set_robot_commands_mean0.005458978069032691
set_robot_commands_median0.005393169142983176
set_robot_commands_min0.005290684152822025
sim_compute_performance-ego_max0.004754845912639911
sim_compute_performance-ego_mean0.004328068856345181
sim_compute_performance-ego_median0.004241748289628463
sim_compute_performance-ego_min0.004179966254312484
sim_compute_robot_state-ego_max0.005546455199901874
sim_compute_robot_state-ego_mean0.005293405684141414
sim_compute_robot_state-ego_median0.0053000330924987795
sim_compute_robot_state-ego_min0.005085823965854332
sim_compute_sim_state_max0.0030588736900916467
sim_compute_sim_state_mean0.003031314686268829
sim_compute_sim_state_median0.003040762508616728
sim_compute_sim_state_min0.0029807686805725098
sim_physics_max0.06285369396209717
sim_physics_mean0.06097315720737665
sim_physics_median0.06070605516433716
sim_physics_min0.05920755276914503
sim_render-ego_max0.007929393878349891
sim_render-ego_mean0.007660624883238099
sim_render-ego_median0.007522797584533692
sim_render-ego_min0.007475677658529843
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
307886318Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5913960118953465
survival_time_median14.950000000000076
deviation-center-line_median0.6999426414103567
in-drivable-lane_median0


other stats
agent_compute-ego_max0.025900285243988037
agent_compute-ego_mean0.0245023299853007
agent_compute-ego_median0.0247263240814209
agent_compute-ego_min0.023142242431640623
deviation-center-line_max0.799865428358987
deviation-center-line_mean0.6541179972525493
deviation-center-line_min0.49926733714084853
deviation-heading_max2.550236718494403
deviation-heading_mean2.025908085910664
deviation-heading_median2.1321883058239424
deviation-heading_min1.3429865224879494
driven_any_max2.9620595489589676
driven_any_mean2.63013603351914
driven_any_median2.642726914194097
driven_any_min2.207933111306789
driven_lanedir_consec_max2.9419579127088142
driven_lanedir_consec_mean2.593737167821998
driven_lanedir_consec_min2.165333067661096
driven_lanedir_max2.9419579127088142
driven_lanedir_mean2.593737167821998
driven_lanedir_median2.5913960118953465
driven_lanedir_min2.165333067661096
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.207933111306789, "sim_physics": 0.08190836270650227, "survival_time": 14.950000000000076, "driven_lanedir": 2.165333067661096, "sim_render-ego": 0.008497479756673178, "in-drivable-lane": 0, "agent_compute-ego": 0.025900285243988037, "deviation-heading": 2.550236718494403, "set_robot_commands": 0.009532305399576824, "deviation-center-line": 0.799865428358987, "driven_lanedir_consec": 2.165333067661096, "sim_compute_sim_state": 0.0047054123878479005, "sim_compute_performance-ego": 0.005183768272399902, "sim_compute_robot_state-ego": 0.006558728218078613}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.642726914194097, "sim_physics": 0.07921923796335856, "survival_time": 14.950000000000076, "driven_lanedir": 2.5913960118953465, "sim_render-ego": 0.008943548997243245, "in-drivable-lane": 0, "agent_compute-ego": 0.0247263240814209, "deviation-heading": 2.196694943033802, "set_robot_commands": 0.00900907834370931, "deviation-center-line": 0.7337193871996148, "driven_lanedir_consec": 2.5913960118953465, "sim_compute_sim_state": 0.004728759129842122, "sim_compute_performance-ego": 0.005268375078837077, "sim_compute_robot_state-ego": 0.00667824665705363}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.457576283905202, "sim_physics": 0.07945696830749512, "survival_time": 14.950000000000076, "driven_lanedir": 2.423627278932452, "sim_render-ego": 0.00861054499944051, "in-drivable-lane": 0, "agent_compute-ego": 0.023161271413167317, "deviation-heading": 2.1321883058239424, "set_robot_commands": 0.009231231212615966, "deviation-center-line": 0.6999426414103567, "driven_lanedir_consec": 2.423627278932452, "sim_compute_sim_state": 0.004669613043467204, "sim_compute_performance-ego": 0.005053331851959228, "sim_compute_robot_state-ego": 0.0065161840120951334}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.9620595489589676, "sim_physics": 0.07875245173772176, "survival_time": 14.950000000000076, "driven_lanedir": 2.9419579127088142, "sim_render-ego": 0.008811704317728679, "in-drivable-lane": 0, "agent_compute-ego": 0.023142242431640623, "deviation-heading": 1.3429865224879494, "set_robot_commands": 0.00940843423207601, "deviation-center-line": 0.49926733714084853, "driven_lanedir_consec": 2.9419579127088142, "sim_compute_sim_state": 0.004829634030659994, "sim_compute_performance-ego": 0.0053259491920471195, "sim_compute_robot_state-ego": 0.006789060433705648}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.880384309230646, "sim_physics": 0.0798975936571757, "survival_time": 14.950000000000076, "driven_lanedir": 2.846371567912281, "sim_render-ego": 0.009080392519632975, "in-drivable-lane": 0, "agent_compute-ego": 0.02558152675628662, "deviation-heading": 1.9074339397132256, "set_robot_commands": 0.009303952058156331, "deviation-center-line": 0.5377951921529395, "driven_lanedir_consec": 2.846371567912281, "sim_compute_sim_state": 0.004805916945139567, "sim_compute_performance-ego": 0.005353310108184814, "sim_compute_robot_state-ego": 0.0068407893180847164}}
set_robot_commands_max0.009532305399576824
set_robot_commands_mean0.009297000249226889
set_robot_commands_median0.009303952058156331
set_robot_commands_min0.00900907834370931
sim_compute_performance-ego_max0.005353310108184814
sim_compute_performance-ego_mean0.005236946900685628
sim_compute_performance-ego_median0.005268375078837077
sim_compute_performance-ego_min0.005053331851959228
sim_compute_robot_state-ego_max0.0068407893180847164
sim_compute_robot_state-ego_mean0.006676601727803548
sim_compute_robot_state-ego_median0.00667824665705363
sim_compute_robot_state-ego_min0.0065161840120951334
sim_compute_sim_state_max0.004829634030659994
sim_compute_sim_state_mean0.004747867107391357
sim_compute_sim_state_median0.004728759129842122
sim_compute_sim_state_min0.004669613043467204
sim_physics_max0.08190836270650227
sim_physics_mean0.07984692287445068
sim_physics_median0.07945696830749512
sim_physics_min0.07875245173772176
sim_render-ego_max0.009080392519632975
sim_render-ego_mean0.008788734118143718
sim_render-ego_median0.008811704317728679
sim_render-ego_min0.008497479756673178
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
307836316Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.56483793258395
survival_time_median14.950000000000076
deviation-center-line_median0.6996733223581909
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0251240340868632
agent_compute-ego_mean0.023682799498240155
agent_compute-ego_median0.024074577490488688
agent_compute-ego_min0.021868378321329752
deviation-center-line_max0.7300665408718845
deviation-center-line_mean0.6457183225565121
deviation-center-line_min0.5306249657325595
deviation-heading_max2.2759201859246807
deviation-heading_mean2.0339165477124217
deviation-heading_median2.233423496076211
deviation-heading_min1.5276998075921675
driven_any_max2.888832231744431
driven_any_mean2.5921943913138192
driven_any_median2.6097935581833034
driven_any_min2.258752390066245
driven_lanedir_consec_max2.8555972733547437
driven_lanedir_consec_mean2.555787513209849
driven_lanedir_consec_min2.2224124120130195
driven_lanedir_max2.8555972733547437
driven_lanedir_mean2.555787513209849
driven_lanedir_median2.56483793258395
driven_lanedir_min2.2224124120130195
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.258752390066245, "sim_physics": 0.08015739520390829, "survival_time": 14.950000000000076, "driven_lanedir": 2.2224124120130195, "sim_render-ego": 0.00837749163309733, "in-drivable-lane": 0, "agent_compute-ego": 0.0251240340868632, "deviation-heading": 2.2759201859246807, "set_robot_commands": 0.009289480845133464, "deviation-center-line": 0.6996733223581909, "driven_lanedir_consec": 2.2224124120130195, "sim_compute_sim_state": 0.004634713331858317, "sim_compute_performance-ego": 0.0052641852696736656, "sim_compute_robot_state-ego": 0.0065703399976094565}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.6097935581833034, "sim_physics": 0.08058584372202555, "survival_time": 14.950000000000076, "driven_lanedir": 2.56483793258395, "sim_render-ego": 0.008974011739095051, "in-drivable-lane": 0, "agent_compute-ego": 0.02472212235132853, "deviation-heading": 2.249100680065387, "set_robot_commands": 0.0095764430363973, "deviation-center-line": 0.7300665408718845, "driven_lanedir_consec": 2.56483793258395, "sim_compute_sim_state": 0.004763446648915609, "sim_compute_performance-ego": 0.005388330618540446, "sim_compute_robot_state-ego": 0.006891712347666423}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.418445921935684, "sim_physics": 0.07797122796376546, "survival_time": 14.950000000000076, "driven_lanedir": 2.377322847677614, "sim_render-ego": 0.008492441177368163, "in-drivable-lane": 0, "agent_compute-ego": 0.021868378321329752, "deviation-heading": 2.233423496076211, "set_robot_commands": 0.0094403608640035, "deviation-center-line": 0.7016521471403708, "driven_lanedir_consec": 2.377322847677614, "sim_compute_sim_state": 0.004711151917775472, "sim_compute_performance-ego": 0.0050238426526387535, "sim_compute_robot_state-ego": 0.006343214511871338}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7851478546394324, "sim_physics": 0.08014286677042644, "survival_time": 14.950000000000076, "driven_lanedir": 2.7587671004199192, "sim_render-ego": 0.008569849332173666, "in-drivable-lane": 0, "agent_compute-ego": 0.022624885241190593, "deviation-heading": 1.5276998075921675, "set_robot_commands": 0.009539436499277751, "deviation-center-line": 0.5665746366795545, "driven_lanedir_consec": 2.7587671004199192, "sim_compute_sim_state": 0.004732301235198974, "sim_compute_performance-ego": 0.0051669700940450035, "sim_compute_robot_state-ego": 0.006674269040425619}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.888832231744431, "sim_physics": 0.07941256205240886, "survival_time": 14.950000000000076, "driven_lanedir": 2.8555972733547437, "sim_render-ego": 0.008895223140716552, "in-drivable-lane": 0, "agent_compute-ego": 0.024074577490488688, "deviation-heading": 1.8834385689036623, "set_robot_commands": 0.009250334898630778, "deviation-center-line": 0.5306249657325595, "driven_lanedir_consec": 2.8555972733547437, "sim_compute_sim_state": 0.004644576708475749, "sim_compute_performance-ego": 0.005406009356180827, "sim_compute_robot_state-ego": 0.0069104234377543134}}
set_robot_commands_max0.0095764430363973
set_robot_commands_mean0.00941921122868856
set_robot_commands_median0.0094403608640035
set_robot_commands_min0.009250334898630778
sim_compute_performance-ego_max0.005406009356180827
sim_compute_performance-ego_mean0.005249867598215739
sim_compute_performance-ego_median0.0052641852696736656
sim_compute_performance-ego_min0.0050238426526387535
sim_compute_robot_state-ego_max0.0069104234377543134
sim_compute_robot_state-ego_mean0.006677991867065429
sim_compute_robot_state-ego_median0.006674269040425619
sim_compute_robot_state-ego_min0.006343214511871338
sim_compute_sim_state_max0.004763446648915609
sim_compute_sim_state_mean0.004697237968444824
sim_compute_sim_state_median0.004711151917775472
sim_compute_sim_state_min0.004634713331858317
sim_physics_max0.08058584372202555
sim_physics_mean0.07965397914250692
sim_physics_median0.08014286677042644
sim_physics_min0.07797122796376546
sim_render-ego_max0.008974011739095051
sim_render-ego_mean0.008661803404490152
sim_render-ego_median0.008569849332173666
sim_render-ego_min0.00837749163309733
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
307826315Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.634898797731723
survival_time_median14.950000000000076
deviation-center-line_median0.5687490306440508
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02640700340270996
agent_compute-ego_mean0.023950623353322348
agent_compute-ego_median0.02427992502848307
agent_compute-ego_min0.02170190413792928
deviation-center-line_max0.8031387256160465
deviation-center-line_mean0.6214281191722646
deviation-center-line_min0.4835280159378837
deviation-heading_max2.6428455046313983
deviation-heading_mean1.993508684343788
deviation-heading_median1.925195132740729
deviation-heading_min1.3965720774519994
driven_any_max2.8943134655858316
driven_any_mean2.6307490559909374
driven_any_median2.672287077524558
driven_any_min2.196116524953908
driven_lanedir_consec_max2.867429947451127
driven_lanedir_consec_mean2.59626297758018
driven_lanedir_consec_min2.151650999506754
driven_lanedir_max2.867429947451127
driven_lanedir_mean2.59626297758018
driven_lanedir_median2.634898797731723
driven_lanedir_min2.151650999506754
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.196116524953908, "sim_physics": 0.08207715272903443, "survival_time": 14.950000000000076, "driven_lanedir": 2.151650999506754, "sim_render-ego": 0.008619540532430013, "in-drivable-lane": 0, "agent_compute-ego": 0.02640700340270996, "deviation-heading": 2.6428455046313983, "set_robot_commands": 0.009250319004058838, "deviation-center-line": 0.8031387256160465, "driven_lanedir_consec": 2.151650999506754, "sim_compute_sim_state": 0.004700422286987305, "sim_compute_performance-ego": 0.0052033527692159015, "sim_compute_robot_state-ego": 0.0064928778012593585}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.672287077524558, "sim_physics": 0.07941913366317749, "survival_time": 14.950000000000076, "driven_lanedir": 2.634898797731723, "sim_render-ego": 0.008726014296213785, "in-drivable-lane": 0, "agent_compute-ego": 0.02427992502848307, "deviation-heading": 1.919999560877432, "set_robot_commands": 0.009379010200500488, "deviation-center-line": 0.7421098527529215, "driven_lanedir_consec": 2.634898797731723, "sim_compute_sim_state": 0.004788999557495117, "sim_compute_performance-ego": 0.0050838502248128255, "sim_compute_robot_state-ego": 0.006395994822184245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.502012300570817, "sim_physics": 0.08058636744817098, "survival_time": 14.950000000000076, "driven_lanedir": 2.468058272052651, "sim_render-ego": 0.008387620449066163, "in-drivable-lane": 0, "agent_compute-ego": 0.02170190413792928, "deviation-heading": 2.08293114601738, "set_robot_commands": 0.009321971734364828, "deviation-center-line": 0.4835280159378837, "driven_lanedir_consec": 2.468058272052651, "sim_compute_sim_state": 0.004716051419576009, "sim_compute_performance-ego": 0.004981513023376465, "sim_compute_robot_state-ego": 0.0064164304733276365}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.8890159113195732, "sim_physics": 0.07936270078023275, "survival_time": 14.950000000000076, "driven_lanedir": 2.867429947451127, "sim_render-ego": 0.008622492949167887, "in-drivable-lane": 0, "agent_compute-ego": 0.023065608342488608, "deviation-heading": 1.3965720774519994, "set_robot_commands": 0.009372830390930176, "deviation-center-line": 0.5096149709104201, "driven_lanedir_consec": 2.867429947451127, "sim_compute_sim_state": 0.0048098007837931315, "sim_compute_performance-ego": 0.005166218280792236, "sim_compute_robot_state-ego": 0.006600171724955241}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8943134655858316, "sim_physics": 0.0811255685488383, "survival_time": 14.950000000000076, "driven_lanedir": 2.8592768711586434, "sim_render-ego": 0.008751951853434244, "in-drivable-lane": 0, "agent_compute-ego": 0.024298675855000815, "deviation-heading": 1.925195132740729, "set_robot_commands": 0.009594425360361735, "deviation-center-line": 0.5687490306440508, "driven_lanedir_consec": 2.8592768711586434, "sim_compute_sim_state": 0.004809234142303467, "sim_compute_performance-ego": 0.005281375249226888, "sim_compute_robot_state-ego": 0.006647371451059978}}
set_robot_commands_max0.009594425360361735
set_robot_commands_mean0.009383711338043214
set_robot_commands_median0.009372830390930176
set_robot_commands_min0.009250319004058838
sim_compute_performance-ego_max0.005281375249226888
sim_compute_performance-ego_mean0.005143261909484863
sim_compute_performance-ego_median0.005166218280792236
sim_compute_performance-ego_min0.004981513023376465
sim_compute_robot_state-ego_max0.006647371451059978
sim_compute_robot_state-ego_mean0.006510569254557291
sim_compute_robot_state-ego_median0.0064928778012593585
sim_compute_robot_state-ego_min0.006395994822184245
sim_compute_sim_state_max0.0048098007837931315
sim_compute_sim_state_mean0.004764901638031006
sim_compute_sim_state_median0.004788999557495117
sim_compute_sim_state_min0.004700422286987305
sim_physics_max0.08207715272903443
sim_physics_mean0.08051418463389079
sim_physics_median0.08058636744817098
sim_physics_min0.07936270078023275
sim_render-ego_max0.008751951853434244
sim_render-ego_mean0.008621524016062417
sim_render-ego_median0.008622492949167887
sim_render-ego_min0.008387620449066163
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
307726310Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:10:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9338242050991306
survival_time_median14.950000000000076
deviation-center-line_median0.6932262407455257
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0557327938079834
agent_compute-ego_mean0.03613763888676961
agent_compute-ego_median0.024389275709788005
agent_compute-ego_min0.022928342819213868
deviation-center-line_max1.0318167768627466
deviation-center-line_mean0.7575038427455739
deviation-center-line_min0.6121481552091795
deviation-heading_max3.2864666892847643
deviation-heading_mean2.1749119613180077
deviation-heading_median2.042184818526622
deviation-heading_min1.4766047255374988
driven_any_max3.3177250001587297
driven_any_mean2.940053570351796
driven_any_median2.9711676765947455
driven_any_min2.5730788631352004
driven_lanedir_consec_max3.2971118818410003
driven_lanedir_consec_mean2.8939040920778076
driven_lanedir_consec_min2.537096510674143
driven_lanedir_max3.2971118818410003
driven_lanedir_mean2.8939040920778076
driven_lanedir_median2.9338242050991306
driven_lanedir_min2.537096510674143
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5730788631352004, "sim_physics": 0.11750770568847656, "survival_time": 14.950000000000076, "driven_lanedir": 2.537096510674143, "sim_render-ego": 0.012475063800811767, "in-drivable-lane": 0, "agent_compute-ego": 0.0557327938079834, "deviation-heading": 2.042184818526622, "set_robot_commands": 0.011552699406941732, "deviation-center-line": 0.8167769192702274, "driven_lanedir_consec": 2.537096510674143, "sim_compute_sim_state": 0.005442287921905518, "sim_compute_performance-ego": 0.007673936684926351, "sim_compute_robot_state-ego": 0.009770994186401366}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.9711676765947455, "sim_physics": 0.12192811648050944, "survival_time": 14.950000000000076, "driven_lanedir": 2.9338242050991306, "sim_render-ego": 0.013161545594533284, "in-drivable-lane": 0, "agent_compute-ego": 0.05459149916966756, "deviation-heading": 2.2249995193209133, "set_robot_commands": 0.011622401078542071, "deviation-center-line": 0.6335511216401901, "driven_lanedir_consec": 2.9338242050991306, "sim_compute_sim_state": 0.005479965209960937, "sim_compute_performance-ego": 0.00799816608428955, "sim_compute_robot_state-ego": 0.009787079493204752}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.701238073445019, "sim_physics": 0.08497883478800455, "survival_time": 14.950000000000076, "driven_lanedir": 2.593321663252128, "sim_render-ego": 0.009052095413208007, "in-drivable-lane": 0, "agent_compute-ego": 0.022928342819213868, "deviation-heading": 3.2864666892847643, "set_robot_commands": 0.00971004088719686, "deviation-center-line": 1.0318167768627466, "driven_lanedir_consec": 2.593321663252128, "sim_compute_sim_state": 0.004989153544108073, "sim_compute_performance-ego": 0.005650332768758138, "sim_compute_robot_state-ego": 0.007101200421651205}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.3177250001587297, "sim_physics": 0.08243422269821167, "survival_time": 14.950000000000076, "driven_lanedir": 3.2971118818410003, "sim_render-ego": 0.00855918566385905, "in-drivable-lane": 0, "agent_compute-ego": 0.02304628292719523, "deviation-heading": 1.4766047255374988, "set_robot_commands": 0.009124931494394938, "deviation-center-line": 0.6121481552091795, "driven_lanedir_consec": 3.2971118818410003, "sim_compute_sim_state": 0.004719883600870768, "sim_compute_performance-ego": 0.005212644735972087, "sim_compute_robot_state-ego": 0.006656249364217122}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.137058238425285, "sim_physics": 0.07914539019266764, "survival_time": 14.950000000000076, "driven_lanedir": 3.108166199522636, "sim_render-ego": 0.008799317677815756, "in-drivable-lane": 0, "agent_compute-ego": 0.024389275709788005, "deviation-heading": 1.8443040539202396, "set_robot_commands": 0.00926347017288208, "deviation-center-line": 0.6932262407455257, "driven_lanedir_consec": 3.108166199522636, "sim_compute_sim_state": 0.0048408071200052895, "sim_compute_performance-ego": 0.005271419684092204, "sim_compute_robot_state-ego": 0.0067303625742594405}}
set_robot_commands_max0.011622401078542071
set_robot_commands_mean0.010254708607991537
set_robot_commands_median0.00971004088719686
set_robot_commands_min0.009124931494394938
sim_compute_performance-ego_max0.00799816608428955
sim_compute_performance-ego_mean0.006361299991607667
sim_compute_performance-ego_median0.005650332768758138
sim_compute_performance-ego_min0.005212644735972087
sim_compute_robot_state-ego_max0.009787079493204752
sim_compute_robot_state-ego_mean0.008009177207946777
sim_compute_robot_state-ego_median0.007101200421651205
sim_compute_robot_state-ego_min0.006656249364217122
sim_compute_sim_state_max0.005479965209960937
sim_compute_sim_state_mean0.005094419479370118
sim_compute_sim_state_median0.004989153544108073
sim_compute_sim_state_min0.004719883600870768
sim_physics_max0.12192811648050944
sim_physics_mean0.09719885396957398
sim_physics_median0.08497883478800455
sim_physics_min0.07914539019266764
sim_render-ego_max0.013161545594533284
sim_render-ego_mean0.010409441630045571
sim_render-ego_median0.009052095413208007
sim_render-ego_min0.00855918566385905
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
307486298Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:13:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.525508134501853
survival_time_median14.950000000000076
deviation-center-line_median0.5549911474340117
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05080652793248495
agent_compute-ego_mean0.04646136093139649
agent_compute-ego_median0.04606772661209106
agent_compute-ego_min0.043704488277435304
deviation-center-line_max0.7481284100842517
deviation-center-line_mean0.5506894822891519
deviation-center-line_min0.3849882494657448
deviation-heading_max2.732647918464128
deviation-heading_mean2.0072873497986983
deviation-heading_median1.9991370651242533
deviation-heading_min1.2238297098139372
driven_any_max3.4414912509928817
driven_any_mean2.7833009198032626
driven_any_median2.5603795925325477
driven_any_min2.368738202297586
driven_lanedir_consec_max3.42467012408603
driven_lanedir_consec_mean2.7435789200837712
driven_lanedir_consec_min2.3051117607292326
driven_lanedir_max3.42467012408603
driven_lanedir_mean2.7435789200837712
driven_lanedir_median2.525508134501853
driven_lanedir_min2.3051117607292326
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.368738202297586, "sim_physics": 0.1201616144180298, "survival_time": 14.950000000000076, "driven_lanedir": 2.3051117607292326, "sim_render-ego": 0.012658283710479735, "in-drivable-lane": 0, "agent_compute-ego": 0.05080652793248495, "deviation-heading": 2.732647918464128, "set_robot_commands": 0.011755649248758953, "deviation-center-line": 0.5549911474340117, "driven_lanedir_consec": 2.3051117607292326, "sim_compute_sim_state": 0.005859251817067464, "sim_compute_performance-ego": 0.00781919797261556, "sim_compute_robot_state-ego": 0.00974207878112793}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5603795925325477, "sim_physics": 0.12245147466659546, "survival_time": 14.950000000000076, "driven_lanedir": 2.525508134501853, "sim_render-ego": 0.012796881993611654, "in-drivable-lane": 0, "agent_compute-ego": 0.043704488277435304, "deviation-heading": 1.9991370651242533, "set_robot_commands": 0.01155702829360962, "deviation-center-line": 0.6639120346137614, "driven_lanedir_consec": 2.525508134501853, "sim_compute_sim_state": 0.005896717707316081, "sim_compute_performance-ego": 0.007670810222625732, "sim_compute_robot_state-ego": 0.010131590366363526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5211805436788177, "sim_physics": 0.12077341636021932, "survival_time": 14.950000000000076, "driven_lanedir": 2.4625510172617107, "sim_render-ego": 0.013028624852498371, "in-drivable-lane": 0, "agent_compute-ego": 0.04606772661209106, "deviation-heading": 2.3958078441371495, "set_robot_commands": 0.011925617853800455, "deviation-center-line": 0.7481284100842517, "driven_lanedir_consec": 2.4625510172617107, "sim_compute_sim_state": 0.005736502011617025, "sim_compute_performance-ego": 0.007956658204396566, "sim_compute_robot_state-ego": 0.010113676389058432}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4414912509928817, "sim_physics": 0.12398192008336384, "survival_time": 14.950000000000076, "driven_lanedir": 3.42467012408603, "sim_render-ego": 0.013231430053710936, "in-drivable-lane": 0, "agent_compute-ego": 0.04437719980875651, "deviation-heading": 1.2238297098139372, "set_robot_commands": 0.01218751589457194, "deviation-center-line": 0.4014275698479901, "driven_lanedir_consec": 3.42467012408603, "sim_compute_sim_state": 0.005769578615824381, "sim_compute_performance-ego": 0.008161511421203613, "sim_compute_robot_state-ego": 0.010116201241811116}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0247150095144795, "sim_physics": 0.12924209833145142, "survival_time": 14.950000000000076, "driven_lanedir": 3.0000535638400274, "sim_render-ego": 0.01401621659596761, "in-drivable-lane": 0, "agent_compute-ego": 0.0473508620262146, "deviation-heading": 1.6850142114540227, "set_robot_commands": 0.011984872023264566, "deviation-center-line": 0.3849882494657448, "driven_lanedir_consec": 3.0000535638400274, "sim_compute_sim_state": 0.005997129281361898, "sim_compute_performance-ego": 0.00828599214553833, "sim_compute_robot_state-ego": 0.01116244872411092}}
set_robot_commands_max0.01218751589457194
set_robot_commands_mean0.011882136662801104
set_robot_commands_median0.011925617853800455
set_robot_commands_min0.01155702829360962
sim_compute_performance-ego_max0.00828599214553833
sim_compute_performance-ego_mean0.00797883399327596
sim_compute_performance-ego_median0.007956658204396566
sim_compute_performance-ego_min0.007670810222625732
sim_compute_robot_state-ego_max0.01116244872411092
sim_compute_robot_state-ego_mean0.010253199100494385
sim_compute_robot_state-ego_median0.010116201241811116
sim_compute_robot_state-ego_min0.00974207878112793
sim_compute_sim_state_max0.005997129281361898
sim_compute_sim_state_mean0.00585183588663737
sim_compute_sim_state_median0.005859251817067464
sim_compute_sim_state_min0.005736502011617025
sim_physics_max0.12924209833145142
sim_physics_mean0.12332210477193198
sim_physics_median0.12245147466659546
sim_physics_min0.1201616144180298
sim_render-ego_max0.01401621659596761
sim_render-ego_mean0.013146287441253662
sim_render-ego_median0.013028624852498371
sim_render-ego_min0.012658283710479735
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
307225967c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval2-visualizesuccessnoip-172-31-35-218-104900:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec5.431742344429185
survival_time44
deviation-center-line2.977521862577583
in-drivable-lane6.6667


other stats
deviation-heading3.1546613882166823
driven_any6.363833556194694
driven_lanedir5.431742344429185
visualized-eval2-passed1
No reset possible
307145956c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval1-videossuccessnoip-172-31-35-218-104900:08:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
307095967c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval0-videossuccessnoip-172-31-35-218-104900:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
306046018Philippe Marcotte 🇨🇦pp + veh dectaido3-LFV-real-validationeval2-visualizesuccessnoip-172-31-35-218-104900:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.1174044936728071
survival_time9.3333
deviation-center-line0.2602611059855985
in-drivable-lane4.666699999999999


other stats
deviation-heading0.948398603803616
driven_any2.4579459947677664
driven_lanedir1.1174044936728071
visualized-eval2-passed1
No reset possible
305866063Oliver Widlerchallenge-aido_LF-template-pytorchaido3-LF-real-validationeval2-videossuccessnoip-172-31-35-218-104900:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305836063Oliver Widlerchallenge-aido_LF-template-pytorchaido3-LF-real-validationeval1-videossuccessnoip-172-31-35-218-104900:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305655827Robert Moni 🇭🇺kaland-225308aido3-LFV-real-validationeval1-videossuccessnoip-172-31-35-218-104900:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
305465977c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LFV-real-validationeval0-videossuccessnoip-172-31-35-218-104900:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
304706281Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:15:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.506923508226795
survival_time_median14.950000000000076
deviation-center-line_median0.6668299776533017
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.05312191009521485
agent_compute-ego_mean0.0496162428855896
agent_compute-ego_median0.05181591113408406
agent_compute-ego_min0.04040203173955281
deviation-center-line_max1.1210421047576862
deviation-center-line_mean0.7129518449918855
deviation-center-line_min0.4867379216017388
deviation-heading_max4.719401492217236
deviation-heading_mean3.807562935522489
deviation-heading_median3.676752318616676
deviation-heading_min3.011523339986783
driven_any_max4.178478910234199
driven_any_mean3.3709820467669274
driven_any_median3.1216078721788674
driven_any_min2.818519579794275
driven_lanedir_consec_max3.819697667571869
driven_lanedir_consec_mean2.651213301768073
driven_lanedir_consec_min1.4516210454807863
driven_lanedir_max3.891164397449663
driven_lanedir_mean3.17112744863094
driven_lanedir_median3.023744412372789
driven_lanedir_min2.506923508226795
in-drivable-lane_max1.4500000000000206
in-drivable-lane_mean0.5200000000000058
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8280611852992745, "sim_physics": 0.11668418327967324, "survival_time": 14.950000000000076, "driven_lanedir": 2.614107257533587, "sim_render-ego": 0.012341291904449462, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04040203173955281, "deviation-heading": 4.719401492217236, "set_robot_commands": 0.011068956057230631, "deviation-center-line": 0.5716862471093808, "driven_lanedir_consec": 1.4516210454807863, "sim_compute_sim_state": 0.005580483277638753, "sim_compute_performance-ego": 0.007632891337076823, "sim_compute_robot_state-ego": 0.009327135880788168}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1216078721788674, "sim_physics": 0.1325375747680664, "survival_time": 14.950000000000076, "driven_lanedir": 3.023744412372789, "sim_render-ego": 0.014274259408315023, "in-drivable-lane": 0, "agent_compute-ego": 0.05181591113408406, "deviation-heading": 3.4120406552097253, "set_robot_commands": 0.01128927230834961, "deviation-center-line": 0.6668299776533017, "driven_lanedir_consec": 3.023744412372789, "sim_compute_sim_state": 0.005906179745992024, "sim_compute_performance-ego": 0.00865769624710083, "sim_compute_robot_state-ego": 0.010818587144215902}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.818519579794275, "sim_physics": 0.11020829121271768, "survival_time": 14.950000000000076, "driven_lanedir": 2.506923508226795, "sim_render-ego": 0.013052983283996582, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.05312191009521485, "deviation-heading": 3.676752318616676, "set_robot_commands": 0.01045887549718221, "deviation-center-line": 1.1210421047576862, "driven_lanedir_consec": 2.506923508226795, "sim_compute_sim_state": 0.005386939843495687, "sim_compute_performance-ego": 0.007837351163228352, "sim_compute_robot_state-ego": 0.009674269358317058}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9082426863280233, "sim_physics": 0.1290492526690165, "survival_time": 14.950000000000076, "driven_lanedir": 3.819697667571869, "sim_render-ego": 0.014156742095947266, "in-drivable-lane": 0, "agent_compute-ego": 0.05238709608713786, "deviation-heading": 3.011523339986783, "set_robot_commands": 0.01208077828089396, "deviation-center-line": 0.4867379216017388, "driven_lanedir_consec": 3.819697667571869, "sim_compute_sim_state": 0.005948561827341716, "sim_compute_performance-ego": 0.00838537613550822, "sim_compute_robot_state-ego": 0.010531724294026691}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.178478910234199, "sim_physics": 0.12241228024164837, "survival_time": 14.950000000000076, "driven_lanedir": 3.891164397449663, "sim_render-ego": 0.01361627499262492, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.05035426537195842, "deviation-heading": 4.218096871582022, "set_robot_commands": 0.011153365770975749, "deviation-center-line": 0.7184629738373204, "driven_lanedir_consec": 2.454079875188124, "sim_compute_sim_state": 0.00547296682993571, "sim_compute_performance-ego": 0.00814598321914673, "sim_compute_robot_state-ego": 0.010019291241963704}}
set_robot_commands_max0.01208077828089396
set_robot_commands_mean0.011210249582926431
set_robot_commands_median0.011153365770975749
set_robot_commands_min0.01045887549718221
sim_compute_performance-ego_max0.00865769624710083
sim_compute_performance-ego_mean0.008131859620412192
sim_compute_performance-ego_median0.00814598321914673
sim_compute_performance-ego_min0.007632891337076823
sim_compute_robot_state-ego_max0.010818587144215902
sim_compute_robot_state-ego_mean0.010074201583862304
sim_compute_robot_state-ego_median0.010019291241963704
sim_compute_robot_state-ego_min0.009327135880788168
sim_compute_sim_state_max0.005948561827341716
sim_compute_sim_state_mean0.005659026304880777
sim_compute_sim_state_median0.005580483277638753
sim_compute_sim_state_min0.005386939843495687
sim_physics_max0.1325375747680664
sim_physics_mean0.12217831643422446
sim_physics_median0.12241228024164837
sim_physics_min0.11020829121271768
sim_render-ego_max0.014274259408315023
sim_render-ego_mean0.01348831033706665
sim_render-ego_median0.01361627499262492
sim_render-ego_min0.012341291904449462
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
303836254Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.221937423662415
survival_time_median14.950000000000076
deviation-center-line_median0.6733844969818357
in-drivable-lane_median0


other stats
agent_compute-ego_max0.037651867866516114
agent_compute-ego_mean0.029489197815488102
agent_compute-ego_median0.0361366613705953
agent_compute-ego_min0.018425739728487454
deviation-center-line_max1.0405140897356029
deviation-center-line_mean0.6623667404005879
deviation-center-line_min0.20063218051454937
deviation-heading_max3.891327221960733
deviation-heading_mean1.9378016033630847
deviation-heading_median1.3343894996346406
deviation-heading_min1.1279622438516634
driven_any_max2.349158496739279
driven_any_mean1.92006685999122
driven_any_median2.3490742921945387
driven_any_min0.6699628213993062
driven_lanedir_consec_max2.3376163765499616
driven_lanedir_consec_mean1.873261587259449
driven_lanedir_consec_min0.6347936238584444
driven_lanedir_max2.3376163765499616
driven_lanedir_mean1.873261587259449
driven_lanedir_median2.221937423662415
driven_lanedir_min0.6347936238584444
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6699628213993062, "sim_physics": 0.07122164506178635, "survival_time": 4.549999999999992, "driven_lanedir": 0.6347936238584444, "sim_render-ego": 0.008402101286165007, "in-drivable-lane": 0, "agent_compute-ego": 0.018425739728487454, "deviation-heading": 1.1279622438516634, "set_robot_commands": 0.00805771481859815, "deviation-center-line": 0.20063218051454937, "driven_lanedir_consec": 0.6347936238584444, "sim_compute_sim_state": 0.004119645108233441, "sim_compute_performance-ego": 0.005177909201318091, "sim_compute_robot_state-ego": 0.006049947424249334}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8830271807761516, "sim_physics": 0.06442062686587766, "survival_time": 12.050000000000036, "driven_lanedir": 1.8633989050100248, "sim_render-ego": 0.008126012517208875, "in-drivable-lane": 0, "agent_compute-ego": 0.01880562255986004, "deviation-heading": 1.3343894996346406, "set_robot_commands": 0.007750230211439964, "deviation-center-line": 0.5623433767605767, "driven_lanedir_consec": 1.8633989050100248, "sim_compute_sim_state": 0.003944303979517514, "sim_compute_performance-ego": 0.004665124465815754, "sim_compute_robot_state-ego": 0.005835776507112495}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490742921945387, "sim_physics": 0.06371241648991903, "survival_time": 14.950000000000076, "driven_lanedir": 2.221937423662415, "sim_render-ego": 0.008214274247487385, "in-drivable-lane": 0, "agent_compute-ego": 0.0361366613705953, "deviation-heading": 3.891327221960733, "set_robot_commands": 0.005724413394927979, "deviation-center-line": 1.0405140897356029, "driven_lanedir_consec": 2.221937423662415, "sim_compute_sim_state": 0.0033945655822753907, "sim_compute_performance-ego": 0.004759512742360433, "sim_compute_robot_state-ego": 0.005795704523722331}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.349111508846823, "sim_physics": 0.06392842849095662, "survival_time": 14.950000000000076, "driven_lanedir": 2.3085616072163986, "sim_render-ego": 0.008187909921010336, "in-drivable-lane": 0, "agent_compute-ego": 0.03642609755198161, "deviation-heading": 2.1410829570922196, "set_robot_commands": 0.005824918746948242, "deviation-center-line": 0.8349595580103748, "driven_lanedir_consec": 2.3085616072163986, "sim_compute_sim_state": 0.0033965547879536945, "sim_compute_performance-ego": 0.0047108880678812665, "sim_compute_robot_state-ego": 0.005779190063476563}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349158496739279, "sim_physics": 0.06299186944961548, "survival_time": 14.950000000000076, "driven_lanedir": 2.3376163765499616, "sim_render-ego": 0.008209600448608398, "in-drivable-lane": 0, "agent_compute-ego": 0.037651867866516114, "deviation-heading": 1.1942460942761677, "set_robot_commands": 0.00588421901067098, "deviation-center-line": 0.6733844969818357, "driven_lanedir_consec": 2.3376163765499616, "sim_compute_sim_state": 0.003404560089111328, "sim_compute_performance-ego": 0.004786934057871501, "sim_compute_robot_state-ego": 0.00594193696975708}}
set_robot_commands_max0.00805771481859815
set_robot_commands_mean0.006648299236517062
set_robot_commands_median0.00588421901067098
set_robot_commands_min0.005724413394927979
sim_compute_performance-ego_max0.005177909201318091
sim_compute_performance-ego_mean0.004820073707049409
sim_compute_performance-ego_median0.004759512742360433
sim_compute_performance-ego_min0.004665124465815754
sim_compute_robot_state-ego_max0.006049947424249334
sim_compute_robot_state-ego_mean0.005880511097663561
sim_compute_robot_state-ego_median0.005835776507112495
sim_compute_robot_state-ego_min0.005779190063476563
sim_compute_sim_state_max0.004119645108233441
sim_compute_sim_state_mean0.0036519259094182736
sim_compute_sim_state_median0.003404560089111328
sim_compute_sim_state_min0.0033945655822753907
sim_physics_max0.07122164506178635
sim_physics_mean0.06525499727163103
sim_physics_median0.06392842849095662
sim_physics_min0.06299186944961548
sim_render-ego_max0.008402101286165007
sim_render-ego_mean0.008227979684096
sim_render-ego_median0.008209600448608398
sim_render-ego_min0.008126012517208875
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.290000000000052
survival_time_min4.549999999999992
No reset possible
303496232Dong Wang 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.195203659880556
survival_time_median14.950000000000076
deviation-center-line_median0.6505461038103788
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01783304948073167
agent_compute-ego_mean0.017168942228416265
agent_compute-ego_median0.016916194756825764
agent_compute-ego_min0.016854719320933024
deviation-center-line_max1.0354228228971527
deviation-center-line_mean0.650205022404937
deviation-center-line_min0.1857381624315424
deviation-heading_max3.669928602938175
deviation-heading_mean1.987237487819668
deviation-heading_median1.6183405653853002
deviation-heading_min1.194933286208695
driven_any_max2.3491376319531545
driven_any_mean1.9280951863763125
driven_any_median2.34908187474823
driven_any_min0.6699534497636944
driven_lanedir_consec_max2.3292535802579044
driven_lanedir_consec_mean1.8695871997511269
driven_lanedir_consec_min0.6098532897914556
driven_lanedir_max2.3292535802579044
driven_lanedir_mean1.8695871997511269
driven_lanedir_median2.195203659880556
driven_lanedir_min0.6098532897914556
in-drivable-lane_max0.25000000000000355
in-drivable-lane_mean0.0800000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6699534497636944, "sim_physics": 0.06485115302788032, "survival_time": 4.549999999999992, "driven_lanedir": 0.6098532897914556, "sim_render-ego": 0.007891647108308562, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.01783304948073167, "deviation-heading": 1.194933286208695, "set_robot_commands": 0.007714808642209231, "deviation-center-line": 0.1857381624315424, "driven_lanedir_consec": 0.6098532897914556, "sim_compute_sim_state": 0.004014649233975254, "sim_compute_performance-ego": 0.004867307432405241, "sim_compute_robot_state-ego": 0.005609863407009251}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9231912405058864, "sim_physics": 0.058827036764563585, "survival_time": 12.30000000000004, "driven_lanedir": 1.8976317766760664, "sim_render-ego": 0.00789609091068671, "in-drivable-lane": 0, "agent_compute-ego": 0.0168747785614758, "deviation-heading": 1.3991161325848205, "set_robot_commands": 0.007949803902850888, "deviation-center-line": 0.6505461038103788, "driven_lanedir_consec": 1.8976317766760664, "sim_compute_sim_state": 0.0036682685216267905, "sim_compute_performance-ego": 0.00452815226423062, "sim_compute_robot_state-ego": 0.0055931932557889115}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34908187474823, "sim_physics": 0.060000836849212646, "survival_time": 14.950000000000076, "driven_lanedir": 2.195203659880556, "sim_render-ego": 0.007886850833892822, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.016916194756825764, "deviation-heading": 3.669928602938175, "set_robot_commands": 0.007629254659016927, "deviation-center-line": 1.0354228228971527, "driven_lanedir_consec": 2.195203659880556, "sim_compute_sim_state": 0.003632810115814209, "sim_compute_performance-ego": 0.004572406609853108, "sim_compute_robot_state-ego": 0.005570839246114095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.349111734910598, "sim_physics": 0.06022311846415202, "survival_time": 14.950000000000076, "driven_lanedir": 2.315993692149653, "sim_render-ego": 0.007841302553812662, "in-drivable-lane": 0, "agent_compute-ego": 0.016854719320933024, "deviation-heading": 2.053868851981349, "set_robot_commands": 0.007904891173044841, "deviation-center-line": 0.7967044092960075, "driven_lanedir_consec": 2.315993692149653, "sim_compute_sim_state": 0.003656384944915771, "sim_compute_performance-ego": 0.004503630797068278, "sim_compute_robot_state-ego": 0.0055490446090698245}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491376319531545, "sim_physics": 0.06335875193277994, "survival_time": 14.950000000000076, "driven_lanedir": 2.3292535802579044, "sim_render-ego": 0.007881762981414795, "in-drivable-lane": 0, "agent_compute-ego": 0.017365969022115072, "deviation-heading": 1.6183405653853002, "set_robot_commands": 0.007847456932067872, "deviation-center-line": 0.582613613589604, "driven_lanedir_consec": 2.3292535802579044, "sim_compute_sim_state": 0.0038158679008483886, "sim_compute_performance-ego": 0.004607911109924316, "sim_compute_robot_state-ego": 0.0056083440780639645}}
set_robot_commands_max0.007949803902850888
set_robot_commands_mean0.007809243061837952
set_robot_commands_median0.007847456932067872
set_robot_commands_min0.007629254659016927
sim_compute_performance-ego_max0.004867307432405241
sim_compute_performance-ego_mean0.004615881642696313
sim_compute_performance-ego_median0.004572406609853108
sim_compute_performance-ego_min0.004503630797068278
sim_compute_robot_state-ego_max0.005609863407009251
sim_compute_robot_state-ego_mean0.005586256919209209
sim_compute_robot_state-ego_median0.0055931932557889115
sim_compute_robot_state-ego_min0.0055490446090698245
sim_compute_sim_state_max0.004014649233975254
sim_compute_sim_state_mean0.0037575961434360822
sim_compute_sim_state_median0.0036682685216267905
sim_compute_sim_state_min0.003632810115814209
sim_physics_max0.06485115302788032
sim_physics_mean0.0614521794077177
sim_physics_median0.06022311846415202
sim_physics_min0.058827036764563585
sim_render-ego_max0.00789609091068671
sim_render-ego_mean0.007879530877623112
sim_render-ego_median0.007886850833892822
sim_render-ego_min0.007841302553812662
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.340000000000051
survival_time_min4.549999999999992
No reset possible
303406227Dong Wang 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationabortedyesip-172-31-35-218-104900:03:14
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
303316223Dong Wang 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8448237733082715
survival_time_median12.050000000000036
deviation-center-line_median0.7492681156624493
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01846254450603596
agent_compute-ego_mean0.01765840196777001
agent_compute-ego_median0.01728953282038371
agent_compute-ego_min0.017097296061852167
deviation-center-line_max0.9508398301234312
deviation-center-line_mean0.629950305680568
deviation-center-line_min0.325937462755145
deviation-heading_max3.302608568279376
deviation-heading_mean1.680027583700563
deviation-heading_median1.3650824306357063
deviation-heading_min0.8690278757166906
driven_any_max2.3491469960781783
driven_any_mean1.7448728528982325
driven_any_median1.8830250656043204
driven_any_min0.766374468818474
driven_lanedir_consec_max2.336009256905946
driven_lanedir_consec_mean1.691801109207687
driven_lanedir_consec_min0.7534989630113308
driven_lanedir_max2.336009256905946
driven_lanedir_mean1.691801109207687
driven_lanedir_median1.8448237733082715
driven_lanedir_min0.7534989630113308
in-drivable-lane_max0.3999999999999986
in-drivable-lane_mean0.08999999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.766374468818474, "sim_physics": 0.06504112076990813, "survival_time": 5.14999999999999, "driven_lanedir": 0.7534989630113308, "sim_render-ego": 0.0078003846325920626, "in-drivable-lane": 0, "agent_compute-ego": 0.01846254450603596, "deviation-heading": 0.8690278757166906, "set_robot_commands": 0.008003716329926426, "deviation-center-line": 0.325937462755145, "driven_lanedir_consec": 0.7534989630113308, "sim_compute_sim_state": 0.003805628100645195, "sim_compute_performance-ego": 0.004780811013527287, "sim_compute_robot_state-ego": 0.005787814705117235}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8830250656043204, "sim_physics": 0.062413210690763485, "survival_time": 12.050000000000036, "driven_lanedir": 1.8448237733082715, "sim_render-ego": 0.007925393670426365, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.017097296061852167, "deviation-heading": 1.3650824306357063, "set_robot_commands": 0.008019993414028056, "deviation-center-line": 0.7893954955888842, "driven_lanedir_consec": 1.8448237733082715, "sim_compute_sim_state": 0.003706844021175907, "sim_compute_performance-ego": 0.004597750936801009, "sim_compute_robot_state-ego": 0.005694247874976193}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.349105701724906, "sim_physics": 0.06217896223068237, "survival_time": 14.950000000000076, "driven_lanedir": 2.1876970191912863, "sim_render-ego": 0.007710522015889486, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.01724799315134684, "deviation-heading": 3.302608568279376, "set_robot_commands": 0.007839117844899495, "deviation-center-line": 0.9508398301234312, "driven_lanedir_consec": 2.1876970191912863, "sim_compute_sim_state": 0.003732429345448812, "sim_compute_performance-ego": 0.004513499736785889, "sim_compute_robot_state-ego": 0.005650191307067871}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3767120322652842, "sim_physics": 0.06196659066703882, "survival_time": 8.899999999999991, "driven_lanedir": 1.3369765336216004, "sim_render-ego": 0.00794726141383139, "in-drivable-lane": 0, "agent_compute-ego": 0.01819464329923137, "deviation-heading": 1.5885162974728526, "set_robot_commands": 0.007817872454611104, "deviation-center-line": 0.3343106242729304, "driven_lanedir_consec": 1.3369765336216004, "sim_compute_sim_state": 0.00378976912980669, "sim_compute_performance-ego": 0.004492605670114581, "sim_compute_robot_state-ego": 0.005743866556146172}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491469960781783, "sim_physics": 0.06452800273895264, "survival_time": 14.950000000000076, "driven_lanedir": 2.336009256905946, "sim_render-ego": 0.00771989901860555, "in-drivable-lane": 0, "agent_compute-ego": 0.01728953282038371, "deviation-heading": 1.2749027463981883, "set_robot_commands": 0.007936968008677164, "deviation-center-line": 0.7492681156624493, "driven_lanedir_consec": 2.336009256905946, "sim_compute_sim_state": 0.0038135480880737305, "sim_compute_performance-ego": 0.004477120240529378, "sim_compute_robot_state-ego": 0.005549419720967611}}
set_robot_commands_max0.008019993414028056
set_robot_commands_mean0.007923533610428449
set_robot_commands_median0.007936968008677164
set_robot_commands_min0.007817872454611104
sim_compute_performance-ego_max0.004780811013527287
sim_compute_performance-ego_mean0.004572357519551629
sim_compute_performance-ego_median0.004513499736785889
sim_compute_performance-ego_min0.004477120240529378
sim_compute_robot_state-ego_max0.005787814705117235
sim_compute_robot_state-ego_mean0.005685108032855017
sim_compute_robot_state-ego_median0.005694247874976193
sim_compute_robot_state-ego_min0.005549419720967611
sim_compute_sim_state_max0.0038135480880737305
sim_compute_sim_state_mean0.0037696437370300664
sim_compute_sim_state_median0.00378976912980669
sim_compute_sim_state_min0.003706844021175907
sim_physics_max0.06504112076990813
sim_physics_mean0.06322557741946909
sim_physics_median0.062413210690763485
sim_physics_min0.06196659066703882
sim_render-ego_max0.00794726141383139
sim_render-ego_mean0.007820692150268971
sim_render-ego_median0.0078003846325920626
sim_render-ego_min0.007710522015889486
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.200000000000037
survival_time_min5.14999999999999
No reset possible
303236216Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6876613286662583
survival_time_median4.94999999999999
deviation-center-line_median0.2682630985299386
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03891342222405392
agent_compute-ego_mean0.03468327248877151
agent_compute-ego_median0.03599911379667879
agent_compute-ego_min0.025494220581921665
deviation-center-line_max0.660156804571272
deviation-center-line_mean0.3487831009871832
deviation-center-line_min0.15356932357088987
deviation-heading_max1.9691931262810023
deviation-heading_mean1.2629457964943185
deviation-heading_median1.1431844277227734
deviation-heading_min0.9443282406934692
driven_any_max1.625786881875722
driven_any_mean0.9878529337904391
driven_any_median0.7418615204302357
driven_any_min0.6458606149233049
driven_lanedir_consec_max1.5647918696337146
driven_lanedir_consec_mean0.9486548105360356
driven_lanedir_consec_min0.6036311224537296
driven_lanedir_max1.5647918696337146
driven_lanedir_mean0.9486548105360356
driven_lanedir_median0.6876613286662583
driven_lanedir_min0.6036311224537296
in-drivable-lane_max0.04999999999999982
in-drivable-lane_mean0.009999999999999964
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6458606149233049, "sim_physics": 0.17805026336149735, "survival_time": 4.399999999999992, "driven_lanedir": 0.6036311224537296, "sim_render-ego": 0.011533341624520042, "in-drivable-lane": 0, "agent_compute-ego": 0.025494220581921665, "deviation-heading": 1.1899758209300122, "set_robot_commands": 0.0104779221794822, "deviation-center-line": 0.18810795684909384, "driven_lanedir_consec": 0.6036311224537296, "sim_compute_sim_state": 0.0046656538139690056, "sim_compute_performance-ego": 0.007037661292336204, "sim_compute_robot_state-ego": 0.00855886394327337, "sim_compute_robot_state-npc0": 0.0094607797535983, "sim_compute_robot_state-npc1": 0.008541608398610895, "sim_compute_robot_state-npc2": 0.008210035887631502, "sim_compute_robot_state-npc3": 0.008094256574457342}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.625786881875722, "sim_physics": 0.17647038122113243, "survival_time": 10.450000000000014, "driven_lanedir": 1.5647918696337146, "sim_render-ego": 0.011449187566218764, "in-drivable-lane": 0, "agent_compute-ego": 0.03891342222405392, "deviation-heading": 1.9691931262810023, "set_robot_commands": 0.010026132090810384, "deviation-center-line": 0.660156804571272, "driven_lanedir_consec": 1.5647918696337146, "sim_compute_sim_state": 0.0046918848484897155, "sim_compute_performance-ego": 0.006639379063291413, "sim_compute_robot_state-ego": 0.008501882188057785, "sim_compute_robot_state-npc0": 0.008432520633679257, "sim_compute_robot_state-npc1": 0.008260325381630346, "sim_compute_robot_state-npc2": 0.00818130730441883, "sim_compute_robot_state-npc3": 0.00815241074447997}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2562029344923706, "sim_physics": 0.11790643440433808, "survival_time": 8.14999999999998, "driven_lanedir": 1.2385260593854552, "sim_render-ego": 0.008058131106792052, "in-drivable-lane": 0, "agent_compute-ego": 0.03599911379667879, "deviation-heading": 1.0680473668443344, "set_robot_commands": 0.005476890166112982, "deviation-center-line": 0.4738183214147216, "driven_lanedir_consec": 1.2385260593854552, "sim_compute_sim_state": 0.0032177424869654367, "sim_compute_performance-ego": 0.00459190526622936, "sim_compute_robot_state-ego": 0.0056099862408784265, "sim_compute_robot_state-npc0": 0.0053484220446253115, "sim_compute_robot_state-npc1": 0.005189142344188105, "sim_compute_robot_state-npc2": 0.005253056075675356, "sim_compute_robot_state-npc3": 0.005345417677990498}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7418615204302357, "sim_physics": 0.1262565116689663, "survival_time": 4.94999999999999, "driven_lanedir": 0.6876613286662583, "sim_render-ego": 0.008040507634480795, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.03592710061506792, "deviation-heading": 1.1431844277227734, "set_robot_commands": 0.005644210661300505, "deviation-center-line": 0.15356932357088987, "driven_lanedir_consec": 0.6876613286662583, "sim_compute_sim_state": 0.0032363130588724154, "sim_compute_performance-ego": 0.004679395694925328, "sim_compute_robot_state-ego": 0.005838820428559275, "sim_compute_robot_state-npc0": 0.005510886510213216, "sim_compute_robot_state-npc1": 0.005295146595348011, "sim_compute_robot_state-npc2": 0.005299731938525884, "sim_compute_robot_state-npc3": 0.005320589951794557}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6695527172305626, "sim_physics": 0.12515322632259793, "survival_time": 4.499999999999992, "driven_lanedir": 0.6486636725410214, "sim_render-ego": 0.007953153716193305, "in-drivable-lane": 0, "agent_compute-ego": 0.03708250522613525, "deviation-heading": 0.9443282406934692, "set_robot_commands": 0.005451305707295736, "deviation-center-line": 0.2682630985299386, "driven_lanedir_consec": 0.6486636725410214, "sim_compute_sim_state": 0.003168434566921658, "sim_compute_performance-ego": 0.004516583018832737, "sim_compute_robot_state-ego": 0.005886771943834093, "sim_compute_robot_state-npc0": 0.005461557706197103, "sim_compute_robot_state-npc1": 0.005234464009602865, "sim_compute_robot_state-npc2": 0.005238172743055556, "sim_compute_robot_state-npc3": 0.005289101600646972}}
set_robot_commands_max0.0104779221794822
set_robot_commands_mean0.007415292161000361
set_robot_commands_median0.005644210661300505
set_robot_commands_min0.005451305707295736
sim_compute_performance-ego_max0.007037661292336204
sim_compute_performance-ego_mean0.005492984867123009
sim_compute_performance-ego_median0.004679395694925328
sim_compute_performance-ego_min0.004516583018832737
sim_compute_robot_state-ego_max0.00855886394327337
sim_compute_robot_state-ego_mean0.006879264948920589
sim_compute_robot_state-ego_median0.005886771943834093
sim_compute_robot_state-ego_min0.0056099862408784265
sim_compute_robot_state-npc0_max0.0094607797535983
sim_compute_robot_state-npc0_mean0.006842833329662637
sim_compute_robot_state-npc0_median0.005510886510213216
sim_compute_robot_state-npc0_min0.0053484220446253115
sim_compute_robot_state-npc1_max0.008541608398610895
sim_compute_robot_state-npc1_mean0.006504137345876045
sim_compute_robot_state-npc1_median0.005295146595348011
sim_compute_robot_state-npc1_min0.005189142344188105
sim_compute_robot_state-npc2_max0.008210035887631502
sim_compute_robot_state-npc2_mean0.006436460789861424
sim_compute_robot_state-npc2_median0.005299731938525884
sim_compute_robot_state-npc2_min0.005238172743055556
sim_compute_robot_state-npc3_max0.00815241074447997
sim_compute_robot_state-npc3_mean0.006440355309873869
sim_compute_robot_state-npc3_median0.005345417677990498
sim_compute_robot_state-npc3_min0.005289101600646972
sim_compute_sim_state_max0.0046918848484897155
sim_compute_sim_state_mean0.003796005755043646
sim_compute_sim_state_median0.0032363130588724154
sim_compute_sim_state_min0.003168434566921658
sim_physics_max0.17805026336149735
sim_physics_mean0.14476736339570642
sim_physics_median0.1262565116689663
sim_physics_min0.11790643440433808
sim_render-ego_max0.011533341624520042
sim_render-ego_mean0.009406864329640992
sim_render-ego_median0.008058131106792052
sim_render-ego_min0.007953153716193305
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean6.489999999999993
survival_time_min4.399999999999992
No reset possible
302496159Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6891981813039396
survival_time_median4.899999999999991
deviation-center-line_median0.21998920266601288
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.018144991933083048
agent_compute-ego_mean0.017663097391245084
agent_compute-ego_median0.017700261274973553
agent_compute-ego_min0.017197746591469675
deviation-center-line_max0.8364220306911798
deviation-center-line_mean0.4036222887382589
deviation-center-line_min0.13301882982212862
deviation-heading_max5.195348079901904
deviation-heading_mean2.3902689543788935
deviation-heading_median1.3322002322177322
deviation-heading_min1.0479081072555727
driven_any_max2.348890218501511
driven_any_mean1.1854775758554228
driven_any_median0.7261976813293118
driven_any_min0.6534768074913957
driven_lanedir_consec_max1.990807837108689
driven_lanedir_consec_mean0.9209652019745942
driven_lanedir_consec_min0.5233265247862211
driven_lanedir_max1.990807837108689
driven_lanedir_mean1.0346527700088664
driven_lanedir_median0.6891981813039396
driven_lanedir_min0.5233265247862211
in-drivable-lane_max0.7500000000000107
in-drivable-lane_mean0.29000000000000165
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7261976813293118, "sim_physics": 0.12508292587435976, "survival_time": 4.899999999999991, "driven_lanedir": 0.6891981813039396, "sim_render-ego": 0.00793226397767359, "in-drivable-lane": 0, "agent_compute-ego": 0.018144991933083048, "deviation-heading": 1.0550685487841518, "set_robot_commands": 0.008236994548719756, "deviation-center-line": 0.16109340397464578, "driven_lanedir_consec": 0.6891981813039396, "sim_compute_sim_state": 0.003260376502056511, "sim_compute_performance-ego": 0.004605777409611916, "sim_compute_robot_state-ego": 0.005882161004202706, "sim_compute_robot_state-npc0": 0.006596054349626813, "sim_compute_robot_state-npc1": 0.005679877436890894, "sim_compute_robot_state-npc2": 0.005522949354989188, "sim_compute_robot_state-npc3": 0.005451684095421616}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7258039446757735, "sim_physics": 0.11854318245170042, "survival_time": 4.849999999999991, "driven_lanedir": 0.6854071225023298, "sim_render-ego": 0.008042891000963977, "in-drivable-lane": 0, "agent_compute-ego": 0.017197746591469675, "deviation-heading": 1.0479081072555727, "set_robot_commands": 0.008327213759274827, "deviation-center-line": 0.21998920266601288, "driven_lanedir_consec": 0.6854071225023298, "sim_compute_sim_state": 0.0033102109260165816, "sim_compute_performance-ego": 0.004483508080551305, "sim_compute_robot_state-ego": 0.005603473211072155, "sim_compute_robot_state-npc0": 0.006432299761428046, "sim_compute_robot_state-npc1": 0.005637326191381081, "sim_compute_robot_state-npc2": 0.0055352781236786205, "sim_compute_robot_state-npc3": 0.005545645644984294}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.4730192272791216, "sim_physics": 0.12032650897377416, "survival_time": 9.5, "driven_lanedir": 1.284524184343152, "sim_render-ego": 0.007933435941997326, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.017840913722389624, "deviation-heading": 3.320819803735106, "set_robot_commands": 0.008145948460227564, "deviation-center-line": 0.8364220306911798, "driven_lanedir_consec": 0.7160863441717907, "sim_compute_sim_state": 0.003419109394675807, "sim_compute_performance-ego": 0.004554912918492368, "sim_compute_robot_state-ego": 0.005631007646259509, "sim_compute_robot_state-npc0": 0.0063532239512393346, "sim_compute_robot_state-npc1": 0.005876686698512027, "sim_compute_robot_state-npc2": 0.005732173668710809, "sim_compute_robot_state-npc3": 0.005608697941428736}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348890218501511, "sim_physics": 0.12294418493906656, "survival_time": 14.950000000000076, "driven_lanedir": 1.990807837108689, "sim_render-ego": 0.007986505826314291, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.017700261274973553, "deviation-heading": 5.195348079901904, "set_robot_commands": 0.008069036801656087, "deviation-center-line": 0.667587976537327, "driven_lanedir_consec": 1.990807837108689, "sim_compute_sim_state": 0.00321378231048584, "sim_compute_performance-ego": 0.004610570271809896, "sim_compute_robot_state-ego": 0.005844192504882812, "sim_compute_robot_state-npc0": 0.006412496566772461, "sim_compute_robot_state-npc1": 0.005696752071380615, "sim_compute_robot_state-npc2": 0.00554445743560791, "sim_compute_robot_state-npc3": 0.005502532323201498}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6534768074913957, "sim_physics": 0.12501103498718957, "survival_time": 4.399999999999992, "driven_lanedir": 0.5233265247862211, "sim_render-ego": 0.007940788160670887, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.017431573434309525, "deviation-heading": 1.3322002322177322, "set_robot_commands": 0.008050119335001165, "deviation-center-line": 0.13301882982212862, "driven_lanedir_consec": 0.5233265247862211, "sim_compute_sim_state": 0.003347182815725153, "sim_compute_performance-ego": 0.00446562333540483, "sim_compute_robot_state-ego": 0.005724657665599476, "sim_compute_robot_state-npc0": 0.006256553259762851, "sim_compute_robot_state-npc1": 0.005469072948802601, "sim_compute_robot_state-npc2": 0.005414743315089832, "sim_compute_robot_state-npc3": 0.005447355183688077}}
set_robot_commands_max0.008327213759274827
set_robot_commands_mean0.008165862580975881
set_robot_commands_median0.008145948460227564
set_robot_commands_min0.008050119335001165
sim_compute_performance-ego_max0.004610570271809896
sim_compute_performance-ego_mean0.004544078403174063
sim_compute_performance-ego_median0.004554912918492368
sim_compute_performance-ego_min0.00446562333540483
sim_compute_robot_state-ego_max0.005882161004202706
sim_compute_robot_state-ego_mean0.0057370984064033315
sim_compute_robot_state-ego_median0.005724657665599476
sim_compute_robot_state-ego_min0.005603473211072155
sim_compute_robot_state-npc0_max0.006596054349626813
sim_compute_robot_state-npc0_mean0.0064101255777659
sim_compute_robot_state-npc0_median0.006412496566772461
sim_compute_robot_state-npc0_min0.006256553259762851
sim_compute_robot_state-npc1_max0.005876686698512027
sim_compute_robot_state-npc1_mean0.005671943069393443
sim_compute_robot_state-npc1_median0.005679877436890894
sim_compute_robot_state-npc1_min0.005469072948802601
sim_compute_robot_state-npc2_max0.005732173668710809
sim_compute_robot_state-npc2_mean0.005549920379615272
sim_compute_robot_state-npc2_median0.0055352781236786205
sim_compute_robot_state-npc2_min0.005414743315089832
sim_compute_robot_state-npc3_max0.005608697941428736
sim_compute_robot_state-npc3_mean0.005511183037744844
sim_compute_robot_state-npc3_median0.005502532323201498
sim_compute_robot_state-npc3_min0.005447355183688077
sim_compute_sim_state_max0.003419109394675807
sim_compute_sim_state_mean0.003310132389791978
sim_compute_sim_state_median0.0033102109260165816
sim_compute_sim_state_min0.00321378231048584
sim_physics_max0.12508292587435976
sim_physics_mean0.12238156744521808
sim_physics_median0.12294418493906656
sim_physics_min0.11854318245170042
sim_render-ego_max0.008042891000963977
sim_render-ego_mean0.007967176981524013
sim_render-ego_median0.007940788160670887
sim_render-ego_min0.00793226397767359
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.72000000000001
survival_time_min4.399999999999992
No reset possible
302026145Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:10:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0871847413107125
survival_time_median5.849999999999987
deviation-center-line_median0.41358961414027445
in-drivable-lane_median0


other stats
agent_compute-ego_max0.049538255411352816
agent_compute-ego_mean0.04132215008770841
agent_compute-ego_median0.040634373823801674
agent_compute-ego_min0.03748617569605509
deviation-center-line_max0.7629611300290748
deviation-center-line_mean0.4297239048642501
deviation-center-line_min0.11933776416791785
deviation-heading_max2.622648093039184
deviation-heading_mean1.5510385113238054
deviation-heading_median1.651086043203726
deviation-heading_min0.5527086032336098
driven_any_max3.770741885421118
driven_any_mean2.3242395724880223
driven_any_median2.2038755668691756
driven_any_min1.2561534803215757
driven_lanedir_consec_max3.681721550959903
driven_lanedir_consec_mean2.2420089572713353
driven_lanedir_consec_min1.2063674823320365
driven_lanedir_max3.681721550959903
driven_lanedir_mean2.2420089572713353
driven_lanedir_median2.0871847413107125
driven_lanedir_min1.2063674823320365
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3380962869063042, "sim_physics": 0.1070250499816168, "survival_time": 4.199999999999993, "driven_lanedir": 1.3190655685281802, "sim_render-ego": 0.012512686706724622, "in-drivable-lane": 0, "agent_compute-ego": 0.03748617569605509, "deviation-heading": 0.5527086032336098, "set_robot_commands": 0.010050816195351735, "deviation-center-line": 0.11933776416791785, "driven_lanedir_consec": 1.3190655685281802, "sim_compute_sim_state": 0.005060337838672456, "sim_compute_performance-ego": 0.007316725594656808, "sim_compute_robot_state-ego": 0.008431145123073034}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2561534803215757, "sim_physics": 0.13761452321083317, "survival_time": 3.099999999999997, "driven_lanedir": 1.2063674823320365, "sim_render-ego": 0.01440821155425041, "in-drivable-lane": 0, "agent_compute-ego": 0.038273984386074926, "deviation-heading": 0.7624844961540521, "set_robot_commands": 0.011518947539790984, "deviation-center-line": 0.21146014035572452, "driven_lanedir_consec": 1.2063674823320365, "sim_compute_sim_state": 0.005736424076941705, "sim_compute_performance-ego": 0.008314009635679184, "sim_compute_robot_state-ego": 0.01029331837930987}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.770741885421118, "sim_physics": 0.11664327462514242, "survival_time": 14.950000000000076, "driven_lanedir": 3.681721550959903, "sim_render-ego": 0.01344946543375651, "in-drivable-lane": 0, "agent_compute-ego": 0.040634373823801674, "deviation-heading": 2.622648093039184, "set_robot_commands": 0.010888485113779704, "deviation-center-line": 0.7629611300290748, "driven_lanedir_consec": 3.681721550959903, "sim_compute_sim_state": 0.005394868850708008, "sim_compute_performance-ego": 0.008001729647318523, "sim_compute_robot_state-ego": 0.010193336804707845}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.052330642921938, "sim_physics": 0.14059742965267202, "survival_time": 8.84999999999999, "driven_lanedir": 2.915705443225845, "sim_render-ego": 0.014642622511265642, "in-drivable-lane": 0, "agent_compute-ego": 0.049538255411352816, "deviation-heading": 2.1662653209884555, "set_robot_commands": 0.011628934892557436, "deviation-center-line": 0.6412708756282588, "driven_lanedir_consec": 2.915705443225845, "sim_compute_sim_state": 0.005581444939651058, "sim_compute_performance-ego": 0.008756400501660709, "sim_compute_robot_state-ego": 0.010701354614085397}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2038755668691756, "sim_physics": 0.12058894247071356, "survival_time": 5.849999999999987, "driven_lanedir": 2.0871847413107125, "sim_render-ego": 0.013580293736906134, "in-drivable-lane": 0, "agent_compute-ego": 0.04067796112125755, "deviation-heading": 1.651086043203726, "set_robot_commands": 0.010766815935444629, "deviation-center-line": 0.41358961414027445, "driven_lanedir_consec": 2.0871847413107125, "sim_compute_sim_state": 0.00537317023318038, "sim_compute_performance-ego": 0.00795898682031876, "sim_compute_robot_state-ego": 0.009694509017161831}}
set_robot_commands_max0.011628934892557436
set_robot_commands_mean0.0109707999353849
set_robot_commands_median0.010888485113779704
set_robot_commands_min0.010050816195351735
sim_compute_performance-ego_max0.008756400501660709
sim_compute_performance-ego_mean0.008069570439926798
sim_compute_performance-ego_median0.008001729647318523
sim_compute_performance-ego_min0.007316725594656808
sim_compute_robot_state-ego_max0.010701354614085397
sim_compute_robot_state-ego_mean0.009862732787667595
sim_compute_robot_state-ego_median0.010193336804707845
sim_compute_robot_state-ego_min0.008431145123073034
sim_compute_sim_state_max0.005736424076941705
sim_compute_sim_state_mean0.005429249187830722
sim_compute_sim_state_median0.005394868850708008
sim_compute_sim_state_min0.005060337838672456
sim_physics_max0.14059742965267202
sim_physics_mean0.1244938439881956
sim_physics_median0.12058894247071356
sim_physics_min0.1070250499816168
sim_render-ego_max0.014642622511265642
sim_render-ego_mean0.013718655988580663
sim_render-ego_median0.013580293736906134
sim_render-ego_min0.012512686706724622
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.3900000000000095
survival_time_min3.099999999999997
No reset possible
301164454Bea Baselines 🐤challenge-aido_LF-baseline-duckietownaido3-LFV-real-validationeval2-visualizehost-errornoip-172-31-35-218-104900:08:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1420, in download_artefacts
    copy_to_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
301116139Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.646656015733202
survival_time_median10.800000000000018
deviation-center-line_median0.5681774786606195
in-drivable-lane_median0


other stats
agent_compute-ego_max0.022468557680286647
agent_compute-ego_mean0.021942746111197564
agent_compute-ego_median0.02189826806386312
agent_compute-ego_min0.02146113452626698
deviation-center-line_max0.8017445309114587
deviation-center-line_mean0.5530148586215098
deviation-center-line_min0.23667274468612323
deviation-heading_max3.737757157450798
deviation-heading_mean2.3700133855907377
deviation-heading_median2.593221971991441
deviation-heading_min0.8680815142781174
driven_any_max4.160389192356546
driven_any_mean3.1129471137856064
driven_any_median3.292507282019598
driven_any_min1.1587614040925451
driven_lanedir_consec_max4.065755660309286
driven_lanedir_consec_mean2.848541409683827
driven_lanedir_consec_min1.1093561030980916
driven_lanedir_max4.065755660309286
driven_lanedir_mean2.848541409683827
driven_lanedir_median2.646656015733202
driven_lanedir_min1.1093561030980916
in-drivable-lane_max1.65000000000002
in-drivable-lane_mean0.40000000000000496
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.888643612250293, "sim_physics": 0.06006167015591681, "survival_time": 10.350000000000012, "driven_lanedir": 2.646656015733202, "sim_render-ego": 0.007450706141006544, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.022468557680286647, "deviation-heading": 1.879663277808796, "set_robot_commands": 0.005545304017366418, "deviation-center-line": 0.4780514876943998, "driven_lanedir_consec": 2.646656015733202, "sim_compute_sim_state": 0.003124315381626, "sim_compute_performance-ego": 0.0044181105019389716, "sim_compute_robot_state-ego": 0.005730147523004651}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1587614040925451, "sim_physics": 0.05941458958298413, "survival_time": 3.349999999999996, "driven_lanedir": 1.1093561030980916, "sim_render-ego": 0.007647489433857932, "in-drivable-lane": 0, "agent_compute-ego": 0.02146113452626698, "deviation-heading": 0.8680815142781174, "set_robot_commands": 0.005474030081905536, "deviation-center-line": 0.23667274468612323, "driven_lanedir_consec": 1.1093561030980916, "sim_compute_sim_state": 0.0029865414349000844, "sim_compute_performance-ego": 0.00427281322763927, "sim_compute_robot_state-ego": 0.005216196401795345}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.160389192356546, "sim_physics": 0.05773397922515869, "survival_time": 14.950000000000076, "driven_lanedir": 4.065755660309286, "sim_render-ego": 0.007475229104359945, "in-drivable-lane": 0, "agent_compute-ego": 0.02214020331700643, "deviation-heading": 2.593221971991441, "set_robot_commands": 0.005607342720031739, "deviation-center-line": 0.6804280511549476, "driven_lanedir_consec": 4.065755660309286, "sim_compute_sim_state": 0.003141937255859375, "sim_compute_performance-ego": 0.004314719041188558, "sim_compute_robot_state-ego": 0.005358600616455078}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.292507282019598, "sim_physics": 0.05860220613303008, "survival_time": 10.800000000000018, "driven_lanedir": 2.519358795197169, "sim_render-ego": 0.007517094965334292, "in-drivable-lane": 1.65000000000002, "agent_compute-ego": 0.021745566968564636, "deviation-heading": 2.7713430064245377, "set_robot_commands": 0.005529288892392759, "deviation-center-line": 0.5681774786606195, "driven_lanedir_consec": 2.519358795197169, "sim_compute_sim_state": 0.003032347670307866, "sim_compute_performance-ego": 0.004293023436157791, "sim_compute_robot_state-ego": 0.0052101148499382865}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.064434078209049, "sim_physics": 0.05947863340377808, "survival_time": 14.950000000000076, "driven_lanedir": 3.901580474081386, "sim_render-ego": 0.007513168652852376, "in-drivable-lane": 0, "agent_compute-ego": 0.02189826806386312, "deviation-heading": 3.737757157450798, "set_robot_commands": 0.005477219422658284, "deviation-center-line": 0.8017445309114587, "driven_lanedir_consec": 3.901580474081386, "sim_compute_sim_state": 0.0031262834866841636, "sim_compute_performance-ego": 0.004316416581471761, "sim_compute_robot_state-ego": 0.005310266812642415}}
set_robot_commands_max0.005607342720031739
set_robot_commands_mean0.005526637026870947
set_robot_commands_median0.005529288892392759
set_robot_commands_min0.005474030081905536
sim_compute_performance-ego_max0.0044181105019389716
sim_compute_performance-ego_mean0.00432301655767927
sim_compute_performance-ego_median0.004314719041188558
sim_compute_performance-ego_min0.00427281322763927
sim_compute_robot_state-ego_max0.005730147523004651
sim_compute_robot_state-ego_mean0.005365065240767155
sim_compute_robot_state-ego_median0.005310266812642415
sim_compute_robot_state-ego_min0.0052101148499382865
sim_compute_sim_state_max0.003141937255859375
sim_compute_sim_state_mean0.0030822850458754976
sim_compute_sim_state_median0.003124315381626
sim_compute_sim_state_min0.0029865414349000844
sim_physics_max0.06006167015591681
sim_physics_mean0.059058215700173555
sim_physics_median0.05941458958298413
sim_physics_min0.05773397922515869
sim_render-ego_max0.007647489433857932
sim_render-ego_mean0.007520737659482218
sim_render-ego_median0.007513168652852376
sim_render-ego_min0.007450706141006544
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.880000000000036
survival_time_min3.349999999999996
No reset possible
301086135Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8316707968510664
survival_time_median5.999999999999987
deviation-center-line_median0.3455111055038667
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.022450166412546664
agent_compute-ego_mean0.021989524937258222
agent_compute-ego_median0.021931151549021404
agent_compute-ego_min0.021601600411497515
deviation-center-line_max0.9189296870682924
deviation-center-line_mean0.429253499277286
deviation-center-line_min0.18528892988974704
deviation-heading_max2.9579415825276074
deviation-heading_mean1.648439523106053
deviation-heading_median1.6782539744147575
deviation-heading_min0.8239147974533532
driven_any_max5.016106099334403
driven_any_mean2.631411213374423
driven_any_median2.4954201840327617
driven_any_min1.2496202637385103
driven_lanedir_consec_max4.859820886427468
driven_lanedir_consec_mean2.355053658332185
driven_lanedir_consec_min0.9295067960231498
driven_lanedir_max4.859820886427468
driven_lanedir_mean2.355053658332185
driven_lanedir_median1.8316707968510664
driven_lanedir_min0.9295067960231498
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.35999999999999893
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2822239643474893, "sim_physics": 0.06003741372989703, "survival_time": 3.949999999999994, "driven_lanedir": 1.2332843462805791, "sim_render-ego": 0.007676833792577816, "in-drivable-lane": 0, "agent_compute-ego": 0.022450166412546664, "deviation-heading": 0.8239147974533532, "set_robot_commands": 0.00559926636611359, "deviation-center-line": 0.18528892988974704, "driven_lanedir_consec": 1.2332843462805791, "sim_compute_sim_state": 0.00317439248290243, "sim_compute_performance-ego": 0.004411540453947043, "sim_compute_robot_state-ego": 0.005435976801039298}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2496202637385103, "sim_physics": 0.06139149588923301, "survival_time": 3.099999999999997, "driven_lanedir": 0.9295067960231498, "sim_render-ego": 0.007577227007958197, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.02223567808828046, "deviation-heading": 0.9745725757920186, "set_robot_commands": 0.00562317140640751, "deviation-center-line": 0.20521023962261287, "driven_lanedir_consec": 0.9295067960231498, "sim_compute_sim_state": 0.0032830892070647207, "sim_compute_performance-ego": 0.0043494047657136, "sim_compute_robot_state-ego": 0.005534875777459914}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.016106099334403, "sim_physics": 0.058572608629862466, "survival_time": 14.950000000000076, "driven_lanedir": 4.859820886427468, "sim_render-ego": 0.007428719997406006, "in-drivable-lane": 0, "agent_compute-ego": 0.021729028224945067, "deviation-heading": 2.9579415825276074, "set_robot_commands": 0.0055240273475646974, "deviation-center-line": 0.9189296870682924, "driven_lanedir_consec": 4.859820886427468, "sim_compute_sim_state": 0.003155895074208578, "sim_compute_performance-ego": 0.00431751807530721, "sim_compute_robot_state-ego": 0.005345911184946696}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1136855554189498, "sim_physics": 0.05755304260018431, "survival_time": 8.09999999999998, "driven_lanedir": 2.9209854660786623, "sim_render-ego": 0.007469826274447971, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.021601600411497515, "deviation-heading": 1.6782539744147575, "set_robot_commands": 0.005483780378176842, "deviation-center-line": 0.4913275343019112, "driven_lanedir_consec": 2.9209854660786623, "sim_compute_sim_state": 0.003103225319473832, "sim_compute_performance-ego": 0.0043127566208074125, "sim_compute_robot_state-ego": 0.005202032901622631}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4954201840327617, "sim_physics": 0.05946465929349264, "survival_time": 5.999999999999987, "driven_lanedir": 1.8316707968510664, "sim_render-ego": 0.0076661229133605955, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.021931151549021404, "deviation-heading": 1.8075146853425277, "set_robot_commands": 0.005540510018666585, "deviation-center-line": 0.3455111055038667, "driven_lanedir_consec": 1.8316707968510664, "sim_compute_sim_state": 0.003119528293609619, "sim_compute_performance-ego": 0.004323989152908325, "sim_compute_robot_state-ego": 0.005395579338073731}}
set_robot_commands_max0.00562317140640751
set_robot_commands_mean0.005554151103385844
set_robot_commands_median0.005540510018666585
set_robot_commands_min0.005483780378176842
sim_compute_performance-ego_max0.004411540453947043
sim_compute_performance-ego_mean0.004343041813736718
sim_compute_performance-ego_median0.004323989152908325
sim_compute_performance-ego_min0.0043127566208074125
sim_compute_robot_state-ego_max0.005534875777459914
sim_compute_robot_state-ego_mean0.0053828752006284545
sim_compute_robot_state-ego_median0.005395579338073731
sim_compute_robot_state-ego_min0.005202032901622631
sim_compute_sim_state_max0.0032830892070647207
sim_compute_sim_state_mean0.0031672260754518357
sim_compute_sim_state_median0.003155895074208578
sim_compute_sim_state_min0.003103225319473832
sim_physics_max0.06139149588923301
sim_physics_mean0.059403844028533895
sim_physics_median0.05946465929349264
sim_physics_min0.05755304260018431
sim_render-ego_max0.007676833792577816
sim_render-ego_mean0.007563745997150116
sim_render-ego_median0.007577227007958197
sim_render-ego_min0.007428719997406006
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.220000000000008
survival_time_min3.099999999999997
No reset possible
301036133Dhaivat Bhatt 🇨🇦whattheduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9031430950148976
survival_time_median7.449999999999981
deviation-center-line_median0.430960355421212
in-drivable-lane_median0.4000000000000057


other stats
agent_compute-ego_max0.04799495204802482
agent_compute-ego_mean0.04030945577817104
agent_compute-ego_median0.04301831086476643
agent_compute-ego_min0.02625215773614461
deviation-center-line_max1.3813754071467663
deviation-center-line_mean0.6743981336560815
deviation-center-line_min0.10984042435731786
deviation-heading_max6.599040739220574
deviation-heading_mean2.310760747203721
deviation-heading_median1.538445019177645
deviation-heading_min0.30629408655464047
driven_any_max3.1462882280296776
driven_any_mean1.6811959517598898
driven_any_median1.021715240995969
driven_any_min0.553473269047608
driven_lanedir_consec_max2.5903816235585073
driven_lanedir_consec_mean1.4180827324101468
driven_lanedir_consec_min0.5393015126701599
driven_lanedir_max2.5903816235585073
driven_lanedir_mean1.44111497261875
driven_lanedir_median0.9031430950148976
driven_lanedir_min0.5393015126701599
in-drivable-lane_max5.050000000000032
in-drivable-lane_mean1.4700000000000062
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.021715240995969, "sim_physics": 0.06311833458458817, "survival_time": 7.449999999999981, "driven_lanedir": 0.6692204711468297, "sim_render-ego": 0.007901570940977775, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.02625215773614461, "deviation-heading": 2.7055388133302785, "set_robot_commands": 0.006556026087511306, "deviation-center-line": 0.430960355421212, "driven_lanedir_consec": 0.6692204711468297, "sim_compute_sim_state": 0.0036228759176779113, "sim_compute_performance-ego": 0.00468383539443048, "sim_compute_robot_state-ego": 0.005543774406381902}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9079250040282252, "sim_physics": 0.07533175714554326, "survival_time": 3.099999999999997, "driven_lanedir": 0.9031430950148976, "sim_render-ego": 0.00913260829064154, "in-drivable-lane": 0, "agent_compute-ego": 0.04799495204802482, "deviation-heading": 0.30629408655464047, "set_robot_commands": 0.006892369639488959, "deviation-center-line": 0.30974084567666965, "driven_lanedir_consec": 0.9031430950148976, "sim_compute_sim_state": 0.003896397929037771, "sim_compute_performance-ego": 0.005411517235540574, "sim_compute_robot_state-ego": 0.0065787569169075254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1462882280296776, "sim_physics": 0.08827240308125814, "survival_time": 14.950000000000076, "driven_lanedir": 2.5903816235585073, "sim_render-ego": 0.01034231185913086, "in-drivable-lane": 5.050000000000032, "agent_compute-ego": 0.04051239569981893, "deviation-heading": 1.538445019177645, "set_robot_commands": 0.008163702487945557, "deviation-center-line": 1.140073635678441, "driven_lanedir_consec": 2.5903816235585073, "sim_compute_sim_state": 0.004254268805185954, "sim_compute_performance-ego": 0.0067636466026306154, "sim_compute_robot_state-ego": 0.007845058441162109}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.553473269047608, "sim_physics": 0.09871134974739768, "survival_time": 2.2, "driven_lanedir": 0.5393015126701599, "sim_render-ego": 0.0118291052904996, "in-drivable-lane": 0, "agent_compute-ego": 0.04376946254210039, "deviation-heading": 0.4044850777354676, "set_robot_commands": 0.008854773911562834, "deviation-center-line": 0.10984042435731786, "driven_lanedir_consec": 0.5393015126701599, "sim_compute_sim_state": 0.004645011641762473, "sim_compute_performance-ego": 0.0068711204962296915, "sim_compute_robot_state-ego": 0.008347159082239325}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.776578016697969, "sim_physics": 0.0859031343460083, "survival_time": 14.950000000000076, "driven_lanedir": 2.503528160703356, "sim_render-ego": 0.010726656119028727, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.04301831086476643, "deviation-heading": 6.599040739220574, "set_robot_commands": 0.008423770268758138, "deviation-center-line": 1.3813754071467663, "driven_lanedir_consec": 2.3883669596603405, "sim_compute_sim_state": 0.004384733041127522, "sim_compute_performance-ego": 0.006427511374155681, "sim_compute_robot_state-ego": 0.008041602770487467}}
set_robot_commands_max0.008854773911562834
set_robot_commands_mean0.007778128479053359
set_robot_commands_median0.008163702487945557
set_robot_commands_min0.006556026087511306
sim_compute_performance-ego_max0.0068711204962296915
sim_compute_performance-ego_mean0.006031526220597408
sim_compute_performance-ego_median0.006427511374155681
sim_compute_performance-ego_min0.00468383539443048
sim_compute_robot_state-ego_max0.008347159082239325
sim_compute_robot_state-ego_mean0.007271270323435666
sim_compute_robot_state-ego_median0.007845058441162109
sim_compute_robot_state-ego_min0.005543774406381902
sim_compute_sim_state_max0.004645011641762473
sim_compute_sim_state_mean0.004160657466958326
sim_compute_sim_state_median0.004254268805185954
sim_compute_sim_state_min0.0036228759176779113
sim_physics_max0.09871134974739768
sim_physics_mean0.08226739578095912
sim_physics_median0.0859031343460083
sim_physics_min0.06311833458458817
sim_render-ego_max0.0118291052904996
sim_render-ego_mean0.0099864505000557
sim_render-ego_median0.01034231185913086
sim_render-ego_min0.007901570940977775
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.530000000000026
survival_time_min2.2
No reset possible
300836122Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:21:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.425494259860701
survival_time_median9.5
deviation-center-line_median0.4239470345054308
in-drivable-lane_median1.7999999999999936


other stats
agent_compute-ego_max0.04475794399485868
agent_compute-ego_mean0.038399351138560495
agent_compute-ego_median0.03887866814931234
agent_compute-ego_min0.027019924587673612
deviation-center-line_max0.8499675644727503
deviation-center-line_mean0.4862193632351901
deviation-center-line_min0.15763173188726828
deviation-heading_max3.3589981226330092
deviation-heading_mean2.043832619954494
deviation-heading_median1.7024737794782685
deviation-heading_min0.3557033964964862
driven_any_max3.0640987848461565
driven_any_mean1.9914634443190975
driven_any_median1.921549087193436
driven_any_min0.8209585423605072
driven_lanedir_consec_max2.8305246151589825
driven_lanedir_consec_mean1.4879916774804174
driven_lanedir_consec_min0.2404000347898476
driven_lanedir_max2.8305246151589825
driven_lanedir_mean1.4880058979278838
driven_lanedir_median1.425494259860701
driven_lanedir_min0.2404000347898476
in-drivable-lane_max4.3000000000000265
in-drivable-lane_mean1.98333333333334
in-drivable-lane_min0.6499999999999977
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0520679396042671, "sim_physics": 0.0803537611608152, "survival_time": 5.399999999999989, "driven_lanedir": 0.7417707115153395, "sim_render-ego": 0.010159591833750406, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.027019924587673612, "deviation-heading": 2.0459793644593907, "set_robot_commands": 0.009769338148611565, "deviation-center-line": 0.1976973008506172, "driven_lanedir_consec": 0.7417707115153395, "sim_compute_sim_state": 0.004435062408447266, "sim_compute_performance-ego": 0.006067808027620669, "sim_compute_robot_state-ego": 0.006936073303222656}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.064069640765819, "sim_physics": 0.0816084345181783, "survival_time": 14.950000000000076, "driven_lanedir": 2.3331919380646684, "sim_render-ego": 0.01000447670618693, "in-drivable-lane": 3.000000000000017, "agent_compute-ego": 0.03842641750971476, "deviation-heading": 2.948022418104234, "set_robot_commands": 0.0075818228721618655, "deviation-center-line": 0.7977651199194614, "driven_lanedir_consec": 2.3331919380646684, "sim_compute_sim_state": 0.004083190759023031, "sim_compute_performance-ego": 0.0058216110865275065, "sim_compute_robot_state-ego": 0.007182451883951823}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0934762361885344, "sim_physics": 0.08335266242156157, "survival_time": 5.549999999999988, "driven_lanedir": 0.47820445880823104, "sim_render-ego": 0.010229353432182791, "in-drivable-lane": 2.3999999999999924, "agent_compute-ego": 0.03744520582594313, "deviation-heading": 1.5981952759279243, "set_robot_commands": 0.007702034872931403, "deviation-center-line": 0.292173175001725, "driven_lanedir_consec": 0.47820445880823104, "sim_compute_sim_state": 0.004254918914657456, "sim_compute_performance-ego": 0.006083219974964588, "sim_compute_robot_state-ego": 0.00722165365476866}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0640987848461565, "sim_physics": 0.09076183319091796, "survival_time": 14.950000000000076, "driven_lanedir": 2.015796850875597, "sim_render-ego": 0.01103945016860962, "in-drivable-lane": 4.3000000000000265, "agent_compute-ego": 0.04055578311284383, "deviation-heading": 3.304568813884144, "set_robot_commands": 0.0088261079788208, "deviation-center-line": 0.8499675644727503, "driven_lanedir_consec": 2.015796850875597, "sim_compute_sim_state": 0.004514674345652263, "sim_compute_performance-ego": 0.006509931087493897, "sim_compute_robot_state-ego": 0.0079441769917806}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.906820309632176, "sim_physics": 0.08523479649718378, "survival_time": 14.200000000000069, "driven_lanedir": 2.518228825116179, "sim_render-ego": 0.010144504862771908, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.03894958697574239, "deviation-heading": 3.3589981226330092, "set_robot_commands": 0.007783247551447908, "deviation-center-line": 0.6040960952565861, "driven_lanedir_consec": 2.5180155184041855, "sim_compute_sim_state": 0.004319898679222859, "sim_compute_performance-ego": 0.00613870167396438, "sim_compute_robot_state-ego": 0.00748841191681338}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.2192707391246516, "sim_physics": 0.08362606288940926, "survival_time": 6.149999999999986, "driven_lanedir": 0.8112142069055839, "sim_render-ego": 0.01053334057815676, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.03874050310956753, "deviation-heading": 0.9396079179411928, "set_robot_commands": 0.00761061955273636, "deviation-center-line": 0.19741151535431056, "driven_lanedir_consec": 0.8112142069055839, "sim_compute_sim_state": 0.004136294853396532, "sim_compute_performance-ego": 0.006122364261286046, "sim_compute_robot_state-ego": 0.007662633570229135}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.921549087193436, "sim_physics": 0.0876877784729004, "survival_time": 9.5, "driven_lanedir": 1.425494259860701, "sim_render-ego": 0.011170704741227, "in-drivable-lane": 2.1000000000000183, "agent_compute-ego": 0.04041003678974352, "deviation-heading": 1.7024737794782685, "set_robot_commands": 0.008939864760950992, "deviation-center-line": 0.4239470345054308, "driven_lanedir_consec": 1.425494259860701, "sim_compute_sim_state": 0.004548491929706774, "sim_compute_performance-ego": 0.0064663861927233245, "sim_compute_robot_state-ego": 0.00824432373046875}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.0640673228902995, "sim_physics": 0.0869473131497701, "survival_time": 14.950000000000076, "driven_lanedir": 2.8305246151589825, "sim_render-ego": 0.010683645407358803, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.03959369421005249, "deviation-heading": 2.941530112245962, "set_robot_commands": 0.00839457352956136, "deviation-center-line": 0.7919692784253944, "driven_lanedir_consec": 2.8305246151589825, "sim_compute_sim_state": 0.0043050678571065265, "sim_compute_performance-ego": 0.006233117580413818, "sim_compute_robot_state-ego": 0.007603209018707275}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.068291549756119, "sim_physics": 0.08127467889411777, "survival_time": 10.20000000000001, "driven_lanedir": 1.600129449264748, "sim_render-ego": 0.01014045757405898, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.03755128967995737, "deviation-heading": 2.4065086264623945, "set_robot_commands": 0.007711650109758564, "deviation-center-line": 0.5503284698773443, "driven_lanedir_consec": 1.600129449264748, "sim_compute_sim_state": 0.00408104237388162, "sim_compute_performance-ego": 0.0060506159184025785, "sim_compute_robot_state-ego": 0.007494710239709592}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.7119102297413318, "sim_physics": 0.1071251392364502, "survival_time": 8.499999999999986, "driven_lanedir": 1.2889870906534004, "sim_render-ego": 0.012673917938681207, "in-drivable-lane": 1.7500000000000018, "agent_compute-ego": 0.04475794399485868, "deviation-heading": 1.4379356484774708, "set_robot_commands": 0.010045205845552333, "deviation-center-line": 0.26819755855969646, "driven_lanedir_consec": 1.2889870906534004, "sim_compute_sim_state": 0.004995340459487017, "sim_compute_performance-ego": 0.007415671909556669, "sim_compute_robot_state-ego": 0.00915662681355196}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.12492519365456, "sim_physics": 0.08608285376900121, "survival_time": 5.699999999999988, "driven_lanedir": 0.4745187456839496, "sim_render-ego": 0.013084811076783297, "in-drivable-lane": 2.699999999999994, "agent_compute-ego": 0.0372245332650971, "deviation-heading": 1.534358968840691, "set_robot_commands": 0.007983766104045668, "deviation-center-line": 0.32611326915950717, "driven_lanedir_consec": 0.4745187456839496, "sim_compute_sim_state": 0.004411011411432634, "sim_compute_performance-ego": 0.00606767545666611, "sim_compute_robot_state-ego": 0.007612667585674085}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.8209585423605072, "sim_physics": 0.08868940577787511, "survival_time": 4.249999999999993, "driven_lanedir": 0.2404000347898476, "sim_render-ego": 0.010590629016651826, "in-drivable-lane": 2.699999999999992, "agent_compute-ego": 0.03912980416241814, "deviation-heading": 0.3557033964964862, "set_robot_commands": 0.008164661070879767, "deviation-center-line": 0.15763173188726828, "driven_lanedir_consec": 0.2404000347898476, "sim_compute_sim_state": 0.0045598366681267235, "sim_compute_performance-ego": 0.006334672254674575, "sim_compute_robot_state-ego": 0.007657168893253102}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 3.0640785773234493, "sim_physics": 0.08051356871922812, "survival_time": 14.950000000000076, "driven_lanedir": 2.4975582903155424, "sim_render-ego": 0.010465788841247558, "in-drivable-lane": 2.2000000000000037, "agent_compute-ego": 0.03887866814931234, "deviation-heading": 2.8560274665862297, "set_robot_commands": 0.008191653887430827, "deviation-center-line": 0.7434040749854016, "driven_lanedir_consec": 2.4975582903155424, "sim_compute_sim_state": 0.004414378007253011, "sim_compute_performance-ego": 0.006187401612599691, "sim_compute_robot_state-ego": 0.007797800699869792}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.4812975460423667, "sim_physics": 0.0850479296735815, "survival_time": 7.399999999999982, "driven_lanedir": 1.2417780117845034, "sim_render-ego": 0.009971898955267828, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0379889736304412, "deviation-heading": 1.553554264978296, "set_robot_commands": 0.007476550501746101, "deviation-center-line": 0.6965184960381715, "driven_lanedir_consec": 1.2417780117845034, "sim_compute_sim_state": 0.004070188548113848, "sim_compute_performance-ego": 0.005842237859158902, "sim_compute_robot_state-ego": 0.0073312359887200435}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.215069965662784, "sim_physics": 0.0942855646850866, "survival_time": 10.90000000000002, "driven_lanedir": 1.8222909801209872, "sim_render-ego": 0.01110663763973691, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.03931790207504132, "deviation-heading": 1.674025122801721, "set_robot_commands": 0.008670671270527971, "deviation-center-line": 0.3960697642341848, "driven_lanedir_consec": 1.8222909801209872, "sim_compute_sim_state": 0.004559042256906492, "sim_compute_performance-ego": 0.006479780608360921, "sim_compute_robot_state-ego": 0.008069296495630107}}
set_robot_commands_max0.010045205845552333
set_robot_commands_mean0.0083234512038109
set_robot_commands_median0.008164661070879767
set_robot_commands_min0.007476550501746101
sim_compute_performance-ego_max0.007415671909556669
sim_compute_performance-ego_mean0.006254746366960912
sim_compute_performance-ego_median0.00613870167396438
sim_compute_performance-ego_min0.0058216110865275065
sim_compute_robot_state-ego_max0.00915662681355196
sim_compute_robot_state-ego_mean0.007693496052423397
sim_compute_robot_state-ego_median0.007612667585674085
sim_compute_robot_state-ego_min0.006936073303222656
sim_compute_sim_state_max0.004995340459487017
sim_compute_sim_state_mean0.004379229298160937
sim_compute_sim_state_median0.004411011411432634
sim_compute_sim_state_min0.004070188548113848
sim_physics_max0.1071251392364502
sim_physics_mean0.0868394522037385
sim_physics_median0.08523479649718378
sim_physics_min0.0803537611608152
sim_render-ego_max0.013084811076783297
sim_render-ego_mean0.010799947251511456
sim_render-ego_median0.01053334057815676
sim_render-ego_min0.009971898955267828
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.836666666666686
survival_time_min4.249999999999993
No reset possible
300766126Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.657268370368318
survival_time_median8.699999999999989
deviation-center-line_median0.4106081544874232
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03074546868984516
agent_compute-ego_mean0.026376787943558334
agent_compute-ego_median0.02625786087342671
agent_compute-ego_min0.02195296436548233
deviation-center-line_max0.6308034373734375
deviation-center-line_mean0.4137048799219407
deviation-center-line_min0.14141394077339722
deviation-heading_max3.4374180511369428
deviation-heading_mean2.006356666836832
deviation-heading_median1.8657482352414616
deviation-heading_min0.7735672160636996
driven_any_max3.9403010851911286
driven_any_mean2.679609467391972
driven_any_median3.362894683976199
driven_any_min1.2857844104995897
driven_lanedir_consec_max3.7820338332374344
driven_lanedir_consec_mean2.3852140602040173
driven_lanedir_consec_min1.2136895467968138
driven_lanedir_max3.7820338332374344
driven_lanedir_mean2.3852140602040173
driven_lanedir_median2.657268370368318
driven_lanedir_min1.2136895467968138
in-drivable-lane_max1.2999999999999965
in-drivable-lane_mean0.3700000000000008
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.373802950467269, "sim_physics": 0.06346477901234346, "survival_time": 4.249999999999993, "driven_lanedir": 1.327776709809096, "sim_render-ego": 0.007754227694343118, "in-drivable-lane": 0, "agent_compute-ego": 0.02275668032029096, "deviation-heading": 0.7735672160636996, "set_robot_commands": 0.005729375166051528, "deviation-center-line": 0.14141394077339722, "driven_lanedir_consec": 1.327776709809096, "sim_compute_sim_state": 0.003212429495418773, "sim_compute_performance-ego": 0.004653181749231675, "sim_compute_robot_state-ego": 0.0056448487674488745}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2857844104995897, "sim_physics": 0.05958211421966553, "survival_time": 3.1999999999999966, "driven_lanedir": 1.2136895467968138, "sim_render-ego": 0.007556177675724029, "in-drivable-lane": 0, "agent_compute-ego": 0.02195296436548233, "deviation-heading": 0.9162288835920332, "set_robot_commands": 0.0056518688797950745, "deviation-center-line": 0.2667684577102693, "driven_lanedir_consec": 1.2136895467968138, "sim_compute_sim_state": 0.0031172409653663635, "sim_compute_performance-ego": 0.004387121647596359, "sim_compute_robot_state-ego": 0.005340211093425751}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.362894683976199, "sim_physics": 0.06899240293673106, "survival_time": 11.200000000000024, "driven_lanedir": 2.945301840808424, "sim_render-ego": 0.008921243250370026, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.02625786087342671, "deviation-heading": 3.038820948150023, "set_robot_commands": 0.006782500871590206, "deviation-center-line": 0.6189304092651766, "driven_lanedir_consec": 2.945301840808424, "sim_compute_sim_state": 0.003542558423110417, "sim_compute_performance-ego": 0.005143515765666962, "sim_compute_robot_state-ego": 0.00639506322996957}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4352642068256736, "sim_physics": 0.0848401456043638, "survival_time": 8.699999999999989, "driven_lanedir": 2.657268370368318, "sim_render-ego": 0.010160433834996718, "in-drivable-lane": 1.2999999999999965, "agent_compute-ego": 0.03017096546874649, "deviation-heading": 1.8657482352414616, "set_robot_commands": 0.007896119150622138, "deviation-center-line": 0.4106081544874232, "driven_lanedir_consec": 2.657268370368318, "sim_compute_sim_state": 0.00421971014176292, "sim_compute_performance-ego": 0.005890661272509345, "sim_compute_robot_state-ego": 0.007545040941786492}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.9403010851911286, "sim_physics": 0.08474017931864812, "survival_time": 13.00000000000005, "driven_lanedir": 3.7820338332374344, "sim_render-ego": 0.010187155466813308, "in-drivable-lane": 0, "agent_compute-ego": 0.03074546868984516, "deviation-heading": 3.4374180511369428, "set_robot_commands": 0.008502727288466233, "deviation-center-line": 0.6308034373734375, "driven_lanedir_consec": 3.7820338332374344, "sim_compute_sim_state": 0.0042999872794518106, "sim_compute_performance-ego": 0.005849899695469783, "sim_compute_robot_state-ego": 0.007351228824028602}}
set_robot_commands_max0.008502727288466233
set_robot_commands_mean0.006912518271305036
set_robot_commands_median0.006782500871590206
set_robot_commands_min0.0056518688797950745
sim_compute_performance-ego_max0.005890661272509345
sim_compute_performance-ego_mean0.005184876026094826
sim_compute_performance-ego_median0.005143515765666962
sim_compute_performance-ego_min0.004387121647596359
sim_compute_robot_state-ego_max0.007545040941786492
sim_compute_robot_state-ego_mean0.006455278571331857
sim_compute_robot_state-ego_median0.00639506322996957
sim_compute_robot_state-ego_min0.005340211093425751
sim_compute_sim_state_max0.0042999872794518106
sim_compute_sim_state_mean0.003678385261022057
sim_compute_sim_state_median0.003542558423110417
sim_compute_sim_state_min0.0031172409653663635
sim_physics_max0.0848401456043638
sim_physics_mean0.0723239242183504
sim_physics_median0.06899240293673106
sim_physics_min0.05958211421966553
sim_render-ego_max0.010187155466813308
sim_render-ego_mean0.00891584758444944
sim_render-ego_median0.008921243250370026
sim_render-ego_min0.007556177675724029
simulation-passed1
survival_time_max13.00000000000005
survival_time_mean8.070000000000011
survival_time_min3.1999999999999966
No reset possible
300664454Bea Baselines 🐤challenge-aido_LF-baseline-duckietownaido3-LFV-real-validationeval1-visualizesuccessnoip-172-31-35-218-104900:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec5.177529881592954
survival_time42.6666
deviation-center-line2.711874361205504
in-drivable-lane0


other stats
deviation-heading7.070049299697855
driven_any5.288640134014538
driven_lanedir5.177529881592954
visualized-eval1-passed1
No reset possible
300235976c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval1-videossuccessnoip-172-31-35-218-104900:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
300216105Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1140146900712409
survival_time_median10.050000000000008
deviation-center-line_median0.33471721195798526
in-drivable-lane_median1.4500000000000206


other stats
agent_compute-ego_max0.01745095063204789
agent_compute-ego_mean0.01654059555961546
agent_compute-ego_median0.016262339763954036
agent_compute-ego_min0.016226760128088165
deviation-center-line_max0.9875577000528216
deviation-center-line_mean0.469804422053088
deviation-center-line_min0.09824566491781651
deviation-heading_max3.6792405964739823
deviation-heading_mean2.1687597077457683
deviation-heading_median2.489611413611319
deviation-heading_min0.6409970700891362
driven_any_max2.8754234768425784
driven_any_mean1.814740100768487
driven_any_median2.0268760540670927
driven_any_min0.5274625307092581
driven_lanedir_consec_max2.497353373176428
driven_lanedir_consec_mean1.29182794983154
driven_lanedir_consec_min0.2263763168217583
driven_lanedir_max2.497353373176428
driven_lanedir_mean1.2919023537413727
driven_lanedir_median1.1140146900712409
driven_lanedir_min0.2267483363709213
in-drivable-lane_max4.750000000000002
in-drivable-lane_mean1.9600000000000055
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0268760540670927, "sim_physics": 0.06559178129357485, "survival_time": 10.050000000000008, "driven_lanedir": 0.8095429592615242, "sim_render-ego": 0.007734107733958989, "in-drivable-lane": 4.750000000000002, "agent_compute-ego": 0.01745095063204789, "deviation-heading": 2.730860684502584, "set_robot_commands": 0.0085289395270656, "deviation-center-line": 0.27663924663468237, "driven_lanedir_consec": 0.8095429592615242, "sim_compute_sim_state": 0.004018178626672545, "sim_compute_performance-ego": 0.0045638926586701505, "sim_compute_robot_state-ego": 0.005638560252403145}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.156385455399319, "sim_physics": 0.061408750012389615, "survival_time": 5.849999999999987, "driven_lanedir": 1.1140146900712409, "sim_render-ego": 0.007827830110859668, "in-drivable-lane": 0, "agent_compute-ego": 0.016247050375001043, "deviation-heading": 1.3030887740518178, "set_robot_commands": 0.007970314759474535, "deviation-center-line": 0.33471721195798526, "driven_lanedir_consec": 1.1140146900712409, "sim_compute_sim_state": 0.003551336435171274, "sim_compute_performance-ego": 0.0044126755151993186, "sim_compute_robot_state-ego": 0.005549932137513772}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.487552986824187, "sim_physics": 0.06070243921436248, "survival_time": 12.200000000000038, "driven_lanedir": 1.811852409826749, "sim_render-ego": 0.007578815593094123, "in-drivable-lane": 2.3500000000000103, "agent_compute-ego": 0.016262339763954036, "deviation-heading": 3.6792405964739823, "set_robot_commands": 0.007766142243244609, "deviation-center-line": 0.9875577000528216, "driven_lanedir_consec": 1.811852409826749, "sim_compute_sim_state": 0.0035208991316498304, "sim_compute_performance-ego": 0.004339628532284596, "sim_compute_robot_state-ego": 0.005438801695088871}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5274625307092581, "sim_physics": 0.06222217124805115, "survival_time": 2.849999999999998, "driven_lanedir": 0.2267483363709213, "sim_render-ego": 0.007689032638282107, "in-drivable-lane": 1.2499999999999971, "agent_compute-ego": 0.016226760128088165, "deviation-heading": 0.6409970700891362, "set_robot_commands": 0.007729116239045796, "deviation-center-line": 0.09824566491781651, "driven_lanedir_consec": 0.2263763168217583, "sim_compute_sim_state": 0.003577985261615954, "sim_compute_performance-ego": 0.00434204988312303, "sim_compute_robot_state-ego": 0.005382629863002844}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8754234768425784, "sim_physics": 0.06286034295567414, "survival_time": 14.050000000000065, "driven_lanedir": 2.497353373176428, "sim_render-ego": 0.00753437836399282, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.016515876898986166, "deviation-heading": 2.489611413611319, "set_robot_commands": 0.00801525675953495, "deviation-center-line": 0.6518622867021342, "driven_lanedir_consec": 2.497353373176428, "sim_compute_sim_state": 0.0035958154345746567, "sim_compute_performance-ego": 0.004350733502479635, "sim_compute_robot_state-ego": 0.005507021187887497}}
set_robot_commands_max0.0085289395270656
set_robot_commands_mean0.008001953905673098
set_robot_commands_median0.007970314759474535
set_robot_commands_min0.007729116239045796
sim_compute_performance-ego_max0.0045638926586701505
sim_compute_performance-ego_mean0.004401796018351346
sim_compute_performance-ego_median0.004350733502479635
sim_compute_performance-ego_min0.004339628532284596
sim_compute_robot_state-ego_max0.005638560252403145
sim_compute_robot_state-ego_mean0.005503389027179226
sim_compute_robot_state-ego_median0.005507021187887497
sim_compute_robot_state-ego_min0.005382629863002844
sim_compute_sim_state_max0.004018178626672545
sim_compute_sim_state_mean0.003652842977936852
sim_compute_sim_state_median0.003577985261615954
sim_compute_sim_state_min0.0035208991316498304
sim_physics_max0.06559178129357485
sim_physics_mean0.06255709694481044
sim_physics_median0.06222217124805115
sim_physics_min0.06070243921436248
sim_render-ego_max0.007827830110859668
sim_render-ego_mean0.007672832888037541
sim_render-ego_median0.007689032638282107
sim_render-ego_min0.00753437836399282
simulation-passed1
survival_time_max14.050000000000065
survival_time_mean9.00000000000002
survival_time_min2.849999999999998
No reset possible
300186104Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0627021903790563
survival_time_median6.149999999999986
deviation-center-line_median0.2865862881101063
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03652425968285763
agent_compute-ego_mean0.030437382658626045
agent_compute-ego_median0.029660364366927237
agent_compute-ego_min0.026368282735347748
deviation-center-line_max0.7543159469332724
deviation-center-line_mean0.4157296808295111
deviation-center-line_min0.22541764935928987
deviation-heading_max3.210375241028987
deviation-heading_mean1.547089574077929
deviation-heading_median1.2738207124515584
deviation-heading_min0.7463245344132126
driven_any_max4.345400946440144
driven_any_mean2.6610602739792566
driven_any_median2.1125103330051234
driven_any_min1.345454044708617
driven_lanedir_consec_max4.301658390811058
driven_lanedir_consec_mean2.549693729442675
driven_lanedir_consec_min1.287099594594354
driven_lanedir_max4.301658390811058
driven_lanedir_mean2.549693729442675
driven_lanedir_median2.0627021903790563
driven_lanedir_min1.287099594594354
in-drivable-lane_max0.25000000000000355
in-drivable-lane_mean0.05000000000000071
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.345454044708617, "sim_physics": 0.07241928825775783, "survival_time": 4.799999999999991, "driven_lanedir": 1.287099594594354, "sim_render-ego": 0.008954688906669617, "in-drivable-lane": 0, "agent_compute-ego": 0.026368282735347748, "deviation-heading": 1.2738207124515584, "set_robot_commands": 0.006985940039157867, "deviation-center-line": 0.27984862013432016, "driven_lanedir_consec": 1.287099594594354, "sim_compute_sim_state": 0.003629567722479502, "sim_compute_performance-ego": 0.005293724437554677, "sim_compute_robot_state-ego": 0.006156995892524719}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3472402659669047, "sim_physics": 0.0932258331414425, "survival_time": 3.2999999999999963, "driven_lanedir": 1.3044814183101658, "sim_render-ego": 0.01170905792351925, "in-drivable-lane": 0, "agent_compute-ego": 0.03652425968285763, "deviation-heading": 0.7463245344132126, "set_robot_commands": 0.00996416626554547, "deviation-center-line": 0.22541764935928987, "driven_lanedir_consec": 1.3044814183101658, "sim_compute_sim_state": 0.004699378302603057, "sim_compute_performance-ego": 0.006500280264652137, "sim_compute_robot_state-ego": 0.008532849225130949}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.345400946440144, "sim_physics": 0.08386272668838501, "survival_time": 14.950000000000076, "driven_lanedir": 4.301658390811058, "sim_render-ego": 0.010419782002766926, "in-drivable-lane": 0, "agent_compute-ego": 0.030361866950988768, "deviation-heading": 1.5894498697315027, "set_robot_commands": 0.008236602942148844, "deviation-center-line": 0.5324798996105669, "driven_lanedir_consec": 4.301658390811058, "sim_compute_sim_state": 0.004208146731058756, "sim_compute_performance-ego": 0.006184598604838053, "sim_compute_robot_state-ego": 0.007555668354034424}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1125103330051234, "sim_physics": 0.07879868561659402, "survival_time": 6.149999999999986, "driven_lanedir": 2.0627021903790563, "sim_render-ego": 0.010074472039695678, "in-drivable-lane": 0, "agent_compute-ego": 0.02927213955700882, "deviation-heading": 0.9154775127643832, "set_robot_commands": 0.007892160880856397, "deviation-center-line": 0.2865862881101063, "driven_lanedir_consec": 2.0627021903790563, "sim_compute_sim_state": 0.004083840827631757, "sim_compute_performance-ego": 0.005830223967389363, "sim_compute_robot_state-ego": 0.007166106526444598}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.154695779775492, "sim_physics": 0.08196593005702181, "survival_time": 10.600000000000016, "driven_lanedir": 3.792527053118741, "sim_render-ego": 0.01129668951034546, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.029660364366927237, "deviation-heading": 3.210375241028987, "set_robot_commands": 0.008428374551377207, "deviation-center-line": 0.7543159469332724, "driven_lanedir_consec": 3.792527053118741, "sim_compute_sim_state": 0.004209773720435376, "sim_compute_performance-ego": 0.006180280784391008, "sim_compute_robot_state-ego": 0.007682837405294742}}
set_robot_commands_max0.00996416626554547
set_robot_commands_mean0.008301448935817158
set_robot_commands_median0.008236602942148844
set_robot_commands_min0.006985940039157867
sim_compute_performance-ego_max0.006500280264652137
sim_compute_performance-ego_mean0.005997821611765047
sim_compute_performance-ego_median0.006180280784391008
sim_compute_performance-ego_min0.005293724437554677
sim_compute_robot_state-ego_max0.008532849225130949
sim_compute_robot_state-ego_mean0.0074188914806858864
sim_compute_robot_state-ego_median0.007555668354034424
sim_compute_robot_state-ego_min0.006156995892524719
sim_compute_sim_state_max0.004699378302603057
sim_compute_sim_state_mean0.004166141460841689
sim_compute_sim_state_median0.004208146731058756
sim_compute_sim_state_min0.003629567722479502
sim_physics_max0.0932258331414425
sim_physics_mean0.08205449275224024
sim_physics_median0.08196593005702181
sim_physics_min0.07241928825775783
sim_render-ego_max0.01170905792351925
sim_render-ego_mean0.010490938076599388
sim_render-ego_median0.010419782002766926
sim_render-ego_min0.008954688906669617
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.960000000000013
survival_time_min3.2999999999999963
No reset possible
300035839Soroush Saryazdi 🇨🇦upduckaido3-LF-real-validationeval1-visualizesuccessnoip-172-31-35-218-104900:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.7084004722999664
survival_time4.6667
deviation-center-line0.20207493943401408
in-drivable-lane0


other stats
deviation-heading1.1028786269833295
driven_any0.7145120954386449
driven_lanedir0.7084004722999664
visualized-eval1-passed1
No reset possible
299936100Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.918384345754224
survival_time_median9.349999999999998
deviation-center-line_median0.5963580842603474
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02279344971260328
agent_compute-ego_mean0.0223322090805806
agent_compute-ego_median0.02222917228937149
agent_compute-ego_min0.022146566666383795
deviation-center-line_max0.9119547912532942
deviation-center-line_mean0.5986157046142908
deviation-center-line_min0.22158198971663004
deviation-heading_max3.5391842193545515
deviation-heading_mean2.5025369652473493
deviation-heading_median2.5089626838486923
deviation-heading_min0.8048601767141526
driven_any_max4.86520904365182
driven_any_mean3.290114384737162
driven_any_median3.0440160110325536
driven_any_min1.2016520621845426
driven_lanedir_consec_max4.282982075488816
driven_lanedir_consec_mean3.009845263505821
driven_lanedir_consec_min1.1538178913253907
driven_lanedir_max4.282982075488816
driven_lanedir_mean3.009845263505821
driven_lanedir_median2.918384345754224
driven_lanedir_min1.1538178913253907
in-drivable-lane_max0.9000000000000128
in-drivable-lane_mean0.2800000000000026
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.878699604986204, "sim_physics": 0.06127878521265608, "survival_time": 8.899999999999991, "driven_lanedir": 2.428028502132056, "sim_render-ego": 0.007917329166712386, "in-drivable-lane": 0.5, "agent_compute-ego": 0.02279344971260328, "deviation-heading": 2.5089626838486923, "set_robot_commands": 0.005662719855147801, "deviation-center-line": 0.5013549917186724, "driven_lanedir_consec": 2.428028502132056, "sim_compute_sim_state": 0.0032414224710357324, "sim_compute_performance-ego": 0.004593247777960273, "sim_compute_robot_state-ego": 0.005495114272899842}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2016520621845426, "sim_physics": 0.06053611636161804, "survival_time": 3.1999999999999966, "driven_lanedir": 1.1538178913253907, "sim_render-ego": 0.007883645594120026, "in-drivable-lane": 0, "agent_compute-ego": 0.02222917228937149, "deviation-heading": 0.8048601767141526, "set_robot_commands": 0.005485270172357559, "deviation-center-line": 0.22158198971663004, "driven_lanedir_consec": 1.1538178913253907, "sim_compute_sim_state": 0.0031464844942092896, "sim_compute_performance-ego": 0.0044530294835567474, "sim_compute_robot_state-ego": 0.0054231248795986176}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.86520904365182, "sim_physics": 0.06012004454930624, "survival_time": 14.950000000000076, "driven_lanedir": 4.282982075488816, "sim_render-ego": 0.007531978289286295, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.02220983346303304, "deviation-heading": 3.5391842193545515, "set_robot_commands": 0.005595051447550456, "deviation-center-line": 0.9119547912532942, "driven_lanedir_consec": 4.282982075488816, "sim_compute_sim_state": 0.003266017436981201, "sim_compute_performance-ego": 0.0043524018923441566, "sim_compute_robot_state-ego": 0.005484317143758138}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.46099520183069, "sim_physics": 0.059547533408302225, "survival_time": 13.550000000000058, "driven_lanedir": 4.266013502828618, "sim_render-ego": 0.007560199477135915, "in-drivable-lane": 0, "agent_compute-ego": 0.0222820232715114, "deviation-heading": 3.2655151431008065, "set_robot_commands": 0.005565088173560111, "deviation-center-line": 0.7618286661225104, "driven_lanedir_consec": 4.266013502828618, "sim_compute_sim_state": 0.0032169915653242837, "sim_compute_performance-ego": 0.004336455651314936, "sim_compute_robot_state-ego": 0.005468543605171006}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0440160110325536, "sim_physics": 0.05910775623219536, "survival_time": 9.349999999999998, "driven_lanedir": 2.918384345754224, "sim_render-ego": 0.007656017089272565, "in-drivable-lane": 0, "agent_compute-ego": 0.022146566666383795, "deviation-heading": 2.3941626032185432, "set_robot_commands": 0.005583089940688189, "deviation-center-line": 0.5963580842603474, "driven_lanedir_consec": 2.918384345754224, "sim_compute_sim_state": 0.0032423894035624947, "sim_compute_performance-ego": 0.004381453927187996, "sim_compute_robot_state-ego": 0.0055292226413992}}
set_robot_commands_max0.005662719855147801
set_robot_commands_mean0.005578243917860823
set_robot_commands_median0.005583089940688189
set_robot_commands_min0.005485270172357559
sim_compute_performance-ego_max0.004593247777960273
sim_compute_performance-ego_mean0.004423317746472822
sim_compute_performance-ego_median0.004381453927187996
sim_compute_performance-ego_min0.004336455651314936
sim_compute_robot_state-ego_max0.0055292226413992
sim_compute_robot_state-ego_mean0.005480064508565361
sim_compute_robot_state-ego_median0.005484317143758138
sim_compute_robot_state-ego_min0.0054231248795986176
sim_compute_sim_state_max0.003266017436981201
sim_compute_sim_state_mean0.0032226610742226
sim_compute_sim_state_median0.0032414224710357324
sim_compute_sim_state_min0.0031464844942092896
sim_physics_max0.06127878521265608
sim_physics_mean0.06011804715281559
sim_physics_median0.06012004454930624
sim_physics_min0.05910775623219536
sim_render-ego_max0.007917329166712386
sim_render-ego_mean0.007709833923305437
sim_render-ego_median0.007656017089272565
sim_render-ego_min0.007531978289286295
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.990000000000023
survival_time_min3.1999999999999966
No reset possible
299876096Aleksei Shpilman 🇷🇺4 seasonsaido3-LF-sim-testingstep1-simulationabortednoip-172-31-35-218-104900:07:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
299756094Aleksei Shpilman 🇷🇺4 seasonsaido3-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:12:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1411916603732006
survival_time_median14.850000000000076
deviation-center-line_median0.6769994613187938
in-drivable-lane_median0.6000000000000085


other stats
agent_compute-ego_max0.01841614325841268
agent_compute-ego_mean0.017838004130795997
agent_compute-ego_median0.017772378847580546
agent_compute-ego_min0.017554505505545773
deviation-center-line_max0.9457041881609408
deviation-center-line_mean0.5947934247575473
deviation-center-line_min0.24733338284927123
deviation-heading_max5.189100526898184
deviation-heading_mean2.991542188106456
deviation-heading_median3.568322097076954
deviation-heading_min1.0791125085839173
driven_any_max4.2562434752114955
driven_any_mean3.108410542552319
driven_any_median3.774021230074158
driven_any_min1.135172382165986
driven_lanedir_consec_max3.5493522072677983
driven_lanedir_consec_mean2.6298753489802578
driven_lanedir_consec_min1.0151049547225228
driven_lanedir_max3.9531453916767982
driven_lanedir_mean2.806717079574774
driven_lanedir_median3.1411916603732006
driven_lanedir_min1.0235703370645628
in-drivable-lane_max1.7000000000000135
in-drivable-lane_mean0.6500000000000071
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 4.2562434752114955, "sim_physics": 0.13121938864390056, "survival_time": 14.950000000000076, "driven_lanedir": 3.9531453916767982, "sim_render-ego": 0.007507434686024984, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.01841614325841268, "deviation-heading": 3.568322097076954, "set_robot_commands": 0.005524833997090657, "deviation-center-line": 0.7494433313221233, "driven_lanedir_consec": 3.5485663628064006, "sim_compute_sim_state": 0.0031255380312601726, "sim_compute_performance-ego": 0.004351302782694499, "sim_compute_robot_state-ego": 0.005508053302764893, "sim_compute_robot_state-npc0": 0.005344924132029216, "sim_compute_robot_state-npc1": 0.005166169007619222, "sim_compute_robot_state-npc2": 0.005139118035634359, "sim_compute_robot_state-npc3": 0.00517837921778361}, "udem1-1-0": {"driven_any": 3.774021230074158, "sim_physics": 0.12546232894614892, "survival_time": 14.850000000000076, "driven_lanedir": 3.1411916603732006, "sim_render-ego": 0.007545333117346972, "in-drivable-lane": 1.7000000000000135, "agent_compute-ego": 0.017554505505545773, "deviation-heading": 5.189100526898184, "set_robot_commands": 0.005533563568937257, "deviation-center-line": 0.9457041881609408, "driven_lanedir_consec": 3.1411916603732006, "sim_compute_sim_state": 0.0031008632094771775, "sim_compute_performance-ego": 0.004305499972719134, "sim_compute_robot_state-ego": 0.005496429674553148, "sim_compute_robot_state-npc0": 0.005333936575687293, "sim_compute_robot_state-npc1": 0.00517505989331589, "sim_compute_robot_state-npc2": 0.005162808228823472, "sim_compute_robot_state-npc3": 0.005099182578449699}, "udem1-2-0": {"driven_any": 1.135172382165986, "sim_physics": 0.1129321946817286, "survival_time": 3.399999999999996, "driven_lanedir": 1.0235703370645628, "sim_render-ego": 0.007913442219004911, "in-drivable-lane": 0, "agent_compute-ego": 0.01762342803618487, "deviation-heading": 1.0791125085839173, "set_robot_commands": 0.005533737294814166, "deviation-center-line": 0.24733338284927123, "driven_lanedir_consec": 1.0151049547225228, "sim_compute_sim_state": 0.003212318700902602, "sim_compute_performance-ego": 0.004352751900168026, "sim_compute_robot_state-ego": 0.005550303879906149, "sim_compute_robot_state-npc0": 0.00552976832670324, "sim_compute_robot_state-npc1": 0.0052799091619603776, "sim_compute_robot_state-npc2": 0.0052253393565907195, "sim_compute_robot_state-npc3": 0.005153557833503275}, "udem1-3-0": {"driven_any": 2.440327693819413, "sim_physics": 0.12216212398322052, "survival_time": 6.449999999999985, "driven_lanedir": 2.364168841037591, "sim_render-ego": 0.007825688798298208, "in-drivable-lane": 0, "agent_compute-ego": 0.017772378847580546, "deviation-heading": 1.2284597000280255, "set_robot_commands": 0.0054358752198921615, "deviation-center-line": 0.35448676013660746, "driven_lanedir_consec": 1.8951615597313665, "sim_compute_sim_state": 0.003105623777522597, "sim_compute_performance-ego": 0.00439502102460048, "sim_compute_robot_state-ego": 0.005496002906976744, "sim_compute_robot_state-npc0": 0.005337739175604295, "sim_compute_robot_state-npc1": 0.005182064780893252, "sim_compute_robot_state-npc2": 0.005117100338603175, "sim_compute_robot_state-npc3": 0.0051412545433340145}, "udem1-4-0": {"driven_any": 3.936287931490543, "sim_physics": 0.1343233283360799, "survival_time": 14.950000000000076, "driven_lanedir": 3.5515091677217168, "sim_render-ego": 0.007525921662648519, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.017823565006256103, "deviation-heading": 3.892716107945199, "set_robot_commands": 0.005513545672098796, "deviation-center-line": 0.6769994613187938, "driven_lanedir_consec": 3.5493522072677983, "sim_compute_sim_state": 0.003138116995493571, "sim_compute_performance-ego": 0.004279820124308268, "sim_compute_robot_state-ego": 0.005499645074208578, "sim_compute_robot_state-npc0": 0.005427746772766113, "sim_compute_robot_state-npc1": 0.005217568079630534, "sim_compute_robot_state-npc2": 0.005192696253458659, "sim_compute_robot_state-npc3": 0.005107209682464599}}
set_robot_commands_max0.005533737294814166
set_robot_commands_mean0.005508311150566607
set_robot_commands_median0.005524833997090657
set_robot_commands_min0.0054358752198921615
sim_compute_performance-ego_max0.00439502102460048
sim_compute_performance-ego_mean0.004336879160898081
sim_compute_performance-ego_median0.004351302782694499
sim_compute_performance-ego_min0.004279820124308268
sim_compute_robot_state-ego_max0.005550303879906149
sim_compute_robot_state-ego_mean0.0055100869676819025
sim_compute_robot_state-ego_median0.005499645074208578
sim_compute_robot_state-ego_min0.005496002906976744
sim_compute_robot_state-npc0_max0.00552976832670324
sim_compute_robot_state-npc0_mean0.005394822996558031
sim_compute_robot_state-npc0_median0.005344924132029216
sim_compute_robot_state-npc0_min0.005333936575687293
sim_compute_robot_state-npc1_max0.0052799091619603776
sim_compute_robot_state-npc1_mean0.005204154184683856
sim_compute_robot_state-npc1_median0.005182064780893252
sim_compute_robot_state-npc1_min0.005166169007619222
sim_compute_robot_state-npc2_max0.0052253393565907195
sim_compute_robot_state-npc2_mean0.005167412442622077
sim_compute_robot_state-npc2_median0.005162808228823472
sim_compute_robot_state-npc2_min0.005117100338603175
sim_compute_robot_state-npc3_max0.00517837921778361
sim_compute_robot_state-npc3_mean0.005135916771107039
sim_compute_robot_state-npc3_median0.0051412545433340145
sim_compute_robot_state-npc3_min0.005099182578449699
sim_compute_sim_state_max0.003212318700902602
sim_compute_sim_state_mean0.0031364921429312244
sim_compute_sim_state_median0.0031255380312601726
sim_compute_sim_state_min0.0031008632094771775
sim_physics_max0.1343233283360799
sim_physics_mean0.1252198729182157
sim_physics_median0.12546232894614892
sim_physics_min0.1129321946817286
sim_render-ego_max0.007913442219004911
sim_render-ego_mean0.007663564096664718
sim_render-ego_median0.007545333117346972
sim_render-ego_min0.007507434686024984
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.92000000000004
survival_time_min3.399999999999996
No reset possible
299656015Philippe Marcotte 🇨🇦pp + veh dectaido3-LFV-sim-testingstep1-simulationabortedyesip-172-31-35-218-104900:28:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
299406087Mikita Sazanovich 🇷🇺chameleon-09-trioaido3-LFVI-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:05:12
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
299306084Mikita Sazanovich 🇷🇺chameleon-09-trioaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.733263804629758
survival_time_median14.950000000000076
deviation-center-line_median0.41394985034253146
in-drivable-lane_median1.149999999999996


other stats
agent_compute-ego_max0.017591509086957117
agent_compute-ego_mean0.016641072625567552
agent_compute-ego_median0.016350932916005454
agent_compute-ego_min0.015871629029690863
deviation-center-line_max0.6174883683321903
deviation-center-line_mean0.4365921942608784
deviation-center-line_min0.19605121788062171
deviation-heading_max3.4592179719744265
deviation-heading_mean2.455876593357916
deviation-heading_median2.2510651323699897
deviation-heading_min1.4856236605174848
driven_any_max3.841086354915331
driven_any_mean3.1951791999890107
driven_any_median3.366291995928615
driven_any_min2.4041409255737736
driven_lanedir_consec_max3.723855099447977
driven_lanedir_consec_mean2.8747555725099123
driven_lanedir_consec_min2.2474333113111493
driven_lanedir_max3.723855099447977
driven_lanedir_mean2.8747555725099123
driven_lanedir_median2.733263804629758
driven_lanedir_min2.2474333113111493
in-drivable-lane_max2.150000000000012
in-drivable-lane_mean0.9600000000000058
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.366291995928615, "sim_physics": 0.0610835740180431, "survival_time": 12.050000000000036, "driven_lanedir": 2.733263804629758, "sim_render-ego": 0.0074480866000860065, "in-drivable-lane": 2.150000000000012, "agent_compute-ego": 0.017591509086957117, "deviation-heading": 3.4592179719744265, "set_robot_commands": 0.00550276906658505, "deviation-center-line": 0.570724078974626, "driven_lanedir_consec": 2.733263804629758, "sim_compute_sim_state": 0.0031120074735142876, "sim_compute_performance-ego": 0.0044196581939444, "sim_compute_robot_state-ego": 0.005321754954167916}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.841086354915331, "sim_physics": 0.05937013546625773, "survival_time": 14.950000000000076, "driven_lanedir": 3.723855099447977, "sim_render-ego": 0.007475422223409017, "in-drivable-lane": 0, "agent_compute-ego": 0.016350932916005454, "deviation-heading": 3.2028376317124927, "set_robot_commands": 0.0055869221687316895, "deviation-center-line": 0.6174883683321903, "driven_lanedir_consec": 3.723855099447977, "sim_compute_sim_state": 0.0032036924362182618, "sim_compute_performance-ego": 0.004331854979197184, "sim_compute_robot_state-ego": 0.005416058699289958}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4041409255737736, "sim_physics": 0.05824978622847688, "survival_time": 8.349999999999984, "driven_lanedir": 2.2474333113111493, "sim_render-ego": 0.00733039193524572, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.015871629029690863, "deviation-heading": 1.880638570215186, "set_robot_commands": 0.005430330059485521, "deviation-center-line": 0.41394985034253146, "driven_lanedir_consec": 2.2474333113111493, "sim_compute_sim_state": 0.0031474721645880603, "sim_compute_performance-ego": 0.00429667398601235, "sim_compute_robot_state-ego": 0.00526395101033285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.420833063376556, "sim_physics": 0.057797357241312665, "survival_time": 14.950000000000076, "driven_lanedir": 3.0957231100161895, "sim_render-ego": 0.00736697514851888, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.016235143343607584, "deviation-heading": 2.2510651323699897, "set_robot_commands": 0.00539950688680013, "deviation-center-line": 0.3847474557744227, "driven_lanedir_consec": 3.0957231100161895, "sim_compute_sim_state": 0.0031139270464579263, "sim_compute_performance-ego": 0.004258847236633301, "sim_compute_robot_state-ego": 0.005356245835622151}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.943543660150777, "sim_physics": 0.05919228871663411, "survival_time": 14.950000000000076, "driven_lanedir": 2.5735025371444884, "sim_render-ego": 0.007487430572509766, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.01715614875157674, "deviation-heading": 1.4856236605174848, "set_robot_commands": 0.005596271355946859, "deviation-center-line": 0.19605121788062171, "driven_lanedir_consec": 2.5735025371444884, "sim_compute_sim_state": 0.003091154098510742, "sim_compute_performance-ego": 0.004186752637227376, "sim_compute_robot_state-ego": 0.005137399832407633}}
set_robot_commands_max0.005596271355946859
set_robot_commands_mean0.005503159907509851
set_robot_commands_median0.00550276906658505
set_robot_commands_min0.00539950688680013
sim_compute_performance-ego_max0.0044196581939444
sim_compute_performance-ego_mean0.004298757406602923
sim_compute_performance-ego_median0.00429667398601235
sim_compute_performance-ego_min0.004186752637227376
sim_compute_robot_state-ego_max0.005416058699289958
sim_compute_robot_state-ego_mean0.005299082066364102
sim_compute_robot_state-ego_median0.005321754954167916
sim_compute_robot_state-ego_min0.005137399832407633
sim_compute_sim_state_max0.0032036924362182618
sim_compute_sim_state_mean0.0031336506438578555
sim_compute_sim_state_median0.0031139270464579263
sim_compute_sim_state_min0.003091154098510742
sim_physics_max0.0610835740180431
sim_physics_mean0.05913862833414489
sim_physics_median0.05919228871663411
sim_physics_min0.057797357241312665
sim_render-ego_max0.007487430572509766
sim_render-ego_mean0.007421661295953878
sim_render-ego_median0.0074480866000860065
sim_render-ego_min0.00733039193524572
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.050000000000049
survival_time_min8.349999999999984
No reset possible
299286082Mikita Sazanovich 🇷🇺chameleon-09-trioaido3-LF-sim-testingstep1-simulationerrornoip-172-31-35-218-104900:01:35
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
299256077Mikita Sazanovich 🇷🇺chameleon-09-trioaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8654291670480903
survival_time_median14.950000000000076
deviation-center-line_median0.3971650547792506
in-drivable-lane_median0.4000000000000057


other stats
agent_compute-ego_max0.018232965078510223
agent_compute-ego_mean0.01743169748228284
agent_compute-ego_median0.017315496603647867
agent_compute-ego_min0.017096498012542725
deviation-center-line_max0.5634804700197761
deviation-center-line_mean0.4128017679725512
deviation-center-line_min0.2040044870702828
deviation-heading_max2.994441481922213
deviation-heading_mean2.2212886490551407
deviation-heading_median1.9477965362167895
deviation-heading_min1.7085530305557153
driven_any_max3.528908376841361
driven_any_mean3.0766567891406136
driven_any_median3.1179007606135376
driven_any_min2.3954111971164314
driven_lanedir_consec_max3.421505205306683
driven_lanedir_consec_mean2.838372799390727
driven_lanedir_consec_min2.2114856526930264
driven_lanedir_max3.421505205306683
driven_lanedir_mean2.838372799390727
driven_lanedir_median2.8654291670480903
driven_lanedir_min2.2114856526930264
in-drivable-lane_max1.4500000000000206
in-drivable-lane_mean0.5900000000000084
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.371672497202043, "sim_physics": 0.05941048606497343, "survival_time": 12.200000000000038, "driven_lanedir": 2.8654291670480903, "sim_render-ego": 0.007388076821311576, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.018232965078510223, "deviation-heading": 2.994441481922213, "set_robot_commands": 0.005796426632365242, "deviation-center-line": 0.5634804700197761, "driven_lanedir_consec": 2.8654291670480903, "sim_compute_sim_state": 0.00313897895031288, "sim_compute_performance-ego": 0.004333353433452669, "sim_compute_robot_state-ego": 0.00518508035628522}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.528908376841361, "sim_physics": 0.06148641268412272, "survival_time": 14.950000000000076, "driven_lanedir": 3.421505205306683, "sim_render-ego": 0.007650872866312663, "in-drivable-lane": 0, "agent_compute-ego": 0.017346566518147786, "deviation-heading": 2.638782879578507, "set_robot_commands": 0.005533786614735922, "deviation-center-line": 0.5592688812117299, "driven_lanedir_consec": 3.421505205306683, "sim_compute_sim_state": 0.0031515018145243327, "sim_compute_performance-ego": 0.004413990179697672, "sim_compute_robot_state-ego": 0.005357410113016764}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3954111971164314, "sim_physics": 0.057920954693322896, "survival_time": 8.699999999999989, "driven_lanedir": 2.2114856526930264, "sim_render-ego": 0.007678527941648987, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.017166961198565603, "deviation-heading": 1.7085530305557153, "set_robot_commands": 0.00552910634841042, "deviation-center-line": 0.3971650547792506, "driven_lanedir_consec": 2.2114856526930264, "sim_compute_sim_state": 0.0031215295024301813, "sim_compute_performance-ego": 0.004365734670354032, "sim_compute_robot_state-ego": 0.005292652667253867}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1179007606135376, "sim_physics": 0.05997641801834106, "survival_time": 14.950000000000076, "driven_lanedir": 3.061332413176254, "sim_render-ego": 0.007644344965616862, "in-drivable-lane": 0, "agent_compute-ego": 0.017096498012542725, "deviation-heading": 1.9477965362167895, "set_robot_commands": 0.005500342051188151, "deviation-center-line": 0.3400899467817166, "driven_lanedir_consec": 3.061332413176254, "sim_compute_sim_state": 0.003141521612803141, "sim_compute_performance-ego": 0.004296707312266032, "sim_compute_robot_state-ego": 0.005273776849110921}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.969391113929696, "sim_physics": 0.06046794255574544, "survival_time": 14.950000000000076, "driven_lanedir": 2.6321115587295827, "sim_render-ego": 0.0074326308568318684, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.017315496603647867, "deviation-heading": 1.8168693170024777, "set_robot_commands": 0.005575546423594157, "deviation-center-line": 0.2040044870702828, "driven_lanedir_consec": 2.6321115587295827, "sim_compute_sim_state": 0.003131274382273356, "sim_compute_performance-ego": 0.004308555126190185, "sim_compute_robot_state-ego": 0.005271414120992025}}
set_robot_commands_max0.005796426632365242
set_robot_commands_mean0.005587041614058779
set_robot_commands_median0.005533786614735922
set_robot_commands_min0.005500342051188151
sim_compute_performance-ego_max0.004413990179697672
sim_compute_performance-ego_mean0.004343668144392118
sim_compute_performance-ego_median0.004333353433452669
sim_compute_performance-ego_min0.004296707312266032
sim_compute_robot_state-ego_max0.005357410113016764
sim_compute_robot_state-ego_mean0.00527606682133176
sim_compute_robot_state-ego_median0.005273776849110921
sim_compute_robot_state-ego_min0.00518508035628522
sim_compute_sim_state_max0.0031515018145243327
sim_compute_sim_state_mean0.0031369612524687783
sim_compute_sim_state_median0.00313897895031288
sim_compute_sim_state_min0.0031215295024301813
sim_physics_max0.06148641268412272
sim_physics_mean0.05985244280330111
sim_physics_median0.05997641801834106
sim_physics_min0.057920954693322896
sim_render-ego_max0.007678527941648987
sim_render-ego_mean0.007558890690344391
sim_render-ego_median0.007644344965616862
sim_render-ego_min0.007388076821311576
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.150000000000052
survival_time_min8.699999999999989
No reset possible
299135774Mikita Sazanovich 🇷🇺chameleon-10-jjluaido3-LF-real-validationeval2-videossuccessnoip-172-31-35-218-104900:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
298526048Frank (Chude) Qian 🇨🇦2019-12-10|FrankNet|(Kay❤️Frank)aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:35:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.143827668246969
survival_time_median13.500000000000057
deviation-center-line_median0.6519036655234698
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.09315624670548872
agent_compute-ego_mean0.07525022082986871
agent_compute-ego_median0.07430999358495076
agent_compute-ego_min0.06458592250429351
deviation-center-line_max1.0055770677436957
deviation-center-line_mean0.5913387768444843
deviation-center-line_min0.09803031731313692
deviation-heading_max3.493766269636332
deviation-heading_mean2.2043126725669
deviation-heading_median2.4595953155013883
deviation-heading_min0.3713013438130891
driven_any_max5.683505781047495
driven_any_mean3.609905988933947
driven_any_median4.5335657071593705
driven_any_min0.7114751375329994
driven_lanedir_consec_max5.205812097421447
driven_lanedir_consec_mean3.1642865217249567
driven_lanedir_consec_min0.6923224341051074
driven_lanedir_max5.205812097421447
driven_lanedir_mean3.1642865217249567
driven_lanedir_median3.143827668246969
driven_lanedir_min0.6923224341051074
in-drivable-lane_max3.60000000000002
in-drivable-lane_mean0.8766666666666675
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.660413962338817, "sim_physics": 0.12411425511042276, "survival_time": 14.950000000000076, "driven_lanedir": 4.506138236760578, "sim_render-ego": 0.01326554536819458, "in-drivable-lane": 0, "agent_compute-ego": 0.08249605894088745, "deviation-heading": 3.267389775475435, "set_robot_commands": 0.010554281075795492, "deviation-center-line": 0.8349768180556698, "driven_lanedir_consec": 4.506138236760578, "sim_compute_sim_state": 0.005147570768992106, "sim_compute_performance-ego": 0.008224128087361653, "sim_compute_robot_state-ego": 0.010030831495920815}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.946550296587986, "sim_physics": 0.12478158712387084, "survival_time": 14.950000000000076, "driven_lanedir": 4.755388024563321, "sim_render-ego": 0.013598535060882568, "in-drivable-lane": 0, "agent_compute-ego": 0.07466066598892213, "deviation-heading": 3.3592892055975914, "set_robot_commands": 0.01031771977742513, "deviation-center-line": 0.9899071814398588, "driven_lanedir_consec": 4.755388024563321, "sim_compute_sim_state": 0.0052210219701131185, "sim_compute_performance-ego": 0.008160300254821777, "sim_compute_robot_state-ego": 0.010078944365183511}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.683505781047495, "sim_physics": 0.117286430199941, "survival_time": 14.950000000000076, "driven_lanedir": 4.1463939723179415, "sim_render-ego": 0.012659318447113037, "in-drivable-lane": 3.60000000000002, "agent_compute-ego": 0.07339429457982381, "deviation-heading": 2.3075427296921096, "set_robot_commands": 0.010210081736246743, "deviation-center-line": 0.6519036655234698, "driven_lanedir_consec": 4.1463939723179415, "sim_compute_sim_state": 0.00510083278020223, "sim_compute_performance-ego": 0.007713685035705567, "sim_compute_robot_state-ego": 0.009501826763153077}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7114751375329994, "sim_physics": 0.11218940294705904, "survival_time": 1.950000000000001, "driven_lanedir": 0.6923224341051074, "sim_render-ego": 0.013487571325057592, "in-drivable-lane": 0, "agent_compute-ego": 0.06746571491926144, "deviation-heading": 0.3713013438130891, "set_robot_commands": 0.009997233366354918, "deviation-center-line": 0.09803031731313692, "driven_lanedir_consec": 0.6923224341051074, "sim_compute_sim_state": 0.005010494819054237, "sim_compute_performance-ego": 0.00758060430869078, "sim_compute_robot_state-ego": 0.009522963792849807}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7932685405744468, "sim_physics": 0.13351927665953942, "survival_time": 4.699999999999991, "driven_lanedir": 1.7366327182286427, "sim_render-ego": 0.014457629082050729, "in-drivable-lane": 0, "agent_compute-ego": 0.08298598959090862, "deviation-heading": 1.044867924851644, "set_robot_commands": 0.01071953519861749, "deviation-center-line": 0.24008108237403117, "driven_lanedir_consec": 1.7366327182286427, "sim_compute_sim_state": 0.005495756230455764, "sim_compute_performance-ego": 0.008588260792671366, "sim_compute_robot_state-ego": 0.01076778198810334}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5305032452095748, "sim_physics": 0.12995163093913686, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9980934226658804, "sim_render-ego": 0.014264167438853873, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.09315624670548872, "deviation-heading": 1.4741051940389975, "set_robot_commands": 0.011223131960088556, "deviation-center-line": 0.25486490907547205, "driven_lanedir_consec": 0.9980934226658804, "sim_compute_sim_state": 0.005438371138139205, "sim_compute_performance-ego": 0.008414227312261408, "sim_compute_robot_state-ego": 0.010646397417241877}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 5.5331724009263334, "sim_physics": 0.11556312084197998, "survival_time": 14.950000000000076, "driven_lanedir": 5.205812097421447, "sim_render-ego": 0.01285083532333374, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07430999358495076, "deviation-heading": 2.636536874007537, "set_robot_commands": 0.01018741766611735, "deviation-center-line": 0.8686270026911411, "driven_lanedir_consec": 5.205812097421447, "sim_compute_sim_state": 0.005186982949574788, "sim_compute_performance-ego": 0.007764249642690023, "sim_compute_robot_state-ego": 0.009843241373697915}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.5335657071593705, "sim_physics": 0.12704771471199514, "survival_time": 13.550000000000058, "driven_lanedir": 3.143827668246969, "sim_render-ego": 0.013983288374334244, "in-drivable-lane": 3.1499999999999924, "agent_compute-ego": 0.0832080744289384, "deviation-heading": 3.493766269636332, "set_robot_commands": 0.01063830210273996, "deviation-center-line": 0.7746464291548107, "driven_lanedir_consec": 3.143827668246969, "sim_compute_sim_state": 0.005353934650491525, "sim_compute_performance-ego": 0.008407847907710339, "sim_compute_robot_state-ego": 0.010302495252602215}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.738577751300749, "sim_physics": 0.11183044989903768, "survival_time": 14.950000000000076, "driven_lanedir": 4.386411042603971, "sim_render-ego": 0.012978352705637616, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07335505644480388, "deviation-heading": 2.9465776490426787, "set_robot_commands": 0.010466089248657226, "deviation-center-line": 0.8369230875755821, "driven_lanedir_consec": 4.386411042603971, "sim_compute_sim_state": 0.005140402317047119, "sim_compute_performance-ego": 0.007960662841796876, "sim_compute_robot_state-ego": 0.010073312918345134}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.659502117525818, "sim_physics": 0.11089247420982078, "survival_time": 13.500000000000057, "driven_lanedir": 4.428542708568279, "sim_render-ego": 0.012658532460530598, "in-drivable-lane": 0, "agent_compute-ego": 0.07254621364452221, "deviation-heading": 3.2980590712873545, "set_robot_commands": 0.013030324158845124, "deviation-center-line": 1.0055770677436957, "driven_lanedir_consec": 4.428542708568279, "sim_compute_sim_state": 0.004930385836848506, "sim_compute_performance-ego": 0.007440087530348036, "sim_compute_robot_state-ego": 0.00941154780211272}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 5.578053124218357, "sim_physics": 0.11507552782694498, "survival_time": 14.950000000000076, "driven_lanedir": 4.723323233323143, "sim_render-ego": 0.012947596708933511, "in-drivable-lane": 1.800000000000007, "agent_compute-ego": 0.07533213376998901, "deviation-heading": 2.490609679729684, "set_robot_commands": 0.0105338986714681, "deviation-center-line": 0.7410933146561487, "driven_lanedir_consec": 4.723323233323143, "sim_compute_sim_state": 0.0051974836985270185, "sim_compute_performance-ego": 0.007855900128682454, "sim_compute_robot_state-ego": 0.009962163766225178}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0714133128802128, "sim_physics": 0.1107286951121162, "survival_time": 3.399999999999996, "driven_lanedir": 1.033965417777499, "sim_render-ego": 0.01269372070536894, "in-drivable-lane": 0, "agent_compute-ego": 0.06748694882673376, "deviation-heading": 0.750555412832735, "set_robot_commands": 0.009918174322913677, "deviation-center-line": 0.1671496128385195, "driven_lanedir_consec": 1.033965417777499, "sim_compute_sim_state": 0.005053492153392118, "sim_compute_performance-ego": 0.008146005518296185, "sim_compute_robot_state-ego": 0.010010466856115004}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 3.169762512834627, "sim_physics": 0.10926689527421722, "survival_time": 9.55, "driven_lanedir": 2.6488316720638423, "sim_render-ego": 0.013279162152275365, "in-drivable-lane": 1.1500000000000066, "agent_compute-ego": 0.07490680979184455, "deviation-heading": 2.140895064027374, "set_robot_commands": 0.010053487348306866, "deviation-center-line": 0.5743421899573307, "driven_lanedir_consec": 2.6488316720638423, "sim_compute_sim_state": 0.0050877214102220784, "sim_compute_performance-ego": 0.007667220699849553, "sim_compute_robot_state-ego": 0.00974987314633674}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.7208406057197294, "sim_physics": 0.11654133204172348, "survival_time": 8.449999999999985, "driven_lanedir": 2.2846876669851164, "sim_render-ego": 0.01300202883206881, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.06886318872666218, "deviation-heading": 2.4595953155013883, "set_robot_commands": 0.010114441256551348, "deviation-center-line": 0.4670347496839041, "driven_lanedir_consec": 2.2846876669851164, "sim_compute_sim_state": 0.005243644206481573, "sim_compute_performance-ego": 0.007748555854932796, "sim_compute_robot_state-ego": 0.009584319662060258}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.8179853381526985, "sim_physics": 0.10449522445941792, "survival_time": 7.249999999999982, "driven_lanedir": 2.7739275102426197, "sim_render-ego": 0.012358346478692417, "in-drivable-lane": 0, "agent_compute-ego": 0.06458592250429351, "deviation-heading": 1.0235985789695463, "set_robot_commands": 0.009199861000324118, "deviation-center-line": 0.3649242245844934, "driven_lanedir_consec": 2.7739275102426197, "sim_compute_sim_state": 0.0047815997025062295, "sim_compute_performance-ego": 0.0073823632865116515, "sim_compute_robot_state-ego": 0.009238713363121296}}
set_robot_commands_max0.013030324158845124
set_robot_commands_mean0.010477598592696806
set_robot_commands_median0.01031771977742513
set_robot_commands_min0.009199861000324118
sim_compute_performance-ego_max0.008588260792671366
sim_compute_performance-ego_mean0.007936939946822031
sim_compute_performance-ego_median0.007855900128682454
sim_compute_performance-ego_min0.0073823632865116515
sim_compute_robot_state-ego_max0.01076778198810334
sim_compute_robot_state-ego_mean0.009914991997537929
sim_compute_robot_state-ego_median0.009962163766225178
sim_compute_robot_state-ego_min0.009238713363121296
sim_compute_sim_state_max0.005495756230455764
sim_compute_sim_state_mean0.005159312975469841
sim_compute_sim_state_median0.005147570768992106
sim_compute_sim_state_min0.0047815997025062295
sim_physics_max0.13351927665953942
sim_physics_mean0.11755226782381492
sim_physics_median0.11556312084197998
sim_physics_min0.10449522445941792
sim_render-ego_max0.014457629082050729
sim_render-ego_mean0.013232308697555172
sim_render-ego_median0.01300202883206881
sim_render-ego_min0.012358346478692417
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.503333333333368
survival_time_min1.950000000000001
No reset possible
298316030Frank (Chude) Qian 🇨🇦2019-12-10|FrankNet|(Kay❤️Frank)aido3-LFV-sim-validationstep1-simulationabortedyesip-172-31-35-218-104900:01:41
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
298176064Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:15:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.949891822174674
survival_time_median14.950000000000076
deviation-center-line_median0.7918673815891828
in-drivable-lane_median1.149999999999996


other stats
agent_compute-ego_max0.053904794851938886
agent_compute-ego_mean0.04519586451848348
agent_compute-ego_median0.04830011208852132
agent_compute-ego_min0.028650331497192386
deviation-center-line_max0.8223733550191243
deviation-center-line_mean0.764564390733306
deviation-center-line_min0.6441109606314008
deviation-heading_max5.162454711174317
deviation-heading_mean3.5580643836463715
deviation-heading_median3.03368230823569
deviation-heading_min2.9444491378451314
driven_any_max4.449565013587186
driven_any_mean3.649511343762157
driven_any_median4.053612763426325
driven_any_min2.3134051923100425
driven_lanedir_consec_max4.209704288883147
driven_lanedir_consec_mean3.134925941514499
driven_lanedir_consec_min1.4118998879069782
driven_lanedir_max4.209704288883147
driven_lanedir_mean3.413454242131023
driven_lanedir_median3.949891822174674
driven_lanedir_min1.9354375506095296
in-drivable-lane_max1.6000000000000227
in-drivable-lane_mean0.8100000000000074
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3134051923100425, "sim_physics": 0.12262948989868164, "survival_time": 14.950000000000076, "driven_lanedir": 1.9354375506095296, "sim_render-ego": 0.013233325481414794, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.028650331497192386, "deviation-heading": 5.162454711174317, "set_robot_commands": 0.012606155077616374, "deviation-center-line": 0.8223733550191243, "driven_lanedir_consec": 1.9354375506095296, "sim_compute_sim_state": 0.0057939600944519045, "sim_compute_performance-ego": 0.008115471998850505, "sim_compute_robot_state-ego": 0.009857495625813804}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.053612763426325, "sim_physics": 0.13443302790323894, "survival_time": 14.950000000000076, "driven_lanedir": 3.949891822174674, "sim_render-ego": 0.013848257064819337, "in-drivable-lane": 0, "agent_compute-ego": 0.04830011208852132, "deviation-heading": 3.027135142152213, "set_robot_commands": 0.011496150493621826, "deviation-center-line": 0.7918673815891828, "driven_lanedir_consec": 3.949891822174674, "sim_compute_sim_state": 0.005430426597595215, "sim_compute_performance-ego": 0.008268067836761475, "sim_compute_robot_state-ego": 0.01031396230061849}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.449565013587186, "sim_physics": 0.12203531821568808, "survival_time": 14.950000000000076, "driven_lanedir": 4.209704288883147, "sim_render-ego": 0.013514596621195476, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.050359894434611, "deviation-heading": 2.9444491378451314, "set_robot_commands": 0.011368584632873536, "deviation-center-line": 0.7966666425944793, "driven_lanedir_consec": 4.209704288883147, "sim_compute_sim_state": 0.005423731009165446, "sim_compute_performance-ego": 0.008182204564412435, "sim_compute_robot_state-ego": 0.010108263492584228}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1576021477637823, "sim_physics": 0.1128918719291687, "survival_time": 14.950000000000076, "driven_lanedir": 2.8045413909895993, "sim_render-ego": 0.01316185156504313, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.053904794851938886, "deviation-heading": 3.6226006188245057, "set_robot_commands": 0.010388909180959064, "deviation-center-line": 0.6441109606314008, "driven_lanedir_consec": 1.4118998879069782, "sim_compute_sim_state": 0.005400255521138509, "sim_compute_performance-ego": 0.007903892993927002, "sim_compute_robot_state-ego": 0.01024303118387858}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.273371601723449, "sim_physics": 0.08118042786916096, "survival_time": 14.950000000000076, "driven_lanedir": 4.167696157998167, "sim_render-ego": 0.01019963264465332, "in-drivable-lane": 0, "agent_compute-ego": 0.04476418972015381, "deviation-heading": 3.03368230823569, "set_robot_commands": 0.007799454530080159, "deviation-center-line": 0.7678036138323429, "driven_lanedir_consec": 4.167696157998167, "sim_compute_sim_state": 0.004397372404734294, "sim_compute_performance-ego": 0.006213829517364502, "sim_compute_robot_state-ego": 0.007431797981262207}}
set_robot_commands_max0.012606155077616374
set_robot_commands_mean0.010731850783030192
set_robot_commands_median0.011368584632873536
set_robot_commands_min0.007799454530080159
sim_compute_performance-ego_max0.008268067836761475
sim_compute_performance-ego_mean0.007736693382263184
sim_compute_performance-ego_median0.008115471998850505
sim_compute_performance-ego_min0.006213829517364502
sim_compute_robot_state-ego_max0.01031396230061849
sim_compute_robot_state-ego_mean0.00959091011683146
sim_compute_robot_state-ego_median0.010108263492584228
sim_compute_robot_state-ego_min0.007431797981262207
sim_compute_sim_state_max0.0057939600944519045
sim_compute_sim_state_mean0.005289149125417074
sim_compute_sim_state_median0.005423731009165446
sim_compute_sim_state_min0.004397372404734294
sim_physics_max0.13443302790323894
sim_physics_mean0.11463402716318769
sim_physics_median0.12203531821568808
sim_physics_min0.08118042786916096
sim_render-ego_max0.013848257064819337
sim_render-ego_mean0.012791532675425214
sim_render-ego_median0.013233325481414794
sim_render-ego_min0.01019963264465332
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
297275947Aleksei Shpilman 🇷🇺challenge-aido_LF-baseline-IL-0215aido3-LF-sim-testingstep1-simulationerrornoip-172-31-35-218-104900:07:41
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
297075931Frank (Chude) Qian 🇨🇦2019-12-09|FrankNet|v3-Patch2aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:23:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.66265322102612
survival_time_median7.79999999999998
deviation-center-line_median0.5141576144379333
in-drivable-lane_median0.9500000000000136


other stats
agent_compute-ego_max0.08161274413891437
agent_compute-ego_mean0.062299362620070776
agent_compute-ego_median0.06273013980765092
agent_compute-ego_min0.047738836929861424
deviation-center-line_max1.0262996849696997
deviation-center-line_mean0.5106070382739133
deviation-center-line_min0.1765511962543562
deviation-heading_max3.686427404808593
deviation-heading_mean1.7606438972922869
deviation-heading_median1.5126722453269883
deviation-heading_min0.6307935138267197
driven_any_max7.000625367416629
driven_any_mean3.694169462698574
driven_any_median3.4257100816011725
driven_any_min1.5917554428020717
driven_lanedir_consec_max6.566189046154868
driven_lanedir_consec_mean2.9972028913755824
driven_lanedir_consec_min1.0533116806315657
driven_lanedir_max6.566189046154868
driven_lanedir_mean2.9972028913755824
driven_lanedir_median2.66265322102612
driven_lanedir_min1.0533116806315657
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean1.3933333333333353
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.92913857676635, "sim_physics": 0.10456288094614066, "survival_time": 7.649999999999981, "driven_lanedir": 1.605334685942624, "sim_render-ego": 0.012066397012448778, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.0648083094677894, "deviation-heading": 1.4890768585861074, "set_robot_commands": 0.009647176156636158, "deviation-center-line": 0.31154102488043006, "driven_lanedir_consec": 1.605334685942624, "sim_compute_sim_state": 0.004956360735924415, "sim_compute_performance-ego": 0.007432423385919309, "sim_compute_robot_state-ego": 0.008967775145387338}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5917554428020717, "sim_physics": 0.11930829019688848, "survival_time": 3.349999999999996, "driven_lanedir": 1.5571607899102646, "sim_render-ego": 0.01364501198725914, "in-drivable-lane": 0, "agent_compute-ego": 0.08010519796342992, "deviation-heading": 0.6307935138267197, "set_robot_commands": 0.010419696124631969, "deviation-center-line": 0.2371890124487037, "driven_lanedir_consec": 1.5571607899102646, "sim_compute_sim_state": 0.005149015739782533, "sim_compute_performance-ego": 0.007564989488516281, "sim_compute_robot_state-ego": 0.00965587060842941}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 7.000625367416629, "sim_physics": 0.11528039534886678, "survival_time": 14.950000000000076, "driven_lanedir": 6.566189046154868, "sim_render-ego": 0.013019707997639974, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.07612076679865519, "deviation-heading": 2.6990229313821654, "set_robot_commands": 0.01081718921661377, "deviation-center-line": 1.0262996849696997, "driven_lanedir_consec": 6.566189046154868, "sim_compute_sim_state": 0.005337904294331869, "sim_compute_performance-ego": 0.008037633101145426, "sim_compute_robot_state-ego": 0.009847137133280436}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.028857010454356, "sim_physics": 0.10219785270340946, "survival_time": 10.90000000000002, "driven_lanedir": 3.5419365430927185, "sim_render-ego": 0.01278030106780726, "in-drivable-lane": 3.1000000000000103, "agent_compute-ego": 0.06387356443142672, "deviation-heading": 1.9676515440401705, "set_robot_commands": 0.009810025538873234, "deviation-center-line": 0.512731966674977, "driven_lanedir_consec": 3.5419365430927185, "sim_compute_sim_state": 0.0052154993792192655, "sim_compute_performance-ego": 0.007595702048835405, "sim_compute_robot_state-ego": 0.00916538435384768}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.581575119822652, "sim_physics": 0.1036088527777256, "survival_time": 7.79999999999998, "driven_lanedir": 2.66265322102612, "sim_render-ego": 0.01223139885144356, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.06252280412576137, "deviation-heading": 1.5008469868933356, "set_robot_commands": 0.009535555656139668, "deviation-center-line": 0.3619602216812943, "driven_lanedir_consec": 2.66265322102612, "sim_compute_sim_state": 0.005160891092740572, "sim_compute_performance-ego": 0.007396433597955949, "sim_compute_robot_state-ego": 0.008931636810302734}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.592892192862294, "sim_physics": 0.10700805877384388, "survival_time": 3.7999999999999945, "driven_lanedir": 1.0533116806315657, "sim_render-ego": 0.012166760469737806, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06273013980765092, "deviation-heading": 0.9586508707777464, "set_robot_commands": 0.01003521994540566, "deviation-center-line": 0.1765511962543562, "driven_lanedir_consec": 1.0533116806315657, "sim_compute_sim_state": 0.005081782215519955, "sim_compute_performance-ego": 0.007566191648182116, "sim_compute_robot_state-ego": 0.009303717236769827}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 5.028309520912083, "sim_physics": 0.12318374864723652, "survival_time": 11.150000000000023, "driven_lanedir": 3.647435991291762, "sim_render-ego": 0.013506284209110276, "in-drivable-lane": 2.8000000000000203, "agent_compute-ego": 0.08161274413891437, "deviation-heading": 2.31059687139679, "set_robot_commands": 0.010277169702298972, "deviation-center-line": 0.6134959894918887, "driven_lanedir_consec": 3.647435991291762, "sim_compute_sim_state": 0.005050498808445952, "sim_compute_performance-ego": 0.008049890064872434, "sim_compute_robot_state-ego": 0.010092976916531276}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.0510977288532506, "sim_physics": 0.10958804794259971, "survival_time": 7.399999999999982, "driven_lanedir": 2.6550813814986345, "sim_render-ego": 0.013106164094564075, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.0696182975897918, "deviation-heading": 1.4539726949437768, "set_robot_commands": 0.010467340817322602, "deviation-center-line": 0.5184166823514182, "driven_lanedir_consec": 2.6550813814986345, "sim_compute_sim_state": 0.005542700355117385, "sim_compute_performance-ego": 0.00778387366114436, "sim_compute_robot_state-ego": 0.009979219050020784}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 5.188623892468657, "sim_physics": 0.07890352718812182, "survival_time": 13.300000000000054, "driven_lanedir": 3.961078422274781, "sim_render-ego": 0.009437613917472666, "in-drivable-lane": 2.3500000000000165, "agent_compute-ego": 0.05269073454060949, "deviation-heading": 3.686427404808593, "set_robot_commands": 0.007008195819711327, "deviation-center-line": 0.891359329706829, "driven_lanedir_consec": 3.961078422274781, "sim_compute_sim_state": 0.003877643355749603, "sim_compute_performance-ego": 0.0054758321073718535, "sim_compute_robot_state-ego": 0.006847235493193892}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.4287891404246778, "sim_physics": 0.07390493410496624, "survival_time": 8.14999999999998, "driven_lanedir": 3.085880960694704, "sim_render-ego": 0.009658927566434708, "in-drivable-lane": 0.4499999999999993, "agent_compute-ego": 0.04830311704998368, "deviation-heading": 2.047366257308369, "set_robot_commands": 0.007104430461953754, "deviation-center-line": 0.6012854282034121, "driven_lanedir_consec": 3.085880960694704, "sim_compute_sim_state": 0.00406708307792804, "sim_compute_performance-ego": 0.005618657071166243, "sim_compute_robot_state-ego": 0.006844021791329413}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.135074021048153, "sim_physics": 0.07607098988124303, "survival_time": 4.899999999999991, "driven_lanedir": 2.1061801689370885, "sim_render-ego": 0.009981495993477958, "in-drivable-lane": 0, "agent_compute-ego": 0.04814334061681008, "deviation-heading": 0.7173889840175083, "set_robot_commands": 0.007131953628695741, "deviation-center-line": 0.29716322017466523, "driven_lanedir_consec": 2.1061801689370885, "sim_compute_sim_state": 0.004256387146151796, "sim_compute_performance-ego": 0.005960476641752282, "sim_compute_robot_state-ego": 0.006816708311742666}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.4257100816011725, "sim_physics": 0.09130779607796374, "survival_time": 8.09999999999998, "driven_lanedir": 2.5574274423430614, "sim_render-ego": 0.010669948142251851, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.06058756363244704, "deviation-heading": 1.5126722453269883, "set_robot_commands": 0.00851395689410928, "deviation-center-line": 0.5141576144379333, "driven_lanedir_consec": 2.5574274423430614, "sim_compute_sim_state": 0.004337696381557135, "sim_compute_performance-ego": 0.00617179458523974, "sim_compute_robot_state-ego": 0.007651651347125018}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 3.201596075764367, "sim_physics": 0.06447596926438182, "survival_time": 7.599999999999981, "driven_lanedir": 2.962122329071751, "sim_render-ego": 0.008689091393822118, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.048098786881095486, "deviation-heading": 1.6168455226642169, "set_robot_commands": 0.006809173445952566, "deviation-center-line": 0.5148672856797128, "driven_lanedir_consec": 2.962122329071751, "sim_compute_sim_state": 0.003514150255604794, "sim_compute_performance-ego": 0.004969192178625809, "sim_compute_robot_state-ego": 0.0061993379341928586}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.5639975145556155, "sim_physics": 0.07686366444140409, "survival_time": 5.649999999999988, "driven_lanedir": 1.9207482383506764, "sim_render-ego": 0.00958766135494266, "in-drivable-lane": 1.1499999999999964, "agent_compute-ego": 0.047738836929861424, "deviation-heading": 1.3760787290054153, "set_robot_commands": 0.006975311093625769, "deviation-center-line": 0.31985047260141647, "driven_lanedir_consec": 1.9207482383506764, "sim_compute_sim_state": 0.00393491297696544, "sim_compute_performance-ego": 0.005730126811339792, "sim_compute_robot_state-ego": 0.006867856051014588}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.664500254726283, "sim_physics": 0.10232405982941035, "survival_time": 12.650000000000045, "driven_lanedir": 5.075502469413115, "sim_render-ego": 0.01206818965112739, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.06753623532683482, "deviation-heading": 2.442267044406405, "set_robot_commands": 0.009518083376375584, "deviation-center-line": 0.7622364445519625, "driven_lanedir_consec": 5.075502469413115, "sim_compute_sim_state": 0.004890825437462848, "sim_compute_performance-ego": 0.007090706127905563, "sim_compute_robot_state-ego": 0.009092018067129988}}
set_robot_commands_max0.01081718921661377
set_robot_commands_mean0.008938031858556404
set_robot_commands_median0.009535555656139668
set_robot_commands_min0.006809173445952566
sim_compute_performance-ego_max0.008049890064872434
sim_compute_performance-ego_mean0.006829594834664836
sim_compute_performance-ego_median0.007396433597955949
sim_compute_performance-ego_min0.004969192178625809
sim_compute_robot_state-ego_max0.010092976916531276
sim_compute_robot_state-ego_mean0.008417503083353194
sim_compute_robot_state-ego_median0.008967775145387338
sim_compute_robot_state-ego_min0.0061993379341928586
sim_compute_sim_state_max0.005542700355117385
sim_compute_sim_state_mean0.004691556750166773
sim_compute_sim_state_median0.004956360735924415
sim_compute_sim_state_min0.003514150255604794
sim_physics_max0.12318374864723652
sim_physics_mean0.09657260454161348
sim_physics_median0.10232405982941035
sim_physics_min0.06447596926438182
sim_render-ego_max0.01364501198725914
sim_render-ego_mean0.011507663580636016
sim_render-ego_median0.01206818965112739
sim_render-ego_min0.008689091393822118
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.490000000000006
survival_time_min3.349999999999996
No reset possible
296735900Robert Moni 🇭🇺lzoltan-03aido3-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:15:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5441833049924094
survival_time_median9.950000000000006
deviation-center-line_median0.5407958292349477
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.04195619265238444
agent_compute-ego_mean0.03381559547804987
agent_compute-ego_median0.031190864856426533
agent_compute-ego_min0.026880697916018083
deviation-center-line_max0.6883992885018939
deviation-center-line_mean0.5503003261568341
deviation-center-line_min0.4248171976381744
deviation-heading_max3.5928167577182095
deviation-heading_mean2.5813147738051203
deviation-heading_median2.7775163674138805
deviation-heading_min1.645173137542015
driven_any_max5.390685991033754
driven_any_mean3.485817307234002
driven_any_median3.150167710219969
driven_any_min2.290550958170496
driven_lanedir_consec_max4.936083868729861
driven_lanedir_consec_mean3.094241827178466
driven_lanedir_consec_min2.1834450089584605
driven_lanedir_max4.946512589110522
driven_lanedir_mean3.099849024536449
driven_lanedir_median2.5441833049924094
driven_lanedir_min2.2002152555822585
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.5299999999999981
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.150167710219969, "sim_physics": 0.16090796940290747, "survival_time": 9.950000000000006, "driven_lanedir": 2.5364940675612737, "sim_render-ego": 0.009215088944938317, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.028155927083001065, "deviation-heading": 2.7775163674138805, "set_robot_commands": 0.006539747343590511, "deviation-center-line": 0.5407958292349477, "driven_lanedir_consec": 2.5356570477758167, "sim_compute_sim_state": 0.003818894151467175, "sim_compute_performance-ego": 0.005311991102132366, "sim_compute_robot_state-ego": 0.006714321261075274, "sim_compute_robot_state-npc0": 0.006455956990994401, "sim_compute_robot_state-npc1": 0.006239555588918715, "sim_compute_robot_state-npc2": 0.006176066758045599, "sim_compute_robot_state-npc3": 0.006179847908978486}, "udem1-1-0": {"driven_any": 2.6524587445788024, "sim_physics": 0.15307904889919613, "survival_time": 7.449999999999981, "driven_lanedir": 2.5441833049924094, "sim_render-ego": 0.009086114448188937, "in-drivable-lane": 0, "agent_compute-ego": 0.026880697916018083, "deviation-heading": 1.727078767993059, "set_robot_commands": 0.006891898660851805, "deviation-center-line": 0.45596323002698064, "driven_lanedir_consec": 2.5441833049924094, "sim_compute_sim_state": 0.003591843099402101, "sim_compute_performance-ego": 0.005256737638639924, "sim_compute_robot_state-ego": 0.0065922833129063545, "sim_compute_robot_state-npc0": 0.00625425537160579, "sim_compute_robot_state-npc1": 0.006072514809218029, "sim_compute_robot_state-npc2": 0.006069810598488622, "sim_compute_robot_state-npc3": 0.005895885045096378}, "udem1-2-0": {"driven_any": 3.9452231321669897, "sim_physics": 0.2335668079025077, "survival_time": 11.950000000000037, "driven_lanedir": 3.271839905435783, "sim_render-ego": 0.011899542110235622, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.04089429488241922, "deviation-heading": 3.1639888383584385, "set_robot_commands": 0.009307854345154064, "deviation-center-line": 0.6415260853821738, "driven_lanedir_consec": 3.271839905435783, "sim_compute_sim_state": 0.004958805179994974, "sim_compute_performance-ego": 0.0069169599142034684, "sim_compute_robot_state-ego": 0.008916522668495339, "sim_compute_robot_state-npc0": 0.008364553730856924, "sim_compute_robot_state-npc1": 0.008128581186717524, "sim_compute_robot_state-npc2": 0.008259922889486017, "sim_compute_robot_state-npc3": 0.008265696808882837}, "udem1-3-0": {"driven_any": 5.390685991033754, "sim_physics": 0.23956180493036905, "survival_time": 14.950000000000076, "driven_lanedir": 4.946512589110522, "sim_render-ego": 0.01254772424697876, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.04195619265238444, "deviation-heading": 3.5928167577182095, "set_robot_commands": 0.010202208360036212, "deviation-center-line": 0.6883992885018939, "driven_lanedir_consec": 4.936083868729861, "sim_compute_sim_state": 0.005271193981170655, "sim_compute_performance-ego": 0.007423132260640462, "sim_compute_robot_state-ego": 0.009282887776692708, "sim_compute_robot_state-npc0": 0.009258224169413248, "sim_compute_robot_state-npc1": 0.008945780595143636, "sim_compute_robot_state-npc2": 0.00895389477411906, "sim_compute_robot_state-npc3": 0.009167840480804443}, "udem1-4-0": {"driven_any": 2.290550958170496, "sim_physics": 0.17800529003143312, "survival_time": 6.499999999999985, "driven_lanedir": 2.2002152555822585, "sim_render-ego": 0.010021312420184796, "in-drivable-lane": 0, "agent_compute-ego": 0.031190864856426533, "deviation-heading": 1.645173137542015, "set_robot_commands": 0.007785520186791053, "deviation-center-line": 0.4248171976381744, "driven_lanedir_consec": 2.1834450089584605, "sim_compute_sim_state": 0.00402682377741887, "sim_compute_performance-ego": 0.005662808051476112, "sim_compute_robot_state-ego": 0.007239690193763146, "sim_compute_robot_state-npc0": 0.007005878595205454, "sim_compute_robot_state-npc1": 0.006693319173959585, "sim_compute_robot_state-npc2": 0.006708983274606558, "sim_compute_robot_state-npc3": 0.006765574675339919}}
set_robot_commands_max0.010202208360036212
set_robot_commands_mean0.00814544577928473
set_robot_commands_median0.007785520186791053
set_robot_commands_min0.006539747343590511
sim_compute_performance-ego_max0.007423132260640462
sim_compute_performance-ego_mean0.006114325793418467
sim_compute_performance-ego_median0.005662808051476112
sim_compute_performance-ego_min0.005256737638639924
sim_compute_robot_state-ego_max0.009282887776692708
sim_compute_robot_state-ego_mean0.007749141042586565
sim_compute_robot_state-ego_median0.007239690193763146
sim_compute_robot_state-ego_min0.0065922833129063545
sim_compute_robot_state-npc0_max0.009258224169413248
sim_compute_robot_state-npc0_mean0.007467773771615163
sim_compute_robot_state-npc0_median0.007005878595205454
sim_compute_robot_state-npc0_min0.00625425537160579
sim_compute_robot_state-npc1_max0.008945780595143636
sim_compute_robot_state-npc1_mean0.007215950270791497
sim_compute_robot_state-npc1_median0.006693319173959585
sim_compute_robot_state-npc1_min0.006072514809218029
sim_compute_robot_state-npc2_max0.00895389477411906
sim_compute_robot_state-npc2_mean0.007233735658949169
sim_compute_robot_state-npc2_median0.006708983274606558
sim_compute_robot_state-npc2_min0.006069810598488622
sim_compute_robot_state-npc3_max0.009167840480804443
sim_compute_robot_state-npc3_mean0.007254968983820412
sim_compute_robot_state-npc3_median0.006765574675339919
sim_compute_robot_state-npc3_min0.005895885045096378
sim_compute_sim_state_max0.005271193981170655
sim_compute_sim_state_mean0.004333512037890755
sim_compute_sim_state_median0.00402682377741887
sim_compute_sim_state_min0.003591843099402101
sim_physics_max0.23956180493036905
sim_physics_mean0.19302418423328271
sim_physics_median0.17800529003143312
sim_physics_min0.15307904889919613
sim_render-ego_max0.01254772424697876
sim_render-ego_mean0.010553956434105286
sim_render-ego_median0.010021312420184796
sim_render-ego_min0.009086114448188937
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.160000000000016
survival_time_min6.499999999999985
No reset possible
296635899Robert Moni 🇭🇺lzoltan-03aido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.319912508010075
survival_time_median14.950000000000076
deviation-center-line_median0.9181337585458912
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.02544273179152916
agent_compute-ego_mean0.02224550011139239
agent_compute-ego_median0.021468176047007244
agent_compute-ego_min0.021322808767619886
deviation-center-line_max0.9391840387446816
deviation-center-line_mean0.6543253957850711
deviation-center-line_min0.2310744078926571
deviation-heading_max3.604526712676506
deviation-heading_mean2.650071804632515
deviation-heading_median3.199502395673281
deviation-heading_min1.1048975828005267
driven_any_max5.0891573786052335
driven_any_mean3.58577983948092
driven_any_median5.035923755610996
driven_any_min1.3816743923002457
driven_lanedir_consec_max4.829713919434889
driven_lanedir_consec_mean3.2414189192683622
driven_lanedir_consec_min0.9662445213203066
driven_lanedir_max4.829713919434889
driven_lanedir_mean3.2414189192683622
driven_lanedir_median4.319912508010075
driven_lanedir_min0.9662445213203066
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.4399999999999985
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 5.036627604461616, "sim_physics": 0.09873498598734538, "survival_time": 14.950000000000076, "driven_lanedir": 4.7859951274294215, "sim_render-ego": 0.007094036738077799, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.021623944441477454, "deviation-heading": 3.542688744488908, "set_robot_commands": 0.005115813414255778, "deviation-center-line": 0.9391840387446816, "driven_lanedir_consec": 4.7859951274294215, "sim_compute_sim_state": 0.0028738935788472494, "sim_compute_performance-ego": 0.004037222067515055, "sim_compute_robot_state-ego": 0.005142457485198974, "sim_compute_robot_state-npc0": 0.00491918166478475, "sim_compute_robot_state-npc1": 0.004707334836324056, "sim_compute_robot_state-npc2": 0.004720194339752197, "sim_compute_robot_state-npc3": 0.004685577551523845}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3816743923002457, "sim_physics": 0.10977896891142191, "survival_time": 3.7999999999999945, "driven_lanedir": 1.305228520147117, "sim_render-ego": 0.007246707615099456, "in-drivable-lane": 0, "agent_compute-ego": 0.021322808767619886, "deviation-heading": 1.1048975828005267, "set_robot_commands": 0.004967545208178069, "deviation-center-line": 0.2524234788410795, "driven_lanedir_consec": 1.305228520147117, "sim_compute_sim_state": 0.0028484651916905455, "sim_compute_performance-ego": 0.0039982544748406665, "sim_compute_robot_state-ego": 0.005098527983615273, "sim_compute_robot_state-npc0": 0.00483311791169016, "sim_compute_robot_state-npc1": 0.004698411414497777, "sim_compute_robot_state-npc2": 0.004662090226223594, "sim_compute_robot_state-npc3": 0.0046325608303672385}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.035923755610996, "sim_physics": 0.10946337938308716, "survival_time": 14.950000000000076, "driven_lanedir": 4.319912508010075, "sim_render-ego": 0.007550666332244873, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02136983950932821, "deviation-heading": 3.604526712676506, "set_robot_commands": 0.005115253130594889, "deviation-center-line": 0.9181337585458912, "driven_lanedir_consec": 4.319912508010075, "sim_compute_sim_state": 0.0028662689526875815, "sim_compute_performance-ego": 0.004011868635813395, "sim_compute_robot_state-ego": 0.005118599732716878, "sim_compute_robot_state-npc0": 0.004902635415395101, "sim_compute_robot_state-npc1": 0.004731356302897135, "sim_compute_robot_state-npc2": 0.004684866269429525, "sim_compute_robot_state-npc3": 0.004680777390797933}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.0891573786052335, "sim_physics": 0.10109471559524535, "survival_time": 14.950000000000076, "driven_lanedir": 4.829713919434889, "sim_render-ego": 0.007042022546132406, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.021468176047007244, "deviation-heading": 3.199502395673281, "set_robot_commands": 0.005051811536153157, "deviation-center-line": 0.930811294901046, "driven_lanedir_consec": 4.829713919434889, "sim_compute_sim_state": 0.002858432133992513, "sim_compute_performance-ego": 0.004011557896931966, "sim_compute_robot_state-ego": 0.005110495090484619, "sim_compute_robot_state-npc0": 0.004893590609232584, "sim_compute_robot_state-npc1": 0.004683882395426432, "sim_compute_robot_state-npc2": 0.004683531125386556, "sim_compute_robot_state-npc3": 0.00467610518137614}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3855160664265094, "sim_physics": 0.12093548391057156, "survival_time": 4.3499999999999925, "driven_lanedir": 0.9662445213203066, "sim_render-ego": 0.00799119609525834, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.02544273179152916, "deviation-heading": 1.7987435875233515, "set_robot_commands": 0.006122323288314644, "deviation-center-line": 0.2310744078926571, "driven_lanedir_consec": 0.9662445213203066, "sim_compute_sim_state": 0.003347547574975025, "sim_compute_performance-ego": 0.004421478030325353, "sim_compute_robot_state-ego": 0.00567629693568438, "sim_compute_robot_state-npc0": 0.0054648141751344175, "sim_compute_robot_state-npc1": 0.005230895404157968, "sim_compute_robot_state-npc2": 0.0052311064183026895, "sim_compute_robot_state-npc3": 0.005337712408482343}}
set_robot_commands_max0.006122323288314644
set_robot_commands_mean0.005274549315499308
set_robot_commands_median0.005115253130594889
set_robot_commands_min0.004967545208178069
sim_compute_performance-ego_max0.004421478030325353
sim_compute_performance-ego_mean0.004096076221085288
sim_compute_performance-ego_median0.004011868635813395
sim_compute_performance-ego_min0.0039982544748406665
sim_compute_robot_state-ego_max0.00567629693568438
sim_compute_robot_state-ego_mean0.005229275445540025
sim_compute_robot_state-ego_median0.005118599732716878
sim_compute_robot_state-ego_min0.005098527983615273
sim_compute_robot_state-npc0_max0.0054648141751344175
sim_compute_robot_state-npc0_mean0.005002667955247403
sim_compute_robot_state-npc0_median0.004902635415395101
sim_compute_robot_state-npc0_min0.00483311791169016
sim_compute_robot_state-npc1_max0.005230895404157968
sim_compute_robot_state-npc1_mean0.004810376070660673
sim_compute_robot_state-npc1_median0.004707334836324056
sim_compute_robot_state-npc1_min0.004683882395426432
sim_compute_robot_state-npc2_max0.0052311064183026895
sim_compute_robot_state-npc2_mean0.004796357675818912
sim_compute_robot_state-npc2_median0.004684866269429525
sim_compute_robot_state-npc2_min0.004662090226223594
sim_compute_robot_state-npc3_max0.005337712408482343
sim_compute_robot_state-npc3_mean0.004802546672509499
sim_compute_robot_state-npc3_median0.004680777390797933
sim_compute_robot_state-npc3_min0.0046325608303672385
sim_compute_sim_state_max0.003347547574975025
sim_compute_sim_state_mean0.0029589214864385828
sim_compute_sim_state_median0.0028662689526875815
sim_compute_sim_state_min0.0028484651916905455
sim_physics_max0.12093548391057156
sim_physics_mean0.10800150675753428
sim_physics_median0.10946337938308716
sim_physics_min0.09873498598734538
sim_render-ego_max0.00799119609525834
sim_render-ego_mean0.007384925865362576
sim_render-ego_median0.007246707615099456
sim_render-ego_min0.007042022546132406
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.600000000000042
survival_time_min3.7999999999999945
No reset possible
296525889Riza Velioglu 🇩🇪UniBielefeld-#3aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5182262686664
survival_time_median14.950000000000076
deviation-center-line_median1.049629653014813
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1028409520785014
agent_compute-ego_mean0.0940333512624105
agent_compute-ego_median0.09746318976084392
agent_compute-ego_min0.08319632848103842
deviation-center-line_max1.2238127695876375
deviation-center-line_mean1.0267799087810758
deviation-center-line_min0.766028831172494
deviation-heading_max3.831816697417848
deviation-heading_mean2.364642310406057
deviation-heading_median2.3542431264739316
deviation-heading_min1.402551478546786
driven_any_max4.010509208165809
driven_any_mean3.568726966503134
driven_any_median3.5552350712642515
driven_any_min3.010820612444709
driven_lanedir_consec_max3.929536841125067
driven_lanedir_consec_mean3.503749178878759
driven_lanedir_consec_min2.8882319820827576
driven_lanedir_max3.929536841125067
driven_lanedir_mean3.503749178878759
driven_lanedir_median3.5182262686664
driven_lanedir_min2.8882319820827576
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.010820612444709, "sim_physics": 0.08092122236887614, "survival_time": 14.950000000000076, "driven_lanedir": 2.8882319820827576, "sim_render-ego": 0.009721744855244954, "in-drivable-lane": 0, "agent_compute-ego": 0.1028409520785014, "deviation-heading": 3.831816697417848, "set_robot_commands": 0.007619838714599609, "deviation-center-line": 1.2238127695876375, "driven_lanedir_consec": 2.8882319820827576, "sim_compute_sim_state": 0.004104118347167968, "sim_compute_performance-ego": 0.005878690083821614, "sim_compute_robot_state-ego": 0.007154138088226319}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.329033761688504, "sim_physics": 0.0802388874689738, "survival_time": 14.950000000000076, "driven_lanedir": 3.276023496576102, "sim_render-ego": 0.009451096852620442, "in-drivable-lane": 0, "agent_compute-ego": 0.09746318976084392, "deviation-heading": 2.3542431264739316, "set_robot_commands": 0.007368903160095214, "deviation-center-line": 1.049629653014813, "driven_lanedir_consec": 3.276023496576102, "sim_compute_sim_state": 0.003946507771809896, "sim_compute_performance-ego": 0.005526583194732666, "sim_compute_robot_state-ego": 0.006848401228586833}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.010509208165809, "sim_physics": 0.08027674674987793, "survival_time": 14.950000000000076, "driven_lanedir": 3.929536841125067, "sim_render-ego": 0.009705817699432372, "in-drivable-lane": 0, "agent_compute-ego": 0.10016759395599366, "deviation-heading": 2.4675073571639023, "set_robot_commands": 0.007453944683074951, "deviation-center-line": 1.0683635940029916, "driven_lanedir_consec": 3.929536841125067, "sim_compute_sim_state": 0.003998311360677084, "sim_compute_performance-ego": 0.005643507639567057, "sim_compute_robot_state-ego": 0.007029336293538411}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9380361789523946, "sim_physics": 0.07481813271840414, "survival_time": 14.950000000000076, "driven_lanedir": 3.906727305943467, "sim_render-ego": 0.009271186192830403, "in-drivable-lane": 0, "agent_compute-ego": 0.08649869203567505, "deviation-heading": 1.402551478546786, "set_robot_commands": 0.007049510478973389, "deviation-center-line": 0.766028831172494, "driven_lanedir_consec": 3.906727305943467, "sim_compute_sim_state": 0.003860337734222412, "sim_compute_performance-ego": 0.00543751319249471, "sim_compute_robot_state-ego": 0.006674920717875163}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5552350712642515, "sim_physics": 0.07277247111002604, "survival_time": 14.950000000000076, "driven_lanedir": 3.5182262686664, "sim_render-ego": 0.009035425980885824, "in-drivable-lane": 0, "agent_compute-ego": 0.08319632848103842, "deviation-heading": 1.7670928924278206, "set_robot_commands": 0.006748341719309489, "deviation-center-line": 1.0260646961274429, "driven_lanedir_consec": 3.5182262686664, "sim_compute_sim_state": 0.003683305581410726, "sim_compute_performance-ego": 0.005157957077026367, "sim_compute_robot_state-ego": 0.006491007804870605}}
set_robot_commands_max0.007619838714599609
set_robot_commands_mean0.007248107751210531
set_robot_commands_median0.007368903160095214
set_robot_commands_min0.006748341719309489
sim_compute_performance-ego_max0.005878690083821614
sim_compute_performance-ego_mean0.005528850237528483
sim_compute_performance-ego_median0.005526583194732666
sim_compute_performance-ego_min0.005157957077026367
sim_compute_robot_state-ego_max0.007154138088226319
sim_compute_robot_state-ego_mean0.006839560826619466
sim_compute_robot_state-ego_median0.006848401228586833
sim_compute_robot_state-ego_min0.006491007804870605
sim_compute_sim_state_max0.004104118347167968
sim_compute_sim_state_mean0.003918516159057617
sim_compute_sim_state_median0.003946507771809896
sim_compute_sim_state_min0.003683305581410726
sim_physics_max0.08092122236887614
sim_physics_mean0.07780549208323162
sim_physics_median0.0802388874689738
sim_physics_min0.07277247111002604
sim_render-ego_max0.009721744855244954
sim_render-ego_mean0.0094370543162028
sim_render-ego_median0.009451096852620442
sim_render-ego_min0.009035425980885824
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
296445892Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.152884276282556
survival_time_median10.95000000000002
deviation-center-line_median0.6023949909164903
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.0217438546816508
agent_compute-ego_mean0.021128317096371703
agent_compute-ego_median0.021035902032024784
agent_compute-ego_min0.020616538730668432
deviation-center-line_max0.7493078650904651
deviation-center-line_mean0.527396209979592
deviation-center-line_min0.25263546027366124
deviation-heading_max2.908858133986845
deviation-heading_mean1.9436418158108089
deviation-heading_median2.270280264869605
deviation-heading_min1.0736854070468715
driven_any_max5.245993173109374
driven_any_mean3.4997002537233426
driven_any_median3.50060851912909
driven_any_min1.3980715249245816
driven_lanedir_consec_max4.558128122400492
driven_lanedir_consec_mean3.142050516724111
driven_lanedir_consec_min1.3374225704792813
driven_lanedir_max4.558128122400492
driven_lanedir_mean3.142050516724111
driven_lanedir_median3.152884276282556
driven_lanedir_min1.3374225704792813
in-drivable-lane_max1.6999999999999948
in-drivable-lane_mean0.7500000000000029
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3980715249245816, "sim_physics": 0.0575451980466428, "survival_time": 4.599999999999992, "driven_lanedir": 1.3374225704792813, "sim_render-ego": 0.007286673006804093, "in-drivable-lane": 0, "agent_compute-ego": 0.021298693573993187, "deviation-heading": 1.0877797938283786, "set_robot_commands": 0.005400789820629618, "deviation-center-line": 0.25263546027366124, "driven_lanedir_consec": 1.3374225704792813, "sim_compute_sim_state": 0.0030061576677405315, "sim_compute_performance-ego": 0.004265904426574707, "sim_compute_robot_state-ego": 0.005148193110590396}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.50060851912909, "sim_physics": 0.05692849202787495, "survival_time": 10.95000000000002, "driven_lanedir": 3.152884276282556, "sim_render-ego": 0.00713480226525433, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.021035902032024784, "deviation-heading": 2.908858133986845, "set_robot_commands": 0.005227515686592555, "deviation-center-line": 0.7493078650904651, "driven_lanedir_consec": 3.152884276282556, "sim_compute_sim_state": 0.002982004592407784, "sim_compute_performance-ego": 0.004045700918049573, "sim_compute_robot_state-ego": 0.005111385153853186}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.250857823681877, "sim_physics": 0.05453623533248901, "survival_time": 14.950000000000076, "driven_lanedir": 4.185264047675597, "sim_render-ego": 0.007026522954305013, "in-drivable-lane": 0, "agent_compute-ego": 0.02094659646352132, "deviation-heading": 2.377605479322342, "set_robot_commands": 0.0052217427889506025, "deviation-center-line": 0.6883612453103944, "driven_lanedir_consec": 4.185264047675597, "sim_compute_sim_state": 0.0030067912737528485, "sim_compute_performance-ego": 0.004011753400166829, "sim_compute_robot_state-ego": 0.00506696621576945}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.245993173109374, "sim_physics": 0.056003553867340086, "survival_time": 14.950000000000076, "driven_lanedir": 4.558128122400492, "sim_render-ego": 0.007145098845163981, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.0217438546816508, "deviation-heading": 2.270280264869605, "set_robot_commands": 0.005229012966156006, "deviation-center-line": 0.6023949909164903, "driven_lanedir_consec": 4.558128122400492, "sim_compute_sim_state": 0.0029997642834981284, "sim_compute_performance-ego": 0.004062497615814209, "sim_compute_robot_state-ego": 0.005077203114827474}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1029702277717908, "sim_physics": 0.05594707124027205, "survival_time": 8.09999999999998, "driven_lanedir": 2.476553566782628, "sim_render-ego": 0.007139279518598392, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.020616538730668432, "deviation-heading": 1.0736854070468715, "set_robot_commands": 0.005212788228635435, "deviation-center-line": 0.3442814883069493, "driven_lanedir_consec": 2.476553566782628, "sim_compute_sim_state": 0.002996503570933401, "sim_compute_performance-ego": 0.004045418751092605, "sim_compute_robot_state-ego": 0.005111361727302457}}
set_robot_commands_max0.005400789820629618
set_robot_commands_mean0.005258369898192843
set_robot_commands_median0.005227515686592555
set_robot_commands_min0.005212788228635435
sim_compute_performance-ego_max0.004265904426574707
sim_compute_performance-ego_mean0.0040862550223395855
sim_compute_performance-ego_median0.004045700918049573
sim_compute_performance-ego_min0.004011753400166829
sim_compute_robot_state-ego_max0.005148193110590396
sim_compute_robot_state-ego_mean0.005103021864468592
sim_compute_robot_state-ego_median0.005111361727302457
sim_compute_robot_state-ego_min0.00506696621576945
sim_compute_sim_state_max0.0030067912737528485
sim_compute_sim_state_mean0.0029982442776665384
sim_compute_sim_state_median0.0029997642834981284
sim_compute_sim_state_min0.002982004592407784
sim_physics_max0.0575451980466428
sim_physics_mean0.05619211010292378
sim_physics_median0.056003553867340086
sim_physics_min0.05453623533248901
sim_render-ego_max0.007286673006804093
sim_render-ego_mean0.007146475318025163
sim_render-ego_median0.007139279518598392
sim_render-ego_min0.007026522954305013
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.71000000000003
survival_time_min4.599999999999992
No reset possible
296375872Aleksei Shpilman 🇷🇺challenge-aido_LF-baseline-ILaido3-LFVI-sim-testingstep1-simulationerroryesip-172-31-35-218-104900:00:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
296205871Aleksei Shpilman 🇷🇺challenge-aido_LF-baseline-ILaido3-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:17:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.768735481649452
survival_time_median14.950000000000076
deviation-center-line_median0.9195239444856133
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.028919216734251824
agent_compute-ego_mean0.02507097268872125
agent_compute-ego_median0.023925853570302327
agent_compute-ego_min0.021122233867645265
deviation-center-line_max1.1660748907295562
deviation-center-line_mean0.8851019596701312
deviation-center-line_min0.4603601929332909
deviation-heading_max4.832498815308608
deviation-heading_mean3.992868737785929
deviation-heading_median4.487204822591696
deviation-heading_min2.204289690068442
driven_any_max5.128617540619755
driven_any_mean4.200211348036737
driven_any_median4.901144062221117
driven_any_min2.318865724040876
driven_lanedir_consec_max4.42084879545191
driven_lanedir_consec_mean3.40573945625304
driven_lanedir_consec_min1.896977982384746
driven_lanedir_max4.42084879545191
driven_lanedir_mean3.525712919069014
driven_lanedir_median3.768735481649452
driven_lanedir_min2.0618835200842267
in-drivable-lane_max3.400000000000021
in-drivable-lane_mean1.320000000000004
in-drivable-lane_min0.04999999999999982
per-episodes
details{"udem1-0-0": {"driven_any": 4.916880513841792, "sim_physics": 0.1578845731417338, "survival_time": 14.950000000000076, "driven_lanedir": 4.42084879545191, "sim_render-ego": 0.009232741196950276, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.022597177823384603, "deviation-heading": 4.832498815308608, "set_robot_commands": 0.006818422476450602, "deviation-center-line": 1.1660748907295562, "driven_lanedir_consec": 4.42084879545191, "sim_compute_sim_state": 0.0037319024403889975, "sim_compute_performance-ego": 0.0054135545094807945, "sim_compute_robot_state-ego": 0.006769735018412272, "sim_compute_robot_state-npc0": 0.006335546970367431, "sim_compute_robot_state-npc1": 0.006207381884256999, "sim_compute_robot_state-npc2": 0.006286683877309163, "sim_compute_robot_state-npc3": 0.006156728267669677}, "udem1-1-0": {"driven_any": 4.901144062221117, "sim_physics": 0.15441851218541464, "survival_time": 14.950000000000076, "driven_lanedir": 3.999255496990658, "sim_render-ego": 0.00968698501586914, "in-drivable-lane": 2.0000000000000036, "agent_compute-ego": 0.023925853570302327, "deviation-heading": 4.70807590818008, "set_robot_commands": 0.007704050540924072, "deviation-center-line": 1.0752771264338228, "driven_lanedir_consec": 3.9725565487299934, "sim_compute_sim_state": 0.004015066623687744, "sim_compute_performance-ego": 0.005709055264790853, "sim_compute_robot_state-ego": 0.006850021680196126, "sim_compute_robot_state-npc0": 0.0069278240203857425, "sim_compute_robot_state-npc1": 0.00678573211034139, "sim_compute_robot_state-npc2": 0.006717385450998942, "sim_compute_robot_state-npc3": 0.006675297419230143}, "udem1-2-0": {"driven_any": 5.128617540619755, "sim_physics": 0.13462522268295288, "survival_time": 14.950000000000076, "driven_lanedir": 3.768735481649452, "sim_render-ego": 0.00845960776011149, "in-drivable-lane": 3.400000000000021, "agent_compute-ego": 0.021122233867645265, "deviation-heading": 4.487204822591696, "set_robot_commands": 0.006609691778818766, "deviation-center-line": 0.9195239444856133, "driven_lanedir_consec": 3.768735481649452, "sim_compute_sim_state": 0.0035318851470947264, "sim_compute_performance-ego": 0.005011637210845948, "sim_compute_robot_state-ego": 0.0062921857833862305, "sim_compute_robot_state-npc0": 0.006135730743408203, "sim_compute_robot_state-npc1": 0.005978356997172037, "sim_compute_robot_state-npc2": 0.005900399684906006, "sim_compute_robot_state-npc3": 0.005893712043762207}, "udem1-3-0": {"driven_any": 2.318865724040876, "sim_physics": 0.2043912122989523, "survival_time": 5.799999999999987, "driven_lanedir": 2.0618835200842267, "sim_render-ego": 0.012742447442021864, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02879038144802225, "deviation-heading": 2.204289690068442, "set_robot_commands": 0.009941092852888436, "deviation-center-line": 0.4603601929332909, "driven_lanedir_consec": 1.896977982384746, "sim_compute_sim_state": 0.005210644212262383, "sim_compute_performance-ego": 0.007915200858280576, "sim_compute_robot_state-ego": 0.009634385848867482, "sim_compute_robot_state-npc0": 0.008640622270518336, "sim_compute_robot_state-npc1": 0.008650368657605401, "sim_compute_robot_state-npc2": 0.00909255701920082, "sim_compute_robot_state-npc3": 0.008948862552642822}, "udem1-4-0": {"driven_any": 3.7355488994601425, "sim_physics": 0.24451345879567693, "survival_time": 11.050000000000022, "driven_lanedir": 3.377841301168824, "sim_render-ego": 0.01226175748384916, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.028919216734251824, "deviation-heading": 3.7322744527808176, "set_robot_commands": 0.010176666182090791, "deviation-center-line": 0.8042736437683724, "driven_lanedir_consec": 2.969578473049098, "sim_compute_sim_state": 0.005037916192102217, "sim_compute_performance-ego": 0.007175624640279227, "sim_compute_robot_state-ego": 0.008992911463948936, "sim_compute_robot_state-npc0": 0.008771168160762182, "sim_compute_robot_state-npc1": 0.008901820463292739, "sim_compute_robot_state-npc2": 0.008806292287904213, "sim_compute_robot_state-npc3": 0.008545295145716602}}
set_robot_commands_max0.010176666182090791
set_robot_commands_mean0.008249984766234534
set_robot_commands_median0.007704050540924072
set_robot_commands_min0.006609691778818766
sim_compute_performance-ego_max0.007915200858280576
sim_compute_performance-ego_mean0.00624501449673548
sim_compute_performance-ego_median0.005709055264790853
sim_compute_performance-ego_min0.005011637210845948
sim_compute_robot_state-ego_max0.009634385848867482
sim_compute_robot_state-ego_mean0.007707847958962209
sim_compute_robot_state-ego_median0.006850021680196126
sim_compute_robot_state-ego_min0.0062921857833862305
sim_compute_robot_state-npc0_max0.008771168160762182
sim_compute_robot_state-npc0_mean0.007362178433088379
sim_compute_robot_state-npc0_median0.0069278240203857425
sim_compute_robot_state-npc0_min0.006135730743408203
sim_compute_robot_state-npc1_max0.008901820463292739
sim_compute_robot_state-npc1_mean0.007304732022533714
sim_compute_robot_state-npc1_median0.00678573211034139
sim_compute_robot_state-npc1_min0.005978356997172037
sim_compute_robot_state-npc2_max0.00909255701920082
sim_compute_robot_state-npc2_mean0.007360663664063828
sim_compute_robot_state-npc2_median0.006717385450998942
sim_compute_robot_state-npc2_min0.005900399684906006
sim_compute_robot_state-npc3_max0.008948862552642822
sim_compute_robot_state-npc3_mean0.00724397908580429
sim_compute_robot_state-npc3_median0.006675297419230143
sim_compute_robot_state-npc3_min0.005893712043762207
sim_compute_sim_state_max0.005210644212262383
sim_compute_sim_state_mean0.004305482923107213
sim_compute_sim_state_median0.004015066623687744
sim_compute_sim_state_min0.0035318851470947264
sim_physics_max0.24451345879567693
sim_physics_mean0.17916659582094613
sim_physics_median0.1578845731417338
sim_physics_min0.13462522268295288
sim_render-ego_max0.012742447442021864
sim_render-ego_mean0.010476707779760388
sim_render-ego_median0.00968698501586914
sim_render-ego_min0.00845960776011149
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.34000000000005
survival_time_min5.799999999999987
No reset possible
295965859Soroush Saryazdi 🇨🇦upduckaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:12:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8359366300261533
survival_time_median14.950000000000076
deviation-center-line_median0.8590146971257738
in-drivable-lane_median0


other stats
agent_compute-ego_max0.029193290869394935
agent_compute-ego_mean0.02176630272584803
agent_compute-ego_median0.019857196807861327
agent_compute-ego_min0.01843228816986084
deviation-center-line_max0.9738469266024192
deviation-center-line_mean0.73465243065245
deviation-center-line_min0.08238313069815627
deviation-heading_max4.531074254914957
deviation-heading_mean3.4703262493445757
deviation-heading_median4.405355591980072
deviation-heading_min0.451929838504817
driven_any_max3.4535495266996348
driven_any_mean2.69752956552097
driven_any_median3.226515497114544
driven_any_min0.4008954678296348
driven_lanedir_consec_max3.327298648124566
driven_lanedir_consec_mean2.4851001149760816
driven_lanedir_consec_min0.3832492995755097
driven_lanedir_max3.327298648124566
driven_lanedir_mean2.4851001149760816
driven_lanedir_median2.8359366300261533
driven_lanedir_min0.3832492995755097
in-drivable-lane_max1.050000000000015
in-drivable-lane_mean0.350000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.4535495266996348, "sim_physics": 0.10845939795176188, "survival_time": 14.950000000000076, "driven_lanedir": 3.327298648124566, "sim_render-ego": 0.007665507793426514, "in-drivable-lane": 0, "agent_compute-ego": 0.029193290869394935, "deviation-heading": 3.528777210409576, "set_robot_commands": 0.00707563320795695, "deviation-center-line": 0.9409878094233214, "driven_lanedir_consec": 3.327298648124566, "sim_compute_sim_state": 0.0031943543752034507, "sim_compute_performance-ego": 0.0045147188504536945, "sim_compute_robot_state-ego": 0.005498239199320475, "sim_compute_robot_state-npc0": 0.0060988704363505045, "sim_compute_robot_state-npc1": 0.005445616245269775, "sim_compute_robot_state-npc2": 0.005360684394836426, "sim_compute_robot_state-npc3": 0.005329587459564209}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.2427889745660923, "sim_physics": 0.11073798497517905, "survival_time": 14.950000000000076, "driven_lanedir": 2.8359366300261533, "sim_render-ego": 0.007198793093363444, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.019857196807861327, "deviation-heading": 4.405355591980072, "set_robot_commands": 0.008107526302337647, "deviation-center-line": 0.8590146971257738, "driven_lanedir_consec": 2.8359366300261533, "sim_compute_sim_state": 0.0029169575373331705, "sim_compute_performance-ego": 0.004081563154856364, "sim_compute_robot_state-ego": 0.005071241060892741, "sim_compute_robot_state-npc0": 0.0062867267926534015, "sim_compute_robot_state-npc1": 0.005101482073465983, "sim_compute_robot_state-npc2": 0.004897470474243164, "sim_compute_robot_state-npc3": 0.004856382211049398}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1638983613949434, "sim_physics": 0.1011858582496643, "survival_time": 14.950000000000076, "driven_lanedir": 2.830748085115617, "sim_render-ego": 0.007122329076131185, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.01843228816986084, "deviation-heading": 4.531074254914957, "set_robot_commands": 0.008078952630360922, "deviation-center-line": 0.9738469266024192, "driven_lanedir_consec": 2.830748085115617, "sim_compute_sim_state": 0.0029161739349365234, "sim_compute_performance-ego": 0.004039862155914307, "sim_compute_robot_state-ego": 0.005000271797180176, "sim_compute_robot_state-npc0": 0.00598816712697347, "sim_compute_robot_state-npc1": 0.005005940596262614, "sim_compute_robot_state-npc2": 0.0049250491460164384, "sim_compute_robot_state-npc3": 0.004881499608357747}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.226515497114544, "sim_physics": 0.11059523741404216, "survival_time": 14.950000000000076, "driven_lanedir": 3.048267912038561, "sim_render-ego": 0.007479849656422933, "in-drivable-lane": 0, "agent_compute-ego": 0.019550638993581136, "deviation-heading": 4.434494350913456, "set_robot_commands": 0.008291359742482502, "deviation-center-line": 0.8170295894125794, "driven_lanedir_consec": 3.048267912038561, "sim_compute_sim_state": 0.0030980706214904785, "sim_compute_performance-ego": 0.004251267910003662, "sim_compute_robot_state-ego": 0.005377257664998372, "sim_compute_robot_state-npc0": 0.006402233441670736, "sim_compute_robot_state-npc1": 0.005407172838846843, "sim_compute_robot_state-npc2": 0.0052076268196105955, "sim_compute_robot_state-npc3": 0.005187821388244629}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4008954678296348, "sim_physics": 0.142255516613231, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3832492995755097, "sim_render-ego": 0.00852645845974193, "in-drivable-lane": 0, "agent_compute-ego": 0.021798098788541907, "deviation-heading": 0.451929838504817, "set_robot_commands": 0.010344645556281597, "deviation-center-line": 0.08238313069815627, "driven_lanedir_consec": 0.3832492995755097, "sim_compute_sim_state": 0.003450470812180463, "sim_compute_performance-ego": 0.004649870535906623, "sim_compute_robot_state-ego": 0.005864522036384134, "sim_compute_robot_state-npc0": 0.007460881682003245, "sim_compute_robot_state-npc1": 0.006154964951907887, "sim_compute_robot_state-npc2": 0.005780283142538632, "sim_compute_robot_state-npc3": 0.005689564873190487}}
set_robot_commands_max0.010344645556281597
set_robot_commands_mean0.008379623487883923
set_robot_commands_median0.008107526302337647
set_robot_commands_min0.00707563320795695
sim_compute_performance-ego_max0.004649870535906623
sim_compute_performance-ego_mean0.004307456521426931
sim_compute_performance-ego_median0.004251267910003662
sim_compute_performance-ego_min0.004039862155914307
sim_compute_robot_state-ego_max0.005864522036384134
sim_compute_robot_state-ego_mean0.0053623063517551795
sim_compute_robot_state-ego_median0.005377257664998372
sim_compute_robot_state-ego_min0.005000271797180176
sim_compute_robot_state-npc0_max0.007460881682003245
sim_compute_robot_state-npc0_mean0.006447375895930271
sim_compute_robot_state-npc0_median0.0062867267926534015
sim_compute_robot_state-npc0_min0.00598816712697347
sim_compute_robot_state-npc1_max0.006154964951907887
sim_compute_robot_state-npc1_mean0.0054230353411506204
sim_compute_robot_state-npc1_median0.005407172838846843
sim_compute_robot_state-npc1_min0.005005940596262614
sim_compute_robot_state-npc2_max0.005780283142538632
sim_compute_robot_state-npc2_mean0.0052342227954490506
sim_compute_robot_state-npc2_median0.0052076268196105955
sim_compute_robot_state-npc2_min0.004897470474243164
sim_compute_robot_state-npc3_max0.005689564873190487
sim_compute_robot_state-npc3_mean0.005188971108081294
sim_compute_robot_state-npc3_median0.005187821388244629
sim_compute_robot_state-npc3_min0.004856382211049398
sim_compute_sim_state_max0.003450470812180463
sim_compute_sim_state_mean0.003115205456228817
sim_compute_sim_state_median0.0030980706214904785
sim_compute_sim_state_min0.0029161739349365234
sim_physics_max0.142255516613231
sim_physics_mean0.11464679904077564
sim_physics_median0.11059523741404216
sim_physics_min0.1011858582496643
sim_render-ego_max0.00852645845974193
sim_render-ego_mean0.0075985876158172014
sim_render-ego_median0.007479849656422933
sim_render-ego_min0.007122329076131185
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.300000000000065
survival_time_min1.7000000000000008
No reset possible
295755858Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:12:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.529707200612318
survival_time_median14.950000000000076
deviation-center-line_median0.49990886024583775
in-drivable-lane_median1.4499999999999948


other stats
agent_compute-ego_max0.04930484492475815
agent_compute-ego_mean0.041210554737329194
agent_compute-ego_median0.04316637516021728
agent_compute-ego_min0.029189202292212123
deviation-center-line_max0.9237727074937806
deviation-center-line_mean0.5701840926424617
deviation-center-line_min0.31993794416118504
deviation-heading_max4.864836050587565
deviation-heading_mean2.7799774345371313
deviation-heading_median2.1430255526746778
deviation-heading_min1.7796542191774734
driven_any_max4.45109252128178
driven_any_mean3.2102479329953626
driven_any_median3.7930893222726434
driven_any_min1.3873262415635368
driven_lanedir_consec_max4.239111407868371
driven_lanedir_consec_mean2.830406019842429
driven_lanedir_consec_min0.9660986656331376
driven_lanedir_max4.239111407868371
driven_lanedir_mean2.830406019842429
driven_lanedir_median3.529707200612318
driven_lanedir_min0.9660986656331376
in-drivable-lane_max2.2500000000000098
in-drivable-lane_mean1.2200000000000075
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3873262415635368, "sim_physics": 0.09906436657083444, "survival_time": 5.799999999999987, "driven_lanedir": 0.9660986656331376, "sim_render-ego": 0.011953865659647974, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.029189202292212123, "deviation-heading": 1.7796542191774734, "set_robot_commands": 0.011664986610412598, "deviation-center-line": 0.31993794416118504, "driven_lanedir_consec": 0.9660986656331376, "sim_compute_sim_state": 0.0052917517464736415, "sim_compute_performance-ego": 0.007196890896764295, "sim_compute_robot_state-ego": 0.008562856707079658}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.972405067997523, "sim_physics": 0.11113308429718018, "survival_time": 14.950000000000076, "driven_lanedir": 3.529707200612318, "sim_render-ego": 0.013230261007944742, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.04316637516021728, "deviation-heading": 3.160796369537887, "set_robot_commands": 0.012010841369628909, "deviation-center-line": 0.7040054665422902, "driven_lanedir_consec": 3.529707200612318, "sim_compute_sim_state": 0.005624984900156657, "sim_compute_performance-ego": 0.008112181822458903, "sim_compute_robot_state-ego": 0.009529160658518472}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4473265118613305, "sim_physics": 0.12972258862869515, "survival_time": 9.049999999999994, "driven_lanedir": 1.8857753587305628, "sim_render-ego": 0.01392158355502134, "in-drivable-lane": 2.2500000000000098, "agent_compute-ego": 0.04930484492475815, "deviation-heading": 2.1430255526746778, "set_robot_commands": 0.01160301161075824, "deviation-center-line": 0.40329548476921534, "driven_lanedir_consec": 1.8857753587305628, "sim_compute_sim_state": 0.005832801207653067, "sim_compute_performance-ego": 0.008506582586804807, "sim_compute_robot_state-ego": 0.01028823325647175}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.7930893222726434, "sim_physics": 0.10837632656097412, "survival_time": 14.950000000000076, "driven_lanedir": 3.531337466367754, "sim_render-ego": 0.01304492712020874, "in-drivable-lane": 0, "agent_compute-ego": 0.04462368806203206, "deviation-heading": 4.864836050587565, "set_robot_commands": 0.010901681582132975, "deviation-center-line": 0.9237727074937806, "driven_lanedir_consec": 3.531337466367754, "sim_compute_sim_state": 0.005500047206878662, "sim_compute_performance-ego": 0.007521932125091553, "sim_compute_robot_state-ego": 0.009699296951293946}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.45109252128178, "sim_physics": 0.1128886620203654, "survival_time": 14.950000000000076, "driven_lanedir": 4.239111407868371, "sim_render-ego": 0.013239380518595375, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.03976866324742635, "deviation-heading": 1.9515749807080545, "set_robot_commands": 0.01203340212504069, "deviation-center-line": 0.49990886024583775, "driven_lanedir_consec": 4.239111407868371, "sim_compute_sim_state": 0.005931588013966879, "sim_compute_performance-ego": 0.008049729665120443, "sim_compute_robot_state-ego": 0.009949469566345214}}
set_robot_commands_max0.01203340212504069
set_robot_commands_mean0.011642784659594682
set_robot_commands_median0.011664986610412598
set_robot_commands_min0.010901681582132975
sim_compute_performance-ego_max0.008506582586804807
sim_compute_performance-ego_mean0.007877463419248
sim_compute_performance-ego_median0.008049729665120443
sim_compute_performance-ego_min0.007196890896764295
sim_compute_robot_state-ego_max0.01028823325647175
sim_compute_robot_state-ego_mean0.009605803427941808
sim_compute_robot_state-ego_median0.009699296951293946
sim_compute_robot_state-ego_min0.008562856707079658
sim_compute_sim_state_max0.005931588013966879
sim_compute_sim_state_mean0.005636234615025781
sim_compute_sim_state_median0.005624984900156657
sim_compute_sim_state_min0.0052917517464736415
sim_physics_max0.12972258862869515
sim_physics_mean0.11223700561560986
sim_physics_median0.11113308429718018
sim_physics_min0.09906436657083444
sim_render-ego_max0.01392158355502134
sim_render-ego_mean0.013078003572283637
sim_render-ego_median0.013230261007944742
sim_render-ego_min0.011953865659647974
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.940000000000044
survival_time_min5.799999999999987
No reset possible
295055811Robert Moni 🇭🇺lzoltan-02aido3-LFV-sim-testingstep1-simulationerroryesip-172-31-35-218-104900:42:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
294935808Robert Moni 🇭🇺lzoltan-02aido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:14:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.041097597645318
survival_time_median14.950000000000076
deviation-center-line_median0.7958466189492501
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.029624900817871093
agent_compute-ego_mean0.025787555353982104
agent_compute-ego_median0.02824316263198853
agent_compute-ego_min0.020840678896222795
deviation-center-line_max0.8574055623956004
deviation-center-line_mean0.7047824411815877
deviation-center-line_min0.25962891958878836
deviation-heading_max4.103067516870562
deviation-heading_mean3.1199079666124105
deviation-heading_median3.3345405487708555
deviation-heading_min1.12199222329529
driven_any_max5.069081203752608
driven_any_mean4.124516330792265
driven_any_median4.69249416162746
driven_any_min1.4075917596146688
driven_lanedir_consec_max4.719977700812984
driven_lanedir_consec_mean3.6318608331899513
driven_lanedir_consec_min1.3101940421117622
driven_lanedir_max4.719977700812984
driven_lanedir_mean3.6318608331899513
driven_lanedir_median4.041097597645318
driven_lanedir_min1.3101940421117622
in-drivable-lane_max2.000000000000001
in-drivable-lane_mean0.7400000000000008
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.592055811983589, "sim_physics": 0.10013483047485353, "survival_time": 14.950000000000076, "driven_lanedir": 4.3686934641972375, "sim_render-ego": 0.0071810555458068845, "in-drivable-lane": 0, "agent_compute-ego": 0.021809852917989096, "deviation-heading": 4.064961568619513, "set_robot_commands": 0.005146374702453613, "deviation-center-line": 0.8574055623956004, "driven_lanedir_consec": 4.3686934641972375, "sim_compute_sim_state": 0.002901453177134196, "sim_compute_performance-ego": 0.004170415401458741, "sim_compute_robot_state-ego": 0.005049734115600586, "sim_compute_robot_state-npc0": 0.004970067342122395, "sim_compute_robot_state-npc1": 0.004880340894063314, "sim_compute_robot_state-npc2": 0.0048625524838765465, "sim_compute_robot_state-npc3": 0.004859250386555989}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4075917596146688, "sim_physics": 0.11192954979933702, "survival_time": 3.8499999999999943, "driven_lanedir": 1.3101940421117622, "sim_render-ego": 0.007323986524111265, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.020840678896222795, "deviation-heading": 1.12199222329529, "set_robot_commands": 0.005005347264277471, "deviation-center-line": 0.25962891958878836, "driven_lanedir_consec": 1.3101940421117622, "sim_compute_sim_state": 0.0028729655525901103, "sim_compute_performance-ego": 0.004053852774880149, "sim_compute_robot_state-ego": 0.005029560683609604, "sim_compute_robot_state-npc0": 0.004918962330013127, "sim_compute_robot_state-npc1": 0.004824316346800172, "sim_compute_robot_state-npc2": 0.0047929039249172455, "sim_compute_robot_state-npc3": 0.004875638268210671}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.069081203752608, "sim_physics": 0.14280728578567506, "survival_time": 14.950000000000076, "driven_lanedir": 4.041097597645318, "sim_render-ego": 0.009242595831553142, "in-drivable-lane": 2.000000000000001, "agent_compute-ego": 0.02841918150583903, "deviation-heading": 3.3345405487708555, "set_robot_commands": 0.006705907185872396, "deviation-center-line": 0.8569259137656747, "driven_lanedir_consec": 4.041097597645318, "sim_compute_sim_state": 0.0037957406044006343, "sim_compute_performance-ego": 0.00547515869140625, "sim_compute_robot_state-ego": 0.006829843521118164, "sim_compute_robot_state-npc0": 0.006407418251037598, "sim_compute_robot_state-npc1": 0.006440418561299642, "sim_compute_robot_state-npc2": 0.0063170496622721355, "sim_compute_robot_state-npc3": 0.006265935897827149}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.861358716982998, "sim_physics": 0.13572969595591228, "survival_time": 14.950000000000076, "driven_lanedir": 4.719977700812984, "sim_render-ego": 0.009541481335957846, "in-drivable-lane": 0, "agent_compute-ego": 0.02824316263198853, "deviation-heading": 2.9749779755058334, "set_robot_commands": 0.0072886792818705245, "deviation-center-line": 0.7958466189492501, "driven_lanedir_consec": 4.719977700812984, "sim_compute_sim_state": 0.00390593687693278, "sim_compute_performance-ego": 0.005478595892588298, "sim_compute_robot_state-ego": 0.007024215857187907, "sim_compute_robot_state-npc0": 0.006722837289174398, "sim_compute_robot_state-npc1": 0.00663495937983195, "sim_compute_robot_state-npc2": 0.0065920225779215495, "sim_compute_robot_state-npc3": 0.006610969702402751}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.69249416162746, "sim_physics": 0.15288235743840536, "survival_time": 14.950000000000076, "driven_lanedir": 3.719341361182456, "sim_render-ego": 0.009604086875915527, "in-drivable-lane": 1.650000000000003, "agent_compute-ego": 0.029624900817871093, "deviation-heading": 4.103067516870562, "set_robot_commands": 0.007231442133585612, "deviation-center-line": 0.7541051912086251, "driven_lanedir_consec": 3.719341361182456, "sim_compute_sim_state": 0.003932943344116211, "sim_compute_performance-ego": 0.005663907527923584, "sim_compute_robot_state-ego": 0.006969303290049235, "sim_compute_robot_state-npc0": 0.006752490997314453, "sim_compute_robot_state-npc1": 0.006651234626770019, "sim_compute_robot_state-npc2": 0.006645938555399577, "sim_compute_robot_state-npc3": 0.006759681701660156}}
set_robot_commands_max0.0072886792818705245
set_robot_commands_mean0.006275550113611923
set_robot_commands_median0.006705907185872396
set_robot_commands_min0.005005347264277471
sim_compute_performance-ego_max0.005663907527923584
sim_compute_performance-ego_mean0.0049683860576514045
sim_compute_performance-ego_median0.00547515869140625
sim_compute_performance-ego_min0.004053852774880149
sim_compute_robot_state-ego_max0.007024215857187907
sim_compute_robot_state-ego_mean0.0061805314935131
sim_compute_robot_state-ego_median0.006829843521118164
sim_compute_robot_state-ego_min0.005029560683609604
sim_compute_robot_state-npc0_max0.006752490997314453
sim_compute_robot_state-npc0_mean0.005954355241932394
sim_compute_robot_state-npc0_median0.006407418251037598
sim_compute_robot_state-npc0_min0.004918962330013127
sim_compute_robot_state-npc1_max0.006651234626770019
sim_compute_robot_state-npc1_mean0.00588625396175302
sim_compute_robot_state-npc1_median0.006440418561299642
sim_compute_robot_state-npc1_min0.004824316346800172
sim_compute_robot_state-npc2_max0.006645938555399577
sim_compute_robot_state-npc2_mean0.005842093440877411
sim_compute_robot_state-npc2_median0.0063170496622721355
sim_compute_robot_state-npc2_min0.0047929039249172455
sim_compute_robot_state-npc3_max0.006759681701660156
sim_compute_robot_state-npc3_mean0.005874295191331344
sim_compute_robot_state-npc3_median0.006265935897827149
sim_compute_robot_state-npc3_min0.004859250386555989
sim_compute_sim_state_max0.003932943344116211
sim_compute_sim_state_mean0.003481807911034786
sim_compute_sim_state_median0.0037957406044006343
sim_compute_sim_state_min0.0028729655525901103
sim_physics_max0.15288235743840536
sim_physics_mean0.12869674389083666
sim_physics_median0.13572969595591228
sim_physics_min0.10013483047485353
sim_render-ego_max0.009604086875915527
sim_render-ego_mean0.008578641222668933
sim_render-ego_median0.009242595831553142
sim_render-ego_min0.0071810555458068845
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.73000000000006
survival_time_min3.8499999999999943
No reset possible
294875796Robert Moni 🇭🇺kaland-225308aido3-LFV-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:14:18
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
294415772Mikita Sazanovich 🇷🇺chameleon-10-jjluaido3-LFVI-sim-testingstep1-simulationsuccessyesip-172-31-35-218-104900:29:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.103760220294911
survival_time_median11.65000000000003
deviation-center-line_median0.6837959004218068
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.018039885320161517
agent_compute-ego_mean0.01676795875884924
agent_compute-ego_median0.016694541330690735
agent_compute-ego_min0.01644044392036669
deviation-center-line_max1.2154856909132432
deviation-center-line_mean0.7340613094272499
deviation-center-line_min0.19458672762003423
deviation-heading_max4.993345865326687
deviation-heading_mean2.9621536785352576
deviation-heading_median3.2522066219897434
deviation-heading_min0.7659732145991751
driven_any_max5.9422691589518575
driven_any_mean3.799412675384711
driven_any_median4.000350632523858
driven_any_min1.0667077898526345
driven_lanedir_consec_max5.232624742697584
driven_lanedir_consec_mean3.260664287454474
driven_lanedir_consec_min0.928084921165082
driven_lanedir_max5.655238825585685
driven_lanedir_mean3.4016968575222464
driven_lanedir_median3.500282004392654
driven_lanedir_min0.9559211442433888
in-drivable-lane_max2.4500000000000135
in-drivable-lane_mean0.7166666666666686
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.5194323852305174, "sim_physics": 0.13165632988277234, "survival_time": 7.599999999999981, "driven_lanedir": 2.2924291826972945, "sim_render-ego": 0.007283569950806468, "in-drivable-lane": 0, "agent_compute-ego": 0.018039885320161517, "deviation-heading": 2.592504678422302, "set_robot_commands": 0.005096851210845144, "deviation-center-line": 0.5864445695194753, "driven_lanedir_consec": 2.291734027124058, "sim_compute_sim_state": 0.0029075177092301218, "sim_compute_performance-ego": 0.004096694682773791, "sim_compute_robot_state-ego": 0.00514086924101177, "sim_compute_robot_state-npc0": 0.004854862627230193, "sim_compute_robot_state-npc1": 0.004720410234049747, "sim_compute_robot_state-npc2": 0.004753065736670243, "sim_compute_robot_state-npc3": 0.004689662080062063}, "udem1-1-0": {"driven_any": 5.645204544741441, "sim_physics": 0.12146620909372964, "survival_time": 14.950000000000076, "driven_lanedir": 4.865304225405385, "sim_render-ego": 0.007132031122843424, "in-drivable-lane": 2.4500000000000135, "agent_compute-ego": 0.016722774505615233, "deviation-heading": 3.2522066219897434, "set_robot_commands": 0.005067466100056966, "deviation-center-line": 0.7989118594957352, "driven_lanedir_consec": 4.853209602207851, "sim_compute_sim_state": 0.0028877584139506023, "sim_compute_performance-ego": 0.004046097596486409, "sim_compute_robot_state-ego": 0.005076054732004801, "sim_compute_robot_state-npc0": 0.004827173550923666, "sim_compute_robot_state-npc1": 0.00474106232325236, "sim_compute_robot_state-npc2": 0.004703869024912516, "sim_compute_robot_state-npc3": 0.004682952562967936}, "udem1-2-0": {"driven_any": 5.212706127873961, "sim_physics": 0.10751433531443276, "survival_time": 14.950000000000076, "driven_lanedir": 4.3635918408918, "sim_render-ego": 0.007118239402770996, "in-drivable-lane": 1.9500000000000055, "agent_compute-ego": 0.016607406139373778, "deviation-heading": 4.4516394986666645, "set_robot_commands": 0.005082841714223226, "deviation-center-line": 0.9051812860383656, "driven_lanedir_consec": 4.363113455569145, "sim_compute_sim_state": 0.0028744975725809732, "sim_compute_performance-ego": 0.0040098452568054195, "sim_compute_robot_state-ego": 0.005002229213714599, "sim_compute_robot_state-npc0": 0.004852604866027832, "sim_compute_robot_state-npc1": 0.004753770033518474, "sim_compute_robot_state-npc2": 0.004736739794413249, "sim_compute_robot_state-npc3": 0.004722456932067871}, "udem1-3-0": {"driven_any": 2.293527043509107, "sim_physics": 0.11495899708471566, "survival_time": 5.349999999999989, "driven_lanedir": 2.067713033552664, "sim_render-ego": 0.007268016583451601, "in-drivable-lane": 0, "agent_compute-ego": 0.016485227602664555, "deviation-heading": 1.926909624118057, "set_robot_commands": 0.005069679188951154, "deviation-center-line": 0.4033394877487913, "driven_lanedir_consec": 1.8715513040782976, "sim_compute_sim_state": 0.002881896830050745, "sim_compute_performance-ego": 0.0039980701196973565, "sim_compute_robot_state-ego": 0.004947684635625821, "sim_compute_robot_state-npc0": 0.00481855312240458, "sim_compute_robot_state-npc1": 0.004743767675952377, "sim_compute_robot_state-npc2": 0.004706567692979474, "sim_compute_robot_state-npc3": 0.004755303124401057}, "udem1-4-0": {"driven_any": 4.000350632523858, "sim_physics": 0.13779130104785314, "survival_time": 11.65000000000003, "driven_lanedir": 3.500282004392654, "sim_render-ego": 0.007242466758760772, "in-drivable-lane": 1.150000000000003, "agent_compute-ego": 0.01715384327802535, "deviation-heading": 3.682359648832749, "set_robot_commands": 0.005216015254990737, "deviation-center-line": 0.6837959004218068, "driven_lanedir_consec": 3.103760220294911, "sim_compute_sim_state": 0.0029221522449935453, "sim_compute_performance-ego": 0.0040628296111274685, "sim_compute_robot_state-ego": 0.005111034336008228, "sim_compute_robot_state-npc0": 0.004939229703256501, "sim_compute_robot_state-npc1": 0.004846721248053686, "sim_compute_robot_state-npc2": 0.004789022928655403, "sim_compute_robot_state-npc3": 0.004772578186231622}, "udem1-5-0": {"driven_any": 5.34367288483905, "sim_physics": 0.120799822807312, "survival_time": 14.950000000000076, "driven_lanedir": 5.105662964355789, "sim_render-ego": 0.007143637339274088, "in-drivable-lane": 0, "agent_compute-ego": 0.01660082260767619, "deviation-heading": 3.574893000789257, "set_robot_commands": 0.005088229179382325, "deviation-center-line": 1.128348941979202, "driven_lanedir_consec": 5.105662964355789, "sim_compute_sim_state": 0.0029037435849507648, "sim_compute_performance-ego": 0.004023305575052897, "sim_compute_robot_state-ego": 0.005077172915140787, "sim_compute_robot_state-npc0": 0.004904657204945882, "sim_compute_robot_state-npc1": 0.004757978121439616, "sim_compute_robot_state-npc2": 0.004769367376963297, "sim_compute_robot_state-npc3": 0.004745783011118571}, "udem1-6-0": {"driven_any": 1.080883535916476, "sim_physics": 0.11417380968729655, "survival_time": 2.6999999999999984, "driven_lanedir": 0.9559211442433888, "sim_render-ego": 0.007438968729089807, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.016694541330690735, "deviation-heading": 1.0257690914345912, "set_robot_commands": 0.005073344265973127, "deviation-center-line": 0.22892068042373545, "driven_lanedir_consec": 0.928084921165082, "sim_compute_sim_state": 0.002939188921893085, "sim_compute_performance-ego": 0.004009348374825937, "sim_compute_robot_state-ego": 0.005149620550650137, "sim_compute_robot_state-npc0": 0.004825375698230884, "sim_compute_robot_state-npc1": 0.004691159283673322, "sim_compute_robot_state-npc2": 0.004685852262708876, "sim_compute_robot_state-npc3": 0.004693044556511773}, "udem1-7-0": {"driven_any": 5.676920331287238, "sim_physics": 0.11854261000951131, "survival_time": 14.950000000000076, "driven_lanedir": 5.3217811824235755, "sim_render-ego": 0.007088592052459717, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.016762744585673013, "deviation-heading": 4.009345281826592, "set_robot_commands": 0.005209856033325196, "deviation-center-line": 1.100880256563342, "driven_lanedir_consec": 5.056602375041005, "sim_compute_sim_state": 0.0028844523429870607, "sim_compute_performance-ego": 0.004007201194763183, "sim_compute_robot_state-ego": 0.005005913575490316, "sim_compute_robot_state-npc0": 0.004889353116353353, "sim_compute_robot_state-npc1": 0.00479307492574056, "sim_compute_robot_state-npc2": 0.004804182052612305, "sim_compute_robot_state-npc3": 0.0047469019889831545}, "udem1-8-0": {"driven_any": 3.697848776326839, "sim_physics": 0.11666171843150876, "survival_time": 10.600000000000016, "driven_lanedir": 3.05219502119382, "sim_render-ego": 0.00716246411485492, "in-drivable-lane": 1.999999999999995, "agent_compute-ego": 0.016753998567473213, "deviation-heading": 2.722323466911729, "set_robot_commands": 0.005214801374471413, "deviation-center-line": 0.5625783429296864, "driven_lanedir_consec": 2.5604192987438186, "sim_compute_sim_state": 0.0028787131579417102, "sim_compute_performance-ego": 0.00404182807454523, "sim_compute_robot_state-ego": 0.0050453150047446195, "sim_compute_robot_state-npc0": 0.004907751983066775, "sim_compute_robot_state-npc1": 0.004791186665588955, "sim_compute_robot_state-npc2": 0.00480853611568235, "sim_compute_robot_state-npc3": 0.004782573232110942}, "udem1-9-0": {"driven_any": 2.29457816522872, "sim_physics": 0.12156762318177657, "survival_time": 6.5999999999999845, "driven_lanedir": 1.92095071506046, "sim_render-ego": 0.007193126461722634, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.01644044392036669, "deviation-heading": 2.034004849898975, "set_robot_commands": 0.00518713394800822, "deviation-center-line": 0.5150552018456016, "driven_lanedir_consec": 1.9042248544266984, "sim_compute_sim_state": 0.002920945485432943, "sim_compute_performance-ego": 0.004014264453541149, "sim_compute_robot_state-ego": 0.005008836587270101, "sim_compute_robot_state-npc0": 0.004889452096187707, "sim_compute_robot_state-npc1": 0.004807172399578672, "sim_compute_robot_state-npc2": 0.004775834806037672, "sim_compute_robot_state-npc3": 0.004761538722298362}, "udem1-10-0": {"driven_any": 4.6812717577295215, "sim_physics": 0.11304720163345336, "survival_time": 14.950000000000076, "driven_lanedir": 4.2582362611326525, "sim_render-ego": 0.007066728274027507, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.01647409995396932, "deviation-heading": 4.993345865326687, "set_robot_commands": 0.005007188320159912, "deviation-center-line": 1.2154856909132432, "driven_lanedir_consec": 4.2582362611326525, "sim_compute_sim_state": 0.002884480158487956, "sim_compute_performance-ego": 0.004016838868459066, "sim_compute_robot_state-ego": 0.0049835705757141115, "sim_compute_robot_state-npc0": 0.004789852301279704, "sim_compute_robot_state-npc1": 0.004812338352203369, "sim_compute_robot_state-npc2": 0.004786278406778971, "sim_compute_robot_state-npc3": 0.004766279856363932}, "udem1-11-0": {"driven_any": 5.011636980653093, "sim_physics": 0.12267814079920451, "survival_time": 14.950000000000076, "driven_lanedir": 4.244852996889898, "sim_render-ego": 0.007056639194488525, "in-drivable-lane": 1.9000000000000157, "agent_compute-ego": 0.016576279799143473, "deviation-heading": 4.217681227669309, "set_robot_commands": 0.004995335737864176, "deviation-center-line": 1.2125853358603529, "driven_lanedir_consec": 4.232387992275052, "sim_compute_sim_state": 0.002886809508005778, "sim_compute_performance-ego": 0.003993999163309733, "sim_compute_robot_state-ego": 0.004999981721242269, "sim_compute_robot_state-npc0": 0.004890113671620687, "sim_compute_robot_state-npc1": 0.0047157923380533855, "sim_compute_robot_state-npc2": 0.004699652194976807, "sim_compute_robot_state-npc3": 0.004681394894917806}, "udem1-12-0": {"driven_any": 2.5241800161063543, "sim_physics": 0.11903036462849584, "survival_time": 5.799999999999987, "driven_lanedir": 2.4446340987555617, "sim_render-ego": 0.007299055313241893, "in-drivable-lane": 0, "agent_compute-ego": 0.016915806408586174, "deviation-heading": 1.1955865532882772, "set_robot_commands": 0.005107215766249032, "deviation-center-line": 0.39839911786539417, "driven_lanedir_consec": 2.187021078398742, "sim_compute_sim_state": 0.002941497440995842, "sim_compute_performance-ego": 0.004108172038505818, "sim_compute_robot_state-ego": 0.005244450322512923, "sim_compute_robot_state-npc0": 0.004864423439420503, "sim_compute_robot_state-npc1": 0.004752962753690523, "sim_compute_robot_state-npc2": 0.00472240817957911, "sim_compute_robot_state-npc3": 0.004771423750910266}, "udem1-13-0": {"driven_any": 5.9422691589518575, "sim_physics": 0.11368316094080608, "survival_time": 14.950000000000076, "driven_lanedir": 5.655238825585685, "sim_render-ego": 0.007112223307291667, "in-drivable-lane": 0, "agent_compute-ego": 0.016748441855112713, "deviation-heading": 3.987762554254754, "set_robot_commands": 0.0050323994954427085, "deviation-center-line": 1.0764062421839793, "driven_lanedir_consec": 5.232624742697584, "sim_compute_sim_state": 0.002870306173960368, "sim_compute_performance-ego": 0.0039856155713399255, "sim_compute_robot_state-ego": 0.0049733360608418785, "sim_compute_robot_state-npc0": 0.004782288869222005, "sim_compute_robot_state-npc1": 0.004748191038767497, "sim_compute_robot_state-npc2": 0.004690873622894287, "sim_compute_robot_state-npc3": 0.0046861982345581055}, "udem1-14-0": {"driven_any": 1.0667077898526345, "sim_physics": 0.1493046929438909, "survival_time": 2.3999999999999995, "driven_lanedir": 0.9766593662530648, "sim_render-ego": 0.007293820381164551, "in-drivable-lane": 0, "agent_compute-ego": 0.016543065508206684, "deviation-heading": 0.7659732145991751, "set_robot_commands": 0.00491460661093394, "deviation-center-line": 0.19458672762003423, "driven_lanedir_consec": 0.9613312143064164, "sim_compute_sim_state": 0.0028586934010187783, "sim_compute_performance-ego": 0.003947685162226359, "sim_compute_robot_state-ego": 0.004939322670300801, "sim_compute_robot_state-npc0": 0.004731213053067525, "sim_compute_robot_state-npc1": 0.004703854521115621, "sim_compute_robot_state-npc2": 0.004671146472295125, "sim_compute_robot_state-npc3": 0.004698609312375386}}
set_robot_commands_max0.005216015254990737
set_robot_commands_mean0.005090864280058486
set_robot_commands_median0.005082841714223226
set_robot_commands_min0.00491460661093394
sim_compute_performance-ego_max0.004108172038505818
sim_compute_performance-ego_mean0.004024119716230649
sim_compute_performance-ego_median0.004014264453541149
sim_compute_performance-ego_min0.003947685162226359
sim_compute_robot_state-ego_max0.005244450322512923
sim_compute_robot_state-ego_mean0.005047026142818211
sim_compute_robot_state-ego_median0.005008836587270101
sim_compute_robot_state-ego_min0.004939322670300801
sim_compute_robot_state-npc0_max0.004939229703256501
sim_compute_robot_state-npc0_mean0.004851127020215853
sim_compute_robot_state-npc0_median0.004854862627230193
sim_compute_robot_state-npc0_min0.004731213053067525
sim_compute_robot_state-npc1_max0.004846721248053686
sim_compute_robot_state-npc1_mean0.004758629460978545
sim_compute_robot_state-npc1_median0.004752962753690523
sim_compute_robot_state-npc1_min0.004691159283673322
sim_compute_robot_state-npc2_max0.00480853611568235
sim_compute_robot_state-npc2_mean0.004740226444543979
sim_compute_robot_state-npc2_median0.004736739794413249
sim_compute_robot_state-npc2_min0.004671146472295125
sim_compute_robot_state-npc3_max0.004782573232110942
sim_compute_robot_state-npc3_mean0.004730446696391923
sim_compute_robot_state-npc3_median0.004745783011118571
sim_compute_robot_state-npc3_min0.004681394894917806
sim_compute_sim_state_max0.002941497440995842
sim_compute_sim_state_mean0.0028961768630986844
sim_compute_sim_state_median0.002886809508005778
sim_compute_sim_state_min0.0028586934010187783
sim_physics_max0.1493046929438909
sim_physics_mean0.12152508783245064
sim_physics_median0.11903036462849584
sim_physics_min0.10751433531443276
sim_render-ego_max0.007438968729089807
sim_render-ego_mean0.007193305265749904
sim_render-ego_median0.00716246411485492
sim_render-ego_min0.007056639194488525
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.490000000000036
survival_time_min2.3999999999999995
No reset possible
294235739Mikita Sazanovich 🇷🇺chameleon-10-jluaido3-LF-real-validationeval1-videossuccessnoip-172-31-35-218-104900:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
294215768Mikita Sazanovich 🇷🇺chameleon-10-jjluaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.87495397590304
survival_time_median11.250000000000025
deviation-center-line_median0.6347854756165775
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016956942876180013
agent_compute-ego_mean0.016478736198605244
agent_compute-ego_median0.0163614392695942
agent_compute-ego_min0.016266342819921228
deviation-center-line_max1.1496889761787936
deviation-center-line_mean0.7409697919493852
deviation-center-line_min0.32865422545560263
deviation-heading_max4.6789376803172695
deviation-heading_mean3.1187776775985747
deviation-heading_median3.4882002987174623
deviation-heading_min1.169474802351249
driven_any_max5.056099345310927
driven_any_mean3.5363242782045803
driven_any_median3.5840456634121356
driven_any_min2.4331625234035577
driven_lanedir_consec_max4.691753221928149
driven_lanedir_consec_mean3.1671752900792747
driven_lanedir_consec_min2.203664974257574
driven_lanedir_max4.691753221928149
driven_lanedir_mean3.1671752900792747
driven_lanedir_median2.87495397590304
driven_lanedir_min2.203664974257574
in-drivable-lane_max2.150000000000005
in-drivable-lane_mean0.5700000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5840456634121356, "sim_physics": 0.05748872862921821, "survival_time": 11.250000000000025, "driven_lanedir": 2.87495397590304, "sim_render-ego": 0.007019600338406033, "in-drivable-lane": 2.150000000000005, "agent_compute-ego": 0.016956942876180013, "deviation-heading": 3.4882002987174623, "set_robot_commands": 0.0050835630628797744, "deviation-center-line": 0.6347854756165775, "driven_lanedir_consec": 2.87495397590304, "sim_compute_sim_state": 0.002866829766167535, "sim_compute_performance-ego": 0.004141903983222114, "sim_compute_robot_state-ego": 0.0049826441870795355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.596326215962528, "sim_physics": 0.05411208386452782, "survival_time": 7.549999999999981, "driven_lanedir": 2.203664974257574, "sim_render-ego": 0.007125331866030662, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.016266342819921228, "deviation-heading": 2.592971256634508, "set_robot_commands": 0.0050570475344626315, "deviation-center-line": 0.5860164413439523, "driven_lanedir_consec": 2.203664974257574, "sim_compute_sim_state": 0.0028494920162175667, "sim_compute_performance-ego": 0.00405932893816209, "sim_compute_robot_state-ego": 0.004977224678393231}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4331625234035577, "sim_physics": 0.05803117476218988, "survival_time": 6.0499999999999865, "driven_lanedir": 2.368295378710247, "sim_render-ego": 0.007265083060776892, "in-drivable-lane": 0, "agent_compute-ego": 0.01630536386789369, "deviation-heading": 1.169474802351249, "set_robot_commands": 0.005096035555374524, "deviation-center-line": 0.32865422545560263, "driven_lanedir_consec": 2.368295378710247, "sim_compute_sim_state": 0.003053436594561112, "sim_compute_performance-ego": 0.004053356233707144, "sim_compute_robot_state-ego": 0.005109775164895807}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.011987642933754, "sim_physics": 0.05388856452444325, "survival_time": 11.500000000000028, "driven_lanedir": 3.697208899597363, "sim_render-ego": 0.007198799174764882, "in-drivable-lane": 0, "agent_compute-ego": 0.016503592159437096, "deviation-heading": 3.664304349972383, "set_robot_commands": 0.005195349195729131, "deviation-center-line": 1.0057038411520005, "driven_lanedir_consec": 3.697208899597363, "sim_compute_sim_state": 0.003039228397866954, "sim_compute_performance-ego": 0.00408774355183477, "sim_compute_robot_state-ego": 0.005018041444861371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.056099345310927, "sim_physics": 0.05537286701933432, "survival_time": 14.350000000000067, "driven_lanedir": 4.691753221928149, "sim_render-ego": 0.007080396293347721, "in-drivable-lane": 0, "agent_compute-ego": 0.0163614392695942, "deviation-heading": 4.6789376803172695, "set_robot_commands": 0.005145161824774659, "deviation-center-line": 1.1496889761787936, "driven_lanedir_consec": 4.691753221928149, "sim_compute_sim_state": 0.002943124505285602, "sim_compute_performance-ego": 0.004046622884398138, "sim_compute_robot_state-ego": 0.00499332989549803}}
set_robot_commands_max0.005195349195729131
set_robot_commands_mean0.005115431434644144
set_robot_commands_median0.005096035555374524
set_robot_commands_min0.0050570475344626315
sim_compute_performance-ego_max0.004141903983222114
sim_compute_performance-ego_mean0.004077791118264852
sim_compute_performance-ego_median0.00405932893816209
sim_compute_performance-ego_min0.004046622884398138
sim_compute_robot_state-ego_max0.005109775164895807
sim_compute_robot_state-ego_mean0.0050162030741455945
sim_compute_robot_state-ego_median0.00499332989549803
sim_compute_robot_state-ego_min0.004977224678393231
sim_compute_sim_state_max0.003053436594561112
sim_compute_sim_state_mean0.002950422256019754
sim_compute_sim_state_median0.002943124505285602
sim_compute_sim_state_min0.0028494920162175667
sim_physics_max0.05803117476218988
sim_physics_mean0.055778683759942695
sim_physics_median0.05537286701933432
sim_physics_min0.05388856452444325
sim_render-ego_max0.007265083060776892
sim_render-ego_mean0.007137842146665238
sim_render-ego_median0.007125331866030662
sim_render-ego_min0.007019600338406033
simulation-passed1
survival_time_max14.350000000000067
survival_time_mean10.140000000000018
survival_time_min6.0499999999999865
No reset possible
294165739Mikita Sazanovich 🇷🇺chameleon-10-jluaido3-LF-real-validationeval0-videossuccessnoip-172-31-35-218-104900:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
294115746Robert Moni 🇭🇺almasip-6824aido3-LF-real-validationeval1-videossuccessnoip-172-31-35-218-104900:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
293535737Mikita Sazanovich 🇷🇺chameleon-10-jluaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:10:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.01799127244725
survival_time_median14.950000000000076
deviation-center-line_median1.05254308282352
in-drivable-lane_median1.3500000000000003


other stats
agent_compute-ego_max0.1594011572753491
agent_compute-ego_mean0.15850564097102493
agent_compute-ego_median0.15821271896362304
agent_compute-ego_min0.15803576310475667
deviation-center-line_max1.2868324517213956
deviation-center-line_mean0.8846973954883353
deviation-center-line_min0.1332032585774572
deviation-heading_max5.568247929933108
deviation-heading_mean3.877497635751253
deviation-heading_median4.571665580040667
deviation-heading_min0.4450308727629294
driven_any_max5.44218617667886
driven_any_mean4.283067152987479
driven_any_median4.860227111321842
driven_any_min1.2375177357753544
driven_lanedir_consec_max5.157434888610627
driven_lanedir_consec_mean3.7092359853746344
driven_lanedir_consec_min1.2182245450916225
driven_lanedir_max5.157434888610627
driven_lanedir_mean3.7092359853746344
driven_lanedir_median4.01799127244725
driven_lanedir_min1.2182245450916225
in-drivable-lane_max3.0000000000000275
in-drivable-lane_mean1.1800000000000066
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.561269133925379, "sim_physics": 0.05382232763329331, "survival_time": 14.700000000000074, "driven_lanedir": 3.5200483444741693, "sim_render-ego": 0.007073953849117772, "in-drivable-lane": 3.0000000000000275, "agent_compute-ego": 0.1594011572753491, "deviation-heading": 4.783442089331564, "set_robot_commands": 0.005179057315904267, "deviation-center-line": 0.835580596532226, "driven_lanedir_consec": 3.5200483444741693, "sim_compute_sim_state": 0.002946116486374213, "sim_compute_performance-ego": 0.004152407451551788, "sim_compute_robot_state-ego": 0.005048365009074308}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.860227111321842, "sim_physics": 0.05513975143432617, "survival_time": 14.950000000000076, "driven_lanedir": 4.01799127244725, "sim_render-ego": 0.007075755596160888, "in-drivable-lane": 1.5500000000000052, "agent_compute-ego": 0.15821271896362304, "deviation-heading": 5.568247929933108, "set_robot_commands": 0.0050824753443400065, "deviation-center-line": 1.115327587787078, "driven_lanedir_consec": 4.01799127244725, "sim_compute_sim_state": 0.002950113614400228, "sim_compute_performance-ego": 0.004029494126637776, "sim_compute_robot_state-ego": 0.004967753887176514}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2375177357753544, "sim_physics": 0.055780222339014855, "survival_time": 3.099999999999997, "driven_lanedir": 1.2182245450916225, "sim_render-ego": 0.007199545060434649, "in-drivable-lane": 0, "agent_compute-ego": 0.15819534178703062, "deviation-heading": 0.4450308727629294, "set_robot_commands": 0.005038842078178159, "deviation-center-line": 0.1332032585774572, "driven_lanedir_consec": 1.2182245450916225, "sim_compute_sim_state": 0.002930264319142988, "sim_compute_performance-ego": 0.004039791322523548, "sim_compute_robot_state-ego": 0.0050904597005536475}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.44218617667886, "sim_physics": 0.05458200454711914, "survival_time": 14.950000000000076, "driven_lanedir": 5.157434888610627, "sim_render-ego": 0.007037251790364583, "in-drivable-lane": 0, "agent_compute-ego": 0.15803576310475667, "deviation-heading": 4.019101706687996, "set_robot_commands": 0.005091851552327474, "deviation-center-line": 1.2868324517213956, "driven_lanedir_consec": 5.157434888610627, "sim_compute_sim_state": 0.0029056668281555176, "sim_compute_performance-ego": 0.0040265949567159015, "sim_compute_robot_state-ego": 0.004947426319122314}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.314135607235958, "sim_physics": 0.05607528209686279, "survival_time": 14.950000000000076, "driven_lanedir": 4.632480876249505, "sim_render-ego": 0.007049745718638103, "in-drivable-lane": 1.3500000000000003, "agent_compute-ego": 0.15868322372436525, "deviation-heading": 4.571665580040667, "set_robot_commands": 0.005071558157602946, "deviation-center-line": 1.05254308282352, "driven_lanedir_consec": 4.632480876249505, "sim_compute_sim_state": 0.002913221518198649, "sim_compute_performance-ego": 0.00400421142578125, "sim_compute_robot_state-ego": 0.004947388172149658}}
set_robot_commands_max0.005179057315904267
set_robot_commands_mean0.00509275688967057
set_robot_commands_median0.0050824753443400065
set_robot_commands_min0.005038842078178159
sim_compute_performance-ego_max0.004152407451551788
sim_compute_performance-ego_mean0.004050499856642053
sim_compute_performance-ego_median0.004029494126637776
sim_compute_performance-ego_min0.00400421142578125
sim_compute_robot_state-ego_max0.0050904597005536475
sim_compute_robot_state-ego_mean0.005000278617615287
sim_compute_robot_state-ego_median0.004967753887176514
sim_compute_robot_state-ego_min0.004947388172149658
sim_compute_sim_state_max0.002950113614400228
sim_compute_sim_state_mean0.002929076553254319
sim_compute_sim_state_median0.002930264319142988
sim_compute_sim_state_min0.0029056668281555176
sim_physics_max0.05607528209686279
sim_physics_mean0.05507991761012325
sim_physics_median0.05513975143432617
sim_physics_min0.05382232763329331
sim_render-ego_max0.007199545060434649
sim_render-ego_mean0.007087250402943199
sim_render-ego_median0.007073953849117772
sim_render-ego_min0.007037251790364583
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.530000000000062
survival_time_min3.099999999999997
No reset possible
293485729Robert Moni 🇭🇺almasip-6824aido3-LFV-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:08:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
293435722Robert Moni 🇭🇺almasip-6824aido3-LFV-sim-testingstep1-simulationsuccessyesip-172-31-35-218-104900:22:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5375615470595156
survival_time_median6.5999999999999845
deviation-center-line_median0.5098014735613494
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.03350021319682372
agent_compute-ego_mean0.027576332885604633
agent_compute-ego_median0.025374484062194825
agent_compute-ego_min0.024513814641141343
deviation-center-line_max1.1436579222718626
deviation-center-line_mean0.6057808345189865
deviation-center-line_min0.23548193467222717
deviation-heading_max6.210209975998607
deviation-heading_mean2.44042596344034
deviation-heading_median1.9656945877631404
deviation-heading_min0.978283925171288
driven_any_max2.080038296318758
driven_any_mean1.0702917637927187
driven_any_median0.8970344666507646
driven_any_min0.5293634879116025
driven_lanedir_consec_max1.3957559896265463
driven_lanedir_consec_mean0.6774804437192384
driven_lanedir_consec_min0.1714123787616071
driven_lanedir_max1.684327820992149
driven_lanedir_mean0.7355095717950242
driven_lanedir_median0.5585905990617896
driven_lanedir_min0.23429992709209368
in-drivable-lane_max2.7499999999999902
in-drivable-lane_mean1.6333333333333335
in-drivable-lane_min0.8500000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4315962047837734, "sim_physics": 0.1298988652229309, "survival_time": 10.000000000000009, "driven_lanedir": 1.1035710614771403, "sim_render-ego": 0.00905388116836548, "in-drivable-lane": 1.700000000000018, "agent_compute-ego": 0.03349823117256165, "deviation-heading": 2.5385642699434157, "set_robot_commands": 0.007021030187606811, "deviation-center-line": 0.8805914475636855, "driven_lanedir_consec": 1.0745572410922533, "sim_compute_sim_state": 0.003742997646331787, "sim_compute_performance-ego": 0.005152604579925537, "sim_compute_robot_state-ego": 0.006434515714645385, "sim_compute_robot_state-npc0": 0.006340141296386719, "sim_compute_robot_state-npc1": 0.006190491914749146, "sim_compute_robot_state-npc2": 0.006255401372909546, "sim_compute_robot_state-npc3": 0.006255677938461304}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5293634879116025, "sim_physics": 0.13169801519030616, "survival_time": 4.199999999999993, "driven_lanedir": 0.2745914532194016, "sim_render-ego": 0.009637670857565743, "in-drivable-lane": 1.2999999999999956, "agent_compute-ego": 0.031846395560673306, "deviation-heading": 1.6260494821439042, "set_robot_commands": 0.007203139009929839, "deviation-center-line": 0.287227313908718, "driven_lanedir_consec": 0.20601937103500312, "sim_compute_sim_state": 0.00390547513961792, "sim_compute_performance-ego": 0.005631106240408761, "sim_compute_robot_state-ego": 0.007068917864844913, "sim_compute_robot_state-npc0": 0.006776548567272368, "sim_compute_robot_state-npc1": 0.0064603885014851885, "sim_compute_robot_state-npc2": 0.006521420819418771, "sim_compute_robot_state-npc3": 0.0064732176916939875}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.862855537887852, "sim_physics": 0.15373319002889818, "survival_time": 6.199999999999986, "driven_lanedir": 0.5521354116187781, "sim_render-ego": 0.009577428140947896, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.03204456452400454, "deviation-heading": 1.4181220777351031, "set_robot_commands": 0.007178162374804097, "deviation-center-line": 0.5098014735613494, "driven_lanedir_consec": 0.5262035373905073, "sim_compute_sim_state": 0.003803966506834953, "sim_compute_performance-ego": 0.005482810158883372, "sim_compute_robot_state-ego": 0.006770049372026997, "sim_compute_robot_state-npc0": 0.006745459571961434, "sim_compute_robot_state-npc1": 0.006575128724498134, "sim_compute_robot_state-npc2": 0.0067328522282262, "sim_compute_robot_state-npc3": 0.006230825378048805}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2307117084181096, "sim_physics": 0.14113971640943815, "survival_time": 8.949999999999992, "driven_lanedir": 0.9689169324601492, "sim_render-ego": 0.00940260674034417, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.03350021319682372, "deviation-heading": 3.2415295278840333, "set_robot_commands": 0.007596535389649802, "deviation-center-line": 0.7703632035949811, "driven_lanedir_consec": 0.8698327031942763, "sim_compute_sim_state": 0.00386320279297216, "sim_compute_performance-ego": 0.005468794753431608, "sim_compute_robot_state-ego": 0.00678106526422767, "sim_compute_robot_state-npc0": 0.0067974935030804, "sim_compute_robot_state-npc1": 0.006639563171557208, "sim_compute_robot_state-npc2": 0.0066178138029641944, "sim_compute_robot_state-npc3": 0.006627447778286215}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.080038296318758, "sim_physics": 0.1291558329264323, "survival_time": 14.950000000000076, "driven_lanedir": 1.684327820992149, "sim_render-ego": 0.008356844584147136, "in-drivable-lane": 0.8500000000000005, "agent_compute-ego": 0.030966315269470215, "deviation-heading": 6.210209975998607, "set_robot_commands": 0.0067384886741638185, "deviation-center-line": 1.1032747624191308, "driven_lanedir_consec": 1.359782075010267, "sim_compute_sim_state": 0.0034589624404907228, "sim_compute_performance-ego": 0.004886415004730225, "sim_compute_robot_state-ego": 0.006115814050038655, "sim_compute_robot_state-npc0": 0.006182323296864828, "sim_compute_robot_state-npc1": 0.005957772731781006, "sim_compute_robot_state-npc2": 0.0057709058125813804, "sim_compute_robot_state-npc3": 0.005687259833017985}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.6957842404066237, "sim_physics": 0.11412109717849858, "survival_time": 12.100000000000035, "driven_lanedir": 1.3230392485963964, "sim_render-ego": 0.007074036874061774, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.025514837138908952, "deviation-heading": 3.2628510404754367, "set_robot_commands": 0.005320627827289676, "deviation-center-line": 1.1436579222718626, "driven_lanedir_consec": 1.3230392485963964, "sim_compute_sim_state": 0.0029282983669564745, "sim_compute_performance-ego": 0.004038961465693702, "sim_compute_robot_state-ego": 0.005121795599125634, "sim_compute_robot_state-npc0": 0.00498398867520419, "sim_compute_robot_state-npc1": 0.0049243958528376805, "sim_compute_robot_state-npc2": 0.004892746279062318, "sim_compute_robot_state-npc3": 0.004891558126969771}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5831378447223788, "sim_physics": 0.09995102628748467, "survival_time": 4.699999999999991, "driven_lanedir": 0.2551014593662857, "sim_render-ego": 0.007376173709301238, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.02507697267735258, "deviation-heading": 1.9586216950084103, "set_robot_commands": 0.0053813102397512885, "deviation-center-line": 0.2494550682524832, "driven_lanedir_consec": 0.22705487165297455, "sim_compute_sim_state": 0.0029902610372989735, "sim_compute_performance-ego": 0.004156061943541182, "sim_compute_robot_state-ego": 0.0052510931136760305, "sim_compute_robot_state-npc0": 0.0052135574056747114, "sim_compute_robot_state-npc1": 0.00508228007783281, "sim_compute_robot_state-npc2": 0.004993945994275681, "sim_compute_robot_state-npc3": 0.004986755391384693}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.5447115805312966, "sim_physics": 0.09772590111041891, "survival_time": 4.3499999999999925, "driven_lanedir": 0.23429992709209368, "sim_render-ego": 0.007164664652155733, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.024513814641141343, "deviation-heading": 1.847132985200011, "set_robot_commands": 0.005290231485476439, "deviation-center-line": 0.23548193467222717, "driven_lanedir_consec": 0.19286754090175495, "sim_compute_sim_state": 0.002918520192990358, "sim_compute_performance-ego": 0.0040467114284120755, "sim_compute_robot_state-ego": 0.005023635666945885, "sim_compute_robot_state-npc0": 0.005010339035384956, "sim_compute_robot_state-npc1": 0.004957020967856221, "sim_compute_robot_state-npc2": 0.004957303233530329, "sim_compute_robot_state-npc3": 0.004837011468821558}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.5421627955109025, "sim_physics": 0.11542269161769322, "survival_time": 4.199999999999993, "driven_lanedir": 0.2464694341928837, "sim_render-ego": 0.007149313177381243, "in-drivable-lane": 1.599999999999996, "agent_compute-ego": 0.025571678365979875, "deviation-heading": 1.4974560730330673, "set_robot_commands": 0.005374780723026821, "deviation-center-line": 0.28326983875409734, "driven_lanedir_consec": 0.1714123787616071, "sim_compute_sim_state": 0.002930309091295515, "sim_compute_performance-ego": 0.003986650989169166, "sim_compute_robot_state-ego": 0.005057837281908307, "sim_compute_robot_state-npc0": 0.005362011137462798, "sim_compute_robot_state-npc1": 0.005015018440428234, "sim_compute_robot_state-npc2": 0.004778677508944557, "sim_compute_robot_state-npc3": 0.0047981880960010345}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5448502146116435, "sim_physics": 0.10416732555211976, "survival_time": 4.299999999999993, "driven_lanedir": 0.2545718968443409, "sim_render-ego": 0.007186507069787314, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.0251834558886151, "deviation-heading": 0.978283925171288, "set_robot_commands": 0.005168108052985613, "deviation-center-line": 0.24885118275209656, "driven_lanedir_consec": 0.25244695783335036, "sim_compute_sim_state": 0.002892544103223224, "sim_compute_performance-ego": 0.004056997077409611, "sim_compute_robot_state-ego": 0.005112928013468898, "sim_compute_robot_state-npc0": 0.004998013030651004, "sim_compute_robot_state-npc1": 0.004955921062203341, "sim_compute_robot_state-npc2": 0.00500133425690407, "sim_compute_robot_state-npc3": 0.004874828249909157}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.182594054177574, "sim_physics": 0.10496770463338712, "survival_time": 8.199999999999982, "driven_lanedir": 0.7094109133024236, "sim_render-ego": 0.007160919468577315, "in-drivable-lane": 2.7499999999999902, "agent_compute-ego": 0.025224973515766424, "deviation-heading": 1.9656945877631404, "set_robot_commands": 0.005165957823032286, "deviation-center-line": 0.4725923418383199, "driven_lanedir_consec": 0.640944614015369, "sim_compute_sim_state": 0.002938952387833014, "sim_compute_performance-ego": 0.004036462888485048, "sim_compute_robot_state-ego": 0.005074421080147348, "sim_compute_robot_state-npc0": 0.005030252584596959, "sim_compute_robot_state-npc1": 0.004855528110411109, "sim_compute_robot_state-npc2": 0.004864169330131717, "sim_compute_robot_state-npc3": 0.0048360272151667895}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.8970344666507646, "sim_physics": 0.10230244650985255, "survival_time": 6.5999999999999845, "driven_lanedir": 0.5585905990617896, "sim_render-ego": 0.007156104752511689, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.02513844497276075, "deviation-heading": 1.796644247280583, "set_robot_commands": 0.0052531758944193525, "deviation-center-line": 0.5923654391497357, "driven_lanedir_consec": 0.5375615470595156, "sim_compute_sim_state": 0.002952396869659424, "sim_compute_performance-ego": 0.004055915456829649, "sim_compute_robot_state-ego": 0.005070532813216701, "sim_compute_robot_state-npc0": 0.005086989113778779, "sim_compute_robot_state-npc1": 0.004944640578645648, "sim_compute_robot_state-npc2": 0.0048829533837058325, "sim_compute_robot_state-npc3": 0.004906712156353575}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4169031894388242, "sim_physics": 0.12133992596676477, "survival_time": 9.5, "driven_lanedir": 0.9464853521022548, "sim_render-ego": 0.007093514894184313, "in-drivable-lane": 2.3999999999999977, "agent_compute-ego": 0.025374484062194825, "deviation-heading": 2.2743085489402346, "set_robot_commands": 0.005238368636683414, "deviation-center-line": 0.909847508342418, "driven_lanedir_consec": 0.9464853521022548, "sim_compute_sim_state": 0.002953774050662392, "sim_compute_performance-ego": 0.004044447447124281, "sim_compute_robot_state-ego": 0.005082273483276367, "sim_compute_robot_state-npc0": 0.0051721083490472095, "sim_compute_robot_state-npc1": 0.0049747291364167865, "sim_compute_robot_state-npc2": 0.005028828821684185, "sim_compute_robot_state-npc3": 0.004905464774683902}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.731272330642377, "sim_physics": 0.09515147515568868, "survival_time": 12.450000000000042, "driven_lanedir": 1.4013430996641807, "sim_render-ego": 0.007061793622242878, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.02517181227963612, "deviation-heading": 3.690869458978367, "set_robot_commands": 0.00527229558033158, "deviation-center-line": 0.9929091510299344, "driven_lanedir_consec": 1.3957559896265463, "sim_compute_sim_state": 0.0029701458881179013, "sim_compute_performance-ego": 0.004045110150992152, "sim_compute_robot_state-ego": 0.0050399657712882785, "sim_compute_robot_state-npc0": 0.005024420688429989, "sim_compute_robot_state-npc1": 0.004950294532929079, "sim_compute_robot_state-npc2": 0.004953325991649704, "sim_compute_robot_state-npc3": 0.004932254193777062}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7813605048783032, "sim_physics": 0.10816225638756384, "survival_time": 5.849999999999987, "driven_lanedir": 0.5197889669350958, "sim_render-ego": 0.00719449458978115, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02501880001818013, "deviation-heading": 2.300051556049497, "set_robot_commands": 0.005290614234076606, "deviation-center-line": 0.4070239296737569, "driven_lanedir_consec": 0.4382432275164977, "sim_compute_sim_state": 0.0029801405393160307, "sim_compute_performance-ego": 0.004070445003672543, "sim_compute_robot_state-ego": 0.005104293171157185, "sim_compute_robot_state-npc0": 0.005092176616701306, "sim_compute_robot_state-npc1": 0.0050256619086632365, "sim_compute_robot_state-npc2": 0.005004619940733299, "sim_compute_robot_state-npc3": 0.004990512489253639}}
set_robot_commands_max0.007596535389649802
set_robot_commands_mean0.005899521742215163
set_robot_commands_median0.005320627827289676
set_robot_commands_min0.005165957823032286
sim_compute_performance-ego_max0.005631106240408761
sim_compute_performance-ego_mean0.004477299639247261
sim_compute_performance-ego_median0.004056997077409611
sim_compute_performance-ego_min0.003986650989169166
sim_compute_robot_state-ego_max0.007068917864844913
sim_compute_robot_state-ego_mean0.005607275883999617
sim_compute_robot_state-ego_median0.005112928013468898
sim_compute_robot_state-ego_min0.005023635666945885
sim_compute_robot_state-npc0_max0.0067974935030804
sim_compute_robot_state-npc0_mean0.005587721524833177
sim_compute_robot_state-npc0_median0.0051721083490472095
sim_compute_robot_state-npc0_min0.00498398867520419
sim_compute_robot_state-npc1_max0.006639563171557208
sim_compute_robot_state-npc1_mean0.005433922380819656
sim_compute_robot_state-npc1_median0.005015018440428234
sim_compute_robot_state-npc1_min0.004855528110411109
sim_compute_robot_state-npc2_max0.0067328522282262
sim_compute_robot_state-npc2_mean0.005417086585114785
sim_compute_robot_state-npc2_median0.00500133425690407
sim_compute_robot_state-npc2_min0.004778677508944557
sim_compute_robot_state-npc3_max0.006627447778286215
sim_compute_robot_state-npc3_mean0.005348916052121965
sim_compute_robot_state-npc3_median0.004932254193777062
sim_compute_robot_state-npc3_min0.0047981880960010345
sim_compute_sim_state_max0.00390547513961792
sim_compute_sim_state_mean0.0032153298035733895
sim_compute_sim_state_median0.0029701458881179013
sim_compute_sim_state_min0.002892544103223224
sim_physics_max0.15373319002889818
sim_physics_mean0.1165958313451652
sim_physics_median0.11412109717849858
sim_physics_min0.09515147515568868
sim_render-ego_max0.009637670857565743
sim_render-ego_mean0.00784306362009034
sim_render-ego_median0.007186507069787314
sim_render-ego_min0.007061793622242878
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.770000000000002
survival_time_min4.199999999999993
No reset possible
293355723Robert Moni 🇭🇺almasip-6824aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:13:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.272254186038966
survival_time_median4.94999999999999
deviation-center-line_median0.32367040713725154
in-drivable-lane_median1.649999999999994


other stats
agent_compute-ego_max0.02594166017521573
agent_compute-ego_mean0.02517114944840036
agent_compute-ego_median0.025253504514694217
agent_compute-ego_min0.024518943968273345
deviation-center-line_max0.996642430176942
deviation-center-line_mean0.4830055792091902
deviation-center-line_min0.23233570792595276
deviation-heading_max6.242468198137502
deviation-heading_mean2.6451374428722647
deviation-heading_median2.0000133050597406
deviation-heading_min1.4045441837331074
driven_any_max2.0519864752182753
driven_any_mean0.9952187471436112
driven_any_median0.6233067541867318
driven_any_min0.4670733118960798
driven_lanedir_consec_max1.2674683901014323
driven_lanedir_consec_mean0.5173907655321497
driven_lanedir_consec_min0.14332903355825088
driven_lanedir_max1.3459822862653683
driven_lanedir_mean0.6098464947139011
driven_lanedir_median0.3379142229814919
driven_lanedir_min0.19069563473363085
in-drivable-lane_max3.950000000000024
in-drivable-lane_mean1.8966666666666705
in-drivable-lane_min1.0499999999999965
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2364068372163717, "sim_physics": 0.055030538537408, "survival_time": 8.84999999999999, "driven_lanedir": 0.9055591371440516, "sim_render-ego": 0.007096929065251755, "in-drivable-lane": 1.6499999999999986, "agent_compute-ego": 0.02594166017521573, "deviation-heading": 2.6007353218408205, "set_robot_commands": 0.0053595769203315345, "deviation-center-line": 0.5661930999398078, "driven_lanedir_consec": 0.8810506023746365, "sim_compute_sim_state": 0.0029628047835355423, "sim_compute_performance-ego": 0.004132750344141728, "sim_compute_robot_state-ego": 0.005184498210411287}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7615322203952256, "sim_physics": 0.05622406976412883, "survival_time": 5.649999999999988, "driven_lanedir": 0.4781006809535844, "sim_render-ego": 0.007180528303163241, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.02458497064303508, "deviation-heading": 2.017761403897146, "set_robot_commands": 0.005272783009351883, "deviation-center-line": 0.3781265697222157, "driven_lanedir_consec": 0.4606915366750821, "sim_compute_sim_state": 0.0030333299552444863, "sim_compute_performance-ego": 0.004130424651424442, "sim_compute_robot_state-ego": 0.005112991923779513}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5049734313592991, "sim_physics": 0.05536387584827565, "survival_time": 4.049999999999994, "driven_lanedir": 0.22928296395339665, "sim_render-ego": 0.007200829776716821, "in-drivable-lane": 1.4499999999999955, "agent_compute-ego": 0.02533452304792993, "deviation-heading": 1.5250063847813735, "set_robot_commands": 0.005323159841843593, "deviation-center-line": 0.27706421254249486, "driven_lanedir_consec": 0.17437990845137818, "sim_compute_sim_state": 0.0028857066307538823, "sim_compute_performance-ego": 0.004063147085684317, "sim_compute_robot_state-ego": 0.005019567630909107}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5717213085309429, "sim_physics": 0.05683206452263726, "survival_time": 4.499999999999992, "driven_lanedir": 0.2710731106716977, "sim_render-ego": 0.007192797131008572, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.025501637988620336, "deviation-heading": 1.534659564893088, "set_robot_commands": 0.005281496047973633, "deviation-center-line": 0.26640400207043763, "driven_lanedir_consec": 0.24738748479071584, "sim_compute_sim_state": 0.0031135082244873047, "sim_compute_performance-ego": 0.0040862189398871525, "sim_compute_robot_state-ego": 0.005022448963589139}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5785548143245407, "sim_physics": 0.055532754792107474, "survival_time": 4.499999999999992, "driven_lanedir": 0.2839434347710499, "sim_render-ego": 0.00723925961388482, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.02467597325642904, "deviation-heading": 1.5334471917733206, "set_robot_commands": 0.005539115269978841, "deviation-center-line": 0.23233570792595276, "driven_lanedir_consec": 0.25993586495042353, "sim_compute_sim_state": 0.003027078840467665, "sim_compute_performance-ego": 0.004118265046013726, "sim_compute_robot_state-ego": 0.005028287569681804}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.536566112688094, "sim_physics": 0.05585047460737683, "survival_time": 4.199999999999993, "driven_lanedir": 0.2641742233228963, "sim_render-ego": 0.00724376950945173, "in-drivable-lane": 1.4499999999999953, "agent_compute-ego": 0.024518943968273345, "deviation-heading": 1.522155259671107, "set_robot_commands": 0.005266677765619187, "deviation-center-line": 0.2820246178218486, "driven_lanedir_consec": 0.20302195153701996, "sim_compute_sim_state": 0.002921110107785179, "sim_compute_performance-ego": 0.004083363782791864, "sim_compute_robot_state-ego": 0.005030155181884766}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.6233067541867318, "sim_physics": 0.054679213148174866, "survival_time": 4.94999999999999, "driven_lanedir": 0.2979194182916789, "sim_render-ego": 0.0072100114340734, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.02525684086963384, "deviation-heading": 2.0000133050597406, "set_robot_commands": 0.005395306481255425, "deviation-center-line": 0.310706886575038, "driven_lanedir_consec": 0.272254186038966, "sim_compute_sim_state": 0.0029651059044731986, "sim_compute_performance-ego": 0.004097849431664052, "sim_compute_robot_state-ego": 0.005065703632855656}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.0519864752182753, "sim_physics": 0.053122305870056154, "survival_time": 14.950000000000076, "driven_lanedir": 1.3459822862653683, "sim_render-ego": 0.007120445569356282, "in-drivable-lane": 2.9000000000000226, "agent_compute-ego": 0.025108560721079507, "deviation-heading": 6.242468198137502, "set_robot_commands": 0.005308908621470133, "deviation-center-line": 0.9646351722643716, "driven_lanedir_consec": 0.7450924697417447, "sim_compute_sim_state": 0.002982131640116374, "sim_compute_performance-ego": 0.00409655491511027, "sim_compute_robot_state-ego": 0.005012613932291667}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.9495078264946588, "sim_physics": 0.05471288281328538, "survival_time": 13.600000000000058, "driven_lanedir": 1.2872156643042094, "sim_render-ego": 0.007095781319281634, "in-drivable-lane": 3.55000000000003, "agent_compute-ego": 0.025253504514694217, "deviation-heading": 4.019070358271651, "set_robot_commands": 0.005313840859076556, "deviation-center-line": 0.9437951323169016, "driven_lanedir_consec": 1.2674683901014323, "sim_compute_sim_state": 0.002950569286065943, "sim_compute_performance-ego": 0.004109128433115342, "sim_compute_robot_state-ego": 0.005026979481472689}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.043557687540962, "sim_physics": 0.05477603197097778, "survival_time": 14.950000000000076, "driven_lanedir": 1.2041348968348211, "sim_render-ego": 0.0070745627085367834, "in-drivable-lane": 3.950000000000024, "agent_compute-ego": 0.0252440611521403, "deviation-heading": 5.900894261323545, "set_robot_commands": 0.005347388585408529, "deviation-center-line": 0.996642430176942, "driven_lanedir_consec": 0.9490020372116192, "sim_compute_sim_state": 0.0029131317138671874, "sim_compute_performance-ego": 0.004096371332804362, "sim_compute_robot_state-ego": 0.005031984647115071}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.581047230979993, "sim_physics": 0.056668416659037275, "survival_time": 4.499999999999992, "driven_lanedir": 0.3379142229814919, "sim_render-ego": 0.0071758482191297745, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.025405375162760417, "deviation-heading": 1.827088191558463, "set_robot_commands": 0.005258931054009331, "deviation-center-line": 0.32367040713725154, "driven_lanedir_consec": 0.26969904843529346, "sim_compute_sim_state": 0.002968713972303602, "sim_compute_performance-ego": 0.004077988200717502, "sim_compute_robot_state-ego": 0.0050520552529229054}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4670733118960798, "sim_physics": 0.05226901330445942, "survival_time": 3.7999999999999945, "driven_lanedir": 0.19069563473363085, "sim_render-ego": 0.007277385184639378, "in-drivable-lane": 1.499999999999997, "agent_compute-ego": 0.024680074892546, "deviation-heading": 1.4045441837331074, "set_robot_commands": 0.005294988029881527, "deviation-center-line": 0.2560752998581507, "driven_lanedir_consec": 0.14332903355825088, "sim_compute_sim_state": 0.002922836102937397, "sim_compute_performance-ego": 0.004118373519495914, "sim_compute_robot_state-ego": 0.005057432149585925}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.5933875715536249, "sim_physics": 0.058004177941216366, "survival_time": 4.499999999999992, "driven_lanedir": 0.3052250789799916, "sim_render-ego": 0.007360516654120551, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.025527903768751355, "deviation-heading": 1.6756291951648128, "set_robot_commands": 0.0052836709552341035, "deviation-center-line": 0.289445917867614, "driven_lanedir_consec": 0.24415245779460815, "sim_compute_sim_state": 0.002913220723470052, "sim_compute_performance-ego": 0.004168126318189833, "sim_compute_robot_state-ego": 0.005131642023722331}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.560502306605673, "sim_physics": 0.05587629313882628, "survival_time": 10.95000000000002, "driven_lanedir": 1.1650799819770357, "sim_render-ego": 0.0071045895145364, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.025478521982828777, "deviation-heading": 3.3155895551501273, "set_robot_commands": 0.005327832208920831, "deviation-center-line": 0.7895962574811181, "driven_lanedir_consec": 1.12181894786128, "sim_compute_sim_state": 0.0029637661154411697, "sim_compute_performance-ego": 0.004087579849103814, "sim_compute_robot_state-ego": 0.005059441475019063}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.8681573181637003, "sim_physics": 0.05550693919640461, "survival_time": 6.549999999999985, "driven_lanedir": 0.5813966855236108, "sim_render-ego": 0.007200732485938618, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.02505468958206759, "deviation-heading": 2.557999267828177, "set_robot_commands": 0.005395224986185554, "deviation-center-line": 0.3683679744377085, "driven_lanedir_consec": 0.5215775634597934, "sim_compute_sim_state": 0.002947450594137643, "sim_compute_performance-ego": 0.004084348678588867, "sim_compute_robot_state-ego": 0.005043684981251491}}
set_robot_commands_max0.005539115269978841
set_robot_commands_mean0.005331260042436044
set_robot_commands_median0.005313840859076556
set_robot_commands_min0.005258931054009331
sim_compute_performance-ego_max0.004168126318189833
sim_compute_performance-ego_mean0.004103366035248879
sim_compute_performance-ego_median0.00409655491511027
sim_compute_performance-ego_min0.004063147085684317
sim_compute_robot_state-ego_max0.005184498210411287
sim_compute_robot_state-ego_mean0.005058632470432828
sim_compute_robot_state-ego_median0.005043684981251491
sim_compute_robot_state-ego_min0.005012613932291667
sim_compute_sim_state_max0.0031135082244873047
sim_compute_sim_state_mean0.002964697639672442
sim_compute_sim_state_median0.0029628047835355423
sim_compute_sim_state_min0.0028857066307538823
sim_physics_max0.058004177941216366
sim_physics_mean0.05536327014095814
sim_physics_median0.05550693919640461
sim_physics_min0.05226901330445942
sim_render-ego_max0.007360516654120551
sim_render-ego_mean0.007184932432605984
sim_render-ego_median0.007192797131008572
sim_render-ego_min0.0070745627085367834
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.366666666666675
survival_time_min3.7999999999999945
No reset possible
292735699Basile Dura 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26189965556369654
survival_time_median2.2
deviation-center-line_median0.07432281795103063
in-drivable-lane_median0.3500000000000002


other stats
agent_compute-ego_max0.03080835125663064
agent_compute-ego_mean0.02468554574495543
agent_compute-ego_median0.02394739319296444
agent_compute-ego_min0.020008156696955364
deviation-center-line_max0.6097135019510972
deviation-center-line_mean0.1701250866357657
deviation-center-line_min0.02990790756265292
deviation-heading_max4.710494633946667
deviation-heading_mean1.437980672690342
deviation-heading_median0.6756115263004427
deviation-heading_min0.4881466983509043
driven_any_max3.898123987137404
driven_any_mean1.1383269113046268
driven_any_median0.6354059238829147
driven_any_min0.1666753345553215
driven_lanedir_consec_max0.854433290977267
driven_lanedir_consec_mean0.3805869817972332
driven_lanedir_consec_min0.07800710824711565
driven_lanedir_max0.854433290977267
driven_lanedir_mean0.3805869817972332
driven_lanedir_median0.26189965556369654
driven_lanedir_min0.07800710824711565
in-drivable-lane_max9.700000000000056
in-drivable-lane_mean2.260000000000011
in-drivable-lane_min0.04999999999999993
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7752806428568676, "sim_physics": 0.093705135233262, "survival_time": 2.549999999999999, "driven_lanedir": 0.6109358236098212, "sim_render-ego": 0.00960529551786535, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02394739319296444, "deviation-heading": 0.8227700760908119, "set_robot_commands": 0.009388030744066423, "deviation-center-line": 0.09774462366371156, "driven_lanedir_consec": 0.6109358236098212, "sim_compute_sim_state": 0.004711992600384881, "sim_compute_performance-ego": 0.005686320510565066, "sim_compute_robot_state-ego": 0.0067250915602141735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6354059238829147, "sim_physics": 0.1121244105425748, "survival_time": 2.2, "driven_lanedir": 0.26189965556369654, "sim_render-ego": 0.011309807950800116, "in-drivable-lane": 0.8499999999999996, "agent_compute-ego": 0.03080835125663064, "deviation-heading": 0.6756115263004427, "set_robot_commands": 0.010547990148717708, "deviation-center-line": 0.07432281795103063, "driven_lanedir_consec": 0.26189965556369654, "sim_compute_sim_state": 0.004838314923373136, "sim_compute_performance-ego": 0.006626671010797674, "sim_compute_robot_state-ego": 0.008486216718500311}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.21614866809062544, "sim_physics": 0.08867951234181722, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07800710824711565, "sim_render-ego": 0.010258833567301432, "in-drivable-lane": 0.3500000000000002, "agent_compute-ego": 0.020008156696955364, "deviation-heading": 0.4881466983509043, "set_robot_commands": 0.008390794197718302, "deviation-center-line": 0.03893658205033621, "driven_lanedir_consec": 0.07800710824711565, "sim_compute_sim_state": 0.004335880279541016, "sim_compute_performance-ego": 0.006314069032669067, "sim_compute_robot_state-ego": 0.0072599053382873535}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1666753345553215, "sim_physics": 0.08842747211456299, "survival_time": 1.0000000000000002, "driven_lanedir": 0.09765903058826564, "sim_render-ego": 0.009661364555358886, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.02176297903060913, "deviation-heading": 0.4928804287628832, "set_robot_commands": 0.008930802345275879, "deviation-center-line": 0.02990790756265292, "driven_lanedir_consec": 0.09765903058826564, "sim_compute_sim_state": 0.004034519195556641, "sim_compute_performance-ego": 0.005702805519104004, "sim_compute_robot_state-ego": 0.00785452127456665}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.898123987137404, "sim_physics": 0.08750871022542318, "survival_time": 14.950000000000076, "driven_lanedir": 0.854433290977267, "sim_render-ego": 0.01073052962621053, "in-drivable-lane": 9.700000000000056, "agent_compute-ego": 0.026900848547617595, "deviation-heading": 4.710494633946667, "set_robot_commands": 0.009555003643035888, "deviation-center-line": 0.6097135019510972, "driven_lanedir_consec": 0.854433290977267, "sim_compute_sim_state": 0.004603344599405925, "sim_compute_performance-ego": 0.006350216070810954, "sim_compute_robot_state-ego": 0.00782063881556193}}
set_robot_commands_max0.010547990148717708
set_robot_commands_mean0.00936252421576284
set_robot_commands_median0.009388030744066423
set_robot_commands_min0.008390794197718302
sim_compute_performance-ego_max0.006626671010797674
sim_compute_performance-ego_mean0.006136016428789353
sim_compute_performance-ego_median0.006314069032669067
sim_compute_performance-ego_min0.005686320510565066
sim_compute_robot_state-ego_max0.008486216718500311
sim_compute_robot_state-ego_mean0.007629274741426084
sim_compute_robot_state-ego_median0.00782063881556193
sim_compute_robot_state-ego_min0.0067250915602141735
sim_compute_sim_state_max0.004838314923373136
sim_compute_sim_state_mean0.004504810319652319
sim_compute_sim_state_median0.004603344599405925
sim_compute_sim_state_min0.004034519195556641
sim_physics_max0.1121244105425748
sim_physics_mean0.09408904809152804
sim_physics_median0.08867951234181722
sim_physics_min0.08750871022542318
sim_render-ego_max0.011309807950800116
sim_render-ego_mean0.010313166243507263
sim_render-ego_median0.010258833567301432
sim_render-ego_min0.00960529551786535
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.380000000000015
survival_time_min1.0000000000000002
No reset possible
292555688Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-testingstep1-simulationerrornoip-172-31-35-218-104900:08:32
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
292505684Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0335540399013547
survival_time_median10.400000000000013
deviation-center-line_median0.6191186201695895
in-drivable-lane_median0


other stats
agent_compute-ego_max0.021219306833603804
agent_compute-ego_mean0.020866923607800125
agent_compute-ego_median0.020831783977123576
agent_compute-ego_min0.02063324525184238
deviation-center-line_max0.8588311234433487
deviation-center-line_mean0.5529521195136384
deviation-center-line_min0.17991242802810617
deviation-heading_max3.236106176367858
deviation-heading_mean1.9626590470442835
deviation-heading_median1.66442883264555
deviation-heading_min0.8537060322666954
driven_any_max3.6459209385635702
driven_any_mean2.9595798893617937
driven_any_median3.156892434255279
driven_any_min1.308143135339802
driven_lanedir_consec_max3.623400654826748
driven_lanedir_consec_mean2.6767438229097733
driven_lanedir_consec_min1.2566393719462403
driven_lanedir_max3.623400654826748
driven_lanedir_mean2.6767438229097733
driven_lanedir_median3.0335540399013547
driven_lanedir_min1.2566393719462403
in-drivable-lane_max2.100000000000022
in-drivable-lane_mean0.6200000000000072
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.308143135339802, "sim_physics": 0.056715628680060894, "survival_time": 4.249999999999993, "driven_lanedir": 1.2566393719462403, "sim_render-ego": 0.007276145149679745, "in-drivable-lane": 0, "agent_compute-ego": 0.021219306833603804, "deviation-heading": 0.8537060322666954, "set_robot_commands": 0.005249730278463925, "deviation-center-line": 0.17991242802810617, "driven_lanedir_consec": 1.2566393719462403, "sim_compute_sim_state": 0.002974911297068876, "sim_compute_performance-ego": 0.004311443777645335, "sim_compute_robot_state-ego": 0.005119079702040728}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.5662457141796917, "sim_physics": 0.0554445971042738, "survival_time": 10.90000000000002, "driven_lanedir": 3.06086793233887, "sim_render-ego": 0.007200083601365395, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.020831783977123576, "deviation-heading": 3.236106176367858, "set_robot_commands": 0.005293753168998508, "deviation-center-line": 0.8588311234433487, "driven_lanedir_consec": 3.06086793233887, "sim_compute_sim_state": 0.0029371747183143545, "sim_compute_performance-ego": 0.004036305147573489, "sim_compute_robot_state-ego": 0.00506944612625542}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.6459209385635702, "sim_physics": 0.05625699202219645, "survival_time": 14.950000000000076, "driven_lanedir": 3.623400654826748, "sim_render-ego": 0.007096671263376872, "in-drivable-lane": 0, "agent_compute-ego": 0.020736478169759116, "deviation-heading": 1.46725378947616, "set_robot_commands": 0.005260135332743327, "deviation-center-line": 0.658263485956641, "driven_lanedir_consec": 3.623400654826748, "sim_compute_sim_state": 0.0029737623532613117, "sim_compute_performance-ego": 0.0040270256996154784, "sim_compute_robot_state-ego": 0.005062205791473389}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.120697224470624, "sim_physics": 0.05596561775994055, "survival_time": 9.700000000000005, "driven_lanedir": 2.4092571155356555, "sim_render-ego": 0.007207188409628328, "in-drivable-lane": 2.100000000000022, "agent_compute-ego": 0.02063324525184238, "deviation-heading": 1.66442883264555, "set_robot_commands": 0.005245916622201192, "deviation-center-line": 0.4486349399705064, "driven_lanedir_consec": 2.4092571155356555, "sim_compute_sim_state": 0.002982794624013999, "sim_compute_performance-ego": 0.004056233720681102, "sim_compute_robot_state-ego": 0.0050540879829642695}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.156892434255279, "sim_physics": 0.055810087002240695, "survival_time": 10.400000000000013, "driven_lanedir": 3.0335540399013547, "sim_render-ego": 0.007153893892581646, "in-drivable-lane": 0, "agent_compute-ego": 0.02091380380667173, "deviation-heading": 2.591800404465155, "set_robot_commands": 0.005232243583752559, "deviation-center-line": 0.6191186201695895, "driven_lanedir_consec": 3.0335540399013547, "sim_compute_sim_state": 0.002963102780855619, "sim_compute_performance-ego": 0.004110316817577069, "sim_compute_robot_state-ego": 0.0050561749018155615}}
set_robot_commands_max0.005293753168998508
set_robot_commands_mean0.005256355797231902
set_robot_commands_median0.005249730278463925
set_robot_commands_min0.005232243583752559
sim_compute_performance-ego_max0.004311443777645335
sim_compute_performance-ego_mean0.0041082650326184945
sim_compute_performance-ego_median0.004056233720681102
sim_compute_performance-ego_min0.0040270256996154784
sim_compute_robot_state-ego_max0.005119079702040728
sim_compute_robot_state-ego_mean0.005072198900909873
sim_compute_robot_state-ego_median0.005062205791473389
sim_compute_robot_state-ego_min0.0050540879829642695
sim_compute_sim_state_max0.002982794624013999
sim_compute_sim_state_mean0.002966349154702832
sim_compute_sim_state_median0.0029737623532613117
sim_compute_sim_state_min0.0029371747183143545
sim_physics_max0.056715628680060894
sim_physics_mean0.05603858451374248
sim_physics_median0.05596561775994055
sim_physics_min0.0554445971042738
sim_render-ego_max0.007276145149679745
sim_render-ego_mean0.007186796463326398
sim_render-ego_median0.007200083601365395
sim_render-ego_min0.007096671263376872
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.040000000000022
survival_time_min4.249999999999993
No reset possible
292305671Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7663224713056533
survival_time_median9.199999999999996
deviation-center-line_median0.42930605286258067
in-drivable-lane_median0


other stats
agent_compute-ego_max0.021464302426292783
agent_compute-ego_mean0.02095623369495138
agent_compute-ego_median0.0208012941090957
agent_compute-ego_min0.02071769714355469
deviation-center-line_max0.7125514495430186
deviation-center-line_mean0.4389644225151691
deviation-center-line_min0.20868368341640964
deviation-heading_max3.4978007433851586
deviation-heading_mean1.9386697688786785
deviation-heading_median2.063567751926827
deviation-heading_min0.8010097463770466
driven_any_max4.849858913130668
driven_any_mean2.9212744706302933
driven_any_median3.2578617091489237
driven_any_min1.201660568305453
driven_lanedir_consec_max4.766984263641928
driven_lanedir_consec_mean2.7480589282721715
driven_lanedir_consec_min1.1541024228933006
driven_lanedir_max4.766984263641928
driven_lanedir_mean2.7480589282721715
driven_lanedir_median2.7663224713056533
driven_lanedir_min1.1541024228933006
in-drivable-lane_max0.8000000000000016
in-drivable-lane_mean0.1600000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3200724183360355, "sim_physics": 0.05862557888031006, "survival_time": 4.199999999999993, "driven_lanedir": 1.269338612798951, "sim_render-ego": 0.00724284705661592, "in-drivable-lane": 0, "agent_compute-ego": 0.021464302426292783, "deviation-heading": 0.9007457737587478, "set_robot_commands": 0.005459637868972052, "deviation-center-line": 0.20868368341640964, "driven_lanedir_consec": 1.269338612798951, "sim_compute_sim_state": 0.0030076418604169574, "sim_compute_performance-ego": 0.004266560077667236, "sim_compute_robot_state-ego": 0.005079919383639381}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.201660568305453, "sim_physics": 0.05546339601278305, "survival_time": 3.1999999999999966, "driven_lanedir": 1.1541024228933006, "sim_render-ego": 0.007124003022909164, "in-drivable-lane": 0, "agent_compute-ego": 0.02104710415005684, "deviation-heading": 0.8010097463770466, "set_robot_commands": 0.005205456167459488, "deviation-center-line": 0.22173840451132593, "driven_lanedir_consec": 1.1541024228933006, "sim_compute_sim_state": 0.0029735974967479706, "sim_compute_performance-ego": 0.0039882175624370575, "sim_compute_robot_state-ego": 0.005035147070884705}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.849858913130668, "sim_physics": 0.05470316966374715, "survival_time": 14.950000000000076, "driven_lanedir": 4.766984263641928, "sim_render-ego": 0.007068320115407308, "in-drivable-lane": 0, "agent_compute-ego": 0.02071769714355469, "deviation-heading": 2.43022482894561, "set_robot_commands": 0.0052340300877889, "deviation-center-line": 0.622542522242511, "driven_lanedir_consec": 4.766984263641928, "sim_compute_sim_state": 0.002995947996775309, "sim_compute_performance-ego": 0.004042633374532064, "sim_compute_robot_state-ego": 0.005037278334299723}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.2578617091489237, "sim_physics": 0.05503012693446616, "survival_time": 9.199999999999996, "driven_lanedir": 2.7663224713056533, "sim_render-ego": 0.007089700387871783, "in-drivable-lane": 0.8000000000000016, "agent_compute-ego": 0.0208012941090957, "deviation-heading": 2.063567751926827, "set_robot_commands": 0.0051986860192340355, "deviation-center-line": 0.42930605286258067, "driven_lanedir_consec": 2.7663224713056533, "sim_compute_sim_state": 0.00297386620355689, "sim_compute_performance-ego": 0.004039540239002394, "sim_compute_robot_state-ego": 0.005047323911086372}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.976918744230385, "sim_physics": 0.05710395786070054, "survival_time": 12.40000000000004, "driven_lanedir": 3.7835468707210262, "sim_render-ego": 0.0071947747661221416, "in-drivable-lane": 0, "agent_compute-ego": 0.020750770645756877, "deviation-heading": 3.4978007433851586, "set_robot_commands": 0.005186973079558342, "deviation-center-line": 0.7125514495430186, "driven_lanedir_consec": 3.7835468707210262, "sim_compute_sim_state": 0.002998275141562185, "sim_compute_performance-ego": 0.004041605418728244, "sim_compute_robot_state-ego": 0.005038778628072431}}
set_robot_commands_max0.005459637868972052
set_robot_commands_mean0.005256956644602563
set_robot_commands_median0.005205456167459488
set_robot_commands_min0.005186973079558342
sim_compute_performance-ego_max0.004266560077667236
sim_compute_performance-ego_mean0.004075711334473399
sim_compute_performance-ego_median0.004041605418728244
sim_compute_performance-ego_min0.0039882175624370575
sim_compute_robot_state-ego_max0.005079919383639381
sim_compute_robot_state-ego_mean0.0050476894655965224
sim_compute_robot_state-ego_median0.005038778628072431
sim_compute_robot_state-ego_min0.005035147070884705
sim_compute_sim_state_max0.0030076418604169574
sim_compute_sim_state_mean0.002989865739811863
sim_compute_sim_state_median0.002995947996775309
sim_compute_sim_state_min0.0029735974967479706
sim_physics_max0.05862557888031006
sim_physics_mean0.05618524587040139
sim_physics_median0.05546339601278305
sim_physics_min0.05470316966374715
sim_render-ego_max0.00724284705661592
sim_render-ego_mean0.007143929069785264
sim_render-ego_median0.007124003022909164
sim_render-ego_min0.007068320115407308
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.79000000000002
survival_time_min3.1999999999999966
No reset possible
292265669Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.732305270392813
survival_time_median5.649999999999988
deviation-center-line_median0.28442078374843494
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.02121464530033852
agent_compute-ego_mean0.020973160182234187
agent_compute-ego_median0.021082251472810728
agent_compute-ego_min0.020506744954123423
deviation-center-line_max0.6373259637943393
deviation-center-line_mean0.37749613273873667
deviation-center-line_min0.2325920837130681
deviation-heading_max2.3871898952516935
deviation-heading_mean1.5138343736584388
deviation-heading_median1.1817007868357023
deviation-heading_min0.9375852571580132
driven_any_max4.48330376479314
driven_any_mean2.435540311374674
driven_any_median2.106379143072422
driven_any_min1.244162932493708
driven_lanedir_consec_max4.409756590744655
driven_lanedir_consec_mean2.188639865695916
driven_lanedir_consec_min1.1717209506797803
driven_lanedir_max4.409756590744655
driven_lanedir_mean2.188639865695916
driven_lanedir_median1.732305270392813
driven_lanedir_min1.1717209506797803
in-drivable-lane_max0.7000000000000064
in-drivable-lane_mean0.3300000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.981600531895153, "sim_physics": 0.05692796759266671, "survival_time": 9.149999999999997, "driven_lanedir": 2.4469081025864847, "sim_render-ego": 0.007151835603140743, "in-drivable-lane": 0.7000000000000064, "agent_compute-ego": 0.02120194018212824, "deviation-heading": 2.091204910440098, "set_robot_commands": 0.0053263257761470605, "deviation-center-line": 0.4714379537471052, "driven_lanedir_consec": 2.4469081025864847, "sim_compute_sim_state": 0.0029951431712166208, "sim_compute_performance-ego": 0.004203961846606979, "sim_compute_robot_state-ego": 0.005084354369366755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.362255184618948, "sim_physics": 0.05984863238548165, "survival_time": 3.349999999999996, "driven_lanedir": 1.1717209506797803, "sim_render-ego": 0.007281563175258352, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.020506744954123423, "deviation-heading": 0.9714910186066864, "set_robot_commands": 0.0051953899326609146, "deviation-center-line": 0.26170387869073586, "driven_lanedir_consec": 1.1717209506797803, "sim_compute_sim_state": 0.002979787427987625, "sim_compute_performance-ego": 0.004064036839043916, "sim_compute_robot_state-ego": 0.005060815099459976}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.48330376479314, "sim_physics": 0.05607547918955485, "survival_time": 14.950000000000076, "driven_lanedir": 4.409756590744655, "sim_render-ego": 0.00713425079981486, "in-drivable-lane": 0, "agent_compute-ego": 0.02086021900177002, "deviation-heading": 2.3871898952516935, "set_robot_commands": 0.005242401758829752, "deviation-center-line": 0.6373259637943393, "driven_lanedir_consec": 4.409756590744655, "sim_compute_sim_state": 0.002971072196960449, "sim_compute_performance-ego": 0.004072926044464111, "sim_compute_robot_state-ego": 0.005091129938761393}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.106379143072422, "sim_physics": 0.06115829417135863, "survival_time": 5.649999999999988, "driven_lanedir": 1.732305270392813, "sim_render-ego": 0.007377063278603343, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.021082251472810728, "deviation-heading": 1.1817007868357023, "set_robot_commands": 0.005354229327851692, "deviation-center-line": 0.28442078374843494, "driven_lanedir_consec": 1.732305270392813, "sim_compute_sim_state": 0.0030317707399351405, "sim_compute_performance-ego": 0.004208305240732378, "sim_compute_robot_state-ego": 0.005267434415564073}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.244162932493708, "sim_physics": 0.05775471943527905, "survival_time": 3.349999999999996, "driven_lanedir": 1.182508414075847, "sim_render-ego": 0.007374283093125072, "in-drivable-lane": 0, "agent_compute-ego": 0.02121464530033852, "deviation-heading": 0.9375852571580132, "set_robot_commands": 0.00526680519331747, "deviation-center-line": 0.2325920837130681, "driven_lanedir_consec": 1.182508414075847, "sim_compute_sim_state": 0.00300561492122821, "sim_compute_performance-ego": 0.004045230239184934, "sim_compute_robot_state-ego": 0.005188639484234711}}
set_robot_commands_max0.005354229327851692
set_robot_commands_mean0.005277030397761378
set_robot_commands_median0.00526680519331747
set_robot_commands_min0.0051953899326609146
sim_compute_performance-ego_max0.004208305240732378
sim_compute_performance-ego_mean0.004118892042006464
sim_compute_performance-ego_median0.004072926044464111
sim_compute_performance-ego_min0.004045230239184934
sim_compute_robot_state-ego_max0.005267434415564073
sim_compute_robot_state-ego_mean0.005138474661477381
sim_compute_robot_state-ego_median0.005091129938761393
sim_compute_robot_state-ego_min0.005060815099459976
sim_compute_sim_state_max0.0030317707399351405
sim_compute_sim_state_mean0.002996677691465609
sim_compute_sim_state_median0.0029951431712166208
sim_compute_sim_state_min0.002971072196960449
sim_physics_max0.06115829417135863
sim_physics_mean0.05835301855486817
sim_physics_median0.05775471943527905
sim_physics_min0.05607547918955485
sim_render-ego_max0.007377063278603343
sim_render-ego_mean0.007263799189988475
sim_render-ego_median0.007281563175258352
sim_render-ego_min0.00713425079981486
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.290000000000009
survival_time_min3.349999999999996
No reset possible
292235668Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.183157217371306
survival_time_median3.4999999999999956
deviation-center-line_median0.1714543982704445
in-drivable-lane_median0.6999999999999997


other stats
agent_compute-ego_max0.021360536984034947
agent_compute-ego_mean0.02087027239911613
agent_compute-ego_median0.020911882508475827
agent_compute-ego_min0.020424611532866063
deviation-center-line_max0.7011857988595532
deviation-center-line_mean0.2985028155944184
deviation-center-line_min0.13975567690055243
deviation-heading_max4.64956670714266
deviation-heading_mean1.642699722192258
deviation-heading_median0.9774228620204244
deviation-heading_min0.5626057942462969
driven_any_max4.829723201846083
driven_any_mean2.2092408850683745
driven_any_median1.2143321420910698
driven_any_min1.0311157677280034
driven_lanedir_consec_max3.0880456467589883
driven_lanedir_consec_mean1.6411737462488272
driven_lanedir_consec_min0.7556151365546546
driven_lanedir_max3.0880456467589883
driven_lanedir_mean1.6411737462488272
driven_lanedir_median1.183157217371306
driven_lanedir_min0.7556151365546546
in-drivable-lane_max3.4500000000000286
in-drivable-lane_mean1.060000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2143321420910698, "sim_physics": 0.0606536899294172, "survival_time": 3.4999999999999956, "driven_lanedir": 1.183157217371306, "sim_render-ego": 0.007380996431623187, "in-drivable-lane": 0, "agent_compute-ego": 0.021360536984034947, "deviation-heading": 0.5626057942462969, "set_robot_commands": 0.005296758243015834, "deviation-center-line": 0.16373276107148554, "driven_lanedir_consec": 1.183157217371306, "sim_compute_sim_state": 0.003016512734549386, "sim_compute_performance-ego": 0.004292798042297363, "sim_compute_robot_state-ego": 0.005120921134948731}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1868284252167676, "sim_physics": 0.05989944328696041, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7556151365546546, "sim_render-ego": 0.007238974005489026, "in-drivable-lane": 0.6999999999999997, "agent_compute-ego": 0.020998768887277378, "deviation-heading": 0.9774228620204244, "set_robot_commands": 0.005270295223947299, "deviation-center-line": 0.1714543982704445, "driven_lanedir_consec": 0.7556151365546546, "sim_compute_sim_state": 0.0029359793258925617, "sim_compute_performance-ego": 0.0039960489434711, "sim_compute_robot_state-ego": 0.0051331762540138375}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.829723201846083, "sim_physics": 0.05477613925933838, "survival_time": 14.950000000000076, "driven_lanedir": 3.0880456467589883, "sim_render-ego": 0.007056183815002441, "in-drivable-lane": 3.4500000000000286, "agent_compute-ego": 0.020655562082926432, "deviation-heading": 4.64956670714266, "set_robot_commands": 0.005228832562764485, "deviation-center-line": 0.7011857988595532, "driven_lanedir_consec": 3.0880456467589883, "sim_compute_sim_state": 0.002970698674519857, "sim_compute_performance-ego": 0.004037091732025147, "sim_compute_robot_state-ego": 0.0050402442614237465}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7842048884599477, "sim_physics": 0.05782729832094107, "survival_time": 6.699999999999984, "driven_lanedir": 2.193891393923926, "sim_render-ego": 0.0071785432189258175, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.020424611532866063, "deviation-heading": 1.328117891631876, "set_robot_commands": 0.005232899936277475, "deviation-center-line": 0.31638544287005615, "driven_lanedir_consec": 2.193891393923926, "sim_compute_sim_state": 0.003019444978059228, "sim_compute_performance-ego": 0.004043244603854507, "sim_compute_robot_state-ego": 0.0050633256115130525}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0311157677280034, "sim_physics": 0.05860735335440006, "survival_time": 2.6499999999999986, "driven_lanedir": 0.9851593366352598, "sim_render-ego": 0.007364574468360757, "in-drivable-lane": 0, "agent_compute-ego": 0.020911882508475827, "deviation-heading": 0.6957853559200324, "set_robot_commands": 0.005282303072371573, "deviation-center-line": 0.13975567690055243, "driven_lanedir_consec": 0.9851593366352598, "sim_compute_sim_state": 0.0030514564154283056, "sim_compute_performance-ego": 0.004105221550419646, "sim_compute_robot_state-ego": 0.005083965805341613}}
set_robot_commands_max0.005296758243015834
set_robot_commands_mean0.005262217807675333
set_robot_commands_median0.005270295223947299
set_robot_commands_min0.005228832562764485
sim_compute_performance-ego_max0.004292798042297363
sim_compute_performance-ego_mean0.004094880974413553
sim_compute_performance-ego_median0.004043244603854507
sim_compute_performance-ego_min0.0039960489434711
sim_compute_robot_state-ego_max0.0051331762540138375
sim_compute_robot_state-ego_mean0.005088326613448196
sim_compute_robot_state-ego_median0.005083965805341613
sim_compute_robot_state-ego_min0.0050402442614237465
sim_compute_sim_state_max0.0030514564154283056
sim_compute_sim_state_mean0.0029988184256898674
sim_compute_sim_state_median0.003016512734549386
sim_compute_sim_state_min0.0029359793258925617
sim_physics_max0.0606536899294172
sim_physics_mean0.058352784830211425
sim_physics_median0.05860735335440006
sim_physics_min0.05477613925933838
sim_render-ego_max0.007380996431623187
sim_render-ego_mean0.007243854387880245
sim_render-ego_median0.007238974005489026
sim_render-ego_min0.007056183815002441
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.150000000000011
survival_time_min2.6499999999999986
No reset possible
292165666Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9142745614375651
survival_time_median5.599999999999988
deviation-center-line_median0.3422741236589514
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.021905241341426455
agent_compute-ego_mean0.021118970311560584
agent_compute-ego_median0.020921545369284495
agent_compute-ego_min0.02073325330053854
deviation-center-line_max0.8511735829127596
deviation-center-line_mean0.4514605136483869
deviation-center-line_min0.2982720372528743
deviation-heading_max3.8055124486665073
deviation-heading_mean1.8981093325364349
deviation-heading_median1.664431399432059
deviation-heading_min0.9461375757659588
driven_any_max5.195123359750725
driven_any_mean2.7093319338961943
driven_any_median2.3379552059816913
driven_any_min1.3697746410165583
driven_lanedir_consec_max4.141168617267769
driven_lanedir_consec_mean2.3019870354121807
driven_lanedir_consec_min1.2982589464126622
driven_lanedir_max4.141168617267769
driven_lanedir_mean2.3019870354121807
driven_lanedir_median1.9142745614375651
driven_lanedir_min1.2982589464126622
in-drivable-lane_max2.10000000000003
in-drivable-lane_mean0.690000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.382783999521769, "sim_physics": 0.057204991921611215, "survival_time": 4.3499999999999925, "driven_lanedir": 1.2982589464126622, "sim_render-ego": 0.007276167814759003, "in-drivable-lane": 0, "agent_compute-ego": 0.021905241341426455, "deviation-heading": 1.2650350643923505, "set_robot_commands": 0.00522981018855654, "deviation-center-line": 0.2982720372528743, "driven_lanedir_consec": 1.2982589464126622, "sim_compute_sim_state": 0.0029818162150766657, "sim_compute_performance-ego": 0.0042383615998016, "sim_compute_robot_state-ego": 0.005133880966011135}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3697746410165583, "sim_physics": 0.0580247373723272, "survival_time": 3.349999999999996, "driven_lanedir": 1.298937991970304, "sim_render-ego": 0.007345854346431903, "in-drivable-lane": 0, "agent_compute-ego": 0.021258678009260942, "deviation-heading": 0.9461375757659588, "set_robot_commands": 0.00531128627150806, "deviation-center-line": 0.2992273178498685, "driven_lanedir_consec": 1.298937991970304, "sim_compute_sim_state": 0.0029902102342292446, "sim_compute_performance-ego": 0.004078601723286643, "sim_compute_robot_state-ego": 0.005170957366032387}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.195123359750725, "sim_physics": 0.05539182186126709, "survival_time": 14.950000000000076, "driven_lanedir": 4.141168617267769, "sim_render-ego": 0.007184351285298665, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.02077613353729248, "deviation-heading": 3.8055124486665073, "set_robot_commands": 0.005221423308054606, "deviation-center-line": 0.8511735829127596, "driven_lanedir_consec": 4.141168617267769, "sim_compute_sim_state": 0.0030097262064615886, "sim_compute_performance-ego": 0.004073930581410726, "sim_compute_robot_state-ego": 0.0050986162821451825}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.261022463210228, "sim_physics": 0.05604109708328693, "survival_time": 8.549999999999986, "driven_lanedir": 2.8572950599726026, "sim_render-ego": 0.007249618831433748, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.02073325330053854, "deviation-heading": 1.8094301744252976, "set_robot_commands": 0.005252418462295978, "deviation-center-line": 0.4663555065674807, "driven_lanedir_consec": 2.8572950599726026, "sim_compute_sim_state": 0.002974252254642241, "sim_compute_performance-ego": 0.004043487080356531, "sim_compute_robot_state-ego": 0.005089440540960658}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3379552059816913, "sim_physics": 0.056083538702556064, "survival_time": 5.599999999999988, "driven_lanedir": 1.9142745614375651, "sim_render-ego": 0.007315388747623989, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.020921545369284495, "deviation-heading": 1.664431399432059, "set_robot_commands": 0.005253623638834272, "deviation-center-line": 0.3422741236589514, "driven_lanedir_consec": 1.9142745614375651, "sim_compute_sim_state": 0.002985522150993347, "sim_compute_performance-ego": 0.004058735711233956, "sim_compute_robot_state-ego": 0.005078941583633423}}
set_robot_commands_max0.00531128627150806
set_robot_commands_mean0.005253712373849891
set_robot_commands_median0.005252418462295978
set_robot_commands_min0.005221423308054606
sim_compute_performance-ego_max0.0042383615998016
sim_compute_performance-ego_mean0.004098623339217891
sim_compute_performance-ego_median0.004073930581410726
sim_compute_performance-ego_min0.004043487080356531
sim_compute_robot_state-ego_max0.005170957366032387
sim_compute_robot_state-ego_mean0.005114367347756557
sim_compute_robot_state-ego_median0.0050986162821451825
sim_compute_robot_state-ego_min0.005078941583633423
sim_compute_sim_state_max0.0030097262064615886
sim_compute_sim_state_mean0.0029883054122806173
sim_compute_sim_state_median0.002985522150993347
sim_compute_sim_state_min0.002974252254642241
sim_physics_max0.0580247373723272
sim_physics_mean0.056549237388209696
sim_physics_median0.056083538702556064
sim_physics_min0.05539182186126709
sim_render-ego_max0.007345854346431903
sim_render-ego_mean0.007274276205109462
sim_render-ego_median0.007276167814759003
sim_render-ego_min0.007184351285298665
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.360000000000008
survival_time_min3.349999999999996
No reset possible
291865660Mikita Sazanovich 🇷🇺chameleon-09-trioaido3-LFV-sim-testingstep1-simulationabortedyesip-172-31-35-218-104900:21:06
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
291105641Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|v3aido3-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:27:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.119753751371817
survival_time_median14.950000000000076
deviation-center-line_median0.9470613802000828
in-drivable-lane_median2.249999999999992


other stats
agent_compute-ego_max0.07508190711339315
agent_compute-ego_mean0.06856320365269979
agent_compute-ego_median0.06666858037312826
agent_compute-ego_min0.06223305861155192
deviation-center-line_max1.1047109661751402
deviation-center-line_mean0.9341893725959564
deviation-center-line_min0.6438633472558384
deviation-heading_max3.6535957859236614
deviation-heading_mean3.193904587939264
deviation-heading_median3.0749112725336993
deviation-heading_min2.690862236536622
driven_any_max6.334410446474408
driven_any_mean5.8004052900826455
driven_any_median5.746644453502022
driven_any_min5.090102456890004
driven_lanedir_consec_max5.383822874023875
driven_lanedir_consec_mean4.4800342284225945
driven_lanedir_consec_min2.7188673228118136
driven_lanedir_max5.383828529381947
driven_lanedir_mean4.652830231071864
driven_lanedir_median5.123235789119175
driven_lanedir_min3.1107431351154182
in-drivable-lane_max5.4500000000000535
in-drivable-lane_mean2.580000000000017
in-drivable-lane_min0.25000000000000355
per-episodes
details{"udem1-0-0": {"driven_any": 5.6806542641198945, "sim_physics": 0.2186950659751892, "survival_time": 14.950000000000076, "driven_lanedir": 5.383828529381947, "sim_render-ego": 0.012161493301391602, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.06489083051681518, "deviation-heading": 3.5091072118984594, "set_robot_commands": 0.00934552272160848, "deviation-center-line": 1.04363902449428, "driven_lanedir_consec": 5.383822874023875, "sim_compute_sim_state": 0.005015748341878255, "sim_compute_performance-ego": 0.007418711185455323, "sim_compute_robot_state-ego": 0.009166023731231689, "sim_compute_robot_state-npc0": 0.00887826124827067, "sim_compute_robot_state-npc1": 0.008548996448516845, "sim_compute_robot_state-npc2": 0.008474241892496745, "sim_compute_robot_state-npc3": 0.00827557643254598}, "udem1-1-0": {"driven_any": 5.746644453502022, "sim_physics": 0.20186562299728392, "survival_time": 14.950000000000076, "driven_lanedir": 5.123235789119175, "sim_render-ego": 0.012375494639078777, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.06223305861155192, "deviation-heading": 3.04104643280388, "set_robot_commands": 0.009222734769185384, "deviation-center-line": 0.9470613802000828, "driven_lanedir_consec": 5.119753751371817, "sim_compute_sim_state": 0.004905659357706706, "sim_compute_performance-ego": 0.00737919012705485, "sim_compute_robot_state-ego": 0.009322326183319091, "sim_compute_robot_state-npc0": 0.008538790543874105, "sim_compute_robot_state-npc1": 0.008653903802235921, "sim_compute_robot_state-npc2": 0.008454399108886719, "sim_compute_robot_state-npc3": 0.008497559229532877}, "udem1-2-0": {"driven_any": 6.150214829426898, "sim_physics": 0.2088308922449748, "survival_time": 14.950000000000076, "driven_lanedir": 4.355923485823737, "sim_render-ego": 0.012678403854370118, "in-drivable-lane": 3.8000000000000194, "agent_compute-ego": 0.06666858037312826, "deviation-heading": 3.0749112725336993, "set_robot_commands": 0.010071088473002116, "deviation-center-line": 0.9316721448544416, "driven_lanedir_consec": 3.8893460597172815, "sim_compute_sim_state": 0.005113500754038493, "sim_compute_performance-ego": 0.007522987524668376, "sim_compute_robot_state-ego": 0.009438239733378092, "sim_compute_robot_state-npc0": 0.009023576577504477, "sim_compute_robot_state-npc1": 0.008938171863555909, "sim_compute_robot_state-npc2": 0.008627544244130453, "sim_compute_robot_state-npc3": 0.008844930330912272}, "udem1-3-0": {"driven_any": 6.334410446474408, "sim_physics": 0.23790367603302, "survival_time": 14.950000000000076, "driven_lanedir": 5.29042021591904, "sim_render-ego": 0.013221596876780192, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.07394164164861043, "deviation-heading": 2.690862236536622, "set_robot_commands": 0.010551884174346923, "deviation-center-line": 1.1047109661751402, "driven_lanedir_consec": 5.288381134188182, "sim_compute_sim_state": 0.005258227189381917, "sim_compute_performance-ego": 0.007832231521606446, "sim_compute_robot_state-ego": 0.00991057554880778, "sim_compute_robot_state-npc0": 0.009589181741078695, "sim_compute_robot_state-npc1": 0.00913791259129842, "sim_compute_robot_state-npc2": 0.009123302300771078, "sim_compute_robot_state-npc3": 0.009194406668345131}, "udem1-4-0": {"driven_any": 5.090102456890004, "sim_physics": 0.2705153505007426, "survival_time": 14.950000000000076, "driven_lanedir": 3.1107431351154182, "sim_render-ego": 0.013310280640920004, "in-drivable-lane": 5.4500000000000535, "agent_compute-ego": 0.07508190711339315, "deviation-heading": 3.6535957859236614, "set_robot_commands": 0.010627400875091552, "deviation-center-line": 0.6438633472558384, "driven_lanedir_consec": 2.7188673228118136, "sim_compute_sim_state": 0.005231812795003255, "sim_compute_performance-ego": 0.007862308820088704, "sim_compute_robot_state-ego": 0.0098475710550944, "sim_compute_robot_state-npc0": 0.009355703989664711, "sim_compute_robot_state-npc1": 0.008927975495656331, "sim_compute_robot_state-npc2": 0.009092994530995688, "sim_compute_robot_state-npc3": 0.009176123936971028}}
set_robot_commands_max0.010627400875091552
set_robot_commands_mean0.009963726202646891
set_robot_commands_median0.010071088473002116
set_robot_commands_min0.009222734769185384
sim_compute_performance-ego_max0.007862308820088704
sim_compute_performance-ego_mean0.007603085835774739
sim_compute_performance-ego_median0.007522987524668376
sim_compute_performance-ego_min0.00737919012705485
sim_compute_robot_state-ego_max0.00991057554880778
sim_compute_robot_state-ego_mean0.009536947250366213
sim_compute_robot_state-ego_median0.009438239733378092
sim_compute_robot_state-ego_min0.009166023731231689
sim_compute_robot_state-npc0_max0.009589181741078695
sim_compute_robot_state-npc0_mean0.009077102820078531
sim_compute_robot_state-npc0_median0.009023576577504477
sim_compute_robot_state-npc0_min0.008538790543874105
sim_compute_robot_state-npc1_max0.00913791259129842
sim_compute_robot_state-npc1_mean0.008841392040252687
sim_compute_robot_state-npc1_median0.008927975495656331
sim_compute_robot_state-npc1_min0.008548996448516845
sim_compute_robot_state-npc2_max0.009123302300771078
sim_compute_robot_state-npc2_mean0.008754496415456137
sim_compute_robot_state-npc2_median0.008627544244130453
sim_compute_robot_state-npc2_min0.008454399108886719
sim_compute_robot_state-npc3_max0.009194406668345131
sim_compute_robot_state-npc3_mean0.008797719319661458
sim_compute_robot_state-npc3_median0.008844930330912272
sim_compute_robot_state-npc3_min0.00827557643254598
sim_compute_sim_state_max0.005258227189381917
sim_compute_sim_state_mean0.0051049896876017254
sim_compute_sim_state_median0.005113500754038493
sim_compute_sim_state_min0.004905659357706706
sim_physics_max0.2705153505007426
sim_physics_mean0.22756212155024208
sim_physics_median0.2186950659751892
sim_physics_min0.20186562299728392
sim_render-ego_max0.013310280640920004
sim_render-ego_mean0.01274945386250814
sim_render-ego_median0.012678403854370118
sim_render-ego_min0.012161493301391602
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
291025626c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.483584321711089
survival_time_median14.950000000000076
deviation-center-line_median0.6693694420080213
in-drivable-lane_median0


other stats
agent_compute-ego_max0.015841710567474365
agent_compute-ego_mean0.01562846899032593
agent_compute-ego_median0.0156767471631368
agent_compute-ego_min0.015176707108815512
deviation-center-line_max0.9675015915041142
deviation-center-line_mean0.7529590795379505
deviation-center-line_min0.5896749293693597
deviation-heading_max3.9682176307165897
deviation-heading_mean3.3593898537216695
deviation-heading_median3.4231826743066236
deviation-heading_min2.887579536939396
driven_any_max2.60168518610608
driven_any_mean2.5742976832573294
driven_any_median2.563198950716767
driven_any_min2.5616199567790474
driven_lanedir_consec_max2.5043698866081145
driven_lanedir_consec_mean2.4385166895415376
driven_lanedir_consec_min2.263533322869777
driven_lanedir_max2.5043698866081145
driven_lanedir_mean2.4385166895415376
driven_lanedir_median2.483584321711089
driven_lanedir_min2.263533322869777
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.18999999999999936
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5616199567790474, "sim_physics": 0.05692634741465251, "survival_time": 14.950000000000076, "driven_lanedir": 2.444684314156401, "sim_render-ego": 0.007006913820902507, "in-drivable-lane": 0, "agent_compute-ego": 0.015841710567474365, "deviation-heading": 3.5248428914243455, "set_robot_commands": 0.007308348814646403, "deviation-center-line": 0.918458205989418, "driven_lanedir_consec": 2.444684314156401, "sim_compute_sim_state": 0.0036117235819498696, "sim_compute_performance-ego": 0.004154434204101562, "sim_compute_robot_state-ego": 0.005134356021881103}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.562949926893745, "sim_physics": 0.056144225597381595, "survival_time": 14.950000000000076, "driven_lanedir": 2.496411602362304, "sim_render-ego": 0.007117223739624023, "in-drivable-lane": 0, "agent_compute-ego": 0.0156767471631368, "deviation-heading": 2.887579536939396, "set_robot_commands": 0.007342057228088379, "deviation-center-line": 0.6197912288188394, "driven_lanedir_consec": 2.496411602362304, "sim_compute_sim_state": 0.0036400032043457033, "sim_compute_performance-ego": 0.004033197561899821, "sim_compute_robot_state-ego": 0.005009459654490153}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.563198950716767, "sim_physics": 0.055811255772908526, "survival_time": 14.950000000000076, "driven_lanedir": 2.263533322869777, "sim_render-ego": 0.007071161270141601, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.015176707108815512, "deviation-heading": 3.9682176307165897, "set_robot_commands": 0.007183342774709066, "deviation-center-line": 0.9675015915041142, "driven_lanedir_consec": 2.263533322869777, "sim_compute_sim_state": 0.003506770928700765, "sim_compute_performance-ego": 0.0040587695439656575, "sim_compute_robot_state-ego": 0.005044008096059163}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.58203439579101, "sim_physics": 0.05859570026397705, "survival_time": 14.950000000000076, "driven_lanedir": 2.483584321711089, "sim_render-ego": 0.007146828969319661, "in-drivable-lane": 0, "agent_compute-ego": 0.01566418250401815, "deviation-heading": 3.4231826743066236, "set_robot_commands": 0.007232306003570557, "deviation-center-line": 0.5896749293693597, "driven_lanedir_consec": 2.483584321711089, "sim_compute_sim_state": 0.0035321656862894696, "sim_compute_performance-ego": 0.004030048052469889, "sim_compute_robot_state-ego": 0.0050185036659240725}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.60168518610608, "sim_physics": 0.05725151856740316, "survival_time": 14.950000000000076, "driven_lanedir": 2.5043698866081145, "sim_render-ego": 0.007192580699920654, "in-drivable-lane": 0, "agent_compute-ego": 0.015782997608184815, "deviation-heading": 2.993126535221392, "set_robot_commands": 0.007328926722208659, "deviation-center-line": 0.6693694420080213, "driven_lanedir_consec": 2.5043698866081145, "sim_compute_sim_state": 0.003739734490712484, "sim_compute_performance-ego": 0.004061381816864013, "sim_compute_robot_state-ego": 0.005080616474151612}}
set_robot_commands_max0.007342057228088379
set_robot_commands_mean0.007278996308644613
set_robot_commands_median0.007308348814646403
set_robot_commands_min0.007183342774709066
sim_compute_performance-ego_max0.004154434204101562
sim_compute_performance-ego_mean0.004067566235860189
sim_compute_performance-ego_median0.0040587695439656575
sim_compute_performance-ego_min0.004030048052469889
sim_compute_robot_state-ego_max0.005134356021881103
sim_compute_robot_state-ego_mean0.005057388782501221
sim_compute_robot_state-ego_median0.005044008096059163
sim_compute_robot_state-ego_min0.005009459654490153
sim_compute_sim_state_max0.003739734490712484
sim_compute_sim_state_mean0.0036060795783996583
sim_compute_sim_state_median0.0036117235819498696
sim_compute_sim_state_min0.003506770928700765
sim_physics_max0.05859570026397705
sim_physics_mean0.05694580952326457
sim_physics_median0.05692634741465251
sim_physics_min0.055811255772908526
sim_render-ego_max0.007192580699920654
sim_render-ego_mean0.007106941699981689
sim_render-ego_median0.007117223739624023
sim_render-ego_min0.007006913820902507
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
290935621Mikita Sazanovich 🇷🇺chameleon-8-trioaido3-LFV-sim-testingstep1-simulationerroryesip-172-31-35-218-104900:26:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
290865620Mikita Sazanovich 🇷🇺chameleon-8-trioaido3-LFV-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:11:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9800018908924618
survival_time_median4.899999999999991
deviation-center-line_median0.21641112240455584
in-drivable-lane_median2.4499999999999913


other stats
agent_compute-ego_max0.16819359160758354
agent_compute-ego_mean0.16693664577124062
agent_compute-ego_median0.1669349137941996
agent_compute-ego_min0.16601203955136812
deviation-center-line_max0.8983138320235211
deviation-center-line_mean0.44074512281214273
deviation-center-line_min0.09634531392767896
deviation-heading_max4.92865089005006
deviation-heading_mean2.473243699047609
deviation-heading_median1.2495615640954625
deviation-heading_min0.8280700199425813
driven_any_max4.29001577059545
driven_any_mean2.441754218743876
driven_any_median1.4644583991484246
driven_any_min1.037545024949314
driven_lanedir_consec_max3.121911321470447
driven_lanedir_consec_mean1.7194243669817295
driven_lanedir_consec_min0.6529544436397083
driven_lanedir_max3.121911321470447
driven_lanedir_mean1.7194243669817295
driven_lanedir_median0.9800018908924618
driven_lanedir_min0.6529544436397083
in-drivable-lane_max3.400000000000026
in-drivable-lane_mean2.1500000000000057
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.29001577059545, "sim_physics": 0.10358083724975586, "survival_time": 14.950000000000076, "driven_lanedir": 3.121911321470447, "sim_render-ego": 0.007053966522216797, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.1670880913734436, "deviation-heading": 4.92865089005006, "set_robot_commands": 0.005148058732350668, "deviation-center-line": 0.8414087587942273, "driven_lanedir_consec": 3.121911321470447, "sim_compute_sim_state": 0.0028983879089355467, "sim_compute_performance-ego": 0.004027330080668132, "sim_compute_robot_state-ego": 0.004999602635701497, "sim_compute_robot_state-npc0": 0.004943102200826009, "sim_compute_robot_state-npc1": 0.004737183252970378, "sim_compute_robot_state-npc2": 0.004705444971720377, "sim_compute_robot_state-npc3": 0.004679108460744222}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4644583991484246, "sim_physics": 0.11108476531748868, "survival_time": 4.899999999999991, "driven_lanedir": 0.7559912235851461, "sim_render-ego": 0.007193480219159808, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.1664545925296083, "deviation-heading": 1.2495615640954625, "set_robot_commands": 0.005166627922836615, "deviation-center-line": 0.1512465869107306, "driven_lanedir_consec": 0.7559912235851461, "sim_compute_sim_state": 0.00289756424573003, "sim_compute_performance-ego": 0.004012579820594009, "sim_compute_robot_state-ego": 0.0049865294475944675, "sim_compute_robot_state-npc0": 0.004999970903201979, "sim_compute_robot_state-npc1": 0.004753869407031001, "sim_compute_robot_state-npc2": 0.0047458069665091375, "sim_compute_robot_state-npc3": 0.004685477334625867}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.037545024949314, "sim_physics": 0.11629720636316249, "survival_time": 3.699999999999995, "driven_lanedir": 0.9800018908924618, "sim_render-ego": 0.007258173581716177, "in-drivable-lane": 0, "agent_compute-ego": 0.16819359160758354, "deviation-heading": 1.019535627801475, "set_robot_commands": 0.005144099931459169, "deviation-center-line": 0.21641112240455584, "driven_lanedir_consec": 0.9800018908924618, "sim_compute_sim_state": 0.0029381062533404374, "sim_compute_performance-ego": 0.004003170374277476, "sim_compute_robot_state-ego": 0.005036083427635399, "sim_compute_robot_state-npc0": 0.004948757790230416, "sim_compute_robot_state-npc1": 0.004743730699693835, "sim_compute_robot_state-npc2": 0.004751807934529072, "sim_compute_robot_state-npc3": 0.0046674786387263115}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.288090837949202, "sim_physics": 0.10320794264475504, "survival_time": 14.950000000000076, "driven_lanedir": 3.0862629553208847, "sim_render-ego": 0.007018406391143799, "in-drivable-lane": 3.400000000000026, "agent_compute-ego": 0.1669349137941996, "deviation-heading": 4.340400393348467, "set_robot_commands": 0.005142886638641358, "deviation-center-line": 0.8983138320235211, "driven_lanedir_consec": 3.0862629553208847, "sim_compute_sim_state": 0.0028801520665486654, "sim_compute_performance-ego": 0.004016177654266357, "sim_compute_robot_state-ego": 0.004976927439371745, "sim_compute_robot_state-npc0": 0.004962093830108642, "sim_compute_robot_state-npc1": 0.004738508065541585, "sim_compute_robot_state-npc2": 0.004688528378804525, "sim_compute_robot_state-npc3": 0.004687713781992594}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1286610610769892, "sim_physics": 0.11995568642249474, "survival_time": 3.899999999999994, "driven_lanedir": 0.6529544436397083, "sim_render-ego": 0.00725248226752648, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.16601203955136812, "deviation-heading": 0.8280700199425813, "set_robot_commands": 0.005175923689817771, "deviation-center-line": 0.09634531392767896, "driven_lanedir_consec": 0.6529544436397083, "sim_compute_sim_state": 0.0029084193400847605, "sim_compute_performance-ego": 0.004010759867154635, "sim_compute_robot_state-ego": 0.005016103768960023, "sim_compute_robot_state-npc0": 0.004985913252219176, "sim_compute_robot_state-npc1": 0.004748102946159167, "sim_compute_robot_state-npc2": 0.0047073853321564505, "sim_compute_robot_state-npc3": 0.004693333919231708}}
set_robot_commands_max0.005175923689817771
set_robot_commands_mean0.0051555193830211165
set_robot_commands_median0.005148058732350668
set_robot_commands_min0.005142886638641358
sim_compute_performance-ego_max0.004027330080668132
sim_compute_performance-ego_mean0.004014003559392122
sim_compute_performance-ego_median0.004012579820594009
sim_compute_performance-ego_min0.004003170374277476
sim_compute_robot_state-ego_max0.005036083427635399
sim_compute_robot_state-ego_mean0.005003049343852627
sim_compute_robot_state-ego_median0.004999602635701497
sim_compute_robot_state-ego_min0.004976927439371745
sim_compute_robot_state-npc0_max0.004999970903201979
sim_compute_robot_state-npc0_mean0.004967967595317245
sim_compute_robot_state-npc0_median0.004962093830108642
sim_compute_robot_state-npc0_min0.004943102200826009
sim_compute_robot_state-npc1_max0.004753869407031001
sim_compute_robot_state-npc1_mean0.0047442788742791935
sim_compute_robot_state-npc1_median0.004743730699693835
sim_compute_robot_state-npc1_min0.004737183252970378
sim_compute_robot_state-npc2_max0.004751807934529072
sim_compute_robot_state-npc2_mean0.004719794716743912
sim_compute_robot_state-npc2_median0.0047073853321564505
sim_compute_robot_state-npc2_min0.004688528378804525
sim_compute_robot_state-npc3_max0.004693333919231708
sim_compute_robot_state-npc3_mean0.004682622427064141
sim_compute_robot_state-npc3_median0.004685477334625867
sim_compute_robot_state-npc3_min0.0046674786387263115
sim_compute_sim_state_max0.0029381062533404374
sim_compute_sim_state_mean0.0029045259629278883
sim_compute_sim_state_median0.0028983879089355467
sim_compute_sim_state_min0.0028801520665486654
sim_physics_max0.11995568642249474
sim_physics_mean0.11082528759953136
sim_physics_median0.11108476531748868
sim_physics_min0.10320794264475504
sim_render-ego_max0.007258173581716177
sim_render-ego_mean0.007155301796352612
sim_render-ego_median0.007193480219159808
sim_render-ego_min0.007018406391143799
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.480000000000027
survival_time_min3.699999999999995
No reset possible
290515599Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.45036918661905423
survival_time_median1.4000000000000006
deviation-center-line_median0.09109465295475942
in-drivable-lane_median0


other stats
agent_compute-ego_max0.020758393738004897
agent_compute-ego_mean0.020202627970428065
agent_compute-ego_median0.02012646198272705
agent_compute-ego_min0.019783360617501394
deviation-center-line_max0.32811405427368456
deviation-center-line_mean0.1446696240031132
deviation-center-line_min0.057929314097483725
deviation-heading_max0.9252849941751268
deviation-heading_mean0.4859492652709479
deviation-heading_median0.3771883469035224
deviation-heading_min0.35195558070438765
driven_any_max1.258807089257687
driven_any_mean0.7134924137653826
driven_any_median0.4723999164642453
driven_any_min0.3540095289716218
driven_lanedir_consec_max1.249683151888431
driven_lanedir_consec_mean0.6260089650909759
driven_lanedir_consec_min0.32991042738258325
driven_lanedir_max1.249683151888431
driven_lanedir_mean0.6260089650909759
driven_lanedir_median0.45036918661905423
driven_lanedir_min0.32991042738258325
in-drivable-lane_max0.849999999999997
in-drivable-lane_mean0.1699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0810836320355406, "sim_physics": 0.0554029643535614, "survival_time": 3.599999999999995, "driven_lanedir": 0.718458325203671, "sim_render-ego": 0.00710492663913303, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.020758393738004897, "deviation-heading": 0.9252849941751268, "set_robot_commands": 0.005177391899956597, "deviation-center-line": 0.15568678698645805, "driven_lanedir_consec": 0.718458325203671, "sim_compute_sim_state": 0.002827915880415174, "sim_compute_performance-ego": 0.004192408588197496, "sim_compute_robot_state-ego": 0.004871391587787204}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.258807089257687, "sim_physics": 0.05582611220223563, "survival_time": 3.4999999999999956, "driven_lanedir": 1.249683151888431, "sim_render-ego": 0.006964983258928571, "in-drivable-lane": 0, "agent_compute-ego": 0.02046961784362793, "deviation-heading": 0.3771883469035224, "set_robot_commands": 0.005163070133754185, "deviation-center-line": 0.32811405427368456, "driven_lanedir_consec": 1.249683151888431, "sim_compute_sim_state": 0.0028241361890520367, "sim_compute_performance-ego": 0.003931862967354911, "sim_compute_robot_state-ego": 0.004860326222011021}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4723999164642453, "sim_physics": 0.05804092795760543, "survival_time": 1.3500000000000003, "driven_lanedir": 0.45036918661905423, "sim_render-ego": 0.007131638350310149, "in-drivable-lane": 0, "agent_compute-ego": 0.019875305670279043, "deviation-heading": 0.35195558070438765, "set_robot_commands": 0.005235309954042788, "deviation-center-line": 0.09052331170318038, "driven_lanedir_consec": 0.45036918661905423, "sim_compute_sim_state": 0.0028327659324363427, "sim_compute_performance-ego": 0.004002315026742441, "sim_compute_robot_state-ego": 0.00485984484354655}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3540095289716218, "sim_physics": 0.05989411047526768, "survival_time": 1.4000000000000006, "driven_lanedir": 0.32991042738258325, "sim_render-ego": 0.007226024355207171, "in-drivable-lane": 0, "agent_compute-ego": 0.019783360617501394, "deviation-heading": 0.3647837636579476, "set_robot_commands": 0.0053102799824305946, "deviation-center-line": 0.057929314097483725, "driven_lanedir_consec": 0.32991042738258325, "sim_compute_sim_state": 0.002960426466805594, "sim_compute_performance-ego": 0.004006751946040562, "sim_compute_robot_state-ego": 0.0048590728214808875}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.40116190209781927, "sim_physics": 0.056972769590524525, "survival_time": 1.3000000000000005, "driven_lanedir": 0.3816237343611406, "sim_render-ego": 0.007276580883906438, "in-drivable-lane": 0, "agent_compute-ego": 0.02012646198272705, "deviation-heading": 0.410533640913755, "set_robot_commands": 0.005257569826566256, "deviation-center-line": 0.09109465295475942, "driven_lanedir_consec": 0.3816237343611406, "sim_compute_sim_state": 0.002800748898432805, "sim_compute_performance-ego": 0.004069805145263672, "sim_compute_robot_state-ego": 0.005161863106947679}}
set_robot_commands_max0.0053102799824305946
set_robot_commands_mean0.005228724359350084
set_robot_commands_median0.005235309954042788
set_robot_commands_min0.005163070133754185
sim_compute_performance-ego_max0.004192408588197496
sim_compute_performance-ego_mean0.004040628734719816
sim_compute_performance-ego_median0.004006751946040562
sim_compute_performance-ego_min0.003931862967354911
sim_compute_robot_state-ego_max0.005161863106947679
sim_compute_robot_state-ego_mean0.004922499716354669
sim_compute_robot_state-ego_median0.004860326222011021
sim_compute_robot_state-ego_min0.0048590728214808875
sim_compute_sim_state_max0.002960426466805594
sim_compute_sim_state_mean0.002849198673428391
sim_compute_sim_state_median0.002827915880415174
sim_compute_sim_state_min0.002800748898432805
sim_physics_max0.05989411047526768
sim_physics_mean0.057227376915838936
sim_physics_median0.056972769590524525
sim_physics_min0.0554029643535614
sim_render-ego_max0.007276580883906438
sim_render-ego_mean0.007140830697497072
sim_render-ego_median0.007131638350310149
sim_render-ego_min0.006964983258928571
simulation-passed1
survival_time_max3.599999999999995
survival_time_mean2.229999999999998
survival_time_min1.3000000000000005
No reset possible
290485597c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.877725463777837
survival_time_median14.950000000000076
deviation-center-line_median0.4982897526833274
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016139567693074543
agent_compute-ego_mean0.01560083121994417
agent_compute-ego_median0.015416715224879382
agent_compute-ego_min0.015275619824727376
deviation-center-line_max0.6904880494373581
deviation-center-line_mean0.509067657184118
deviation-center-line_min0.30898128753589893
deviation-heading_max3.725416690758863
deviation-heading_mean2.403694090718896
deviation-heading_median2.0609830439124948
deviation-heading_min1.8794999572368831
driven_any_max2.514759980108901
driven_any_mean1.8327415648527976
driven_any_median1.9033806990266928
driven_any_min1.1936900539274131
driven_lanedir_consec_max2.4938921589641994
driven_lanedir_consec_mean1.6850511685231602
driven_lanedir_consec_min0.8201248419458694
driven_lanedir_max2.4938921589641994
driven_lanedir_mean1.6850511685231602
driven_lanedir_median1.877725463777837
driven_lanedir_min0.8201248419458694
in-drivable-lane_max3.3500000000000476
in-drivable-lane_mean0.8600000000000122
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1936900539274131, "sim_physics": 0.05629665901263555, "survival_time": 14.40000000000007, "driven_lanedir": 0.8201248419458694, "sim_render-ego": 0.00700974381632275, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.01582608785894182, "deviation-heading": 2.294296178217241, "set_robot_commands": 0.0072120510869556, "deviation-center-line": 0.30898128753589893, "driven_lanedir_consec": 0.8201248419458694, "sim_compute_sim_state": 0.0035678206218613517, "sim_compute_performance-ego": 0.00415803740421931, "sim_compute_robot_state-ego": 0.004955644408861796}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.915105488802724, "sim_physics": 0.05533797979354858, "survival_time": 14.950000000000076, "driven_lanedir": 1.8918979511685643, "sim_render-ego": 0.007107547918955485, "in-drivable-lane": 0, "agent_compute-ego": 0.016139567693074543, "deviation-heading": 2.0609830439124948, "set_robot_commands": 0.007254481315612793, "deviation-center-line": 0.4982897526833274, "driven_lanedir_consec": 1.8918979511685643, "sim_compute_sim_state": 0.003391203085581462, "sim_compute_performance-ego": 0.004090766906738281, "sim_compute_robot_state-ego": 0.004939837455749512}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9033806990266928, "sim_physics": 0.05558451493581136, "survival_time": 14.950000000000076, "driven_lanedir": 1.877725463777837, "sim_render-ego": 0.007087319691975911, "in-drivable-lane": 0, "agent_compute-ego": 0.015346165498097737, "deviation-heading": 2.058274583468996, "set_robot_commands": 0.007325275739034017, "deviation-center-line": 0.6904880494373581, "driven_lanedir_consec": 1.877725463777837, "sim_compute_sim_state": 0.003381818930308024, "sim_compute_performance-ego": 0.004050921599070231, "sim_compute_robot_state-ego": 0.004924632708231608}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6367716023982584, "sim_physics": 0.05330097896902091, "survival_time": 13.450000000000056, "driven_lanedir": 1.341615426759332, "sim_render-ego": 0.007097183107000301, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.015416715224879382, "deviation-heading": 3.725416690758863, "set_robot_commands": 0.007241159566716191, "deviation-center-line": 0.6704070589622168, "driven_lanedir_consec": 1.341615426759332, "sim_compute_sim_state": 0.003468733294745803, "sim_compute_performance-ego": 0.004070125104769455, "sim_compute_robot_state-ego": 0.004912316134428003}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.514759980108901, "sim_physics": 0.05450668891270955, "survival_time": 14.950000000000076, "driven_lanedir": 2.4938921589641994, "sim_render-ego": 0.007037003835042317, "in-drivable-lane": 0, "agent_compute-ego": 0.015275619824727376, "deviation-heading": 1.8794999572368831, "set_robot_commands": 0.007104544639587402, "deviation-center-line": 0.37717213730178895, "driven_lanedir_consec": 2.4938921589641994, "sim_compute_sim_state": 0.0033490713437398273, "sim_compute_performance-ego": 0.004058837095896403, "sim_compute_robot_state-ego": 0.004912859598795573}}
set_robot_commands_max0.007325275739034017
set_robot_commands_mean0.007227502469581201
set_robot_commands_median0.007241159566716191
set_robot_commands_min0.007104544639587402
sim_compute_performance-ego_max0.00415803740421931
sim_compute_performance-ego_mean0.004085737622138735
sim_compute_performance-ego_median0.004070125104769455
sim_compute_performance-ego_min0.004050921599070231
sim_compute_robot_state-ego_max0.004955644408861796
sim_compute_robot_state-ego_mean0.004929058061213298
sim_compute_robot_state-ego_median0.004924632708231608
sim_compute_robot_state-ego_min0.004912316134428003
sim_compute_sim_state_max0.0035678206218613517
sim_compute_sim_state_mean0.0034317294552472935
sim_compute_sim_state_median0.003391203085581462
sim_compute_sim_state_min0.0033490713437398273
sim_physics_max0.05629665901263555
sim_physics_mean0.05500536432474519
sim_physics_median0.05533797979354858
sim_physics_min0.05330097896902091
sim_render-ego_max0.007107547918955485
sim_render-ego_mean0.007067759673859353
sim_render-ego_median0.007087319691975911
sim_render-ego_min0.00700974381632275
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.540000000000072
survival_time_min13.450000000000056
No reset possible
290345585Mikita Sazanovich 🇷🇺chameleon-7aido3-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:14:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2631094381008117
survival_time_median7.349999999999982
deviation-center-line_median0.6427500888745314
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.21012715741890628
agent_compute-ego_mean0.2075195543061963
agent_compute-ego_median0.20938638366501908
agent_compute-ego_min0.2014388267440025
deviation-center-line_max1.2943170768162728
deviation-center-line_mean0.7143038748635299
deviation-center-line_min0.31477878605105253
deviation-heading_max4.277706826841596
deviation-heading_mean2.835517881727718
deviation-heading_median2.3016993969939903
deviation-heading_min1.1654629698757342
driven_any_max6.433196176426518
driven_any_mean4.004248538995029
driven_any_median2.8463408968697457
driven_any_min2.32642871255312
driven_lanedir_consec_max5.66976474868473
driven_lanedir_consec_mean3.223412028229452
driven_lanedir_consec_min1.674323648915855
driven_lanedir_max6.031703784590313
driven_lanedir_mean3.476797009213537
driven_lanedir_median2.6529623757089293
driven_lanedir_min1.693428915643702
in-drivable-lane_max2.8000000000000167
in-drivable-lane_mean0.880000000000004
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 6.433196176426518, "sim_physics": 0.16310312271118163, "survival_time": 14.950000000000076, "driven_lanedir": 6.031703784590313, "sim_render-ego": 0.009549227555592857, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.20945496400197347, "deviation-heading": 4.150468431226751, "set_robot_commands": 0.007264285087585449, "deviation-center-line": 1.2943170768162728, "driven_lanedir_consec": 5.66976474868473, "sim_compute_sim_state": 0.0038165497779846192, "sim_compute_performance-ego": 0.005566411813100179, "sim_compute_robot_state-ego": 0.006976974805196126, "sim_compute_robot_state-npc0": 0.006633140246073405, "sim_compute_robot_state-npc1": 0.006326050758361817, "sim_compute_robot_state-npc2": 0.006363200346628825, "sim_compute_robot_state-npc3": 0.006255636215209961}, "udem1-1-0": {"driven_any": 6.000630822311609, "sim_physics": 0.15224291721979777, "survival_time": 14.950000000000076, "driven_lanedir": 4.822570180635436, "sim_render-ego": 0.009303932189941404, "in-drivable-lane": 2.8000000000000167, "agent_compute-ego": 0.2071904397010803, "deviation-heading": 4.277706826841596, "set_robot_commands": 0.007126631736755371, "deviation-center-line": 0.9709256950523342, "driven_lanedir_consec": 4.81643338980216, "sim_compute_sim_state": 0.0037230714162190754, "sim_compute_performance-ego": 0.0053787501653035485, "sim_compute_robot_state-ego": 0.006606113910675049, "sim_compute_robot_state-npc0": 0.0065376520156860355, "sim_compute_robot_state-npc1": 0.006324038505554199, "sim_compute_robot_state-npc2": 0.006269490718841553, "sim_compute_robot_state-npc3": 0.006227257251739502}, "udem1-2-0": {"driven_any": 2.32642871255312, "sim_physics": 0.13662035778315382, "survival_time": 4.94999999999999, "driven_lanedir": 2.1833197894893055, "sim_render-ego": 0.00920817105457036, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2014388267440025, "deviation-heading": 1.1654629698757342, "set_robot_commands": 0.007053071802312677, "deviation-center-line": 0.31477878605105253, "driven_lanedir_consec": 1.674323648915855, "sim_compute_sim_state": 0.0036154539898188426, "sim_compute_performance-ego": 0.0051117786253341525, "sim_compute_robot_state-ego": 0.006430796902589124, "sim_compute_robot_state-npc0": 0.006435493026116882, "sim_compute_robot_state-npc1": 0.006071923959134805, "sim_compute_robot_state-npc2": 0.006065631153607609, "sim_compute_robot_state-npc3": 0.005986353363653626}, "udem1-3-0": {"driven_any": 2.414646086814153, "sim_physics": 0.15312309100710111, "survival_time": 5.799999999999987, "driven_lanedir": 1.693428915643702, "sim_render-ego": 0.00912003887110743, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.20938638366501908, "deviation-heading": 2.3016993969939903, "set_robot_commands": 0.007302841235851419, "deviation-center-line": 0.3487477275234581, "driven_lanedir_consec": 1.693428915643702, "sim_compute_sim_state": 0.0036881730474274737, "sim_compute_performance-ego": 0.005231668209207469, "sim_compute_robot_state-ego": 0.006572817933970484, "sim_compute_robot_state-npc0": 0.0063661932945251465, "sim_compute_robot_state-npc1": 0.0061105859690699085, "sim_compute_robot_state-npc2": 0.006132197791132434, "sim_compute_robot_state-npc3": 0.0062156278511573525}, "udem1-4-0": {"driven_any": 2.8463408968697457, "sim_physics": 0.1743857228026098, "survival_time": 7.349999999999982, "driven_lanedir": 2.6529623757089293, "sim_render-ego": 0.009565679394468968, "in-drivable-lane": 0, "agent_compute-ego": 0.21012715741890628, "deviation-heading": 2.282251783700518, "set_robot_commands": 0.007015022290807192, "deviation-center-line": 0.6427500888745314, "driven_lanedir_consec": 2.2631094381008117, "sim_compute_sim_state": 0.0036583044091049502, "sim_compute_performance-ego": 0.005469575220224809, "sim_compute_robot_state-ego": 0.006751573004690157, "sim_compute_robot_state-npc0": 0.006280480598916813, "sim_compute_robot_state-npc1": 0.006109836150188835, "sim_compute_robot_state-npc2": 0.0061455340612502326, "sim_compute_robot_state-npc3": 0.006252858103538046}}
set_robot_commands_max0.007302841235851419
set_robot_commands_mean0.007152370430662422
set_robot_commands_median0.007126631736755371
set_robot_commands_min0.007015022290807192
sim_compute_performance-ego_max0.005566411813100179
sim_compute_performance-ego_mean0.005351636806634032
sim_compute_performance-ego_median0.0053787501653035485
sim_compute_performance-ego_min0.0051117786253341525
sim_compute_robot_state-ego_max0.006976974805196126
sim_compute_robot_state-ego_mean0.006667655311424188
sim_compute_robot_state-ego_median0.006606113910675049
sim_compute_robot_state-ego_min0.006430796902589124
sim_compute_robot_state-npc0_max0.006633140246073405
sim_compute_robot_state-npc0_mean0.006450591836263656
sim_compute_robot_state-npc0_median0.006435493026116882
sim_compute_robot_state-npc0_min0.006280480598916813
sim_compute_robot_state-npc1_max0.006326050758361817
sim_compute_robot_state-npc1_mean0.006188487068461913
sim_compute_robot_state-npc1_median0.0061105859690699085
sim_compute_robot_state-npc1_min0.006071923959134805
sim_compute_robot_state-npc2_max0.006363200346628825
sim_compute_robot_state-npc2_mean0.006195210814292131
sim_compute_robot_state-npc2_median0.0061455340612502326
sim_compute_robot_state-npc2_min0.006065631153607609
sim_compute_robot_state-npc3_max0.006255636215209961
sim_compute_robot_state-npc3_mean0.006187546557059697
sim_compute_robot_state-npc3_median0.006227257251739502
sim_compute_robot_state-npc3_min0.005986353363653626
sim_compute_sim_state_max0.0038165497779846192
sim_compute_sim_state_mean0.003700310528110992
sim_compute_sim_state_median0.0036881730474274737
sim_compute_sim_state_min0.0036154539898188426
sim_physics_max0.1743857228026098
sim_physics_mean0.15589504230476883
sim_physics_median0.15312309100710111
sim_physics_min0.13662035778315382
sim_render-ego_max0.009565679394468968
sim_render-ego_mean0.009349409813136204
sim_render-ego_median0.009303932189941404
sim_render-ego_min0.00912003887110743
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.600000000000025
survival_time_min4.94999999999999
No reset possible
290105572Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.32496502242872094
survival_time_median4.049999999999994
deviation-center-line_median0.20765891036641673
in-drivable-lane_median0.7499999999999982


other stats
agent_compute-ego_max0.0210190169951495
agent_compute-ego_mean0.01969186536239394
agent_compute-ego_median0.019674074359056427
agent_compute-ego_min0.018967952368394384
deviation-center-line_max0.3462294771945917
deviation-center-line_mean0.17697516010186667
deviation-center-line_min0.04507688558954316
deviation-heading_max3.346361589920944
deviation-heading_mean1.6396085747240428
deviation-heading_median1.7632329700161655
deviation-heading_min0.5819487228197983
driven_any_max1.458711747031605
driven_any_mean1.0058654345071725
driven_any_median1.093065588669354
driven_any_min0.4399285128274294
driven_lanedir_consec_max0.6026923812352631
driven_lanedir_consec_mean0.3198264022863606
driven_lanedir_consec_min0.042072147679519833
driven_lanedir_max0.8372155021216554
driven_lanedir_mean0.44220500849580696
driven_lanedir_median0.48150006944482016
driven_lanedir_min0.042072147679519833
in-drivable-lane_max1.299999999999996
in-drivable-lane_mean0.8399999999999984
in-drivable-lane_min0.4000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6708056019241977, "sim_physics": 0.05953119782840505, "survival_time": 1.7000000000000008, "driven_lanedir": 0.32496502242872094, "sim_render-ego": 0.007412749178269331, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.0210190169951495, "deviation-heading": 0.6316996945548322, "set_robot_commands": 0.005319840767804314, "deviation-center-line": 0.057002362785138205, "driven_lanedir_consec": 0.32496502242872094, "sim_compute_sim_state": 0.0028014744029325597, "sim_compute_performance-ego": 0.0043750931234920725, "sim_compute_robot_state-ego": 0.004973278326146743}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4399285128274294, "sim_physics": 0.0590364933013916, "survival_time": 1.4500000000000006, "driven_lanedir": 0.042072147679519833, "sim_render-ego": 0.01090161553744612, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.01910005766769935, "deviation-heading": 0.5819487228197983, "set_robot_commands": 0.005050215227850552, "deviation-center-line": 0.04507688558954316, "driven_lanedir_consec": 0.042072147679519833, "sim_compute_sim_state": 0.0027854113743222995, "sim_compute_performance-ego": 0.003923514793659079, "sim_compute_robot_state-ego": 0.004808179263410897}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.458711747031605, "sim_physics": 0.054623450761959874, "survival_time": 4.049999999999994, "driven_lanedir": 0.8372155021216554, "sim_render-ego": 0.007096446590659059, "in-drivable-lane": 0.7499999999999982, "agent_compute-ego": 0.01969822542167004, "deviation-heading": 1.7632329700161655, "set_robot_commands": 0.00519414006927867, "deviation-center-line": 0.2289081645736436, "driven_lanedir_consec": 0.6026923812352631, "sim_compute_sim_state": 0.00282273174803934, "sim_compute_performance-ego": 0.003993820261072229, "sim_compute_robot_state-ego": 0.004994077447019977}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.093065588669354, "sim_physics": 0.054078413218986696, "survival_time": 4.099999999999993, "driven_lanedir": 0.5252723008043187, "sim_render-ego": 0.008602793623761432, "in-drivable-lane": 1.149999999999997, "agent_compute-ego": 0.019674074359056427, "deviation-heading": 1.8747998963084744, "set_robot_commands": 0.005352904156940739, "deviation-center-line": 0.20765891036641673, "driven_lanedir_consec": 0.4205260986480208, "sim_compute_sim_state": 0.002846650960968762, "sim_compute_performance-ego": 0.004037304622371022, "sim_compute_robot_state-ego": 0.004943914529753894}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.366815722083275, "sim_physics": 0.05477145033062629, "survival_time": 5.299999999999989, "driven_lanedir": 0.48150006944482016, "sim_render-ego": 0.007156920882890809, "in-drivable-lane": 1.299999999999996, "agent_compute-ego": 0.018967952368394384, "deviation-heading": 3.346361589920944, "set_robot_commands": 0.00522660309413694, "deviation-center-line": 0.3462294771945917, "driven_lanedir_consec": 0.2088763614402782, "sim_compute_sim_state": 0.0028405751822129736, "sim_compute_performance-ego": 0.004018167279801279, "sim_compute_robot_state-ego": 0.00486470843261143}}
set_robot_commands_max0.005352904156940739
set_robot_commands_mean0.005228740663202244
set_robot_commands_median0.00522660309413694
set_robot_commands_min0.005050215227850552
sim_compute_performance-ego_max0.0043750931234920725
sim_compute_performance-ego_mean0.004069580016079136
sim_compute_performance-ego_median0.004018167279801279
sim_compute_performance-ego_min0.003923514793659079
sim_compute_robot_state-ego_max0.004994077447019977
sim_compute_robot_state-ego_mean0.004916831599788588
sim_compute_robot_state-ego_median0.004943914529753894
sim_compute_robot_state-ego_min0.004808179263410897
sim_compute_sim_state_max0.002846650960968762
sim_compute_sim_state_mean0.0028193687336951867
sim_compute_sim_state_median0.00282273174803934
sim_compute_sim_state_min0.0027854113743222995
sim_physics_max0.05953119782840505
sim_physics_mean0.0564082010882739
sim_physics_median0.05477145033062629
sim_physics_min0.054078413218986696
sim_render-ego_max0.01090161553744612
sim_render-ego_mean0.00823410516260535
sim_render-ego_median0.007412749178269331
sim_render-ego_min0.007096446590659059
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean3.3199999999999954
survival_time_min1.4500000000000006
No reset possible
290005568Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.415300404469748
survival_time_median1.0500000000000005
deviation-center-line_median0.06528162699891357
in-drivable-lane_median0


other stats
agent_compute-ego_max0.021709521611531574
agent_compute-ego_mean0.019856332540512084
agent_compute-ego_median0.019568649927775066
agent_compute-ego_min0.01906353235244751
deviation-center-line_max0.15652714823361255
deviation-center-line_mean0.08485546452346285
deviation-center-line_min0.060680576551180435
deviation-heading_max0.3288103798068405
deviation-heading_mean0.26512819425077916
deviation-heading_median0.28217974079465513
deviation-heading_min0.2047531117605221
driven_any_max1.599654688730024
driven_any_mean0.7429584200327175
driven_any_median0.4307612897755801
driven_any_min0.2836294060063822
driven_lanedir_consec_max0.933358306057232
driven_lanedir_consec_mean0.5419980405976785
driven_lanedir_consec_min0.2743915476157708
driven_lanedir_max0.933358306057232
driven_lanedir_mean0.5419980405976785
driven_lanedir_median0.415300404469748
driven_lanedir_min0.2743915476157708
in-drivable-lane_max1.0999999999999963
in-drivable-lane_mean0.3099999999999993
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4307612897755801, "sim_physics": 0.06218528747558594, "survival_time": 1.0500000000000005, "driven_lanedir": 0.415300404469748, "sim_render-ego": 0.007813510440644763, "in-drivable-lane": 0, "agent_compute-ego": 0.021709521611531574, "deviation-heading": 0.28217974079465513, "set_robot_commands": 0.0052769070579892115, "deviation-center-line": 0.06119413751278363, "driven_lanedir_consec": 0.415300404469748, "sim_compute_sim_state": 0.0029235113234747025, "sim_compute_performance-ego": 0.004353943325224377, "sim_compute_robot_state-ego": 0.0053130217960902625}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2836294060063822, "sim_physics": 0.06359370052814484, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2743915476157708, "sim_render-ego": 0.007202938199043274, "in-drivable-lane": 0, "agent_compute-ego": 0.01906353235244751, "deviation-heading": 0.2047531117605221, "set_robot_commands": 0.0051533132791519165, "deviation-center-line": 0.06528162699891357, "driven_lanedir_consec": 0.2743915476157708, "sim_compute_sim_state": 0.002790495753288269, "sim_compute_performance-ego": 0.003923147916793823, "sim_compute_robot_state-ego": 0.004830867052078247}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9996632207705768, "sim_physics": 0.05580329895019531, "survival_time": 2.000000000000001, "driven_lanedir": 0.7073435611552017, "sim_render-ego": 0.007108914852142334, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.01925681233406067, "deviation-heading": 0.2895873372755112, "set_robot_commands": 0.005192393064498901, "deviation-center-line": 0.08059383332082407, "driven_lanedir_consec": 0.7073435611552017, "sim_compute_sim_state": 0.002767425775527954, "sim_compute_performance-ego": 0.004040676355361939, "sim_compute_robot_state-ego": 0.005014258623123169}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.599654688730024, "sim_physics": 0.05649441480636597, "survival_time": 2.9999999999999973, "driven_lanedir": 0.933358306057232, "sim_render-ego": 0.00706101655960083, "in-drivable-lane": 1.0999999999999963, "agent_compute-ego": 0.019568649927775066, "deviation-heading": 0.22031040161636695, "set_robot_commands": 0.005274879932403565, "deviation-center-line": 0.15652714823361255, "driven_lanedir_consec": 0.933358306057232, "sim_compute_sim_state": 0.002824290593465169, "sim_compute_performance-ego": 0.0040032347043355305, "sim_compute_robot_state-ego": 0.004978438218434651}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810239, "sim_physics": 0.05968848466873169, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3795963836904402, "sim_render-ego": 0.0071535944938659664, "in-drivable-lane": 0, "agent_compute-ego": 0.019683146476745607, "deviation-heading": 0.3288103798068405, "set_robot_commands": 0.005523192882537842, "deviation-center-line": 0.060680576551180435, "driven_lanedir_consec": 0.3795963836904402, "sim_compute_sim_state": 0.0028963088989257812, "sim_compute_performance-ego": 0.004008698463439942, "sim_compute_robot_state-ego": 0.004885542392730713}}
set_robot_commands_max0.005523192882537842
set_robot_commands_mean0.005284137243316287
set_robot_commands_median0.005274879932403565
set_robot_commands_min0.0051533132791519165
sim_compute_performance-ego_max0.004353943325224377
sim_compute_performance-ego_mean0.004065940153031121
sim_compute_performance-ego_median0.004008698463439942
sim_compute_performance-ego_min0.003923147916793823
sim_compute_robot_state-ego_max0.0053130217960902625
sim_compute_robot_state-ego_mean0.005004425616491408
sim_compute_robot_state-ego_median0.004978438218434651
sim_compute_robot_state-ego_min0.004830867052078247
sim_compute_sim_state_max0.0029235113234747025
sim_compute_sim_state_mean0.002840406468936375
sim_compute_sim_state_median0.002824290593465169
sim_compute_sim_state_min0.002767425775527954
sim_physics_max0.06359370052814484
sim_physics_mean0.059553037285804744
sim_physics_median0.05968848466873169
sim_physics_min0.05580329895019531
sim_render-ego_max0.007813510440644763
sim_render-ego_mean0.0072679949090594335
sim_render-ego_median0.0071535944938659664
sim_render-ego_min0.00706101655960083
simulation-passed1
survival_time_max2.9999999999999973
survival_time_mean1.5699999999999998
survival_time_min0.8000000000000002
No reset possible
289494389Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-real-validationeval2-visualizesuccessnoip-172-31-35-218-104900:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.7059998245239258
survival_time5.3333
deviation-center-line0.10233935021036776
in-drivable-lane1.3333000000000004


other stats
deviation-heading0.38082185069391494
driven_any1.1904029323893663
driven_lanedir0.7059998245239258
visualized-eval2-passed1
No reset possible
289384379Soroush Saryazdi 🇨🇦bluejayaido3-LF-real-validationeval2-videossuccessnoip-172-31-35-218-104900:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
289314379Soroush Saryazdi 🇨🇦bluejayaido3-LF-real-validationeval1-videossuccessnoip-172-31-35-218-104900:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
289244552Robert Moni 🇭🇺kaland-22405aido3-LF-real-validationeval2-videossuccessnoip-172-31-35-218-104900:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
289154379Soroush Saryazdi 🇨🇦bluejayaido3-LF-real-validationeval0-videossuccessnoip-172-31-35-218-104900:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
289095542Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5102736673584536
survival_time_median2.000000000000001
deviation-center-line_median0.13748511577400016
in-drivable-lane_median0


other stats
agent_compute-ego_max0.019695854187011717
agent_compute-ego_mean0.01905298509353246
agent_compute-ego_median0.019175044695536297
agent_compute-ego_min0.0183685302734375
deviation-center-line_max0.7844482071516864
deviation-center-line_mean0.2634100568727199
deviation-center-line_min0.1235167866037554
deviation-heading_max1.7586371913434735
deviation-heading_mean0.6985484350004565
deviation-heading_median0.5285495442563236
deviation-heading_min0.24671068787927675
driven_any_max3.354314971329071
driven_any_mean1.0818607924968462
driven_any_median0.5251308056592814
driven_any_min0.34768359184914155
driven_lanedir_consec_max1.764748246011277
driven_lanedir_consec_mean0.7321352414488942
driven_lanedir_consec_min0.34102793747536553
driven_lanedir_max1.764748246011277
driven_lanedir_mean0.7321352414488942
driven_lanedir_median0.5102736673584536
driven_lanedir_min0.34102793747536553
in-drivable-lane_max4.000000000000021
in-drivable-lane_mean0.8500000000000041
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4075027957123158, "sim_physics": 0.06024811267852783, "survival_time": 2.000000000000001, "driven_lanedir": 0.3931397411200763, "sim_render-ego": 0.007422035932540894, "in-drivable-lane": 0, "agent_compute-ego": 0.019695854187011717, "deviation-heading": 0.5338152906902677, "set_robot_commands": 0.005029571056365967, "deviation-center-line": 0.1329016061201247, "driven_lanedir_consec": 0.3931397411200763, "sim_compute_sim_state": 0.002785128355026245, "sim_compute_performance-ego": 0.00423164963722229, "sim_compute_robot_state-ego": 0.004997038841247558}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.34768359184914155, "sim_physics": 0.060072526931762696, "survival_time": 1.2500000000000004, "driven_lanedir": 0.34102793747536553, "sim_render-ego": 0.007294492721557617, "in-drivable-lane": 0, "agent_compute-ego": 0.019536361694335935, "deviation-heading": 0.24671068787927675, "set_robot_commands": 0.004975395202636719, "deviation-center-line": 0.1235167866037554, "driven_lanedir_consec": 0.34102793747536553, "sim_compute_sim_state": 0.0028600215911865233, "sim_compute_performance-ego": 0.0039624786376953125, "sim_compute_robot_state-ego": 0.005013971328735351}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7746717979344209, "sim_physics": 0.05560847520828247, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6514866152792984, "sim_render-ego": 0.00706723133722941, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.019175044695536297, "deviation-heading": 0.5285495442563236, "set_robot_commands": 0.005056504408518473, "deviation-center-line": 0.13869856871403283, "driven_lanedir_consec": 0.6514866152792984, "sim_compute_sim_state": 0.002824588616689046, "sim_compute_performance-ego": 0.00398411750793457, "sim_compute_robot_state-ego": 0.005085504055023194}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.354314971329071, "sim_physics": 0.05179404499184372, "survival_time": 11.700000000000031, "driven_lanedir": 1.764748246011277, "sim_render-ego": 0.0069933936127230655, "in-drivable-lane": 4.000000000000021, "agent_compute-ego": 0.01848913461734087, "deviation-heading": 1.7586371913434735, "set_robot_commands": 0.004957341740274021, "deviation-center-line": 0.7844482071516864, "driven_lanedir_consec": 1.764748246011277, "sim_compute_sim_state": 0.0027960192443978074, "sim_compute_performance-ego": 0.003975577843494904, "sim_compute_robot_state-ego": 0.0049117192243918395}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5251308056592814, "sim_physics": 0.05784100123814174, "survival_time": 1.7500000000000009, "driven_lanedir": 0.5102736673584536, "sim_render-ego": 0.00725219590323312, "in-drivable-lane": 0, "agent_compute-ego": 0.0183685302734375, "deviation-heading": 0.4250294608329409, "set_robot_commands": 0.004964637756347656, "deviation-center-line": 0.13748511577400016, "driven_lanedir_consec": 0.5102736673584536, "sim_compute_sim_state": 0.002843965802873884, "sim_compute_performance-ego": 0.003987550735473633, "sim_compute_robot_state-ego": 0.005001299721854074}}
set_robot_commands_max0.005056504408518473
set_robot_commands_mean0.004996690032828566
set_robot_commands_median0.004975395202636719
set_robot_commands_min0.004957341740274021
sim_compute_performance-ego_max0.00423164963722229
sim_compute_performance-ego_mean0.004028274872364142
sim_compute_performance-ego_median0.00398411750793457
sim_compute_performance-ego_min0.0039624786376953125
sim_compute_robot_state-ego_max0.005085504055023194
sim_compute_robot_state-ego_mean0.0050019066342504035
sim_compute_robot_state-ego_median0.005001299721854074
sim_compute_robot_state-ego_min0.0049117192243918395
sim_compute_sim_state_max0.0028600215911865233
sim_compute_sim_state_mean0.0028219447220347014
sim_compute_sim_state_median0.002824588616689046
sim_compute_sim_state_min0.002785128355026245
sim_physics_max0.06024811267852783
sim_physics_mean0.057112832209711695
sim_physics_median0.05784100123814174
sim_physics_min0.05179404499184372
sim_render-ego_max0.007422035932540894
sim_render-ego_mean0.007205869901456821
sim_render-ego_median0.00725219590323312
sim_render-ego_min0.0069933936127230655
simulation-passed1
survival_time_max11.700000000000031
survival_time_mean3.940000000000006
survival_time_min1.2500000000000004
No reset possible
288935537Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:03:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
288865535Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-validationstep1-simulationabortedyesip-172-31-35-218-104900:02:05
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
288825534Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7361490209579915
survival_time_median14.950000000000076
deviation-center-line_median0.6797007059428586
in-drivable-lane_median0


other stats
agent_compute-ego_max0.018872604370117188
agent_compute-ego_mean0.018536930391992952
agent_compute-ego_median0.018578417301177975
agent_compute-ego_min0.01814935276809248
deviation-center-line_max1.00413525926133
deviation-center-line_mean0.5973879689791328
deviation-center-line_min0.25217675815585255
deviation-heading_max2.650329704042613
deviation-heading_mean2.0821998486217494
deviation-heading_median2.4427233798457544
deviation-heading_min1.2319246893286433
driven_any_max2.684356346897968
driven_any_mean1.7060637394190796
driven_any_median1.7717753608960607
driven_any_min0.8276355143072283
driven_lanedir_consec_max2.640243462616658
driven_lanedir_consec_mean1.644377317819352
driven_lanedir_consec_min0.6707921364626372
driven_lanedir_max2.640243462616658
driven_lanedir_mean1.644377317819352
driven_lanedir_median1.7361490209579915
driven_lanedir_min0.6707921364626372
in-drivable-lane_max0.849999999999997
in-drivable-lane_mean0.1699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.7717753608960607, "sim_physics": 0.055540305773417155, "survival_time": 14.950000000000076, "driven_lanedir": 1.7361490209579915, "sim_render-ego": 0.006937392552693685, "in-drivable-lane": 0, "agent_compute-ego": 0.018872604370117188, "deviation-heading": 2.650329704042613, "set_robot_commands": 0.0050198992093404135, "deviation-center-line": 1.00413525926133, "driven_lanedir_consec": 1.7361490209579915, "sim_compute_sim_state": 0.002794813315073649, "sim_compute_performance-ego": 0.004093958536783854, "sim_compute_robot_state-ego": 0.004885456562042236}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.4059782849246667, "sim_physics": 0.05412542502085368, "survival_time": 14.950000000000076, "driven_lanedir": 2.359971045293671, "sim_render-ego": 0.007015154361724853, "in-drivable-lane": 0, "agent_compute-ego": 0.018578417301177975, "deviation-heading": 2.6361767285876003, "set_robot_commands": 0.004997587998708089, "deviation-center-line": 0.7224697165048704, "driven_lanedir_consec": 2.359971045293671, "sim_compute_sim_state": 0.002810372511545817, "sim_compute_performance-ego": 0.004032645225524902, "sim_compute_robot_state-ego": 0.004894406000773112}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8276355143072283, "sim_physics": 0.05426213890314102, "survival_time": 6.399999999999985, "driven_lanedir": 0.6707921364626372, "sim_render-ego": 0.007116999477148056, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.01840526983141899, "deviation-heading": 1.4498447413041369, "set_robot_commands": 0.005012275651097298, "deviation-center-line": 0.3284574050307526, "driven_lanedir_consec": 0.6707921364626372, "sim_compute_sim_state": 0.0028082672506570816, "sim_compute_performance-ego": 0.003988130018115044, "sim_compute_robot_state-ego": 0.004972413182258606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8405731900694734, "sim_physics": 0.05227330587442639, "survival_time": 5.14999999999999, "driven_lanedir": 0.8147309237658024, "sim_render-ego": 0.007029195433681451, "in-drivable-lane": 0, "agent_compute-ego": 0.01814935276809248, "deviation-heading": 1.2319246893286433, "set_robot_commands": 0.004955361190351467, "deviation-center-line": 0.25217675815585255, "driven_lanedir_consec": 0.8147309237658024, "sim_compute_sim_state": 0.0028065963856224877, "sim_compute_performance-ego": 0.003983425862580827, "sim_compute_robot_state-ego": 0.004850109804023817}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.684356346897968, "sim_physics": 0.055244898001352946, "survival_time": 14.950000000000076, "driven_lanedir": 2.640243462616658, "sim_render-ego": 0.006982678572336832, "in-drivable-lane": 0, "agent_compute-ego": 0.01867900768915812, "deviation-heading": 2.4427233798457544, "set_robot_commands": 0.004953984419504801, "deviation-center-line": 0.6797007059428586, "driven_lanedir_consec": 2.640243462616658, "sim_compute_sim_state": 0.002796704769134522, "sim_compute_performance-ego": 0.004020881652832031, "sim_compute_robot_state-ego": 0.004835449059804281}}
set_robot_commands_max0.0050198992093404135
set_robot_commands_mean0.004987821693800414
set_robot_commands_median0.004997587998708089
set_robot_commands_min0.004953984419504801
sim_compute_performance-ego_max0.004093958536783854
sim_compute_performance-ego_mean0.004023808259167332
sim_compute_performance-ego_median0.004020881652832031
sim_compute_performance-ego_min0.003983425862580827
sim_compute_robot_state-ego_max0.004972413182258606
sim_compute_robot_state-ego_mean0.00488756692178041
sim_compute_robot_state-ego_median0.004885456562042236
sim_compute_robot_state-ego_min0.004835449059804281
sim_compute_sim_state_max0.002810372511545817
sim_compute_sim_state_mean0.002803350846406711
sim_compute_sim_state_median0.0028065963856224877
sim_compute_sim_state_min0.002794813315073649
sim_physics_max0.055540305773417155
sim_physics_mean0.05428921471463823
sim_physics_median0.05426213890314102
sim_physics_min0.05227330587442639
sim_render-ego_max0.007116999477148056
sim_render-ego_mean0.007016284079516976
sim_render-ego_median0.007015154361724853
sim_render-ego_min0.006937392552693685
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.28000000000004
survival_time_min5.14999999999999
No reset possible
288795532Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3494245878979525
survival_time_median6.449999999999985
deviation-center-line_median0.34980390885564067
in-drivable-lane_median0


other stats
agent_compute-ego_max0.032182779577043324
agent_compute-ego_mean0.02889028191085252
agent_compute-ego_median0.028190124182053553
agent_compute-ego_min0.027803786098957065
deviation-center-line_max0.7592808718282436
deviation-center-line_mean0.427071319985198
deviation-center-line_min0.13798313138350252
deviation-heading_max2.344640269816902
deviation-heading_mean1.22639913645211
deviation-heading_median1.0667700001072322
deviation-heading_min0.5170937959258605
driven_any_max4.547000260703078
driven_any_mean2.731890182108154
driven_any_median2.506360574162301
driven_any_min1.2216248702611563
driven_lanedir_consec_max4.422198348783598
driven_lanedir_consec_mean2.657690416697851
driven_lanedir_consec_min1.2061059573225186
driven_lanedir_max4.422198348783598
driven_lanedir_mean2.657690416697851
driven_lanedir_median2.3494245878979525
driven_lanedir_min1.2061059573225186
in-drivable-lane_max0.29999999999999893
in-drivable-lane_mean0.05999999999999979
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2216248702611563, "sim_physics": 0.05631490217314826, "survival_time": 3.599999999999995, "driven_lanedir": 1.2061059573225186, "sim_render-ego": 0.007289018895890977, "in-drivable-lane": 0, "agent_compute-ego": 0.032182779577043324, "deviation-heading": 0.5170937959258605, "set_robot_commands": 0.005229665173424615, "deviation-center-line": 0.13798313138350252, "driven_lanedir_consec": 1.2061059573225186, "sim_compute_sim_state": 0.002939158015780979, "sim_compute_performance-ego": 0.004360490375094944, "sim_compute_robot_state-ego": 0.005190461874008179}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.350573004146905, "sim_physics": 0.056964040726654286, "survival_time": 6.449999999999985, "driven_lanedir": 2.3183933707764446, "sim_render-ego": 0.007440247276956721, "in-drivable-lane": 0, "agent_compute-ego": 0.02833266221275625, "deviation-heading": 0.9553788565929324, "set_robot_commands": 0.00518501082132029, "deviation-center-line": 0.32571674819836827, "driven_lanedir_consec": 2.3183933707764446, "sim_compute_sim_state": 0.0030427718347357225, "sim_compute_performance-ego": 0.004158398901769357, "sim_compute_robot_state-ego": 0.005283581194027449}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.506360574162301, "sim_physics": 0.05768280476331711, "survival_time": 6.399999999999985, "driven_lanedir": 2.3494245878979525, "sim_render-ego": 0.007141713052988052, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.027803786098957065, "deviation-heading": 1.0667700001072322, "set_robot_commands": 0.005105769261717796, "deviation-center-line": 0.5625719396602351, "driven_lanedir_consec": 2.3494245878979525, "sim_compute_sim_state": 0.0029281284660100937, "sim_compute_performance-ego": 0.004032295197248459, "sim_compute_robot_state-ego": 0.005112398415803909}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.547000260703078, "sim_physics": 0.05679138140244917, "survival_time": 12.100000000000035, "driven_lanedir": 4.422198348783598, "sim_render-ego": 0.007090734056204803, "in-drivable-lane": 0, "agent_compute-ego": 0.02794205748345241, "deviation-heading": 2.344640269816902, "set_robot_commands": 0.005162748423489657, "deviation-center-line": 0.7592808718282436, "driven_lanedir_consec": 4.422198348783598, "sim_compute_sim_state": 0.0029383089916765197, "sim_compute_performance-ego": 0.004061061488695381, "sim_compute_robot_state-ego": 0.005110274661671032}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0338922012673266, "sim_physics": 0.05590086954611319, "survival_time": 8.09999999999998, "driven_lanedir": 2.9923298187087433, "sim_render-ego": 0.007134156462586957, "in-drivable-lane": 0, "agent_compute-ego": 0.028190124182053553, "deviation-heading": 1.2481127598176232, "set_robot_commands": 0.005106271049122752, "deviation-center-line": 0.34980390885564067, "driven_lanedir_consec": 2.9923298187087433, "sim_compute_sim_state": 0.0029343204733766155, "sim_compute_performance-ego": 0.004040744569566514, "sim_compute_robot_state-ego": 0.005086850236963343}}
set_robot_commands_max0.005229665173424615
set_robot_commands_mean0.0051578929458150225
set_robot_commands_median0.005162748423489657
set_robot_commands_min0.005105769261717796
sim_compute_performance-ego_max0.004360490375094944
sim_compute_performance-ego_mean0.0041305981064749305
sim_compute_performance-ego_median0.004061061488695381
sim_compute_performance-ego_min0.004032295197248459
sim_compute_robot_state-ego_max0.005283581194027449
sim_compute_robot_state-ego_mean0.005156713276494782
sim_compute_robot_state-ego_median0.005112398415803909
sim_compute_robot_state-ego_min0.005086850236963343
sim_compute_sim_state_max0.0030427718347357225
sim_compute_sim_state_mean0.002956537556315986
sim_compute_sim_state_median0.0029383089916765197
sim_compute_sim_state_min0.0029281284660100937
sim_physics_max0.05768280476331711
sim_physics_mean0.0567307997223364
sim_physics_median0.05679138140244917
sim_physics_min0.05590086954611319
sim_render-ego_max0.007440247276956721
sim_render-ego_mean0.007219173948925501
sim_render-ego_median0.007141713052988052
sim_render-ego_min0.007090734056204803
simulation-passed1
survival_time_max12.100000000000035
survival_time_mean7.329999999999996
survival_time_min3.599999999999995
No reset possible
288715527Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7691968785310883
survival_time_median14.950000000000076
deviation-center-line_median0.6613310105912914
in-drivable-lane_median0


other stats
agent_compute-ego_max0.019082969824473064
agent_compute-ego_mean0.018541620405657773
agent_compute-ego_median0.0184989848607023
agent_compute-ego_min0.01827682892481486
deviation-center-line_max0.8977637880614937
deviation-center-line_mean0.6475445489952777
deviation-center-line_min0.31356081890646226
deviation-heading_max2.912495592849645
deviation-heading_mean2.3162916068758372
deviation-heading_median2.274152696002625
deviation-heading_min1.4848018892760229
driven_any_max2.715968861256784
driven_any_mean1.907457428328278
driven_any_median1.8189258474150385
driven_any_min0.7980467652116946
driven_lanedir_consec_max2.671650700680833
driven_lanedir_consec_mean1.8449406014551148
driven_lanedir_consec_min0.6707771962597033
driven_lanedir_max2.671650700680833
driven_lanedir_mean1.8449406014551148
driven_lanedir_median1.7691968785310883
driven_lanedir_min0.6707771962597033
in-drivable-lane_max0.4499999999999984
in-drivable-lane_mean0.08999999999999968
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8189258474150385, "sim_physics": 0.055917317867279055, "survival_time": 14.950000000000076, "driven_lanedir": 1.7691968785310883, "sim_render-ego": 0.006919385592142741, "in-drivable-lane": 0, "agent_compute-ego": 0.019082969824473064, "deviation-heading": 2.912495592849645, "set_robot_commands": 0.00520686149597168, "deviation-center-line": 0.8977637880614937, "driven_lanedir_consec": 1.7691968785310883, "sim_compute_sim_state": 0.00280927022298177, "sim_compute_performance-ego": 0.004071484406789144, "sim_compute_robot_state-ego": 0.004922329584757487}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.4826029415962667, "sim_physics": 0.05494951486587525, "survival_time": 14.950000000000076, "driven_lanedir": 2.439217586150054, "sim_render-ego": 0.006954325040181478, "in-drivable-lane": 0, "agent_compute-ego": 0.0185227100054423, "deviation-heading": 2.2062084323282143, "set_robot_commands": 0.004970982074737549, "deviation-center-line": 0.6613310105912914, "driven_lanedir_consec": 2.439217586150054, "sim_compute_sim_state": 0.002765777905782064, "sim_compute_performance-ego": 0.003986829916636149, "sim_compute_robot_state-ego": 0.004802645047505697}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7980467652116946, "sim_physics": 0.0558740303549968, "survival_time": 7.099999999999983, "driven_lanedir": 0.6707771962597033, "sim_render-ego": 0.007105315235299124, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.0184989848607023, "deviation-heading": 1.4848018892760229, "set_robot_commands": 0.005004830763373576, "deviation-center-line": 0.31356081890646226, "driven_lanedir_consec": 0.6707771962597033, "sim_compute_sim_state": 0.002875554729515398, "sim_compute_performance-ego": 0.004033112190139126, "sim_compute_robot_state-ego": 0.004920358389196262}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.721742726161608, "sim_physics": 0.05736704047666777, "survival_time": 10.90000000000002, "driven_lanedir": 1.6738606456538954, "sim_render-ego": 0.006985003795098821, "in-drivable-lane": 0, "agent_compute-ego": 0.01832660841285635, "deviation-heading": 2.274152696002625, "set_robot_commands": 0.005008510493357247, "deviation-center-line": 0.8752071843277186, "driven_lanedir_consec": 1.6738606456538954, "sim_compute_sim_state": 0.002804797723752643, "sim_compute_performance-ego": 0.004007281513389097, "sim_compute_robot_state-ego": 0.0048827326625858975}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.715968861256784, "sim_physics": 0.05520569801330567, "survival_time": 14.950000000000076, "driven_lanedir": 2.671650700680833, "sim_render-ego": 0.006945851643880208, "in-drivable-lane": 0, "agent_compute-ego": 0.01827682892481486, "deviation-heading": 2.70379942392268, "set_robot_commands": 0.004919049739837647, "deviation-center-line": 0.4898599430894222, "driven_lanedir_consec": 2.671650700680833, "sim_compute_sim_state": 0.002740920384724935, "sim_compute_performance-ego": 0.003961390654246013, "sim_compute_robot_state-ego": 0.004771238168080648}}
set_robot_commands_max0.00520686149597168
set_robot_commands_mean0.00502204691345554
set_robot_commands_median0.005004830763373576
set_robot_commands_min0.004919049739837647
sim_compute_performance-ego_max0.004071484406789144
sim_compute_performance-ego_mean0.004012019736239906
sim_compute_performance-ego_median0.004007281513389097
sim_compute_performance-ego_min0.003961390654246013
sim_compute_robot_state-ego_max0.004922329584757487
sim_compute_robot_state-ego_mean0.004859860770425198
sim_compute_robot_state-ego_median0.0048827326625858975
sim_compute_robot_state-ego_min0.004771238168080648
sim_compute_sim_state_max0.002875554729515398
sim_compute_sim_state_mean0.002799264193351362
sim_compute_sim_state_median0.002804797723752643
sim_compute_sim_state_min0.002740920384724935
sim_physics_max0.05736704047666777
sim_physics_mean0.05586272031562491
sim_physics_median0.0558740303549968
sim_physics_min0.05494951486587525
sim_render-ego_max0.007105315235299124
sim_render-ego_mean0.006981976261320475
sim_render-ego_median0.006954325040181478
sim_render-ego_min0.006919385592142741
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.570000000000046
survival_time_min7.099999999999983
No reset possible
288645522Frank (Chude) Qian 🇨🇦2019-12-05|FrankNet|Frozen2aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.613063728935532
survival_time_median14.950000000000076
deviation-center-line_median0.7406220206883317
in-drivable-lane_median0


other stats
agent_compute-ego_max0.029665130774180093
agent_compute-ego_mean0.028302104104067628
agent_compute-ego_median0.027980645497639973
agent_compute-ego_min0.0278858690883008
deviation-center-line_max0.786341022670844
deviation-center-line_mean0.6370021025159353
deviation-center-line_min0.3404567088619324
deviation-heading_max2.6651049286295545
deviation-heading_mean2.173505656226149
deviation-heading_median1.975224356686026
deviation-heading_min1.7705664762533508
driven_any_max4.910721166854033
driven_any_mean4.540559252687487
driven_any_median4.727879566085885
driven_any_min3.673911440659957
driven_lanedir_consec_max4.6591088753670045
driven_lanedir_consec_mean3.758169232810462
driven_lanedir_consec_min2.7992235314675415
driven_lanedir_max4.6591088753670045
driven_lanedir_mean3.758169232810462
driven_lanedir_median3.613063728935532
driven_lanedir_min2.7992235314675415
in-drivable-lane_max7.600000000000072
in-drivable-lane_mean2.440000000000018
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.673911440659957, "sim_physics": 0.05890323321024577, "survival_time": 14.950000000000076, "driven_lanedir": 3.613063728935532, "sim_render-ego": 0.007050300439198812, "in-drivable-lane": 0, "agent_compute-ego": 0.029665130774180093, "deviation-heading": 2.6651049286295545, "set_robot_commands": 0.0050896406173706055, "deviation-center-line": 0.786341022670844, "driven_lanedir_consec": 3.613063728935532, "sim_compute_sim_state": 0.002943686644236247, "sim_compute_performance-ego": 0.004148821036020915, "sim_compute_robot_state-ego": 0.004963174661000569}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.745853329581077, "sim_physics": 0.05604387362798055, "survival_time": 14.950000000000076, "driven_lanedir": 3.1407711456688094, "sim_render-ego": 0.007142550945281982, "in-drivable-lane": 4.600000000000019, "agent_compute-ego": 0.027998438676198324, "deviation-heading": 1.9296727597239516, "set_robot_commands": 0.005140399138132731, "deviation-center-line": 0.5758127161901517, "driven_lanedir_consec": 3.1407711456688094, "sim_compute_sim_state": 0.0029598228136698407, "sim_compute_performance-ego": 0.004052679538726806, "sim_compute_robot_state-ego": 0.0049593186378479}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.644430760256483, "sim_physics": 0.05624288160682181, "survival_time": 13.05000000000005, "driven_lanedir": 4.578678882613422, "sim_render-ego": 0.007147405339383531, "in-drivable-lane": 0, "agent_compute-ego": 0.0278858690883008, "deviation-heading": 1.975224356686026, "set_robot_commands": 0.004991999987898202, "deviation-center-line": 0.7406220206883317, "driven_lanedir_consec": 4.578678882613422, "sim_compute_sim_state": 0.0029343910144206667, "sim_compute_performance-ego": 0.004038563176589907, "sim_compute_robot_state-ego": 0.0049481647681459155}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.727879566085885, "sim_physics": 0.056832928657531735, "survival_time": 14.950000000000076, "driven_lanedir": 4.6591088753670045, "sim_render-ego": 0.007148315111796061, "in-drivable-lane": 0, "agent_compute-ego": 0.027980645497639973, "deviation-heading": 2.526959759837864, "set_robot_commands": 0.005041087468465169, "deviation-center-line": 0.7417780441684165, "driven_lanedir_consec": 4.6591088753670045, "sim_compute_sim_state": 0.002971015771230062, "sim_compute_performance-ego": 0.004048687616984049, "sim_compute_robot_state-ego": 0.005040787855784099}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.910721166854033, "sim_physics": 0.05711033980051677, "survival_time": 14.950000000000076, "driven_lanedir": 2.7992235314675415, "sim_render-ego": 0.0071918741861979165, "in-drivable-lane": 7.600000000000072, "agent_compute-ego": 0.02798043648401896, "deviation-heading": 1.7705664762533508, "set_robot_commands": 0.0050915710131327315, "deviation-center-line": 0.3404567088619324, "driven_lanedir_consec": 2.7992235314675415, "sim_compute_sim_state": 0.002985268433888753, "sim_compute_performance-ego": 0.004074114163716634, "sim_compute_robot_state-ego": 0.005099101861317953}}
set_robot_commands_max0.005140399138132731
set_robot_commands_mean0.005070939644999888
set_robot_commands_median0.0050896406173706055
set_robot_commands_min0.004991999987898202
sim_compute_performance-ego_max0.004148821036020915
sim_compute_performance-ego_mean0.0040725731064076625
sim_compute_performance-ego_median0.004052679538726806
sim_compute_performance-ego_min0.004038563176589907
sim_compute_robot_state-ego_max0.005099101861317953
sim_compute_robot_state-ego_mean0.005002109556819287
sim_compute_robot_state-ego_median0.004963174661000569
sim_compute_robot_state-ego_min0.0049481647681459155
sim_compute_sim_state_max0.002985268433888753
sim_compute_sim_state_mean0.002958836935489114
sim_compute_sim_state_median0.0029598228136698407
sim_compute_sim_state_min0.0029343910144206667
sim_physics_max0.05890323321024577
sim_physics_mean0.05702665138061932
sim_physics_median0.056832928657531735
sim_physics_min0.05604387362798055
sim_render-ego_max0.0071918741861979165
sim_render-ego_mean0.007136089204371661
sim_render-ego_median0.007147405339383531
sim_render-ego_min0.007050300439198812
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.57000000000007
survival_time_min13.05000000000005
No reset possible
288025181Robert Moni 🇭🇺almasip-6824aido3-LF-real-validationeval0-videossuccessnoip-172-31-35-218-104900:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
287915174Robert Moni 🇭🇺almasip-6824aido3-LF-real-validationeval0-videossuccessnoip-172-31-35-218-104900:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
287625508Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0460839735112355
survival_time_median7.99999999999998
deviation-center-line_median0.748130557993483
in-drivable-lane_median0


other stats
agent_compute-ego_max0.021144004968496468
agent_compute-ego_mean0.020545861951815778
agent_compute-ego_median0.02028183698654175
agent_compute-ego_min0.020098672463343695
deviation-center-line_max1.0743739957435725
deviation-center-line_mean0.6424309003622186
deviation-center-line_min0.15017844246668904
deviation-heading_max3.8156213871694087
deviation-heading_mean2.394059265888921
deviation-heading_median3.308259333282135
deviation-heading_min0.3678097626682172
driven_any_max3.537953674595794
driven_any_mean1.8277415876181
driven_any_median1.1988895017369483
driven_any_min0.3663182774112132
driven_lanedir_consec_max3.3968733778592615
driven_lanedir_consec_mean1.7341156942942706
driven_lanedir_consec_min0.3145250787679519
driven_lanedir_max3.3968733778592615
driven_lanedir_mean1.7341156942942706
driven_lanedir_median1.0460839735112355
driven_lanedir_min0.3145250787679519
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.020000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1988895017369483, "sim_physics": 0.056896133720874785, "survival_time": 7.99999999999998, "driven_lanedir": 1.0460839735112355, "sim_render-ego": 0.007238602638244629, "in-drivable-lane": 0, "agent_compute-ego": 0.020978195965290068, "deviation-heading": 3.308259333282135, "set_robot_commands": 0.005399654805660248, "deviation-center-line": 0.748130557993483, "driven_lanedir_consec": 1.0460839735112355, "sim_compute_sim_state": 0.002994652092456818, "sim_compute_performance-ego": 0.004235520958900452, "sim_compute_robot_state-ego": 0.005138757824897766}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7913087370450672, "sim_physics": 0.058528441649216875, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7828343457202152, "sim_render-ego": 0.007259345971621, "in-drivable-lane": 0, "agent_compute-ego": 0.020098672463343695, "deviation-heading": 0.3678097626682172, "set_robot_commands": 0.005164957963503324, "deviation-center-line": 0.23985654320364352, "driven_lanedir_consec": 0.7828343457202152, "sim_compute_sim_state": 0.002994688657613901, "sim_compute_performance-ego": 0.004046747317680946, "sim_compute_robot_state-ego": 0.005174407592186561}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3663182774112132, "sim_physics": 0.05824727278489333, "survival_time": 1.950000000000001, "driven_lanedir": 0.3145250787679519, "sim_render-ego": 0.007357438405354817, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.021144004968496468, "deviation-heading": 0.8325844692289825, "set_robot_commands": 0.005214923467391577, "deviation-center-line": 0.15017844246668904, "driven_lanedir_consec": 0.3145250787679519, "sim_compute_sim_state": 0.002979125732030624, "sim_compute_performance-ego": 0.004064132005740435, "sim_compute_robot_state-ego": 0.005105862250694862}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.537953674595794, "sim_physics": 0.05610452810923258, "survival_time": 14.950000000000076, "driven_lanedir": 3.3968733778592615, "sim_render-ego": 0.007039726575215658, "in-drivable-lane": 0, "agent_compute-ego": 0.02028183698654175, "deviation-heading": 3.8156213871694087, "set_robot_commands": 0.005290433565775554, "deviation-center-line": 0.9996149624037048, "driven_lanedir_consec": 3.3968733778592615, "sim_compute_sim_state": 0.0029870239893595375, "sim_compute_performance-ego": 0.0040711371103922525, "sim_compute_robot_state-ego": 0.005105026563008626}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.2442377473014763, "sim_physics": 0.05834743897120158, "survival_time": 14.950000000000076, "driven_lanedir": 3.130261695612689, "sim_render-ego": 0.007175359725952148, "in-drivable-lane": 0, "agent_compute-ego": 0.0202265993754069, "deviation-heading": 3.646021377095862, "set_robot_commands": 0.005233504772186279, "deviation-center-line": 1.0743739957435725, "driven_lanedir_consec": 3.130261695612689, "sim_compute_sim_state": 0.0029897562662760417, "sim_compute_performance-ego": 0.004064908027648926, "sim_compute_robot_state-ego": 0.00510964552561442}}
set_robot_commands_max0.005399654805660248
set_robot_commands_mean0.005260694914903397
set_robot_commands_median0.005233504772186279
set_robot_commands_min0.005164957963503324
sim_compute_performance-ego_max0.004235520958900452
sim_compute_performance-ego_mean0.004096489084072602
sim_compute_performance-ego_median0.004064908027648926
sim_compute_performance-ego_min0.004046747317680946
sim_compute_robot_state-ego_max0.005174407592186561
sim_compute_robot_state-ego_mean0.005126739951280447
sim_compute_robot_state-ego_median0.00510964552561442
sim_compute_robot_state-ego_min0.005105026563008626
sim_compute_sim_state_max0.002994688657613901
sim_compute_sim_state_mean0.0029890493475473847
sim_compute_sim_state_median0.0029897562662760417
sim_compute_sim_state_min0.002979125732030624
sim_physics_max0.058528441649216875
sim_physics_mean0.057624763047083825
sim_physics_median0.05824727278489333
sim_physics_min0.05610452810923258
sim_render-ego_max0.007357438405354817
sim_render-ego_mean0.007214094663277651
sim_render-ego_median0.007238602638244629
sim_render-ego_min0.007039726575215658
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.490000000000027
survival_time_min1.950000000000001
No reset possible
287185498Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0763523674382272
survival_time_median3.4999999999999956
deviation-center-line_median0.3112707158814599
in-drivable-lane_median0


other stats
agent_compute-ego_max0.021420167416942363
agent_compute-ego_mean0.020393855067188084
agent_compute-ego_median0.02012259851802479
agent_compute-ego_min0.019910780159202782
deviation-center-line_max0.5544262641979917
deviation-center-line_mean0.36353941321665745
deviation-center-line_min0.21655955560297316
deviation-heading_max2.540276603046126
deviation-heading_mean0.9779441854035736
deviation-heading_median0.6855979034398121
deviation-heading_min0.3724934359569603
driven_any_max1.607549519554538
driven_any_mean0.9967759384133454
driven_any_median1.0877285599940767
driven_any_min0.37375739736662617
driven_lanedir_consec_max1.383019634407978
driven_lanedir_consec_mean0.9105774627968805
driven_lanedir_consec_min0.3582890643008674
driven_lanedir_max1.383019634407978
driven_lanedir_mean0.9105774627968805
driven_lanedir_median1.0763523674382272
driven_lanedir_min0.3582890643008674
in-drivable-lane_max2.000000000000014
in-drivable-lane_mean0.40000000000000285
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.37375739736662617, "sim_physics": 0.06099587070698641, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3582890643008674, "sim_render-ego": 0.007462083076944156, "in-drivable-lane": 0, "agent_compute-ego": 0.021420167416942363, "deviation-heading": 0.6855979034398121, "set_robot_commands": 0.005607979638235909, "deviation-center-line": 0.21655955560297316, "driven_lanedir_consec": 0.3582890643008674, "sim_compute_sim_state": 0.0029607257064507933, "sim_compute_performance-ego": 0.004367336934926558, "sim_compute_robot_state-ego": 0.005123663921745456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.389174846259328, "sim_physics": 0.05739804018627514, "survival_time": 4.399999999999992, "driven_lanedir": 1.383019634407978, "sim_render-ego": 0.007151365280151367, "in-drivable-lane": 0, "agent_compute-ego": 0.02012259851802479, "deviation-heading": 0.3724934359569603, "set_robot_commands": 0.005250722169876099, "deviation-center-line": 0.49277706444698377, "driven_lanedir_consec": 1.383019634407978, "sim_compute_sim_state": 0.0028745532035827637, "sim_compute_performance-ego": 0.003981855782595548, "sim_compute_robot_state-ego": 0.0050922307101163}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5256693688921593, "sim_physics": 0.05677979979021796, "survival_time": 2.8999999999999977, "driven_lanedir": 0.5044383638004772, "sim_render-ego": 0.007185644116894952, "in-drivable-lane": 0, "agent_compute-ego": 0.01992724270656191, "deviation-heading": 0.8334512060411309, "set_robot_commands": 0.0051122369437382135, "deviation-center-line": 0.24266346595387883, "driven_lanedir_consec": 0.5044383638004772, "sim_compute_sim_state": 0.002867250606931489, "sim_compute_performance-ego": 0.004005797978105216, "sim_compute_robot_state-ego": 0.00497468586625724}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.607549519554538, "sim_physics": 0.05431461978603054, "survival_time": 9.249999999999996, "driven_lanedir": 1.2307878840368522, "sim_render-ego": 0.007155640060837205, "in-drivable-lane": 2.000000000000014, "agent_compute-ego": 0.019910780159202782, "deviation-heading": 2.540276603046126, "set_robot_commands": 0.005261097727595149, "deviation-center-line": 0.5544262641979917, "driven_lanedir_consec": 1.2307878840368522, "sim_compute_sim_state": 0.002909156438466665, "sim_compute_performance-ego": 0.004081396154455236, "sim_compute_robot_state-ego": 0.005077119775720545}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0877285599940767, "sim_physics": 0.06111933844430106, "survival_time": 3.4999999999999956, "driven_lanedir": 1.0763523674382272, "sim_render-ego": 0.007483819552830288, "in-drivable-lane": 0, "agent_compute-ego": 0.020588486535208565, "deviation-heading": 0.4579017785338376, "set_robot_commands": 0.005538197926112584, "deviation-center-line": 0.3112707158814599, "driven_lanedir_consec": 1.0763523674382272, "sim_compute_sim_state": 0.0030665567943028043, "sim_compute_performance-ego": 0.0041915178298950195, "sim_compute_robot_state-ego": 0.005113131659371512}}
set_robot_commands_max0.005607979638235909
set_robot_commands_mean0.005354046881111591
set_robot_commands_median0.005261097727595149
set_robot_commands_min0.0051122369437382135
sim_compute_performance-ego_max0.004367336934926558
sim_compute_performance-ego_mean0.004125580935995516
sim_compute_performance-ego_median0.004081396154455236
sim_compute_performance-ego_min0.003981855782595548
sim_compute_robot_state-ego_max0.005123663921745456
sim_compute_robot_state-ego_mean0.0050761663866422104
sim_compute_robot_state-ego_median0.0050922307101163
sim_compute_robot_state-ego_min0.00497468586625724
sim_compute_sim_state_max0.0030665567943028043
sim_compute_sim_state_mean0.002935648549946903
sim_compute_sim_state_median0.002909156438466665
sim_compute_sim_state_min0.002867250606931489
sim_physics_max0.06111933844430106
sim_physics_mean0.058121533782762226
sim_physics_median0.05739804018627514
sim_physics_min0.05431461978603054
sim_render-ego_max0.007483819552830288
sim_render-ego_mean0.007287710417531594
sim_render-ego_median0.007185644116894952
sim_render-ego_min0.007151365280151367
simulation-passed1
survival_time_max9.249999999999996
survival_time_mean4.4999999999999964
survival_time_min2.4499999999999993
No reset possible
287115495Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9136046490385314
survival_time_median2.549999999999999
deviation-center-line_median0.11635739359185474
in-drivable-lane_median0


other stats
agent_compute-ego_max0.021052906248304575
agent_compute-ego_mean0.020236842552431265
agent_compute-ego_median0.02023445814847946
agent_compute-ego_min0.01969549059867859
deviation-center-line_max0.35119684513556537
deviation-center-line_mean0.1728902432327314
deviation-center-line_min0.09244300995701764
deviation-heading_max1.4538970137534393
deviation-heading_mean0.7275883966053305
deviation-heading_median0.542397864575087
deviation-heading_min0.4059846139868456
driven_any_max1.2084608100765637
driven_any_mean0.814000309417376
driven_any_median0.9369465807013116
driven_any_min0.47034934512952087
driven_lanedir_consec_max1.0377031366633451
driven_lanedir_consec_mean0.7583169723259549
driven_lanedir_consec_min0.4456984621052422
driven_lanedir_max1.0377031366633451
driven_lanedir_mean0.7583169723259549
driven_lanedir_median0.9136046490385314
driven_lanedir_min0.4456984621052422
in-drivable-lane_max0.4499999999999984
in-drivable-lane_mean0.08999999999999968
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2084608100765637, "sim_physics": 0.05469429228040907, "survival_time": 4.499999999999992, "driven_lanedir": 1.0377031366633451, "sim_render-ego": 0.007373574044969347, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.021052906248304575, "deviation-heading": 1.4538970137534393, "set_robot_commands": 0.005315883954366048, "deviation-center-line": 0.35119684513556537, "driven_lanedir_consec": 1.0377031366633451, "sim_compute_sim_state": 0.002935263845655653, "sim_compute_performance-ego": 0.004308144251505534, "sim_compute_robot_state-ego": 0.005140945646497939}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9838840672145444, "sim_physics": 0.058571664492289226, "survival_time": 2.9999999999999973, "driven_lanedir": 0.9445200738582716, "sim_render-ego": 0.007231183846791585, "in-drivable-lane": 0, "agent_compute-ego": 0.020504037539164223, "deviation-heading": 0.8140941713803624, "set_robot_commands": 0.005218990643819173, "deviation-center-line": 0.19539010656905756, "driven_lanedir_consec": 0.9445200738582716, "sim_compute_sim_state": 0.0029454429944356284, "sim_compute_performance-ego": 0.004037173589070638, "sim_compute_robot_state-ego": 0.005057430267333985}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.47036074396493954, "sim_physics": 0.058443523943424225, "survival_time": 1.6000000000000008, "driven_lanedir": 0.4500585399643833, "sim_render-ego": 0.007245868444442749, "in-drivable-lane": 0, "agent_compute-ego": 0.01969549059867859, "deviation-heading": 0.4059846139868456, "set_robot_commands": 0.005166411399841309, "deviation-center-line": 0.11635739359185474, "driven_lanedir_consec": 0.4500585399643833, "sim_compute_sim_state": 0.002894386649131775, "sim_compute_performance-ego": 0.004084832966327667, "sim_compute_robot_state-ego": 0.0050806403160095215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.47034934512952087, "sim_physics": 0.05869438499212265, "survival_time": 1.6000000000000008, "driven_lanedir": 0.4456984621052422, "sim_render-ego": 0.011238828301429749, "in-drivable-lane": 0, "agent_compute-ego": 0.02023445814847946, "deviation-heading": 0.42156831933091776, "set_robot_commands": 0.00532938539981842, "deviation-center-line": 0.09244300995701764, "driven_lanedir_consec": 0.4456984621052422, "sim_compute_sim_state": 0.0029709935188293457, "sim_compute_performance-ego": 0.00406164675951004, "sim_compute_robot_state-ego": 0.005106128752231598}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9369465807013116, "sim_physics": 0.057266539218379, "survival_time": 2.549999999999999, "driven_lanedir": 0.9136046490385314, "sim_render-ego": 0.007185678856045592, "in-drivable-lane": 0, "agent_compute-ego": 0.01969732022752949, "deviation-heading": 0.542397864575087, "set_robot_commands": 0.005175211850334616, "deviation-center-line": 0.10906386091016176, "driven_lanedir_consec": 0.9136046490385314, "sim_compute_sim_state": 0.002858606039309034, "sim_compute_performance-ego": 0.004033972235286937, "sim_compute_robot_state-ego": 0.005020637138217103}}
set_robot_commands_max0.00532938539981842
set_robot_commands_mean0.005241176649635913
set_robot_commands_median0.005218990643819173
set_robot_commands_min0.005166411399841309
sim_compute_performance-ego_max0.004308144251505534
sim_compute_performance-ego_mean0.004105153960340164
sim_compute_performance-ego_median0.00406164675951004
sim_compute_performance-ego_min0.004033972235286937
sim_compute_robot_state-ego_max0.005140945646497939
sim_compute_robot_state-ego_mean0.005081156424058029
sim_compute_robot_state-ego_median0.0050806403160095215
sim_compute_robot_state-ego_min0.005020637138217103
sim_compute_sim_state_max0.0029709935188293457
sim_compute_sim_state_mean0.0029209386094722874
sim_compute_sim_state_median0.002935263845655653
sim_compute_sim_state_min0.002858606039309034
sim_physics_max0.05869438499212265
sim_physics_mean0.05753408098532483
sim_physics_median0.058443523943424225
sim_physics_min0.05469429228040907
sim_render-ego_max0.011238828301429749
sim_render-ego_mean0.008055026698735803
sim_render-ego_median0.007245868444442749
sim_render-ego_min0.007185678856045592
simulation-passed1
survival_time_max4.499999999999992
survival_time_mean2.649999999999998
survival_time_min1.6000000000000008
No reset possible
286965487Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:01:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
286855481Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5546387205418775
survival_time_median1.7000000000000008
deviation-center-line_median0.09668725662047828
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02058195366578944
agent_compute-ego_mean0.01911777096228031
agent_compute-ego_median0.01879726705097017
agent_compute-ego_min0.018308736659862376
deviation-center-line_max0.210109754572976
deviation-center-line_mean0.12819762255292405
deviation-center-line_min0.0956379082117296
deviation-heading_max1.1568719297193395
deviation-heading_mean0.4712309912453934
deviation-heading_median0.3199801906639129
deviation-heading_min0.20295633820289985
driven_any_max1.6087798212271385
driven_any_mean0.7630283154275523
driven_any_median0.5682634213297622
driven_any_min0.4013588159333582
driven_lanedir_consec_max1.2270875779689958
driven_lanedir_consec_mean0.6566733549223729
driven_lanedir_consec_min0.39535121775324034
driven_lanedir_max1.2270875779689958
driven_lanedir_mean0.6566733549223729
driven_lanedir_median0.5546387205418775
driven_lanedir_min0.39535121775324034
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.2299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4868861381746047, "sim_physics": 0.06329242622151095, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4753559776101013, "sim_render-ego": 0.007453694063074449, "in-drivable-lane": 0, "agent_compute-ego": 0.02058195366578944, "deviation-heading": 0.3570927060084943, "set_robot_commands": 0.005222264458151425, "deviation-center-line": 0.14255282928409954, "driven_lanedir_consec": 0.4753559776101013, "sim_compute_sim_state": 0.0030178182265337777, "sim_compute_performance-ego": 0.004441569833194508, "sim_compute_robot_state-ego": 0.005211177994223202}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4013588159333582, "sim_physics": 0.06087959380376907, "survival_time": 1.0500000000000005, "driven_lanedir": 0.39535121775324034, "sim_render-ego": 0.007234675543648856, "in-drivable-lane": 0, "agent_compute-ego": 0.01855809347970145, "deviation-heading": 0.20295633820289985, "set_robot_commands": 0.004919949032011486, "deviation-center-line": 0.0956379082117296, "driven_lanedir_consec": 0.39535121775324034, "sim_compute_sim_state": 0.00290551639738537, "sim_compute_performance-ego": 0.0039628346761067705, "sim_compute_robot_state-ego": 0.005085581824893043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7498533804728982, "sim_physics": 0.057489192485809325, "survival_time": 2.000000000000001, "driven_lanedir": 0.6309332807376493, "sim_render-ego": 0.00721777081489563, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.019342803955078126, "deviation-heading": 0.31925379163232026, "set_robot_commands": 0.005063247680664062, "deviation-center-line": 0.09668725662047828, "driven_lanedir_consec": 0.6309332807376493, "sim_compute_sim_state": 0.002908027172088623, "sim_compute_performance-ego": 0.004024028778076172, "sim_compute_robot_state-ego": 0.005238109827041626}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6087798212271385, "sim_physics": 0.05599306878589448, "survival_time": 4.199999999999993, "driven_lanedir": 1.2270875779689958, "sim_render-ego": 0.007205239364079067, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.01879726705097017, "deviation-heading": 1.1568719297193395, "set_robot_commands": 0.005109599658421108, "deviation-center-line": 0.210109754572976, "driven_lanedir_consec": 1.2270875779689958, "sim_compute_sim_state": 0.0029227761995224725, "sim_compute_performance-ego": 0.0040671371278308685, "sim_compute_robot_state-ego": 0.00517986501966204}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5682634213297622, "sim_physics": 0.05993043934857404, "survival_time": 1.3500000000000003, "driven_lanedir": 0.5546387205418775, "sim_render-ego": 0.007276367258142542, "in-drivable-lane": 0, "agent_compute-ego": 0.018308736659862376, "deviation-heading": 0.3199801906639129, "set_robot_commands": 0.0049796369340684675, "deviation-center-line": 0.09600036407533684, "driven_lanedir_consec": 0.5546387205418775, "sim_compute_sim_state": 0.0028554775096752026, "sim_compute_performance-ego": 0.0041008613727710865, "sim_compute_robot_state-ego": 0.005140498832420066}}
set_robot_commands_max0.005222264458151425
set_robot_commands_mean0.00505893955266331
set_robot_commands_median0.005063247680664062
set_robot_commands_min0.004919949032011486
sim_compute_performance-ego_max0.004441569833194508
sim_compute_performance-ego_mean0.0041192863575958815
sim_compute_performance-ego_median0.0040671371278308685
sim_compute_performance-ego_min0.0039628346761067705
sim_compute_robot_state-ego_max0.005238109827041626
sim_compute_robot_state-ego_mean0.005171046699647996
sim_compute_robot_state-ego_median0.00517986501966204
sim_compute_robot_state-ego_min0.005085581824893043
sim_compute_sim_state_max0.0030178182265337777
sim_compute_sim_state_mean0.0029219231010410894
sim_compute_sim_state_median0.002908027172088623
sim_compute_sim_state_min0.0028554775096752026
sim_physics_max0.06329242622151095
sim_physics_mean0.059516944129111585
sim_physics_median0.05993043934857404
sim_physics_min0.05599306878589448
sim_render-ego_max0.007453694063074449
sim_render-ego_mean0.007277549408768109
sim_render-ego_median0.007234675543648856
sim_render-ego_min0.007205239364079067
simulation-passed1
survival_time_max4.199999999999993
survival_time_mean2.0599999999999996
survival_time_min1.0500000000000005
No reset possible
286755475Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-35-218-104900:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 54, in on_received_get_commands
               ||     omega = vel * np.sin(steering_angle) /  (1/6.3)
               || NameError: name 'vel' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
286654558Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Actaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:21:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.2081047437254036
survival_time_median14.950000000000076
deviation-center-line_median0.7447394129860716
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02901224692662557
agent_compute-ego_mean0.027938050693935824
agent_compute-ego_median0.027807137966156005
agent_compute-ego_min0.02758785645167033
deviation-center-line_max0.9920226997942804
deviation-center-line_mean0.7582751315442086
deviation-center-line_min0.6353541153369346
deviation-heading_max3.587016797829913
deviation-heading_mean2.5705274314598294
deviation-heading_median2.6806228942094656
deviation-heading_min1.6576926547523405
driven_any_max5.598307273363383
driven_any_mean4.43858713003946
driven_any_median4.433246483155833
driven_any_min3.5499205258706232
driven_lanedir_consec_max5.549838967797342
driven_lanedir_consec_mean4.311351657137667
driven_lanedir_consec_min3.4687487726602257
driven_lanedir_max5.549838967797342
driven_lanedir_mean4.311351657137667
driven_lanedir_median4.2081047437254036
driven_lanedir_min3.4687487726602257
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.20333333333333625
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5499205258706232, "sim_physics": 0.05848021348317464, "survival_time": 14.950000000000076, "driven_lanedir": 3.4687487726602257, "sim_render-ego": 0.007266223430633545, "in-drivable-lane": 0, "agent_compute-ego": 0.02901224692662557, "deviation-heading": 2.7576416443014273, "set_robot_commands": 0.005228614012400309, "deviation-center-line": 0.6579523311834499, "driven_lanedir_consec": 3.4687487726602257, "sim_compute_sim_state": 0.0030873751640319823, "sim_compute_performance-ego": 0.004255736668904622, "sim_compute_robot_state-ego": 0.005207095940907796}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.221673437968647, "sim_physics": 0.05522568066914876, "survival_time": 14.950000000000076, "driven_lanedir": 4.137548265916124, "sim_render-ego": 0.007221084435780843, "in-drivable-lane": 0, "agent_compute-ego": 0.027640153566996256, "deviation-heading": 2.6806228942094656, "set_robot_commands": 0.005080935955047608, "deviation-center-line": 0.7447394129860716, "driven_lanedir_consec": 4.137548265916124, "sim_compute_sim_state": 0.0029575324058532717, "sim_compute_performance-ego": 0.004094170729319255, "sim_compute_robot_state-ego": 0.00509289026260376}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.598307273363383, "sim_physics": 0.058045272827148435, "survival_time": 14.950000000000076, "driven_lanedir": 5.549838967797342, "sim_render-ego": 0.007176221211751302, "in-drivable-lane": 0, "agent_compute-ego": 0.02758785645167033, "deviation-heading": 1.7554938956026542, "set_robot_commands": 0.005134081840515137, "deviation-center-line": 0.769757252542064, "driven_lanedir_consec": 5.549838967797342, "sim_compute_sim_state": 0.0029842154184977214, "sim_compute_performance-ego": 0.0040701349576314294, "sim_compute_robot_state-ego": 0.005101683139801025}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.735978494009785, "sim_physics": 0.05495833794275919, "survival_time": 14.950000000000076, "driven_lanedir": 4.6482655096550465, "sim_render-ego": 0.007188927332560221, "in-drivable-lane": 0, "agent_compute-ego": 0.028743953704833985, "deviation-heading": 2.6871743608562055, "set_robot_commands": 0.0050859506924947106, "deviation-center-line": 0.696749742832282, "driven_lanedir_consec": 4.6482655096550465, "sim_compute_sim_state": 0.0030014642079671224, "sim_compute_performance-ego": 0.00410120964050293, "sim_compute_robot_state-ego": 0.005130230585734049}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.618729112639179, "sim_physics": 0.057133160432179766, "survival_time": 14.950000000000076, "driven_lanedir": 4.540835317152483, "sim_render-ego": 0.007186839580535889, "in-drivable-lane": 0, "agent_compute-ego": 0.02799197753270467, "deviation-heading": 2.482742521676227, "set_robot_commands": 0.0051222705841064455, "deviation-center-line": 0.6512188538610738, "driven_lanedir_consec": 4.540835317152483, "sim_compute_sim_state": 0.0030076018969217937, "sim_compute_performance-ego": 0.004139456748962402, "sim_compute_robot_state-ego": 0.005193798542022705}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.664393761668556, "sim_physics": 0.0560070546468099, "survival_time": 14.950000000000076, "driven_lanedir": 3.5684775916713978, "sim_render-ego": 0.00714527686436971, "in-drivable-lane": 0, "agent_compute-ego": 0.02792022705078125, "deviation-heading": 2.9567602530826043, "set_robot_commands": 0.005063407421112061, "deviation-center-line": 0.7784664498552417, "driven_lanedir_consec": 3.5684775916713978, "sim_compute_sim_state": 0.002974966367085775, "sim_compute_performance-ego": 0.004078059991200765, "sim_compute_robot_state-ego": 0.00508618434270223}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.979559732846017, "sim_physics": 0.057431960105896, "survival_time": 14.950000000000076, "driven_lanedir": 4.5283145324088165, "sim_render-ego": 0.007176798184712728, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.027807137966156005, "deviation-heading": 3.022329317705002, "set_robot_commands": 0.0050577561060587565, "deviation-center-line": 0.7004896998484923, "driven_lanedir_consec": 4.5283145324088165, "sim_compute_sim_state": 0.0030057557423909505, "sim_compute_performance-ego": 0.004142121473948161, "sim_compute_robot_state-ego": 0.005142513910929362}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.894413502485549, "sim_physics": 0.0555054759979248, "survival_time": 14.950000000000076, "driven_lanedir": 3.825488373943767, "sim_render-ego": 0.007870307763417562, "in-drivable-lane": 0, "agent_compute-ego": 0.027783144315083823, "deviation-heading": 2.550204442585227, "set_robot_commands": 0.005117990175882975, "deviation-center-line": 0.6922738555868765, "driven_lanedir_consec": 3.825488373943767, "sim_compute_sim_state": 0.002980491320292155, "sim_compute_performance-ego": 0.004113332430521647, "sim_compute_robot_state-ego": 0.005149170557657878}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.181162666368815, "sim_physics": 0.05709746917088827, "survival_time": 14.950000000000076, "driven_lanedir": 4.089131758090776, "sim_render-ego": 0.007204953829447428, "in-drivable-lane": 0, "agent_compute-ego": 0.02788630644480387, "deviation-heading": 2.694122508768428, "set_robot_commands": 0.005110523700714111, "deviation-center-line": 0.9851130219720676, "driven_lanedir_consec": 4.089131758090776, "sim_compute_sim_state": 0.002997279167175293, "sim_compute_performance-ego": 0.004133721987406413, "sim_compute_robot_state-ego": 0.005145217577616374}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.838301424111702, "sim_physics": 0.05656814336776733, "survival_time": 14.950000000000076, "driven_lanedir": 3.7817273990564217, "sim_render-ego": 0.0071645871798197425, "in-drivable-lane": 0, "agent_compute-ego": 0.027799407641092937, "deviation-heading": 2.376639380058307, "set_robot_commands": 0.005059503714243571, "deviation-center-line": 0.6353541153369346, "driven_lanedir_consec": 3.7817273990564217, "sim_compute_sim_state": 0.002989382743835449, "sim_compute_performance-ego": 0.0041418186823527015, "sim_compute_robot_state-ego": 0.005112656752268473}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 5.474836364242119, "sim_physics": 0.0564789875348409, "survival_time": 14.950000000000076, "driven_lanedir": 5.425518870715865, "sim_render-ego": 0.00719592014948527, "in-drivable-lane": 0, "agent_compute-ego": 0.02770699739456177, "deviation-heading": 1.6576926547523405, "set_robot_commands": 0.00506642738978068, "deviation-center-line": 0.7546308562771951, "driven_lanedir_consec": 5.425518870715865, "sim_compute_sim_state": 0.0029714568456013996, "sim_compute_performance-ego": 0.004104621410369873, "sim_compute_robot_state-ego": 0.0051423088709513344}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.011707267585006, "sim_physics": 0.05578977743784586, "survival_time": 14.950000000000076, "driven_lanedir": 3.661015301880532, "sim_render-ego": 0.007171773910522461, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.027889730135599772, "deviation-heading": 3.587016797829913, "set_robot_commands": 0.005081679026285807, "deviation-center-line": 0.8564980611407192, "driven_lanedir_consec": 3.661015301880532, "sim_compute_sim_state": 0.0029761179288228354, "sim_compute_performance-ego": 0.004068722724914551, "sim_compute_robot_state-ego": 0.005091956456502279}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.433246483155833, "sim_physics": 0.05476092576980591, "survival_time": 14.950000000000076, "driven_lanedir": 4.2081047437254036, "sim_render-ego": 0.007149712244669596, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.02760229508082072, "deviation-heading": 2.6863865920240535, "set_robot_commands": 0.005099131266276042, "deviation-center-line": 0.9920226997942804, "driven_lanedir_consec": 4.2081047437254036, "sim_compute_sim_state": 0.002978718280792236, "sim_compute_performance-ego": 0.004090125560760498, "sim_compute_robot_state-ego": 0.005101277033487956}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.760397894344304, "sim_physics": 0.05697434902191162, "survival_time": 14.950000000000076, "driven_lanedir": 4.695884574832615, "sim_render-ego": 0.007162017027537028, "in-drivable-lane": 0, "agent_compute-ego": 0.02791142463684082, "deviation-heading": 2.2759268375136092, "set_robot_commands": 0.005079495112101237, "deviation-center-line": 0.7581548755809413, "driven_lanedir_consec": 4.695884574832615, "sim_compute_sim_state": 0.0029755433400472007, "sim_compute_performance-ego": 0.004070307413736979, "sim_compute_robot_state-ego": 0.005109365781148275}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.6161790099323845, "sim_physics": 0.05701707522074381, "survival_time": 14.950000000000076, "driven_lanedir": 4.541374877558184, "sim_render-ego": 0.007110110918680827, "in-drivable-lane": 0, "agent_compute-ego": 0.027787901560465497, "deviation-heading": 2.3871573709319738, "set_robot_commands": 0.005065274238586426, "deviation-center-line": 0.7007057443654403, "driven_lanedir_consec": 4.541374877558184, "sim_compute_sim_state": 0.0029667838414510093, "sim_compute_performance-ego": 0.00407072385152181, "sim_compute_robot_state-ego": 0.005060441493988037}}
set_robot_commands_max0.005228614012400309
set_robot_commands_mean0.005096869415707058
set_robot_commands_median0.005081679026285807
set_robot_commands_min0.0050577561060587565
sim_compute_performance-ego_max0.004255736668904622
sim_compute_performance-ego_mean0.0041116176181369354
sim_compute_performance-ego_median0.00410120964050293
sim_compute_performance-ego_min0.004068722724914551
sim_compute_robot_state-ego_max0.005207095940907796
sim_compute_robot_state-ego_mean0.005124452749888101
sim_compute_robot_state-ego_median0.005112656752268473
sim_compute_robot_state-ego_min0.005060441493988037
sim_compute_sim_state_max0.0030873751640319823
sim_compute_sim_state_mean0.0029903123113844132
sim_compute_sim_state_median0.002980491320292155
sim_compute_sim_state_min0.0029575324058532717
sim_physics_max0.05848021348317464
sim_physics_mean0.056498258908589685
sim_physics_median0.05656814336776733
sim_physics_min0.05476092576980591
sim_render-ego_max0.007870307763417562
sim_render-ego_mean0.007226050270928277
sim_render-ego_median0.007176798184712728
sim_render-ego_min0.007110110918680827
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
286625469Frank (Chude) Qian 🇨🇦2019-12-04|FrankNet|Frozen1aido3-LF-sim-testingstep1-simulationabortednoip-172-31-35-218-104900:09:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
286255460Mikita Sazanovich 🇷🇺chameleon-4aido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:13:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.507530268068205
survival_time_median14.950000000000076
deviation-center-line_median0.5136935101511859
in-drivable-lane_median0


other stats
agent_compute-ego_max0.21338943958282472
agent_compute-ego_mean0.20862544571944855
agent_compute-ego_median0.2110540270805359
agent_compute-ego_min0.2022347595090064
deviation-center-line_max0.8875754984575618
deviation-center-line_mean0.6070871214703248
deviation-center-line_min0.4833937112698863
deviation-heading_max4.389242328773915
deviation-heading_mean3.2857750746930767
deviation-heading_median3.18471620678984
deviation-heading_min2.5655176258348455
driven_any_max4.3432281599258395
driven_any_mean3.596920667862551
driven_any_median3.721473816832072
driven_any_min2.72155633864179
driven_lanedir_consec_max4.249711284245816
driven_lanedir_consec_mean3.435115710486427
driven_lanedir_consec_min2.5783292251774927
driven_lanedir_max4.249711284245816
driven_lanedir_mean3.435115710486427
driven_lanedir_median3.507530268068205
driven_lanedir_min2.5783292251774927
in-drivable-lane_max0.549999999999998
in-drivable-lane_mean0.1099999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.721473816832072, "sim_physics": 0.07348000526428222, "survival_time": 14.950000000000076, "driven_lanedir": 3.507530268068205, "sim_render-ego": 0.009107505480448403, "in-drivable-lane": 0, "agent_compute-ego": 0.20442296822865805, "deviation-heading": 4.389242328773915, "set_robot_commands": 0.007081952095031738, "deviation-center-line": 0.8875754984575618, "driven_lanedir_consec": 3.507530268068205, "sim_compute_sim_state": 0.003797547022501628, "sim_compute_performance-ego": 0.005424687067667643, "sim_compute_robot_state-ego": 0.006641620794932047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.72155633864179, "sim_physics": 0.07004674349989846, "survival_time": 10.700000000000015, "driven_lanedir": 2.5783292251774927, "sim_render-ego": 0.00930022970538273, "in-drivable-lane": 0, "agent_compute-ego": 0.2022347595090064, "deviation-heading": 2.8627434291481744, "set_robot_commands": 0.007003839884962991, "deviation-center-line": 0.4833937112698863, "driven_lanedir_consec": 2.5783292251774927, "sim_compute_sim_state": 0.0038257391653328298, "sim_compute_performance-ego": 0.005345448155269445, "sim_compute_robot_state-ego": 0.006624181693959459}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3432281599258395, "sim_physics": 0.07480762004852295, "survival_time": 14.950000000000076, "driven_lanedir": 4.249711284245816, "sim_render-ego": 0.009188786347707112, "in-drivable-lane": 0, "agent_compute-ego": 0.21338943958282472, "deviation-heading": 2.5655176258348455, "set_robot_commands": 0.007228711446126302, "deviation-center-line": 0.6432788390834387, "driven_lanedir_consec": 4.249711284245816, "sim_compute_sim_state": 0.003841556708017985, "sim_compute_performance-ego": 0.005283341407775879, "sim_compute_robot_state-ego": 0.006595535278320313}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.754511085382949, "sim_physics": 0.07224956512451172, "survival_time": 14.950000000000076, "driven_lanedir": 3.5567395835169955, "sim_render-ego": 0.009410285949707033, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.21202603419621785, "deviation-heading": 3.18471620678984, "set_robot_commands": 0.00748716672261556, "deviation-center-line": 0.5136935101511859, "driven_lanedir_consec": 3.5567395835169955, "sim_compute_sim_state": 0.003985198338826498, "sim_compute_performance-ego": 0.005603070259094238, "sim_compute_robot_state-ego": 0.006921463807423909}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.443833938530105, "sim_physics": 0.07692651828130086, "survival_time": 14.950000000000076, "driven_lanedir": 3.2832681914236286, "sim_render-ego": 0.009423831303914387, "in-drivable-lane": 0, "agent_compute-ego": 0.2110540270805359, "deviation-heading": 3.4266557829186093, "set_robot_commands": 0.007581268946329753, "deviation-center-line": 0.5074940483895517, "driven_lanedir_consec": 3.2832681914236286, "sim_compute_sim_state": 0.0040569098790486655, "sim_compute_performance-ego": 0.005541079044342041, "sim_compute_robot_state-ego": 0.00688504695892334}}
set_robot_commands_max0.007581268946329753
set_robot_commands_mean0.00727658781901327
set_robot_commands_median0.007228711446126302
set_robot_commands_min0.007003839884962991
sim_compute_performance-ego_max0.005603070259094238
sim_compute_performance-ego_mean0.005439525186829849
sim_compute_performance-ego_median0.005424687067667643
sim_compute_performance-ego_min0.005283341407775879
sim_compute_robot_state-ego_max0.006921463807423909
sim_compute_robot_state-ego_mean0.006733569706711814
sim_compute_robot_state-ego_median0.006641620794932047
sim_compute_robot_state-ego_min0.006595535278320313
sim_compute_sim_state_max0.0040569098790486655
sim_compute_sim_state_mean0.003901390222745521
sim_compute_sim_state_median0.003841556708017985
sim_compute_sim_state_min0.003797547022501628
sim_physics_max0.07692651828130086
sim_physics_mean0.07350209044370325
sim_physics_median0.07348000526428222
sim_physics_min0.07004674349989846
sim_render-ego_max0.009423831303914387
sim_render-ego_mean0.009286127757431931
sim_render-ego_median0.00930022970538273
sim_render-ego_min0.009107505480448403
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.100000000000064
survival_time_min10.700000000000015
No reset possible
285774453Bea Baselines 🐤challenge-aido_LF-baseline-duckietownaido3-LF-real-validationeval2-videossuccessnoip-172-31-35-218-104900:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
285225434Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0269352243833523
survival_time_median9.950000000000006
deviation-center-line_median0.49486397693805745
in-drivable-lane_median0.7499999999999973


other stats
agent_compute-ego_max0.017160988989330474
agent_compute-ego_mean0.016392652935145847
agent_compute-ego_median0.016294721382946225
agent_compute-ego_min0.0158785613377889
deviation-center-line_max1.0976140273366135
deviation-center-line_mean0.4947871692189401
deviation-center-line_min0.10959305465005006
deviation-heading_max4.183116857481753
deviation-heading_mean2.2619557272592212
deviation-heading_median1.8142901233478308
deviation-heading_min1.0857619967849337
driven_any_max4.0852306003970345
driven_any_mean2.2238982466347292
driven_any_median2.687717468317792
driven_any_min0.5075752173934217
driven_lanedir_consec_max3.8700188839287826
driven_lanedir_consec_mean1.7736612149501858
driven_lanedir_consec_min0.19160633418095577
driven_lanedir_max3.8700188839287826
driven_lanedir_mean1.7851254131663885
driven_lanedir_median2.0269352243833523
driven_lanedir_min0.2403706852194147
in-drivable-lane_max2.4000000000000306
in-drivable-lane_mean1.0500000000000105
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0673076623663764, "sim_physics": 0.05893791573388236, "survival_time": 4.199999999999993, "driven_lanedir": 0.6903272360139652, "sim_render-ego": 0.00749078251066662, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.017160988989330474, "deviation-heading": 1.6597228059674063, "set_robot_commands": 0.008562176000504266, "deviation-center-line": 0.1804423789246719, "driven_lanedir_consec": 0.6817705959714107, "sim_compute_sim_state": 0.0036451475960867746, "sim_compute_performance-ego": 0.004428974219730922, "sim_compute_robot_state-ego": 0.0052013085001990905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.687717468317792, "sim_physics": 0.05730287154116223, "survival_time": 9.950000000000006, "driven_lanedir": 2.097975036286429, "sim_render-ego": 0.007462119337302357, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.016294721382946225, "deviation-heading": 2.566886852714182, "set_robot_commands": 0.007693084640119543, "deviation-center-line": 0.49486397693805745, "driven_lanedir_consec": 2.097975036286429, "sim_compute_sim_state": 0.003474854943740308, "sim_compute_performance-ego": 0.004251852706449116, "sim_compute_robot_state-ego": 0.00528618558567373}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.0852306003970345, "sim_physics": 0.05565467993418376, "survival_time": 14.950000000000076, "driven_lanedir": 3.8700188839287826, "sim_render-ego": 0.007334412733713786, "in-drivable-lane": 0, "agent_compute-ego": 0.0158785613377889, "deviation-heading": 4.183116857481753, "set_robot_commands": 0.007264787356058756, "deviation-center-line": 1.0976140273366135, "driven_lanedir_consec": 3.8700188839287826, "sim_compute_sim_state": 0.0033837056159973147, "sim_compute_performance-ego": 0.004202009836832683, "sim_compute_robot_state-ego": 0.005223512649536133}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5075752173934217, "sim_physics": 0.06096713487492051, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2403706852194147, "sim_render-ego": 0.007405391959256904, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.016535908676857173, "deviation-heading": 1.0857619967849337, "set_robot_commands": 0.007407254950944768, "deviation-center-line": 0.10959305465005006, "driven_lanedir_consec": 0.19160633418095577, "sim_compute_sim_state": 0.003628963647886764, "sim_compute_performance-ego": 0.004180514535238576, "sim_compute_robot_state-ego": 0.005143365194631177}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7716602846990206, "sim_physics": 0.05440821415040551, "survival_time": 10.25000000000001, "driven_lanedir": 2.0269352243833523, "sim_render-ego": 0.00733908095010897, "in-drivable-lane": 2.4000000000000306, "agent_compute-ego": 0.01609308428880645, "deviation-heading": 1.8142901233478308, "set_robot_commands": 0.007533446753897318, "deviation-center-line": 0.5914224082453073, "driven_lanedir_consec": 2.0269352243833523, "sim_compute_sim_state": 0.003337969431063024, "sim_compute_performance-ego": 0.0042136483076142105, "sim_compute_robot_state-ego": 0.0052195642052627195}}
set_robot_commands_max0.008562176000504266
set_robot_commands_mean0.007692149940304931
set_robot_commands_median0.007533446753897318
set_robot_commands_min0.007264787356058756
sim_compute_performance-ego_max0.004428974219730922
sim_compute_performance-ego_mean0.004255399921173101
sim_compute_performance-ego_median0.0042136483076142105
sim_compute_performance-ego_min0.004180514535238576
sim_compute_robot_state-ego_max0.00528618558567373
sim_compute_robot_state-ego_mean0.005214787227060569
sim_compute_robot_state-ego_median0.0052195642052627195
sim_compute_robot_state-ego_min0.005143365194631177
sim_compute_sim_state_max0.0036451475960867746
sim_compute_sim_state_mean0.0034941282469548368
sim_compute_sim_state_median0.003474854943740308
sim_compute_sim_state_min0.003337969431063024
sim_physics_max0.06096713487492051
sim_physics_mean0.05745416324691087
sim_physics_median0.05730287154116223
sim_physics_min0.05440821415040551
sim_render-ego_max0.00749078251066662
sim_render-ego_mean0.007406357498209728
sim_render-ego_median0.007405391959256904
sim_render-ego_min0.007334412733713786
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.300000000000017
survival_time_min2.1500000000000004
No reset possible
285135427Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.85751784204025
survival_time_median14.950000000000076
deviation-center-line_median0.5952730920970035
in-drivable-lane_median0.7500000000000107


other stats
agent_compute-ego_max0.016796971956888836
agent_compute-ego_mean0.01625659735997518
agent_compute-ego_median0.01624339501063029
agent_compute-ego_min0.015970335006713868
deviation-center-line_max0.9304634721347164
deviation-center-line_mean0.7093999979298555
deviation-center-line_min0.5604049820880511
deviation-heading_max7.005685102404091
deviation-heading_mean4.29334399183648
deviation-heading_median3.428765344007435
deviation-heading_min2.992239282553296
driven_any_max3.746901953173968
driven_any_mean3.149737126650765
driven_any_median3.2845262472564714
driven_any_min1.9972322694166935
driven_lanedir_consec_max3.6346332443090006
driven_lanedir_consec_mean2.613898593890345
driven_lanedir_consec_min1.270602299638833
driven_lanedir_max3.6346332443090006
driven_lanedir_mean2.891653640218318
driven_lanedir_median2.883406696568631
driven_lanedir_min1.7144257447944853
in-drivable-lane_max3.250000000000016
in-drivable-lane_mean1.2500000000000062
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1484835348125033, "sim_physics": 0.058890101114908854, "survival_time": 14.950000000000076, "driven_lanedir": 2.883406696568631, "sim_render-ego": 0.007258435885111491, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.016796971956888836, "deviation-heading": 3.1818305588983797, "set_robot_commands": 0.007685770193735758, "deviation-center-line": 0.5604049820880511, "driven_lanedir_consec": 2.883406696568631, "sim_compute_sim_state": 0.003746930758158366, "sim_compute_performance-ego": 0.004289302825927734, "sim_compute_robot_state-ego": 0.0052079296112060545}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.746901953173968, "sim_physics": 0.0593207057317098, "survival_time": 14.950000000000076, "driven_lanedir": 3.6346332443090006, "sim_render-ego": 0.00731762170791626, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.016299722194671632, "deviation-heading": 2.992239282553296, "set_robot_commands": 0.007613661289215088, "deviation-center-line": 0.5783574977228839, "driven_lanedir_consec": 3.6346332443090006, "sim_compute_sim_state": 0.003659489154815674, "sim_compute_performance-ego": 0.004209416707356771, "sim_compute_robot_state-ego": 0.005221985181172689}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2845262472564714, "sim_physics": 0.058424564202626546, "survival_time": 14.950000000000076, "driven_lanedir": 2.85751784204025, "sim_render-ego": 0.007342120011647542, "in-drivable-lane": 3.250000000000016, "agent_compute-ego": 0.015972562630971274, "deviation-heading": 3.428765344007435, "set_robot_commands": 0.0074459099769592285, "deviation-center-line": 0.5952730920970035, "driven_lanedir_consec": 2.85751784204025, "sim_compute_sim_state": 0.003612907727559407, "sim_compute_performance-ego": 0.00418816884358724, "sim_compute_robot_state-ego": 0.005192744731903076}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9972322694166935, "sim_physics": 0.05709597587585449, "survival_time": 14.950000000000076, "driven_lanedir": 1.7144257447944853, "sim_render-ego": 0.007376313209533691, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.015970335006713868, "deviation-heading": 7.005685102404091, "set_robot_commands": 0.007321675618489583, "deviation-center-line": 0.8825009456066224, "driven_lanedir_consec": 1.270602299638833, "sim_compute_sim_state": 0.003710778554280599, "sim_compute_performance-ego": 0.004240563710530599, "sim_compute_robot_state-ego": 0.0052496385574340824}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.571541628594189, "sim_physics": 0.057462648550669355, "survival_time": 14.950000000000076, "driven_lanedir": 3.3682846733792244, "sim_render-ego": 0.007376170158386231, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.01624339501063029, "deviation-heading": 4.858199671319198, "set_robot_commands": 0.007525334358215332, "deviation-center-line": 0.9304634721347164, "driven_lanedir_consec": 2.423332886895011, "sim_compute_sim_state": 0.0037467559178670246, "sim_compute_performance-ego": 0.004210092226664225, "sim_compute_robot_state-ego": 0.005209534962972005}}
set_robot_commands_max0.007685770193735758
set_robot_commands_mean0.007518470287322998
set_robot_commands_median0.007525334358215332
set_robot_commands_min0.007321675618489583
sim_compute_performance-ego_max0.004289302825927734
sim_compute_performance-ego_mean0.0042275088628133135
sim_compute_performance-ego_median0.004210092226664225
sim_compute_performance-ego_min0.00418816884358724
sim_compute_robot_state-ego_max0.0052496385574340824
sim_compute_robot_state-ego_mean0.005216366608937582
sim_compute_robot_state-ego_median0.005209534962972005
sim_compute_robot_state-ego_min0.005192744731903076
sim_compute_sim_state_max0.003746930758158366
sim_compute_sim_state_mean0.003695372422536214
sim_compute_sim_state_median0.003710778554280599
sim_compute_sim_state_min0.003612907727559407
sim_physics_max0.0593207057317098
sim_physics_mean0.058238799095153816
sim_physics_median0.058424564202626546
sim_physics_min0.05709597587585449
sim_render-ego_max0.007376313209533691
sim_render-ego_mean0.007334132194519043
sim_render-ego_median0.007342120011647542
sim_render-ego_min0.007258435885111491
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
283865353Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8876366989807996
survival_time_median10.650000000000016
deviation-center-line_median0.6400219136506118
in-drivable-lane_median2.0000000000000018


other stats
agent_compute-ego_max0.04960352635523032
agent_compute-ego_mean0.04830421451721397
agent_compute-ego_median0.04798596302668254
agent_compute-ego_min0.04747023940646033
deviation-center-line_max0.9849983598727822
deviation-center-line_mean0.6039176169123125
deviation-center-line_min0.24703118911178748
deviation-heading_max4.8487264862650115
deviation-heading_mean2.237946413535608
deviation-heading_median1.5451433413051745
deviation-heading_min0.7558308845904599
driven_any_max5.508882944758788
driven_any_mean3.2146167706300552
driven_any_median2.928497893109543
driven_any_min1.6282754197585154
driven_lanedir_consec_max4.703342349441767
driven_lanedir_consec_mean2.319810115372829
driven_lanedir_consec_min1.302097789769436
driven_lanedir_max4.703342349441767
driven_lanedir_mean2.733161495537403
driven_lanedir_median2.6032043512891443
driven_lanedir_min1.302097789769436
in-drivable-lane_max5.0500000000000105
in-drivable-lane_mean2.550000000000002
in-drivable-lane_min1.399999999999995
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.778704942549575, "sim_physics": 0.11963710149129232, "survival_time": 14.950000000000076, "driven_lanedir": 3.169526288205868, "sim_render-ego": 0.013432786464691164, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.04787624518076579, "deviation-heading": 4.8487264862650115, "set_robot_commands": 0.01111944595972697, "deviation-center-line": 0.9849983598727822, "driven_lanedir_consec": 2.2777974713034808, "sim_compute_sim_state": 0.005601553122202555, "sim_compute_performance-ego": 0.008364278475443522, "sim_compute_robot_state-ego": 0.010005226135253906}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2287226529738535, "sim_physics": 0.12587655496876143, "survival_time": 8.549999999999986, "driven_lanedir": 1.8876366989807996, "sim_render-ego": 0.014617207454659088, "in-drivable-lane": 2.0000000000000018, "agent_compute-ego": 0.04960352635523032, "deviation-heading": 0.9986606574434688, "set_robot_commands": 0.01214398417556495, "deviation-center-line": 0.49862802083218066, "driven_lanedir_consec": 1.8876366989807996, "sim_compute_sim_state": 0.0059508705696864434, "sim_compute_performance-ego": 0.00877713459974144, "sim_compute_robot_state-ego": 0.010512322710271468}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.508882944758788, "sim_physics": 0.11420974651972451, "survival_time": 14.950000000000076, "driven_lanedir": 4.703342349441767, "sim_render-ego": 0.013296396732330322, "in-drivable-lane": 5.0500000000000105, "agent_compute-ego": 0.04798596302668254, "deviation-heading": 1.5451433413051745, "set_robot_commands": 0.010054914951324464, "deviation-center-line": 0.6400219136506118, "driven_lanedir_consec": 4.703342349441767, "sim_compute_sim_state": 0.0053370467821757, "sim_compute_performance-ego": 0.007931419213612874, "sim_compute_robot_state-ego": 0.009380587736765544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6282754197585154, "sim_physics": 0.10994841127979511, "survival_time": 4.899999999999991, "driven_lanedir": 1.302097789769436, "sim_render-ego": 0.01374346382763921, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.0485850986169309, "deviation-heading": 0.7558308845904599, "set_robot_commands": 0.009904664389941156, "deviation-center-line": 0.24703118911178748, "driven_lanedir_consec": 1.302097789769436, "sim_compute_sim_state": 0.005488726557517538, "sim_compute_performance-ego": 0.007899839050915777, "sim_compute_robot_state-ego": 0.00911722621139215}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.928497893109543, "sim_physics": 0.1210241586389676, "survival_time": 10.650000000000016, "driven_lanedir": 2.6032043512891443, "sim_render-ego": 0.013665883194113002, "in-drivable-lane": 1.7000000000000135, "agent_compute-ego": 0.04747023940646033, "deviation-heading": 3.0413706980739272, "set_robot_commands": 0.01113680382849465, "deviation-center-line": 0.6489086010942003, "driven_lanedir_consec": 1.428176267368661, "sim_compute_sim_state": 0.005629836113799905, "sim_compute_performance-ego": 0.008266183691965023, "sim_compute_robot_state-ego": 0.00977699185760928}}
set_robot_commands_max0.01214398417556495
set_robot_commands_mean0.010871962661010436
set_robot_commands_median0.01111944595972697
set_robot_commands_min0.009904664389941156
sim_compute_performance-ego_max0.00877713459974144
sim_compute_performance-ego_mean0.008247771006335728
sim_compute_performance-ego_median0.008266183691965023
sim_compute_performance-ego_min0.007899839050915777
sim_compute_robot_state-ego_max0.010512322710271468
sim_compute_robot_state-ego_mean0.00975847093025847
sim_compute_robot_state-ego_median0.00977699185760928
sim_compute_robot_state-ego_min0.00911722621139215
sim_compute_sim_state_max0.0059508705696864434
sim_compute_sim_state_mean0.005601606629076428
sim_compute_sim_state_median0.005601553122202555
sim_compute_sim_state_min0.0053370467821757
sim_physics_max0.12587655496876143
sim_physics_mean0.1181391945797082
sim_physics_median0.11963710149129232
sim_physics_min0.10994841127979511
sim_render-ego_max0.014617207454659088
sim_render-ego_mean0.01375114753468656
sim_render-ego_median0.013665883194113002
sim_render-ego_min0.013296396732330322
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.800000000000033
survival_time_min4.899999999999991
No reset possible
283665340Charles Cossette 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4017852831207365
survival_time_median14.950000000000076
deviation-center-line_median0.6817383568596694
in-drivable-lane_median1.499999999999995


other stats
agent_compute-ego_max0.03767419179280599
agent_compute-ego_mean0.03580768821905325
agent_compute-ego_median0.03587885697682699
agent_compute-ego_min0.03359970410664876
deviation-center-line_max0.8102716840007341
deviation-center-line_mean0.5799415459301687
deviation-center-line_min0.26761249044571017
deviation-heading_max2.324785008218865
deviation-heading_mean1.4309738633804538
deviation-heading_median1.7522203128757663
deviation-heading_min0.5270015798916097
driven_any_max4.246350186380165
driven_any_mean2.8033493828303184
driven_any_median2.8957511648992034
driven_any_min1.0084088037942176
driven_lanedir_consec_max3.3627536121073676
driven_lanedir_consec_mean2.2702516025898634
driven_lanedir_consec_min0.99386371079362
driven_lanedir_max3.3627536121073676
driven_lanedir_mean2.2702516025898634
driven_lanedir_median2.4017852831207365
driven_lanedir_min0.99386371079362
in-drivable-lane_max4.7500000000000675
in-drivable-lane_mean2.1500000000000163
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8957511648992034, "sim_physics": 0.05989299058914185, "survival_time": 14.950000000000076, "driven_lanedir": 2.4017852831207365, "sim_render-ego": 0.007476696968078613, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.03359970410664876, "deviation-heading": 2.324785008218865, "set_robot_commands": 0.00564467986424764, "deviation-center-line": 0.8102716840007341, "driven_lanedir_consec": 2.4017852831207365, "sim_compute_sim_state": 0.0033527795473734536, "sim_compute_performance-ego": 0.00437143882115682, "sim_compute_robot_state-ego": 0.00528552770614624}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6504039318885484, "sim_physics": 0.059177065754795935, "survival_time": 5.549999999999988, "driven_lanedir": 1.6372270690395274, "sim_render-ego": 0.009728017154040638, "in-drivable-lane": 0, "agent_compute-ego": 0.03626091630609186, "deviation-heading": 0.6473153757550411, "set_robot_commands": 0.005265081250989759, "deviation-center-line": 0.42756489134923054, "driven_lanedir_consec": 1.6372270690395274, "sim_compute_sim_state": 0.003156694206031593, "sim_compute_performance-ego": 0.004232385137059667, "sim_compute_robot_state-ego": 0.005228369085638372}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.246350186380165, "sim_physics": 0.05585335890452067, "survival_time": 14.950000000000076, "driven_lanedir": 3.3627536121073676, "sim_render-ego": 0.007360212802886963, "in-drivable-lane": 4.500000000000019, "agent_compute-ego": 0.03562477191289266, "deviation-heading": 1.9035470401609875, "set_robot_commands": 0.005195732911427816, "deviation-center-line": 0.6817383568596694, "driven_lanedir_consec": 3.3627536121073676, "sim_compute_sim_state": 0.0031394219398498536, "sim_compute_performance-ego": 0.004217522144317627, "sim_compute_robot_state-ego": 0.005202701886494954}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0084088037942176, "sim_physics": 0.057510356903076175, "survival_time": 3.7499999999999942, "driven_lanedir": 0.99386371079362, "sim_render-ego": 0.007524690628051758, "in-drivable-lane": 0, "agent_compute-ego": 0.03767419179280599, "deviation-heading": 0.5270015798916097, "set_robot_commands": 0.005250031153361002, "deviation-center-line": 0.26761249044571017, "driven_lanedir_consec": 0.99386371079362, "sim_compute_sim_state": 0.0031362533569335937, "sim_compute_performance-ego": 0.004227797190348308, "sim_compute_robot_state-ego": 0.005214576721191406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.215832827189457, "sim_physics": 0.05750757137934367, "survival_time": 14.950000000000076, "driven_lanedir": 2.9556283378880654, "sim_render-ego": 0.007480583985646566, "in-drivable-lane": 4.7500000000000675, "agent_compute-ego": 0.03587885697682699, "deviation-heading": 1.7522203128757663, "set_robot_commands": 0.005231111049652099, "deviation-center-line": 0.7125203069954988, "driven_lanedir_consec": 2.9556283378880654, "sim_compute_sim_state": 0.003161180814107259, "sim_compute_performance-ego": 0.004249734083811442, "sim_compute_robot_state-ego": 0.005243669350941976}}
set_robot_commands_max0.00564467986424764
set_robot_commands_mean0.0053173272459356635
set_robot_commands_median0.005250031153361002
set_robot_commands_min0.005195732911427816
sim_compute_performance-ego_max0.00437143882115682
sim_compute_performance-ego_mean0.004259775475338773
sim_compute_performance-ego_median0.004232385137059667
sim_compute_performance-ego_min0.004217522144317627
sim_compute_robot_state-ego_max0.00528552770614624
sim_compute_robot_state-ego_mean0.00523496895008259
sim_compute_robot_state-ego_median0.005228369085638372
sim_compute_robot_state-ego_min0.005202701886494954
sim_compute_sim_state_max0.0033527795473734536
sim_compute_sim_state_mean0.003189265972859151
sim_compute_sim_state_median0.003156694206031593
sim_compute_sim_state_min0.0031362533569335937
sim_physics_max0.05989299058914185
sim_physics_mean0.05798826870617566
sim_physics_median0.057510356903076175
sim_physics_min0.05585335890452067
sim_render-ego_max0.009728017154040638
sim_render-ego_mean0.007914040307740908
sim_render-ego_median0.007480583985646566
sim_render-ego_min0.007360212802886963
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.830000000000044
survival_time_min3.7499999999999942
No reset possible
283195314Soumye Singhal 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.528336672579883
survival_time_median2.1500000000000004
deviation-center-line_median0.13303232267564524
in-drivable-lane_median0


other stats
agent_compute-ego_max0.022206766660823374
agent_compute-ego_mean0.01836858415059499
agent_compute-ego_median0.016693615331882385
agent_compute-ego_min0.016189965936872695
deviation-center-line_max0.22827847559326556
deviation-center-line_mean0.147774398708551
deviation-center-line_min0.10432452043099062
deviation-heading_max1.1395721880547611
deviation-heading_mean1.0046970438371476
deviation-heading_median1.034717515150396
deviation-heading_min0.8269342147317074
driven_any_max1.135847150464025
driven_any_mean0.7952603188605247
driven_any_median0.6288851790884044
driven_any_min0.5773959625384236
driven_lanedir_consec_max1.0569866251228868
driven_lanedir_consec_mean0.6101921121474488
driven_lanedir_consec_min0.43796157244749023
driven_lanedir_max1.0569866251228868
driven_lanedir_mean0.6101921121474488
driven_lanedir_median0.528336672579883
driven_lanedir_min0.43796157244749023
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.20999999999999924
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5773959625384236, "sim_physics": 0.06295888016863567, "survival_time": 2.0500000000000007, "driven_lanedir": 0.43796157244749023, "sim_render-ego": 0.007616101241693264, "in-drivable-lane": 0, "agent_compute-ego": 0.016693615331882385, "deviation-heading": 1.034717515150396, "set_robot_commands": 0.007541406445386933, "deviation-center-line": 0.13303232267564524, "driven_lanedir_consec": 0.43796157244749023, "sim_compute_sim_state": 0.00393114438871058, "sim_compute_performance-ego": 0.004639608104054521, "sim_compute_robot_state-ego": 0.005407757875395984}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6072163282201495, "sim_physics": 0.061325572785877046, "survival_time": 2.1000000000000005, "driven_lanedir": 0.460120757792313, "sim_render-ego": 0.007555166880289714, "in-drivable-lane": 0, "agent_compute-ego": 0.0163750307900565, "deviation-heading": 1.1395721880547611, "set_robot_commands": 0.007119593166169666, "deviation-center-line": 0.15230688665843653, "driven_lanedir_consec": 0.460120757792313, "sim_compute_sim_state": 0.00369765077318464, "sim_compute_performance-ego": 0.004214178948175339, "sim_compute_robot_state-ego": 0.005303802944365002}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.135847150464025, "sim_physics": 0.05851110153728061, "survival_time": 3.599999999999995, "driven_lanedir": 1.0569866251228868, "sim_render-ego": 0.0075787438286675345, "in-drivable-lane": 0, "agent_compute-ego": 0.016189965936872695, "deviation-heading": 1.078482643316241, "set_robot_commands": 0.007059120469623142, "deviation-center-line": 0.22827847559326556, "driven_lanedir_consec": 1.0569866251228868, "sim_compute_sim_state": 0.00366812613275316, "sim_compute_performance-ego": 0.004248009787665473, "sim_compute_robot_state-ego": 0.005323128567801582}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0269569739916204, "sim_physics": 0.0765046603751905, "survival_time": 3.2999999999999963, "driven_lanedir": 0.5675549327946714, "sim_render-ego": 0.009506171399896795, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.020377542033339992, "deviation-heading": 0.9437786579326318, "set_robot_commands": 0.008806192513668177, "deviation-center-line": 0.1209297881844171, "driven_lanedir_consec": 0.5675549327946714, "sim_compute_sim_state": 0.004581238284255519, "sim_compute_performance-ego": 0.0050193071365356445, "sim_compute_robot_state-ego": 0.007198438499913071}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6288851790884044, "sim_physics": 0.07612461821977483, "survival_time": 2.1500000000000004, "driven_lanedir": 0.528336672579883, "sim_render-ego": 0.00963400131048158, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.022206766660823374, "deviation-heading": 0.8269342147317074, "set_robot_commands": 0.009617672410122183, "deviation-center-line": 0.10432452043099062, "driven_lanedir_consec": 0.528336672579883, "sim_compute_sim_state": 0.004415451094161632, "sim_compute_performance-ego": 0.0056287133416464165, "sim_compute_robot_state-ego": 0.006848185561424078}}
set_robot_commands_max0.009617672410122183
set_robot_commands_mean0.00802879700099402
set_robot_commands_median0.007541406445386933
set_robot_commands_min0.007059120469623142
sim_compute_performance-ego_max0.0056287133416464165
sim_compute_performance-ego_mean0.004749963463615479
sim_compute_performance-ego_median0.004639608104054521
sim_compute_performance-ego_min0.004214178948175339
sim_compute_robot_state-ego_max0.007198438499913071
sim_compute_robot_state-ego_mean0.006016262689779944
sim_compute_robot_state-ego_median0.005407757875395984
sim_compute_robot_state-ego_min0.005303802944365002
sim_compute_sim_state_max0.004581238284255519
sim_compute_sim_state_mean0.004058722134613106
sim_compute_sim_state_median0.00393114438871058
sim_compute_sim_state_min0.00366812613275316
sim_physics_max0.0765046603751905
sim_physics_mean0.06708496661735174
sim_physics_median0.06295888016863567
sim_physics_min0.05851110153728061
sim_render-ego_max0.00963400131048158
sim_render-ego_mean0.008378036932205778
sim_render-ego_median0.007616101241693264
sim_render-ego_min0.007555166880289714
simulation-passed1
survival_time_max3.599999999999995
survival_time_mean2.639999999999999
survival_time_min2.0500000000000007
No reset possible
283065305Fabrice Normandin 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8413718330287023
survival_time_median14.950000000000076
deviation-center-line_median0.6266132849341255
in-drivable-lane_median1.8000000000000256


other stats
agent_compute-ego_max0.01779059648513794
agent_compute-ego_mean0.01730389912923177
agent_compute-ego_median0.017250142097473144
agent_compute-ego_min0.016992139021555584
deviation-center-line_max0.9680978070914794
deviation-center-line_mean0.6452148992252941
deviation-center-line_min0.32239352761203033
deviation-heading_max3.803631037035386
deviation-heading_mean3.237287454004927
deviation-heading_median3.2360956956599347
deviation-heading_min2.5760019585794347
driven_any_max2.7909376473152547
driven_any_mean2.6757029184047085
driven_any_median2.71053281367722
driven_any_min2.522099366152815
driven_lanedir_consec_max2.4625914126723023
driven_lanedir_consec_mean1.792401112221156
driven_lanedir_consec_min0.9826951579647574
driven_lanedir_max2.5371624122463725
driven_lanedir_mean2.234744270887178
driven_lanedir_median2.2828366282793944
driven_lanedir_min1.9027272351889633
in-drivable-lane_max3.9000000000000097
in-drivable-lane_mean2.070000000000019
in-drivable-lane_min0.70000000000001
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5940914450654016, "sim_physics": 0.06164198557535807, "survival_time": 14.950000000000076, "driven_lanedir": 1.9027272351889633, "sim_render-ego": 0.007482730547587077, "in-drivable-lane": 3.9000000000000097, "agent_compute-ego": 0.01779059648513794, "deviation-heading": 3.4927665949127817, "set_robot_commands": 0.007246362368265788, "deviation-center-line": 0.6934834806901874, "driven_lanedir_consec": 0.9826951579647574, "sim_compute_sim_state": 0.004185518423716227, "sim_compute_performance-ego": 0.0044029871622721355, "sim_compute_robot_state-ego": 0.005384673277537028}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.71053281367722, "sim_physics": 0.05990028142929077, "survival_time": 14.950000000000076, "driven_lanedir": 2.2828366282793944, "sim_render-ego": 0.007535893122355144, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.016992139021555584, "deviation-heading": 3.2360956956599347, "set_robot_commands": 0.007387215296427409, "deviation-center-line": 0.6266132849341255, "driven_lanedir_consec": 1.8413718330287023, "sim_compute_sim_state": 0.004169708093007406, "sim_compute_performance-ego": 0.004338277180989583, "sim_compute_robot_state-ego": 0.005369837284088135}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7909376473152547, "sim_physics": 0.06247830788294474, "survival_time": 14.950000000000076, "driven_lanedir": 2.4625914126723023, "sim_render-ego": 0.007537187735239665, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.017250142097473144, "deviation-heading": 3.077941983837095, "set_robot_commands": 0.00744072675704956, "deviation-center-line": 0.9680978070914794, "driven_lanedir_consec": 2.4625914126723023, "sim_compute_sim_state": 0.004281180699666341, "sim_compute_performance-ego": 0.004332079887390137, "sim_compute_robot_state-ego": 0.005387631257375082}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.522099366152815, "sim_physics": 0.0610188094774882, "survival_time": 14.950000000000076, "driven_lanedir": 1.9884036660488584, "sim_render-ego": 0.0075704820950826, "in-drivable-lane": 2.5000000000000275, "agent_compute-ego": 0.017472874323527017, "deviation-heading": 3.803631037035386, "set_robot_commands": 0.0071581260363260905, "deviation-center-line": 0.6154863957986481, "driven_lanedir_consec": 1.2163950376204304, "sim_compute_sim_state": 0.004155225753784179, "sim_compute_performance-ego": 0.004289052486419678, "sim_compute_robot_state-ego": 0.005358947118123372}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.760853319812851, "sim_physics": 0.06027572552363078, "survival_time": 14.950000000000076, "driven_lanedir": 2.5371624122463725, "sim_render-ego": 0.007533334891001384, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.01701374371846517, "deviation-heading": 2.5760019585794347, "set_robot_commands": 0.007192529042561849, "deviation-center-line": 0.32239352761203033, "driven_lanedir_consec": 2.4589521198195876, "sim_compute_sim_state": 0.004256382783253987, "sim_compute_performance-ego": 0.004331997235616048, "sim_compute_robot_state-ego": 0.0053833683331807455}}
set_robot_commands_max0.00744072675704956
set_robot_commands_mean0.007284991900126138
set_robot_commands_median0.007246362368265788
set_robot_commands_min0.0071581260363260905
sim_compute_performance-ego_max0.0044029871622721355
sim_compute_performance-ego_mean0.0043388787905375165
sim_compute_performance-ego_median0.004332079887390137
sim_compute_performance-ego_min0.004289052486419678
sim_compute_robot_state-ego_max0.005387631257375082
sim_compute_robot_state-ego_mean0.005376891454060872
sim_compute_robot_state-ego_median0.0053833683331807455
sim_compute_robot_state-ego_min0.005358947118123372
sim_compute_sim_state_max0.004281180699666341
sim_compute_sim_state_mean0.004209603150685628
sim_compute_sim_state_median0.004185518423716227
sim_compute_sim_state_min0.004155225753784179
sim_physics_max0.06247830788294474
sim_physics_mean0.061063021977742514
sim_physics_median0.0610188094774882
sim_physics_min0.05990028142929077
sim_render-ego_max0.0075704820950826
sim_render-ego_mean0.007531925678253175
sim_render-ego_median0.007535893122355144
sim_render-ego_min0.007482730547587077
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
282905295Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-35-218-104900:07:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 40, in copy_to_cache
    msg = "Copying %s to cache %s" % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5295/step1-simulation-ip-172-31-35-218-10490-job28290/tmp/tmppeklj_pr/episodes/ETHZ_autolab_technical_track-4-0/drawing.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282345265Dhaivat Bhatt 🇨🇦whattheduckaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:06:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282215260Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.983391015232316
survival_time_median7.499999999999981
deviation-center-line_median0.27658367008660595
in-drivable-lane_median1.2499999999999956


other stats
agent_compute-ego_max0.025242651303609212
agent_compute-ego_mean0.02328454568206171
agent_compute-ego_median0.023844832017016503
agent_compute-ego_min0.01998585643190326
deviation-center-line_max0.5592755886482647
deviation-center-line_mean0.292549413249004
deviation-center-line_min0.1066208056436621
deviation-heading_max0.9687070763879037
deviation-heading_mean0.636070380185348
deviation-heading_median0.5856446365257625
deviation-heading_min0.4543318289729285
driven_any_max2.519744967862987
driven_any_mean1.6864354301804405
driven_any_median1.5834020047361284
driven_any_min1.0139763813061873
driven_lanedir_consec_max1.7322721999669357
driven_lanedir_consec_mean0.9232623145164104
driven_lanedir_consec_min0.2556111986694314
driven_lanedir_max1.7322721999669357
driven_lanedir_mean0.9232623145164104
driven_lanedir_median0.983391015232316
driven_lanedir_min0.2556111986694314
in-drivable-lane_max10.950000000000044
in-drivable-lane_mean2.9700000000000095
in-drivable-lane_min0.1999999999999993
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0139763813061873, "sim_physics": 0.06193864706790808, "survival_time": 3.2999999999999963, "driven_lanedir": 0.49915851558674873, "sim_render-ego": 0.007583553140813654, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.01998585643190326, "deviation-heading": 0.4543318289729285, "set_robot_commands": 0.006063233722339977, "deviation-center-line": 0.1247233488986669, "driven_lanedir_consec": 0.49915851558674873, "sim_compute_sim_state": 0.0030694405237833657, "sim_compute_performance-ego": 0.004519675717209325, "sim_compute_robot_state-ego": 0.005316181616349654}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.232295388720435, "sim_physics": 0.06792756336838451, "survival_time": 10.050000000000008, "driven_lanedir": 1.7322721999669357, "sim_render-ego": 0.008362773639052662, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.022660197310186737, "deviation-heading": 0.9687070763879037, "set_robot_commands": 0.006357285513806699, "deviation-center-line": 0.5592755886482647, "driven_lanedir_consec": 1.7322721999669357, "sim_compute_sim_state": 0.003541373494845718, "sim_compute_performance-ego": 0.004740289194666924, "sim_compute_robot_state-ego": 0.006048187094541331}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0827584082764643, "sim_physics": 0.08017487340159231, "survival_time": 3.8499999999999943, "driven_lanedir": 0.983391015232316, "sim_render-ego": 0.01037109052980101, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.024689191347592836, "deviation-heading": 0.5873527392480782, "set_robot_commands": 0.006921991125329748, "deviation-center-line": 0.27658367008660595, "driven_lanedir_consec": 0.983391015232316, "sim_compute_sim_state": 0.004084565422751687, "sim_compute_performance-ego": 0.005648136138916016, "sim_compute_robot_state-ego": 0.00702404666256595}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5834020047361284, "sim_physics": 0.07897201061248779, "survival_time": 7.499999999999981, "driven_lanedir": 1.1458786431266208, "sim_render-ego": 0.009388731320699057, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.025242651303609212, "deviation-heading": 0.5843156197920666, "set_robot_commands": 0.006825238863627116, "deviation-center-line": 0.39554365296782035, "driven_lanedir_consec": 1.1458786431266208, "sim_compute_sim_state": 0.003808925946553548, "sim_compute_performance-ego": 0.005292425155639649, "sim_compute_robot_state-ego": 0.006489721934000651}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.519744967862987, "sim_physics": 0.07523128731919843, "survival_time": 12.650000000000045, "driven_lanedir": 0.2556111986694314, "sim_render-ego": 0.009332680419499697, "in-drivable-lane": 10.950000000000044, "agent_compute-ego": 0.023844832017016503, "deviation-heading": 0.5856446365257625, "set_robot_commands": 0.00673407716713404, "deviation-center-line": 0.1066208056436621, "driven_lanedir_consec": 0.2556111986694314, "sim_compute_sim_state": 0.004082401750587192, "sim_compute_performance-ego": 0.005424654059730499, "sim_compute_robot_state-ego": 0.006772360782849459}}
set_robot_commands_max0.006921991125329748
set_robot_commands_mean0.006580365278447515
set_robot_commands_median0.00673407716713404
set_robot_commands_min0.006063233722339977
sim_compute_performance-ego_max0.005648136138916016
sim_compute_performance-ego_mean0.005125036053232482
sim_compute_performance-ego_median0.005292425155639649
sim_compute_performance-ego_min0.004519675717209325
sim_compute_robot_state-ego_max0.00702404666256595
sim_compute_robot_state-ego_mean0.006330099618061409
sim_compute_robot_state-ego_median0.006489721934000651
sim_compute_robot_state-ego_min0.005316181616349654
sim_compute_sim_state_max0.004084565422751687
sim_compute_sim_state_mean0.0037173414277043024
sim_compute_sim_state_median0.003808925946553548
sim_compute_sim_state_min0.0030694405237833657
sim_physics_max0.08017487340159231
sim_physics_mean0.07284887635391422
sim_physics_median0.07523128731919843
sim_physics_min0.06193864706790808
sim_render-ego_max0.01037109052980101
sim_render-ego_mean0.009007765809973214
sim_render-ego_median0.009332680419499697
sim_render-ego_min0.007583553140813654
simulation-passed1
survival_time_max12.650000000000045
survival_time_mean7.470000000000004
survival_time_min3.2999999999999963
No reset possible
282195259Basile Dura 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282125254Dhaivat Bhatt 🇨🇦whattheduckaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282105252c reddy 🇮🇳challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
282045249Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4275329248343187
survival_time_median14.950000000000076
deviation-center-line_median0.8960451824485766
in-drivable-lane_median1.099999999999996


other stats
agent_compute-ego_max0.016420332590738933
agent_compute-ego_mean0.01628597577412923
agent_compute-ego_median0.016275168259938556
agent_compute-ego_min0.016179683208465575
deviation-center-line_max1.0384000359904708
deviation-center-line_mean0.835029847243252
deviation-center-line_min0.6052939271678541
deviation-heading_max6.765160650515599
deviation-heading_mean5.88558117918736
deviation-heading_median6.156698826463095
deviation-heading_min4.327593506905699
driven_any_max2.590068428024316
driven_any_mean2.2812404834722892
driven_any_median2.3377728396257145
driven_any_min1.864748621362672
driven_lanedir_consec_max1.633378645439405
driven_lanedir_consec_mean1.3201147546033378
driven_lanedir_consec_min0.7755497043577054
driven_lanedir_max2.2331309288118835
driven_lanedir_mean1.8858257635293427
driven_lanedir_median1.8647523297671231
driven_lanedir_min1.5484811835654646
in-drivable-lane_max1.7000000000000242
in-drivable-lane_mean0.9100000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.065428982991348, "sim_physics": 0.05758386532465617, "survival_time": 14.950000000000076, "driven_lanedir": 1.5484811835654646, "sim_render-ego": 0.007271162668863932, "in-drivable-lane": 1.2000000000000002, "agent_compute-ego": 0.016358015537261964, "deviation-heading": 6.765160650515599, "set_robot_commands": 0.007195773124694824, "deviation-center-line": 0.9848797450979804, "driven_lanedir_consec": 0.7755497043577054, "sim_compute_sim_state": 0.00373279333114624, "sim_compute_performance-ego": 0.004256249268849691, "sim_compute_robot_state-ego": 0.005229935646057129}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3377728396257145, "sim_physics": 0.059483052094777424, "survival_time": 14.950000000000076, "driven_lanedir": 1.8647523297671231, "sim_render-ego": 0.00750450611114502, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.016179683208465575, "deviation-heading": 5.689514331989121, "set_robot_commands": 0.007277586460113525, "deviation-center-line": 0.8960451824485766, "driven_lanedir_consec": 1.4776958057496234, "sim_compute_sim_state": 0.0036826046307881673, "sim_compute_performance-ego": 0.004221274058024089, "sim_compute_robot_state-ego": 0.005250163078308105}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5481835453573947, "sim_physics": 0.0601714022954305, "survival_time": 14.950000000000076, "driven_lanedir": 2.2331309288118835, "sim_render-ego": 0.007402451833089193, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.01619667927424113, "deviation-heading": 4.327593506905699, "set_robot_commands": 0.007493698596954345, "deviation-center-line": 0.6505303455113773, "driven_lanedir_consec": 1.4275329248343187, "sim_compute_sim_state": 0.003689399560292562, "sim_compute_performance-ego": 0.0041960819562276205, "sim_compute_robot_state-ego": 0.0052043135960896806}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.590068428024316, "sim_physics": 0.05938663244247437, "survival_time": 14.950000000000076, "driven_lanedir": 2.1493857300628365, "sim_render-ego": 0.007319404284159343, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.016420332590738933, "deviation-heading": 6.488938580063287, "set_robot_commands": 0.007253857453664144, "deviation-center-line": 1.0384000359904708, "driven_lanedir_consec": 1.2864166926356366, "sim_compute_sim_state": 0.003654790719350179, "sim_compute_performance-ego": 0.004183564186096191, "sim_compute_robot_state-ego": 0.005196006298065186}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.864748621362672, "sim_physics": 0.057574814955393475, "survival_time": 14.950000000000076, "driven_lanedir": 1.633378645439405, "sim_render-ego": 0.007380051612854004, "in-drivable-lane": 0, "agent_compute-ego": 0.016275168259938556, "deviation-heading": 6.156698826463095, "set_robot_commands": 0.007110909620920817, "deviation-center-line": 0.6052939271678541, "driven_lanedir_consec": 1.633378645439405, "sim_compute_sim_state": 0.0034821287790934245, "sim_compute_performance-ego": 0.00420395294825236, "sim_compute_robot_state-ego": 0.005168546040852865}}
set_robot_commands_max0.007493698596954345
set_robot_commands_mean0.00726636505126953
set_robot_commands_median0.007253857453664144
set_robot_commands_min0.007110909620920817
sim_compute_performance-ego_max0.004256249268849691
sim_compute_performance-ego_mean0.00421222448348999
sim_compute_performance-ego_median0.00420395294825236
sim_compute_performance-ego_min0.004183564186096191
sim_compute_robot_state-ego_max0.005250163078308105
sim_compute_robot_state-ego_mean0.0052097929318745935
sim_compute_robot_state-ego_median0.0052043135960896806
sim_compute_robot_state-ego_min0.005168546040852865
sim_compute_sim_state_max0.00373279333114624
sim_compute_sim_state_mean0.0036483434041341143
sim_compute_sim_state_median0.0036826046307881673
sim_compute_sim_state_min0.0034821287790934245
sim_physics_max0.0601714022954305
sim_physics_mean0.05883995342254639
sim_physics_median0.05938663244247437
sim_physics_min0.057574814955393475
sim_render-ego_max0.00750450611114502
sim_render-ego_mean0.007375515302022298
sim_render-ego_median0.007380051612854004
sim_render-ego_min0.007271162668863932
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
281645221Charles Cossette 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:10:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6315282260405977
survival_time_median14.650000000000071
deviation-center-line_median0.7982936511906201
in-drivable-lane_median2.0999999999999934


other stats
agent_compute-ego_max0.03089625494820731
agent_compute-ego_mean0.024858467324776277
agent_compute-ego_median0.022360051451282698
agent_compute-ego_min0.021800939242045084
deviation-center-line_max1.13901327068053
deviation-center-line_mean0.7410791410776222
deviation-center-line_min0.2791864663112249
deviation-heading_max5.344482077291029
deviation-heading_mean3.415325144379058
deviation-heading_median3.5789022428679975
deviation-heading_min1.2836118398250709
driven_any_max5.972116856290818
driven_any_mean4.1852719560701654
driven_any_median4.429829036722013
driven_any_min1.1126734467535866
driven_lanedir_consec_max3.6366598344696777
driven_lanedir_consec_mean2.290465061653967
driven_lanedir_consec_min0.8060384527338892
driven_lanedir_max4.689960220995692
driven_lanedir_mean3.265656152308017
driven_lanedir_median3.6366598344696777
driven_lanedir_min0.8060384527338892
in-drivable-lane_max2.750000000000032
in-drivable-lane_mean2.0700000000000083
in-drivable-lane_min1.149999999999996
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1126734467535866, "sim_physics": 0.13365612973223676, "survival_time": 4.549999999999992, "driven_lanedir": 0.8060384527338892, "sim_render-ego": 0.014036752365447665, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.03089625494820731, "deviation-heading": 1.2836118398250709, "set_robot_commands": 0.013273826012244591, "deviation-center-line": 0.2791864663112249, "driven_lanedir_consec": 0.8060384527338892, "sim_compute_sim_state": 0.005763234672965584, "sim_compute_performance-ego": 0.008642448173774468, "sim_compute_robot_state-ego": 0.010434300034910768}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.796661617589382, "sim_physics": 0.1187692674001058, "survival_time": 14.950000000000076, "driven_lanedir": 4.6763282540315245, "sim_render-ego": 0.013716842333475749, "in-drivable-lane": 2.650000000000019, "agent_compute-ego": 0.026970542271931967, "deviation-heading": 3.9865787423413033, "set_robot_commands": 0.011978836059570312, "deviation-center-line": 0.843059407622545, "driven_lanedir_consec": 2.703398813312186, "sim_compute_sim_state": 0.005675388971964518, "sim_compute_performance-ego": 0.007837400436401368, "sim_compute_robot_state-ego": 0.0098870849609375}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.429829036722013, "sim_physics": 0.07920721769332886, "survival_time": 14.950000000000076, "driven_lanedir": 3.6366598344696777, "sim_render-ego": 0.010484155019124348, "in-drivable-lane": 1.700000000000002, "agent_compute-ego": 0.021800939242045084, "deviation-heading": 5.344482077291029, "set_robot_commands": 0.009509177207946777, "deviation-center-line": 1.13901327068053, "driven_lanedir_consec": 3.6366598344696777, "sim_compute_sim_state": 0.004609173138936361, "sim_compute_performance-ego": 0.00613897720972697, "sim_compute_robot_state-ego": 0.007699061234792074}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.6150788229950304, "sim_physics": 0.08751044954572405, "survival_time": 11.200000000000024, "driven_lanedir": 2.519293999309302, "sim_render-ego": 0.01052172588450568, "in-drivable-lane": 2.0999999999999934, "agent_compute-ego": 0.02226454871041434, "deviation-heading": 3.5789022428679975, "set_robot_commands": 0.009628374661718096, "deviation-center-line": 0.6458429095831905, "driven_lanedir_consec": 1.6746999817134842, "sim_compute_sim_state": 0.004854655691555568, "sim_compute_performance-ego": 0.006236085934298379, "sim_compute_robot_state-ego": 0.007663745965276446}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.972116856290818, "sim_physics": 0.08326006179783531, "survival_time": 14.650000000000071, "driven_lanedir": 4.689960220995692, "sim_render-ego": 0.010385710224763523, "in-drivable-lane": 2.750000000000032, "agent_compute-ego": 0.022360051451282698, "deviation-heading": 2.883050819569889, "set_robot_commands": 0.01023504595707708, "deviation-center-line": 0.7982936511906201, "driven_lanedir_consec": 2.6315282260405977, "sim_compute_sim_state": 0.004747140936477192, "sim_compute_performance-ego": 0.006023040810542709, "sim_compute_robot_state-ego": 0.007660091126738148}}
set_robot_commands_max0.013273826012244591
set_robot_commands_mean0.010925051979711373
set_robot_commands_median0.01023504595707708
set_robot_commands_min0.009509177207946777
sim_compute_performance-ego_max0.008642448173774468
sim_compute_performance-ego_mean0.006975590512948779
sim_compute_performance-ego_median0.006236085934298379
sim_compute_performance-ego_min0.006023040810542709
sim_compute_robot_state-ego_max0.010434300034910768
sim_compute_robot_state-ego_mean0.008668856664530988
sim_compute_robot_state-ego_median0.007699061234792074
sim_compute_robot_state-ego_min0.007660091126738148
sim_compute_sim_state_max0.005763234672965584
sim_compute_sim_state_mean0.005129918682379845
sim_compute_sim_state_median0.004854655691555568
sim_compute_sim_state_min0.004609173138936361
sim_physics_max0.13365612973223676
sim_physics_mean0.10048062523384615
sim_physics_median0.08751044954572405
sim_physics_min0.07920721769332886
sim_render-ego_max0.014036752365447665
sim_render-ego_mean0.011829037165463394
sim_render-ego_median0.01052172588450568
sim_render-ego_min0.010385710224763523
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.060000000000048
survival_time_min4.549999999999992
No reset possible
281435212Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:04:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8708122694244445
survival_time_median8.249999999999982
deviation-center-line_median0.3365089549499174
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016446410393228337
agent_compute-ego_mean0.01592934025597504
agent_compute-ego_median0.01576415371132768
agent_compute-ego_min0.015595065222846136
deviation-center-line_max0.9965909115718824
deviation-center-line_mean0.4439671976401865
deviation-center-line_min0.15697042491423044
deviation-heading_max2.686818669092837
deviation-heading_mean1.456786987186662
deviation-heading_median0.9234769702278643
deviation-heading_min0.6193082658692771
driven_any_max5.078609917563519
driven_any_mean2.688148744691765
driven_any_median2.8944532643630247
driven_any_min0.9362750080494796
driven_lanedir_consec_max4.95855935896887
driven_lanedir_consec_mean2.6303292623359393
driven_lanedir_consec_min0.913197354700688
driven_lanedir_max4.95855935896887
driven_lanedir_mean2.6303292623359393
driven_lanedir_median2.8708122694244445
driven_lanedir_min0.913197354700688
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1324363953022558, "sim_physics": 0.05984139685728112, "survival_time": 4.899999999999991, "driven_lanedir": 1.1143044448611814, "sim_render-ego": 0.007397461910637057, "in-drivable-lane": 0, "agent_compute-ego": 0.016446410393228337, "deviation-heading": 0.6651445048630308, "set_robot_commands": 0.007396106817284409, "deviation-center-line": 0.18192286823584555, "driven_lanedir_consec": 1.1143044448611814, "sim_compute_sim_state": 0.003893246456068389, "sim_compute_performance-ego": 0.004353868718049964, "sim_compute_robot_state-ego": 0.005228563230864855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9362750080494796, "sim_physics": 0.058371831500341025, "survival_time": 3.149999999999997, "driven_lanedir": 0.913197354700688, "sim_render-ego": 0.007433024663773794, "in-drivable-lane": 0, "agent_compute-ego": 0.015595065222846136, "deviation-heading": 0.6193082658692771, "set_robot_commands": 0.007159603966606988, "deviation-center-line": 0.15697042491423044, "driven_lanedir_consec": 0.913197354700688, "sim_compute_sim_state": 0.0038654463631766184, "sim_compute_performance-ego": 0.004191296441214425, "sim_compute_robot_state-ego": 0.005240512272668263}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.078609917563519, "sim_physics": 0.05507201671600342, "survival_time": 14.950000000000076, "driven_lanedir": 4.95855935896887, "sim_render-ego": 0.007618583838144938, "in-drivable-lane": 0, "agent_compute-ego": 0.015660585562388103, "deviation-heading": 2.686818669092837, "set_robot_commands": 0.007511535485585531, "deviation-center-line": 0.9965909115718824, "driven_lanedir_consec": 4.95855935896887, "sim_compute_sim_state": 0.003767180442810059, "sim_compute_performance-ego": 0.004186479250590006, "sim_compute_robot_state-ego": 0.00519210418065389}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.398969138180546, "sim_physics": 0.05723916450047602, "survival_time": 10.95000000000002, "driven_lanedir": 3.2947728837245136, "sim_render-ego": 0.007308707389657356, "in-drivable-lane": 0, "agent_compute-ego": 0.01576415371132768, "deviation-heading": 2.3891865258803007, "set_robot_commands": 0.007419474048701595, "deviation-center-line": 0.5478428285290565, "driven_lanedir_consec": 3.2947728837245136, "sim_compute_sim_state": 0.003791247328666791, "sim_compute_performance-ego": 0.004090678201962824, "sim_compute_robot_state-ego": 0.005091324244460014}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8944532643630247, "sim_physics": 0.05823577245076497, "survival_time": 8.249999999999982, "driven_lanedir": 2.8708122694244445, "sim_render-ego": 0.007354473345207445, "in-drivable-lane": 0, "agent_compute-ego": 0.01618048639008493, "deviation-heading": 0.9234769702278643, "set_robot_commands": 0.007532085071910511, "deviation-center-line": 0.3365089549499174, "driven_lanedir_consec": 2.8708122694244445, "sim_compute_sim_state": 0.003985474326393821, "sim_compute_performance-ego": 0.004137906161221591, "sim_compute_robot_state-ego": 0.005140996701789625}}
set_robot_commands_max0.007532085071910511
set_robot_commands_mean0.007403761078017807
set_robot_commands_median0.007419474048701595
set_robot_commands_min0.007159603966606988
sim_compute_performance-ego_max0.004353868718049964
sim_compute_performance-ego_mean0.004192045754607763
sim_compute_performance-ego_median0.004186479250590006
sim_compute_performance-ego_min0.004090678201962824
sim_compute_robot_state-ego_max0.005240512272668263
sim_compute_robot_state-ego_mean0.00517870012608733
sim_compute_robot_state-ego_median0.00519210418065389
sim_compute_robot_state-ego_min0.005091324244460014
sim_compute_sim_state_max0.003985474326393821
sim_compute_sim_state_mean0.003860518983423136
sim_compute_sim_state_median0.0038654463631766184
sim_compute_sim_state_min0.003767180442810059
sim_physics_max0.05984139685728112
sim_physics_mean0.057752036404973305
sim_physics_median0.05823577245076497
sim_physics_min0.05507201671600342
sim_render-ego_max0.007618583838144938
sim_render-ego_mean0.007422450229484118
sim_render-ego_median0.007397461910637057
sim_render-ego_min0.007308707389657356
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.440000000000015
survival_time_min3.149999999999997
No reset possible
281345207Charles Cossette 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4463003883347567
survival_time_median1.4500000000000006
deviation-center-line_median0.1017724046767832
in-drivable-lane_median0


other stats
agent_compute-ego_max0.035483786934300474
agent_compute-ego_mean0.02683684735060841
agent_compute-ego_median0.030138558354871028
agent_compute-ego_min0.016064152121543884
deviation-center-line_max0.386778757435443
deviation-center-line_mean0.14499472991804208
deviation-center-line_min0.0624972760241913
deviation-heading_max0.7983154957900045
deviation-heading_mean0.4024880528308902
deviation-heading_median0.35533000410287924
deviation-heading_min0.2047531117605221
driven_any_max2.055640352228857
driven_any_mean0.8015159945354913
driven_any_median0.46587712485591654
driven_any_min0.283452373584827
driven_lanedir_consec_max2.0294806693024396
driven_lanedir_consec_mean0.7855263382648093
driven_lanedir_consec_min0.27422045429303865
driven_lanedir_max2.0294806693024396
driven_lanedir_mean0.7855263382648093
driven_lanedir_median0.4463003883347567
driven_lanedir_min0.27422045429303865
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.43220890852861776, "sim_physics": 0.06599698283455589, "survival_time": 1.1000000000000003, "driven_lanedir": 0.41669613390867377, "sim_render-ego": 0.007753588936545632, "in-drivable-lane": 0, "agent_compute-ego": 0.017331405119462448, "deviation-heading": 0.29561687130868636, "set_robot_commands": 0.007926214825023304, "deviation-center-line": 0.0624972760241913, "driven_lanedir_consec": 0.41669613390867377, "sim_compute_sim_state": 0.00405573844909668, "sim_compute_performance-ego": 0.004405054179104892, "sim_compute_robot_state-ego": 0.005319703708995472}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.283452373584827, "sim_physics": 0.0644294023513794, "survival_time": 0.8000000000000002, "driven_lanedir": 0.27422045429303865, "sim_render-ego": 0.007486984133720398, "in-drivable-lane": 0, "agent_compute-ego": 0.016064152121543884, "deviation-heading": 0.2047531117605221, "set_robot_commands": 0.007108479738235474, "deviation-center-line": 0.06528162699891357, "driven_lanedir_consec": 0.27422045429303865, "sim_compute_sim_state": 0.00334024429321289, "sim_compute_performance-ego": 0.004089772701263428, "sim_compute_robot_state-ego": 0.005157679319381714}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.46587712485591654, "sim_physics": 0.06092026315886399, "survival_time": 1.4500000000000006, "driven_lanedir": 0.4463003883347567, "sim_render-ego": 0.007262690313931169, "in-drivable-lane": 0, "agent_compute-ego": 0.030138558354871028, "deviation-heading": 0.35533000410287924, "set_robot_commands": 0.005305092910240437, "deviation-center-line": 0.1017724046767832, "driven_lanedir_consec": 0.4463003883347567, "sim_compute_sim_state": 0.0030885482656544654, "sim_compute_performance-ego": 0.004026264979921538, "sim_compute_robot_state-ego": 0.005149874193915005}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.055640352228857, "sim_physics": 0.05734528877117016, "survival_time": 5.399999999999989, "driven_lanedir": 2.0294806693024396, "sim_render-ego": 0.007243255774180095, "in-drivable-lane": 0, "agent_compute-ego": 0.03516633422286422, "deviation-heading": 0.7983154957900045, "set_robot_commands": 0.005231819770954273, "deviation-center-line": 0.386778757435443, "driven_lanedir_consec": 2.0294806693024396, "sim_compute_sim_state": 0.0030289711775603116, "sim_compute_performance-ego": 0.004079792234632704, "sim_compute_robot_state-ego": 0.005136617907771358}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7704012134792385, "sim_physics": 0.06048451599321867, "survival_time": 1.900000000000001, "driven_lanedir": 0.7609340454851383, "sim_render-ego": 0.007336202420686421, "in-drivable-lane": 0, "agent_compute-ego": 0.035483786934300474, "deviation-heading": 0.3584247811923587, "set_robot_commands": 0.005072581140618575, "deviation-center-line": 0.10864358445487932, "driven_lanedir_consec": 0.7609340454851383, "sim_compute_sim_state": 0.003074338561610172, "sim_compute_performance-ego": 0.00410151481628418, "sim_compute_robot_state-ego": 0.005173143587614361}}
set_robot_commands_max0.007926214825023304
set_robot_commands_mean0.006128837677014413
set_robot_commands_median0.005305092910240437
set_robot_commands_min0.005072581140618575
sim_compute_performance-ego_max0.004405054179104892
sim_compute_performance-ego_mean0.004140479782241349
sim_compute_performance-ego_median0.004089772701263428
sim_compute_performance-ego_min0.004026264979921538
sim_compute_robot_state-ego_max0.005319703708995472
sim_compute_robot_state-ego_mean0.005187403743535582
sim_compute_robot_state-ego_median0.005157679319381714
sim_compute_robot_state-ego_min0.005136617907771358
sim_compute_sim_state_max0.00405573844909668
sim_compute_sim_state_mean0.003317568149426904
sim_compute_sim_state_median0.0030885482656544654
sim_compute_sim_state_min0.0030289711775603116
sim_physics_max0.06599698283455589
sim_physics_mean0.061835290621837624
sim_physics_median0.06092026315886399
sim_physics_min0.05734528877117016
sim_render-ego_max0.007753588936545632
sim_render-ego_mean0.007416544315812743
sim_render-ego_median0.007336202420686421
sim_render-ego_min0.007243255774180095
simulation-passed1
survival_time_max5.399999999999989
survival_time_mean2.129999999999998
survival_time_min0.8000000000000002
No reset possible
280345139Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7590072073384113
survival_time_median4.3499999999999925
deviation-center-line_median0.14000523026848655
in-drivable-lane_median1.399999999999995


other stats
agent_compute-ego_max0.3219432830810547
agent_compute-ego_mean0.2613436535031916
agent_compute-ego_median0.2667581121126811
agent_compute-ego_min0.2043559891836984
deviation-center-line_max0.25822347104821713
deviation-center-line_mean0.16477209330465392
deviation-center-line_min0.09160272769528936
deviation-heading_max0.8285788949491042
deviation-heading_mean0.7082720383005944
deviation-heading_median0.7453268647243949
deviation-heading_min0.4344761085042613
driven_any_max1.17849139904482
driven_any_mean1.0555022342063904
driven_any_median1.1225884413459617
driven_any_min0.7452318156993826
driven_lanedir_consec_max1.0142549056405474
driven_lanedir_consec_mean0.6940065822172723
driven_lanedir_consec_min0.33385065851625173
driven_lanedir_max1.0142549056405474
driven_lanedir_mean0.6940065822172723
driven_lanedir_median0.7590072073384113
driven_lanedir_min0.33385065851625173
in-drivable-lane_max1.699999999999994
in-drivable-lane_mean1.1699999999999962
in-drivable-lane_min0.14999999999999947
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1225884413459617, "sim_physics": 0.1334040329374116, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6026313929822715, "sim_render-ego": 0.014313577235430136, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.3219432830810547, "deviation-heading": 0.7052384259437867, "set_robot_commands": 0.011536307718561983, "deviation-center-line": 0.09160272769528936, "driven_lanedir_consec": 0.6026313929822715, "sim_compute_sim_state": 0.005669917183360834, "sim_compute_performance-ego": 0.00834640963324185, "sim_compute_robot_state-ego": 0.010165406369614875}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.136561350949919, "sim_physics": 0.10751097852533514, "survival_time": 4.399999999999992, "driven_lanedir": 0.7602887466088799, "sim_render-ego": 0.012548977678472344, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.21973290226676248, "deviation-heading": 0.8285788949491042, "set_robot_commands": 0.00947459719397805, "deviation-center-line": 0.23317082693195143, "driven_lanedir_consec": 0.7602887466088799, "sim_compute_sim_state": 0.004985348744825883, "sim_compute_performance-ego": 0.007593366232785312, "sim_compute_robot_state-ego": 0.009684123776175758}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.094638163991868, "sim_physics": 0.11930536662831026, "survival_time": 4.249999999999993, "driven_lanedir": 1.0142549056405474, "sim_render-ego": 0.013996620739207547, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.29392798087176153, "deviation-heading": 0.8277398973814244, "set_robot_commands": 0.011791285346536076, "deviation-center-line": 0.25822347104821713, "driven_lanedir_consec": 1.0142549056405474, "sim_compute_sim_state": 0.0056654958163990694, "sim_compute_performance-ego": 0.007918341019574334, "sim_compute_robot_state-ego": 0.010489766737994026}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7452318156993826, "sim_physics": 0.1231891671816508, "survival_time": 2.9999999999999973, "driven_lanedir": 0.33385065851625173, "sim_render-ego": 0.013857229550679523, "in-drivable-lane": 1.3999999999999966, "agent_compute-ego": 0.2667581121126811, "deviation-heading": 0.4344761085042613, "set_robot_commands": 0.010167495409647623, "deviation-center-line": 0.10085821057932512, "driven_lanedir_consec": 0.33385065851625173, "sim_compute_sim_state": 0.005228912830352784, "sim_compute_performance-ego": 0.008158723513285318, "sim_compute_robot_state-ego": 0.009861024220784505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.17849139904482, "sim_physics": 0.10175731155898544, "survival_time": 4.549999999999992, "driven_lanedir": 0.7590072073384113, "sim_render-ego": 0.0119935182424692, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.2043559891836984, "deviation-heading": 0.7453268647243949, "set_robot_commands": 0.009136689888252008, "deviation-center-line": 0.14000523026848655, "driven_lanedir_consec": 0.7590072073384113, "sim_compute_sim_state": 0.004971294612674922, "sim_compute_performance-ego": 0.007034299137828114, "sim_compute_robot_state-ego": 0.008505912927480845}}
set_robot_commands_max0.011791285346536076
set_robot_commands_mean0.010421275111395147
set_robot_commands_median0.010167495409647623
set_robot_commands_min0.009136689888252008
sim_compute_performance-ego_max0.00834640963324185
sim_compute_performance-ego_mean0.007810227907342987
sim_compute_performance-ego_median0.007918341019574334
sim_compute_performance-ego_min0.007034299137828114
sim_compute_robot_state-ego_max0.010489766737994026
sim_compute_robot_state-ego_mean0.009741246806410002
sim_compute_robot_state-ego_median0.009861024220784505
sim_compute_robot_state-ego_min0.008505912927480845
sim_compute_sim_state_max0.005669917183360834
sim_compute_sim_state_mean0.0053041938375226975
sim_compute_sim_state_median0.005228912830352784
sim_compute_sim_state_min0.004971294612674922
sim_physics_max0.1334040329374116
sim_physics_mean0.11703337136633864
sim_physics_median0.11930536662831026
sim_physics_min0.10175731155898544
sim_render-ego_max0.014313577235430136
sim_render-ego_mean0.01334198468925175
sim_render-ego_median0.013857229550679523
sim_render-ego_min0.0119935182424692
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean4.109999999999994
survival_time_min2.9999999999999973
No reset possible
280135119Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7968479281660552
survival_time_median4.049999999999994
deviation-center-line_median0.18401536080392775
in-drivable-lane_median1.649999999999994


other stats
agent_compute-ego_max0.18215128702995104
agent_compute-ego_mean0.15029295298437828
agent_compute-ego_median0.1540183501365857
agent_compute-ego_min0.10194686862909905
deviation-center-line_max0.2564509343627275
deviation-center-line_mean0.1931710226767104
deviation-center-line_min0.1493281454414054
deviation-heading_max1.0572642910478338
deviation-heading_mean0.7578829448347676
deviation-heading_median0.7646162917318058
deviation-heading_min0.4351073502065217
driven_any_max1.402115022154902
driven_any_mean1.1561364144851347
driven_any_median1.0387376672964168
driven_any_min0.996809304000998
driven_lanedir_consec_max0.8547548769735045
driven_lanedir_consec_mean0.723778237428158
driven_lanedir_consec_min0.4798524151285697
driven_lanedir_max0.8547548769735045
driven_lanedir_mean0.723778237428158
driven_lanedir_median0.7968479281660552
driven_lanedir_min0.4798524151285697
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean1.399999999999995
in-drivable-lane_min0.549999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9968095564588912, "sim_physics": 0.0770793969814594, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396771702152415, "sim_render-ego": 0.009068654133723332, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.18215128702995104, "deviation-heading": 1.0572642910478338, "set_robot_commands": 0.006752689679463704, "deviation-center-line": 0.18401536080392775, "driven_lanedir_consec": 0.6396771702152415, "sim_compute_sim_state": 0.003801932701697717, "sim_compute_performance-ego": 0.005684660031245305, "sim_compute_robot_state-ego": 0.006638759221786108}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3462105225144654, "sim_physics": 0.07592308174059229, "survival_time": 5.14999999999999, "driven_lanedir": 0.8547548769735045, "sim_render-ego": 0.008958557277049833, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.16975150987939927, "deviation-heading": 0.8110897698761766, "set_robot_commands": 0.0065993892336354675, "deviation-center-line": 0.2564509343627275, "driven_lanedir_consec": 0.8547548769735045, "sim_compute_sim_state": 0.00375362970296619, "sim_compute_performance-ego": 0.005221290495789167, "sim_compute_robot_state-ego": 0.006621094583307655}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.996809304000998, "sim_physics": 0.07369113885439359, "survival_time": 3.899999999999994, "driven_lanedir": 0.7968479281660552, "sim_render-ego": 0.00920872810559395, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1540183501365857, "deviation-heading": 0.7213370213114996, "set_robot_commands": 0.006568688612717848, "deviation-center-line": 0.19705730590293716, "driven_lanedir_consec": 0.7968479281660552, "sim_compute_sim_state": 0.0037085490349011542, "sim_compute_performance-ego": 0.005189061164855957, "sim_compute_robot_state-ego": 0.0064656612200614735}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0387376672964168, "sim_physics": 0.0671454182377568, "survival_time": 4.049999999999994, "driven_lanedir": 0.4798524151285697, "sim_render-ego": 0.008410656893694843, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.1435967492468563, "deviation-heading": 0.4351073502065217, "set_robot_commands": 0.006133732972321687, "deviation-center-line": 0.1493281454414054, "driven_lanedir_consec": 0.4798524151285697, "sim_compute_sim_state": 0.0035042321240460433, "sim_compute_performance-ego": 0.004689225444087276, "sim_compute_robot_state-ego": 0.006042524620338723}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.402115022154902, "sim_physics": 0.05605903518534152, "survival_time": 5.349999999999989, "driven_lanedir": 0.8477587966574192, "sim_render-ego": 0.007195254352605231, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.10194686862909905, "deviation-heading": 0.7646162917318058, "set_robot_commands": 0.005026133260994314, "deviation-center-line": 0.17900336687255428, "driven_lanedir_consec": 0.8477587966574192, "sim_compute_sim_state": 0.00294538079021133, "sim_compute_performance-ego": 0.004026482038408797, "sim_compute_robot_state-ego": 0.005021705805698288}}
set_robot_commands_max0.006752689679463704
set_robot_commands_mean0.006216126751826605
set_robot_commands_median0.006568688612717848
set_robot_commands_min0.005026133260994314
sim_compute_performance-ego_max0.005684660031245305
sim_compute_performance-ego_mean0.0049621438348773
sim_compute_performance-ego_median0.005189061164855957
sim_compute_performance-ego_min0.004026482038408797
sim_compute_robot_state-ego_max0.006638759221786108
sim_compute_robot_state-ego_mean0.00615794909023845
sim_compute_robot_state-ego_median0.0064656612200614735
sim_compute_robot_state-ego_min0.005021705805698288
sim_compute_sim_state_max0.003801932701697717
sim_compute_sim_state_mean0.003542744870764487
sim_compute_sim_state_median0.0037085490349011542
sim_compute_sim_state_min0.00294538079021133
sim_physics_max0.0770793969814594
sim_physics_mean0.06997961419990872
sim_physics_median0.07369113885439359
sim_physics_min0.05605903518534152
sim_render-ego_max0.00920872810559395
sim_render-ego_mean0.00856837015253344
sim_render-ego_median0.008958557277049833
sim_render-ego_min0.007195254352605231
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean4.469999999999992
survival_time_min3.899999999999994
No reset possible
279955108Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5095693039974682
survival_time_median4.199999999999993
deviation-center-line_median0.2170902874551572
in-drivable-lane_median1.1499999999999992


other stats
agent_compute-ego_max0.025998374249072784
agent_compute-ego_mean0.019362022225914835
agent_compute-ego_median0.01854685183321492
agent_compute-ego_min0.01534652312596639
deviation-center-line_max0.5004111356446598
deviation-center-line_mean0.22254008143241005
deviation-center-line_min0.06897092453335478
deviation-heading_max1.8115132954150304
deviation-heading_mean0.9868509086747947
deviation-heading_median0.7733673652300649
deviation-heading_min0.4515605722724416
driven_any_max2.4222765605887586
driven_any_mean1.153412173616246
driven_any_median1.0806265810301456
driven_any_min0.5502121838401209
driven_lanedir_consec_max1.9678909969236844
driven_lanedir_consec_mean0.8385600336655905
driven_lanedir_consec_min0.2111234425183599
driven_lanedir_max1.9678909969236844
driven_lanedir_mean0.8385600336655905
driven_lanedir_median0.5095693039974682
driven_lanedir_min0.2111234425183599
in-drivable-lane_max2.099999999999995
in-drivable-lane_mean0.9200000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5502121838401209, "sim_physics": 0.09155940502247913, "survival_time": 2.3499999999999996, "driven_lanedir": 0.5095693039974682, "sim_render-ego": 0.011590942423394384, "in-drivable-lane": 0, "agent_compute-ego": 0.025998374249072784, "deviation-heading": 0.7033293658705596, "set_robot_commands": 0.011307751878778983, "deviation-center-line": 0.10246530520934335, "driven_lanedir_consec": 0.5095693039974682, "sim_compute_sim_state": 0.005143911280530564, "sim_compute_performance-ego": 0.006994729346417366, "sim_compute_robot_state-ego": 0.008020340128147856}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0806265810301456, "sim_physics": 0.08260061343510945, "survival_time": 4.199999999999993, "driven_lanedir": 1.0547795273571918, "sim_render-ego": 0.01011851288023449, "in-drivable-lane": 0, "agent_compute-ego": 0.021357329118819462, "deviation-heading": 0.7733673652300649, "set_robot_commands": 0.00975302571342105, "deviation-center-line": 0.2237627543195351, "driven_lanedir_consec": 1.0547795273571918, "sim_compute_sim_state": 0.004477322101593018, "sim_compute_performance-ego": 0.005778491497039795, "sim_compute_robot_state-ego": 0.007365712097712925}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.15042811871526, "sim_physics": 0.06740380672926313, "survival_time": 4.449999999999992, "driven_lanedir": 0.4494368975312484, "sim_render-ego": 0.008650787760702413, "in-drivable-lane": 2.099999999999995, "agent_compute-ego": 0.01854685183321492, "deviation-heading": 1.1944839445858777, "set_robot_commands": 0.008450891194718608, "deviation-center-line": 0.2170902874551572, "driven_lanedir_consec": 0.4494368975312484, "sim_compute_sim_state": 0.003873629516430115, "sim_compute_performance-ego": 0.004907369613647461, "sim_compute_robot_state-ego": 0.006045025386167377}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5635174239069451, "sim_physics": 0.06004737285857505, "survival_time": 2.3499999999999996, "driven_lanedir": 0.2111234425183599, "sim_render-ego": 0.007314935643622216, "in-drivable-lane": 1.1499999999999992, "agent_compute-ego": 0.015561032802500624, "deviation-heading": 0.4515605722724416, "set_robot_commands": 0.0071549669225165185, "deviation-center-line": 0.06897092453335478, "driven_lanedir_consec": 0.2111234425183599, "sim_compute_sim_state": 0.003155195966679999, "sim_compute_performance-ego": 0.004055068847980905, "sim_compute_robot_state-ego": 0.00508969895383145}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4222765605887586, "sim_physics": 0.05692818032370673, "survival_time": 8.999999999999993, "driven_lanedir": 1.9678909969236844, "sim_render-ego": 0.007203099462721083, "in-drivable-lane": 1.350000000000012, "agent_compute-ego": 0.01534652312596639, "deviation-heading": 1.8115132954150304, "set_robot_commands": 0.007282978958553738, "deviation-center-line": 0.5004111356446598, "driven_lanedir_consec": 1.9678909969236844, "sim_compute_sim_state": 0.003242834409077962, "sim_compute_performance-ego": 0.004105293750762939, "sim_compute_robot_state-ego": 0.005093753337860107}}
set_robot_commands_max0.011307751878778983
set_robot_commands_mean0.00878992293359778
set_robot_commands_median0.008450891194718608
set_robot_commands_min0.0071549669225165185
sim_compute_performance-ego_max0.006994729346417366
sim_compute_performance-ego_mean0.005168190611169693
sim_compute_performance-ego_median0.004907369613647461
sim_compute_performance-ego_min0.004055068847980905
sim_compute_robot_state-ego_max0.008020340128147856
sim_compute_robot_state-ego_mean0.006322905980743943
sim_compute_robot_state-ego_median0.006045025386167377
sim_compute_robot_state-ego_min0.00508969895383145
sim_compute_sim_state_max0.005143911280530564
sim_compute_sim_state_mean0.003978578654862332
sim_compute_sim_state_median0.003873629516430115
sim_compute_sim_state_min0.003155195966679999
sim_physics_max0.09155940502247913
sim_physics_mean0.0717078756738267
sim_physics_median0.06740380672926313
sim_physics_min0.05692818032370673
sim_render-ego_max0.011590942423394384
sim_render-ego_mean0.008975655634134917
sim_render-ego_median0.008650787760702413
sim_render-ego_min0.007203099462721083
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean4.469999999999996
survival_time_min2.3499999999999996
No reset possible
279495085Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-35-218-104900:09:46
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5085/step1-simulation-ip-172-31-35-218-10490-job27949/tmp/tmp87j_yx7i/episodes/ETHZ_autolab_technical_track-4-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
279335076Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0969978142030024
survival_time_median14.950000000000076
deviation-center-line_median0.8663245765459677
in-drivable-lane_median1.4500000000000206


other stats
agent_compute-ego_max0.04167388598124186
agent_compute-ego_mean0.03626027584075928
agent_compute-ego_median0.03445475021998087
agent_compute-ego_min0.030915226141611737
deviation-center-line_max1.1268064879267077
deviation-center-line_mean0.9031802333767076
deviation-center-line_min0.788618869754792
deviation-heading_max5.077987993132196
deviation-heading_mean3.776502113830355
deviation-heading_median3.81653501507421
deviation-heading_min2.528546813790965
driven_any_max3.798065777726085
driven_any_mean3.479072143929521
driven_any_median3.4306463568138676
driven_any_min3.1693970496488877
driven_lanedir_consec_max3.715822744133301
driven_lanedir_consec_mean2.9212580659193064
driven_lanedir_consec_min1.8309298016901367
driven_lanedir_max3.715822744133301
driven_lanedir_mean3.1186519852452212
driven_lanedir_median3.0969978142030024
driven_lanedir_min2.726566620668913
in-drivable-lane_max2.3500000000000147
in-drivable-lane_mean1.3700000000000156
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1693970496488877, "sim_physics": 0.05608447790145874, "survival_time": 14.950000000000076, "driven_lanedir": 2.738100444947643, "sim_render-ego": 0.007049763997395833, "in-drivable-lane": 2.3500000000000147, "agent_compute-ego": 0.030915226141611737, "deviation-heading": 3.81653501507421, "set_robot_commands": 0.0058159613609313964, "deviation-center-line": 0.8459227058918672, "driven_lanedir_consec": 2.738100444947643, "sim_compute_sim_state": 0.0031296539306640623, "sim_compute_performance-ego": 0.0041854953765869144, "sim_compute_robot_state-ego": 0.005115919907887776}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4096126171872605, "sim_physics": 0.0561100705464681, "survival_time": 14.950000000000076, "driven_lanedir": 2.726566620668913, "sim_render-ego": 0.007181103229522705, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.03313183069229126, "deviation-heading": 5.077987993132196, "set_robot_commands": 0.00527035395304362, "deviation-center-line": 1.1268064879267077, "driven_lanedir_consec": 1.8309298016901367, "sim_compute_sim_state": 0.003010243574778239, "sim_compute_performance-ego": 0.00411293903986613, "sim_compute_robot_state-ego": 0.005132439931233724}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.4306463568138676, "sim_physics": 0.05556666851043701, "survival_time": 14.950000000000076, "driven_lanedir": 3.0969978142030024, "sim_render-ego": 0.007220746676127116, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.03445475021998087, "deviation-heading": 2.528546813790965, "set_robot_commands": 0.005158162911732991, "deviation-center-line": 0.8882285267642023, "driven_lanedir_consec": 3.0969978142030024, "sim_compute_sim_state": 0.0029953718185424805, "sim_compute_performance-ego": 0.004134372075398763, "sim_compute_robot_state-ego": 0.005123416582743327}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.798065777726085, "sim_physics": 0.07988759835561117, "survival_time": 14.950000000000076, "driven_lanedir": 3.715822744133301, "sim_render-ego": 0.009515875180562338, "in-drivable-lane": 0, "agent_compute-ego": 0.04167388598124186, "deviation-heading": 2.9781766703040184, "set_robot_commands": 0.0071812637646993, "deviation-center-line": 0.788618869754792, "driven_lanedir_consec": 3.715822744133301, "sim_compute_sim_state": 0.003916129271189372, "sim_compute_performance-ego": 0.005589791138966878, "sim_compute_robot_state-ego": 0.006985681056976318}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5876389182715025, "sim_physics": 0.0790700387954712, "survival_time": 14.950000000000076, "driven_lanedir": 3.3157723022732477, "sim_render-ego": 0.009540783564249674, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.041125686168670655, "deviation-heading": 4.481264076850387, "set_robot_commands": 0.007286194960276286, "deviation-center-line": 0.8663245765459677, "driven_lanedir_consec": 3.22443952462245, "sim_compute_sim_state": 0.0040289521217346195, "sim_compute_performance-ego": 0.005616541703542074, "sim_compute_robot_state-ego": 0.006933678785959879}}
set_robot_commands_max0.007286194960276286
set_robot_commands_mean0.006142387390136719
set_robot_commands_median0.0058159613609313964
set_robot_commands_min0.005158162911732991
sim_compute_performance-ego_max0.005616541703542074
sim_compute_performance-ego_mean0.004727827866872152
sim_compute_performance-ego_median0.0041854953765869144
sim_compute_performance-ego_min0.00411293903986613
sim_compute_robot_state-ego_max0.006985681056976318
sim_compute_robot_state-ego_mean0.005858227252960205
sim_compute_robot_state-ego_median0.005132439931233724
sim_compute_robot_state-ego_min0.005115919907887776
sim_compute_sim_state_max0.0040289521217346195
sim_compute_sim_state_mean0.0034160701433817546
sim_compute_sim_state_median0.0031296539306640623
sim_compute_sim_state_min0.0029953718185424805
sim_physics_max0.07988759835561117
sim_physics_mean0.06534377082188925
sim_physics_median0.0561100705464681
sim_physics_min0.05556666851043701
sim_render-ego_max0.009540783564249674
sim_render-ego_mean0.008101654529571532
sim_render-ego_median0.007220746676127116
sim_render-ego_min0.007049763997395833
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
279245071Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.147668767106981
survival_time_median9.750000000000004
deviation-center-line_median0.4699191911936247
in-drivable-lane_median1.4500000000000206


other stats
agent_compute-ego_max0.022071852741471255
agent_compute-ego_mean0.021209201135738404
agent_compute-ego_median0.02097485115478089
agent_compute-ego_min0.020334098981395703
deviation-center-line_max0.8709135901819355
deviation-center-line_mean0.5226690056634119
deviation-center-line_min0.3023962484875289
deviation-heading_max2.8702997536094323
deviation-heading_mean1.8454161618540468
deviation-heading_median1.874463707960231
deviation-heading_min1.1243989234336758
driven_any_max4.08536127214223
driven_any_mean2.5286248849651263
driven_any_median2.6185600986199553
driven_any_min1.0666600622716658
driven_lanedir_consec_max3.354859957243163
driven_lanedir_consec_mean2.0334536897103335
driven_lanedir_consec_min0.8943542552489656
driven_lanedir_max3.354859957243163
driven_lanedir_mean2.0334536897103335
driven_lanedir_median2.147668767106981
driven_lanedir_min0.8943542552489656
in-drivable-lane_max2.150000000000026
in-drivable-lane_mean1.4700000000000115
in-drivable-lane_min0.34999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6185600986199553, "sim_physics": 0.0799778082431891, "survival_time": 9.750000000000004, "driven_lanedir": 2.147668767106981, "sim_render-ego": 0.009531193513136645, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.022009872778868064, "deviation-heading": 1.874463707960231, "set_robot_commands": 0.008896507360996344, "deviation-center-line": 0.4699191911936247, "driven_lanedir_consec": 2.147668767106981, "sim_compute_sim_state": 0.004695513309576573, "sim_compute_performance-ego": 0.005901337892581255, "sim_compute_robot_state-ego": 0.007037135882255359}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.08536127214223, "sim_physics": 0.07933290719985962, "survival_time": 14.950000000000076, "driven_lanedir": 3.354859957243163, "sim_render-ego": 0.009518664677937824, "in-drivable-lane": 2.150000000000026, "agent_compute-ego": 0.020655330022176108, "deviation-heading": 2.8702997536094323, "set_robot_commands": 0.009435455004374186, "deviation-center-line": 0.8709135901819355, "driven_lanedir_consec": 3.354859957243163, "sim_compute_sim_state": 0.004560185273488363, "sim_compute_performance-ego": 0.005518534183502197, "sim_compute_robot_state-ego": 0.0069646040598551435}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0666600622716658, "sim_physics": 0.08077740381999188, "survival_time": 4.149999999999993, "driven_lanedir": 0.8943542552489656, "sim_render-ego": 0.010257643389414591, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.022071852741471255, "deviation-heading": 1.1243989234336758, "set_robot_commands": 0.009806736406073512, "deviation-center-line": 0.3023962484875289, "driven_lanedir_consec": 0.8943542552489656, "sim_compute_sim_state": 0.004496304385633354, "sim_compute_performance-ego": 0.005915038556937712, "sim_compute_robot_state-ego": 0.007305630718369082}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9051899874961769, "sim_physics": 0.08077928236314466, "survival_time": 7.149999999999983, "driven_lanedir": 1.3016868018512704, "sim_render-ego": 0.009574786766425711, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.02097485115478089, "deviation-heading": 1.2054053363802644, "set_robot_commands": 0.009056919938200837, "deviation-center-line": 0.4112690654651493, "driven_lanedir_consec": 1.3016868018512704, "sim_compute_sim_state": 0.0045591100946172965, "sim_compute_performance-ego": 0.005470649345771416, "sim_compute_robot_state-ego": 0.006970568970366791}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.9673530042956027, "sim_physics": 0.07368222219214592, "survival_time": 10.95000000000002, "driven_lanedir": 2.468698667101286, "sim_render-ego": 0.009218544720514725, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.020334098981395703, "deviation-heading": 2.1525130878866294, "set_robot_commands": 0.008781158760802387, "deviation-center-line": 0.5588469329888213, "driven_lanedir_consec": 2.468698667101286, "sim_compute_sim_state": 0.004298035956953214, "sim_compute_performance-ego": 0.005433555063047366, "sim_compute_robot_state-ego": 0.006709460254129209}}
set_robot_commands_max0.009806736406073512
set_robot_commands_mean0.009195355494089456
set_robot_commands_median0.009056919938200837
set_robot_commands_min0.008781158760802387
sim_compute_performance-ego_max0.005915038556937712
sim_compute_performance-ego_mean0.005647823008367989
sim_compute_performance-ego_median0.005518534183502197
sim_compute_performance-ego_min0.005433555063047366
sim_compute_robot_state-ego_max0.007305630718369082
sim_compute_robot_state-ego_mean0.006997479976995118
sim_compute_robot_state-ego_median0.006970568970366791
sim_compute_robot_state-ego_min0.006709460254129209
sim_compute_sim_state_max0.004695513309576573
sim_compute_sim_state_mean0.00452182980405376
sim_compute_sim_state_median0.0045591100946172965
sim_compute_sim_state_min0.004298035956953214
sim_physics_max0.08077928236314466
sim_physics_mean0.07890992476366623
sim_physics_median0.0799778082431891
sim_physics_min0.07368222219214592
sim_render-ego_max0.010257643389414591
sim_render-ego_mean0.0096201666134859
sim_render-ego_median0.009531193513136645
sim_render-ego_min0.009218544720514725
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.390000000000017
survival_time_min4.149999999999993
No reset possible
279155066Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8602692906056593
survival_time_median14.150000000000066
deviation-center-line_median0.6479017009202998
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.04922556961383078
agent_compute-ego_mean0.03839438574496726
agent_compute-ego_median0.038710455099741616
agent_compute-ego_min0.027567822758744403
deviation-center-line_max1.126863398464274
deviation-center-line_mean0.6085838656005013
deviation-center-line_min0.10771969582011667
deviation-heading_max4.547027071538886
deviation-heading_mean3.02699315845348
deviation-heading_median3.905717710131003
deviation-heading_min1.000634129155564
driven_any_max4.08525045645754
driven_any_mean2.715830850791702
driven_any_median3.8617399701579873
driven_any_min0.5075826997598266
driven_lanedir_consec_max3.71178510884997
driven_lanedir_consec_mean2.1244036289907315
driven_lanedir_consec_min0.20573708906907995
driven_lanedir_max3.71178510884997
driven_lanedir_mean2.158946825984877
driven_lanedir_median2.991533649087455
driven_lanedir_min0.2382285447221657
in-drivable-lane_max2.400000000000028
in-drivable-lane_mean1.16000000000001
in-drivable-lane_min0.55
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0393534446719856, "sim_physics": 0.10336663374086706, "survival_time": 4.099999999999993, "driven_lanedir": 0.6834037751334952, "sim_render-ego": 0.012285910001615198, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.027567822758744403, "deviation-heading": 1.6969576979698853, "set_robot_commands": 0.011655830755466367, "deviation-center-line": 0.17916284512011407, "driven_lanedir_consec": 0.6744436042976474, "sim_compute_sim_state": 0.0051625094762662565, "sim_compute_performance-ego": 0.007512488016268102, "sim_compute_robot_state-ego": 0.008678101911777404}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.08525045645754, "sim_physics": 0.0835959792137146, "survival_time": 14.950000000000076, "driven_lanedir": 3.1697830521313, "sim_render-ego": 0.010227510929107666, "in-drivable-lane": 2.400000000000028, "agent_compute-ego": 0.038710455099741616, "deviation-heading": 3.905717710131003, "set_robot_commands": 0.007693878014882406, "deviation-center-line": 0.6479017009202998, "driven_lanedir_consec": 3.1697830521313, "sim_compute_sim_state": 0.004126367568969727, "sim_compute_performance-ego": 0.006058340867360433, "sim_compute_robot_state-ego": 0.007561619281768799}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.085227682911172, "sim_physics": 0.08521575927734375, "survival_time": 14.950000000000076, "driven_lanedir": 3.71178510884997, "sim_render-ego": 0.010305655002593997, "in-drivable-lane": 0.55, "agent_compute-ego": 0.03764297962188721, "deviation-heading": 3.9846291834720633, "set_robot_commands": 0.007889427344004314, "deviation-center-line": 1.126863398464274, "driven_lanedir_consec": 3.71178510884997, "sim_compute_sim_state": 0.0042330527305603025, "sim_compute_performance-ego": 0.006050390402475993, "sim_compute_robot_state-ego": 0.00753316322962443}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5075826997598266, "sim_physics": 0.09240905074186104, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2382285447221657, "sim_render-ego": 0.011404874712921852, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.03882510163063227, "deviation-heading": 1.000634129155564, "set_robot_commands": 0.008632255154986715, "deviation-center-line": 0.10771969582011667, "driven_lanedir_consec": 0.20573708906907995, "sim_compute_sim_state": 0.004241904547048169, "sim_compute_performance-ego": 0.0065516150274942085, "sim_compute_robot_state-ego": 0.007644547972568246}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.8617399701579873, "sim_physics": 0.12882816075436218, "survival_time": 14.150000000000066, "driven_lanedir": 2.991533649087455, "sim_render-ego": 0.014014961020264104, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.04922556961383078, "deviation-heading": 4.547027071538886, "set_robot_commands": 0.011427626592952876, "deviation-center-line": 0.981271687677702, "driven_lanedir_consec": 2.8602692906056593, "sim_compute_sim_state": 0.005661342674767592, "sim_compute_performance-ego": 0.008175520509376122, "sim_compute_robot_state-ego": 0.010371988316728031}}
set_robot_commands_max0.011655830755466367
set_robot_commands_mean0.009459803572458536
set_robot_commands_median0.008632255154986715
set_robot_commands_min0.007693878014882406
sim_compute_performance-ego_max0.008175520509376122
sim_compute_performance-ego_mean0.006869670964594972
sim_compute_performance-ego_median0.0065516150274942085
sim_compute_performance-ego_min0.006050390402475993
sim_compute_robot_state-ego_max0.010371988316728031
sim_compute_robot_state-ego_mean0.008357884142493383
sim_compute_robot_state-ego_median0.007644547972568246
sim_compute_robot_state-ego_min0.00753316322962443
sim_compute_sim_state_max0.005661342674767592
sim_compute_sim_state_mean0.00468503539952241
sim_compute_sim_state_median0.004241904547048169
sim_compute_sim_state_min0.004126367568969727
sim_physics_max0.12882816075436218
sim_physics_mean0.09868311674562973
sim_physics_median0.09240905074186104
sim_physics_min0.0835959792137146
sim_render-ego_max0.014014961020264104
sim_render-ego_mean0.011647782333300565
sim_render-ego_median0.011404874712921852
sim_render-ego_min0.010227510929107666
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.06000000000004
survival_time_min2.1500000000000004
No reset possible
278955058Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7656909517592029
survival_time_median3.899999999999994
deviation-center-line_median0.183688667907069
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.17944507122039796
agent_compute-ego_mean0.13671985303436102
agent_compute-ego_median0.1416322879302196
agent_compute-ego_min0.10181325177351634
deviation-center-line_max0.48876165630568064
deviation-center-line_mean0.2555261543746581
deviation-center-line_min0.1482875974830999
deviation-heading_max1.0264194861541822
deviation-heading_mean0.7025659087544206
deviation-heading_median0.5449403492362149
deviation-heading_min0.421054147710854
driven_any_max2.0030970069353313
driven_any_mean1.234405864097076
driven_any_median0.9968103647330874
driven_any_min0.5775232484729117
driven_lanedir_consec_max1.2986686801388674
driven_lanedir_consec_mean0.8148961649701016
driven_lanedir_consec_min0.5643014721799098
driven_lanedir_max1.2986686801388674
driven_lanedir_mean0.8148961649701016
driven_lanedir_median0.7656909517592029
driven_lanedir_min0.5643014721799098
in-drivable-lane_max2.9499999999999895
in-drivable-lane_mean1.379999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9968097329433304, "sim_physics": 0.07719628321818817, "survival_time": 3.899999999999994, "driven_lanedir": 0.6425317850190072, "sim_render-ego": 0.00895381279480763, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.1574533291352101, "deviation-heading": 1.0264194861541822, "set_robot_commands": 0.00647282906067677, "deviation-center-line": 0.16992100153724107, "driven_lanedir_consec": 0.6425317850190072, "sim_compute_sim_state": 0.003866703082353641, "sim_compute_performance-ego": 0.005420296620099972, "sim_compute_robot_state-ego": 0.006509163440802159}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0030970069353313, "sim_physics": 0.08169079144795735, "survival_time": 7.499999999999981, "driven_lanedir": 1.2986686801388674, "sim_render-ego": 0.009672396977742512, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.17944507122039796, "deviation-heading": 0.9936268410219792, "set_robot_commands": 0.007335777282714844, "deviation-center-line": 0.48876165630568064, "driven_lanedir_consec": 1.2986686801388674, "sim_compute_sim_state": 0.004022938410441081, "sim_compute_performance-ego": 0.005476849873860677, "sim_compute_robot_state-ego": 0.006909890174865723}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9968103647330874, "sim_physics": 0.06529021568787403, "survival_time": 3.899999999999994, "driven_lanedir": 0.803287935753521, "sim_render-ego": 0.0084916781156491, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1416322879302196, "deviation-heading": 0.5449403492362149, "set_robot_commands": 0.0059647743518535905, "deviation-center-line": 0.1482875974830999, "driven_lanedir_consec": 0.803287935753521, "sim_compute_sim_state": 0.003529753440465682, "sim_compute_performance-ego": 0.004764621074383075, "sim_compute_robot_state-ego": 0.0059734735733423475}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5977889674007184, "sim_physics": 0.05588485386745989, "survival_time": 6.0499999999999865, "driven_lanedir": 0.7656909517592029, "sim_render-ego": 0.007202544488197516, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.10325532511246106, "deviation-heading": 0.421054147710854, "set_robot_commands": 0.004927396774291992, "deviation-center-line": 0.2869718486401997, "driven_lanedir_consec": 0.7656909517592029, "sim_compute_sim_state": 0.002941929604396347, "sim_compute_performance-ego": 0.004024515467241776, "sim_compute_robot_state-ego": 0.004987590569109956}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5775232484729117, "sim_physics": 0.05920921266078949, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5643014721799098, "sim_render-ego": 0.007214024662971497, "in-drivable-lane": 0, "agent_compute-ego": 0.10181325177351634, "deviation-heading": 0.5267887196488722, "set_robot_commands": 0.005150169134140015, "deviation-center-line": 0.183688667907069, "driven_lanedir_consec": 0.5643014721799098, "sim_compute_sim_state": 0.0029695977767308555, "sim_compute_performance-ego": 0.00398312509059906, "sim_compute_robot_state-ego": 0.0050014058748881025}}
set_robot_commands_max0.007335777282714844
set_robot_commands_mean0.005970189320735442
set_robot_commands_median0.0059647743518535905
set_robot_commands_min0.004927396774291992
sim_compute_performance-ego_max0.005476849873860677
sim_compute_performance-ego_mean0.004733881625236912
sim_compute_performance-ego_median0.004764621074383075
sim_compute_performance-ego_min0.00398312509059906
sim_compute_robot_state-ego_max0.006909890174865723
sim_compute_robot_state-ego_mean0.005876304726601658
sim_compute_robot_state-ego_median0.0059734735733423475
sim_compute_robot_state-ego_min0.004987590569109956
sim_compute_sim_state_max0.004022938410441081
sim_compute_sim_state_mean0.003466184462877521
sim_compute_sim_state_median0.003529753440465682
sim_compute_sim_state_min0.002941929604396347
sim_physics_max0.08169079144795735
sim_physics_mean0.06785427137645379
sim_physics_median0.06529021568787403
sim_physics_min0.05588485386745989
sim_render-ego_max0.009672396977742512
sim_render-ego_mean0.008306891407873652
sim_render-ego_median0.0084916781156491
sim_render-ego_min0.007202544488197516
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean4.749999999999991
survival_time_min2.3999999999999995
No reset possible
278825047Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:09:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.809322084348672
survival_time_median14.950000000000076
deviation-center-line_median0.7768552404694199
in-drivable-lane_median1.3500000000000192


other stats
agent_compute-ego_max0.021901991367340088
agent_compute-ego_mean0.019654205163319904
agent_compute-ego_median0.02086442788441976
agent_compute-ego_min0.015914283593495688
deviation-center-line_max1.190943013971933
deviation-center-line_mean0.8720794442690348
deviation-center-line_min0.6992794552789734
deviation-heading_max4.455499213892497
deviation-heading_mean3.674688382213489
deviation-heading_median3.549759345517011
deviation-heading_min2.6329526188000507
driven_any_max4.329325225228139
driven_any_mean3.717168712292761
driven_any_median3.7494750177090768
driven_any_min3.2259679330086444
driven_lanedir_consec_max3.827769639127868
driven_lanedir_consec_mean3.0757621461543416
driven_lanedir_consec_min2.3592212951318965
driven_lanedir_max4.068865571684194
driven_lanedir_mean3.367691941984659
driven_lanedir_median3.577774341727159
driven_lanedir_min2.687894777795358
in-drivable-lane_max2.9500000000000197
in-drivable-lane_mean1.5600000000000158
in-drivable-lane_min0.8500000000000023
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2259679330086444, "sim_physics": 0.07800205230712891, "survival_time": 14.950000000000076, "driven_lanedir": 2.809322084348672, "sim_render-ego": 0.009491228262583414, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.02086442788441976, "deviation-heading": 4.455499213892497, "set_robot_commands": 0.009664006233215332, "deviation-center-line": 0.7768552404694199, "driven_lanedir_consec": 2.809322084348672, "sim_compute_sim_state": 0.00474712610244751, "sim_compute_performance-ego": 0.00558464765548706, "sim_compute_robot_state-ego": 0.0069185789426167805}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.015950984960197, "sim_physics": 0.08153515895207723, "survival_time": 14.950000000000076, "driven_lanedir": 3.694602934367914, "sim_render-ego": 0.00957320769627889, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.021901991367340088, "deviation-heading": 3.549759345517011, "set_robot_commands": 0.009886526266733805, "deviation-center-line": 0.9380376073674926, "driven_lanedir_consec": 3.694602934367914, "sim_compute_sim_state": 0.004741818904876709, "sim_compute_performance-ego": 0.005658056735992432, "sim_compute_robot_state-ego": 0.007025485038757324}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.265124400557748, "sim_physics": 0.08015605052312215, "survival_time": 14.950000000000076, "driven_lanedir": 2.687894777795358, "sim_render-ego": 0.009799726009368896, "in-drivable-lane": 2.9500000000000197, "agent_compute-ego": 0.021109039783477786, "deviation-heading": 3.546829905991534, "set_robot_commands": 0.009577759901682536, "deviation-center-line": 0.7552819042573551, "driven_lanedir_consec": 2.687894777795358, "sim_compute_sim_state": 0.004826290607452393, "sim_compute_performance-ego": 0.0059021504720052085, "sim_compute_robot_state-ego": 0.007266105016072591}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.329325225228139, "sim_physics": 0.06632068157196044, "survival_time": 14.950000000000076, "driven_lanedir": 4.068865571684194, "sim_render-ego": 0.008355785210927327, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.01848128318786621, "deviation-heading": 2.6329526188000507, "set_robot_commands": 0.008320980072021485, "deviation-center-line": 0.6992794552789734, "driven_lanedir_consec": 3.827769639127868, "sim_compute_sim_state": 0.0040620374679565426, "sim_compute_performance-ego": 0.004841603438059489, "sim_compute_robot_state-ego": 0.005998857021331787}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.7494750177090768, "sim_physics": 0.058248559633890785, "survival_time": 14.950000000000076, "driven_lanedir": 3.577774341727159, "sim_render-ego": 0.007179730733235677, "in-drivable-lane": 0.8500000000000023, "agent_compute-ego": 0.015914283593495688, "deviation-heading": 4.188400826866355, "set_robot_commands": 0.007266390323638916, "deviation-center-line": 1.190943013971933, "driven_lanedir_consec": 2.3592212951318965, "sim_compute_sim_state": 0.0036049405733744305, "sim_compute_performance-ego": 0.004102049668629964, "sim_compute_robot_state-ego": 0.005126332441965739}}
set_robot_commands_max0.009886526266733805
set_robot_commands_mean0.008943132559458415
set_robot_commands_median0.009577759901682536
set_robot_commands_min0.007266390323638916
sim_compute_performance-ego_max0.0059021504720052085
sim_compute_performance-ego_mean0.005217701594034831
sim_compute_performance-ego_median0.00558464765548706
sim_compute_performance-ego_min0.004102049668629964
sim_compute_robot_state-ego_max0.007266105016072591
sim_compute_robot_state-ego_mean0.006467071692148845
sim_compute_robot_state-ego_median0.0069185789426167805
sim_compute_robot_state-ego_min0.005126332441965739
sim_compute_sim_state_max0.004826290607452393
sim_compute_sim_state_mean0.004396442731221517
sim_compute_sim_state_median0.004741818904876709
sim_compute_sim_state_min0.0036049405733744305
sim_physics_max0.08153515895207723
sim_physics_mean0.07285250059763591
sim_physics_median0.07800205230712891
sim_physics_min0.058248559633890785
sim_render-ego_max0.009799726009368896
sim_render-ego_mean0.008879935582478841
sim_render-ego_median0.009491228262583414
sim_render-ego_min0.007179730733235677
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
278665038Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8971210013399498
survival_time_median14.950000000000076
deviation-center-line_median0.7011830234781639
in-drivable-lane_median1.300000000000006


other stats
agent_compute-ego_max0.042307022412618
agent_compute-ego_mean0.04059695002323296
agent_compute-ego_median0.04065404002298445
agent_compute-ego_min0.03901474952697754
deviation-center-line_max0.9688872975051814
deviation-center-line_mean0.7037032332519342
deviation-center-line_min0.40744735757703465
deviation-heading_max4.26399160852017
deviation-heading_mean3.0514632193286073
deviation-heading_median3.392239983614805
deviation-heading_min1.2909880247792025
driven_any_max4.103531249069024
driven_any_mean3.2053866854175737
driven_any_median3.3581161472246563
driven_any_min1.7616355037389904
driven_lanedir_consec_max3.984195706085494
driven_lanedir_consec_mean2.639724613105221
driven_lanedir_consec_min1.3142459893665288
driven_lanedir_max3.984195706085494
driven_lanedir_mean2.90771131791564
driven_lanedir_median3.103321646660893
driven_lanedir_min1.3142459893665288
in-drivable-lane_max3.9000000000000146
in-drivable-lane_mean1.5600000000000025
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2632485172619528, "sim_physics": 0.08802849451700846, "survival_time": 14.950000000000076, "driven_lanedir": 2.8971210013399498, "sim_render-ego": 0.01065572738647461, "in-drivable-lane": 1.300000000000006, "agent_compute-ego": 0.03901474952697754, "deviation-heading": 4.26399160852017, "set_robot_commands": 0.00920567512512207, "deviation-center-line": 0.9688872975051814, "driven_lanedir_consec": 2.8971210013399498, "sim_compute_sim_state": 0.004578421115875244, "sim_compute_performance-ego": 0.00630440632502238, "sim_compute_robot_state-ego": 0.007685543696085612}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.3581161472246563, "sim_physics": 0.08602722326914469, "survival_time": 14.950000000000076, "driven_lanedir": 3.2396722461253353, "sim_render-ego": 0.011161355177561444, "in-drivable-lane": 0, "agent_compute-ego": 0.042307022412618, "deviation-heading": 3.4237889067790546, "set_robot_commands": 0.008153134187062582, "deviation-center-line": 0.7853827564799886, "driven_lanedir_consec": 3.2396722461253353, "sim_compute_sim_state": 0.0042166717847188315, "sim_compute_performance-ego": 0.006056737899780273, "sim_compute_robot_state-ego": 0.007323267459869384}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7616355037389904, "sim_physics": 0.07816914103975232, "survival_time": 7.449999999999981, "driven_lanedir": 1.3142459893665288, "sim_render-ego": 0.009823744729061256, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.04065404002298445, "deviation-heading": 1.2909880247792025, "set_robot_commands": 0.007507207409647487, "deviation-center-line": 0.40744735757703465, "driven_lanedir_consec": 1.3142459893665288, "sim_compute_sim_state": 0.003897060483894092, "sim_compute_performance-ego": 0.005600326013245039, "sim_compute_robot_state-ego": 0.006969010269881895}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.540402009793245, "sim_physics": 0.08473946809768677, "survival_time": 14.950000000000076, "driven_lanedir": 3.103321646660893, "sim_render-ego": 0.010033531188964844, "in-drivable-lane": 3.9000000000000146, "agent_compute-ego": 0.04183816909790039, "deviation-heading": 2.8863075729498036, "set_robot_commands": 0.008010247548421223, "deviation-center-line": 0.7011830234781639, "driven_lanedir_consec": 1.763388122608798, "sim_compute_sim_state": 0.004342249234517415, "sim_compute_performance-ego": 0.005821346441904704, "sim_compute_robot_state-ego": 0.007218853632609049}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.103531249069024, "sim_physics": 0.0712441356976827, "survival_time": 14.950000000000076, "driven_lanedir": 3.984195706085494, "sim_render-ego": 0.008950839837392172, "in-drivable-lane": 0, "agent_compute-ego": 0.03917076905568441, "deviation-heading": 3.392239983614805, "set_robot_commands": 0.00683103879292806, "deviation-center-line": 0.6556157312193025, "driven_lanedir_consec": 3.984195706085494, "sim_compute_sim_state": 0.0038196953137715657, "sim_compute_performance-ego": 0.005272125403086345, "sim_compute_robot_state-ego": 0.00656094233194987}}
set_robot_commands_max0.00920567512512207
set_robot_commands_mean0.007941460612636285
set_robot_commands_median0.008010247548421223
set_robot_commands_min0.00683103879292806
sim_compute_performance-ego_max0.00630440632502238
sim_compute_performance-ego_mean0.005810988416607749
sim_compute_performance-ego_median0.005821346441904704
sim_compute_performance-ego_min0.005272125403086345
sim_compute_robot_state-ego_max0.007685543696085612
sim_compute_robot_state-ego_mean0.007151523478079162
sim_compute_robot_state-ego_median0.007218853632609049
sim_compute_robot_state-ego_min0.00656094233194987
sim_compute_sim_state_max0.004578421115875244
sim_compute_sim_state_mean0.00417081958655543
sim_compute_sim_state_median0.0042166717847188315
sim_compute_sim_state_min0.0038196953137715657
sim_physics_max0.08802849451700846
sim_physics_mean0.08164169252425499
sim_physics_median0.08473946809768677
sim_physics_min0.0712441356976827
sim_render-ego_max0.011161355177561444
sim_render-ego_mean0.010125039663890865
sim_render-ego_median0.010033531188964844
sim_render-ego_min0.008950839837392172
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.450000000000056
survival_time_min7.449999999999981
No reset possible
278495027Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.435466023741965
survival_time_median14.950000000000076
deviation-center-line_median0.7963032412216196
in-drivable-lane_median1.2000000000000108


other stats
agent_compute-ego_max0.04259537220001221
agent_compute-ego_mean0.03929593515396118
agent_compute-ego_median0.041252509752909346
agent_compute-ego_min0.03290367603302002
deviation-center-line_max0.9898755193873684
deviation-center-line_mean0.8286761838845192
deviation-center-line_min0.6714863017182602
deviation-heading_max4.396544275990978
deviation-heading_mean3.712091997426568
deviation-heading_median4.039058998258742
deviation-heading_min2.0381181057458764
driven_any_max5.489896448211993
driven_any_mean3.803137049843497
driven_any_median3.3820268815680654
driven_any_min3.2787653269303436
driven_lanedir_consec_max3.19107534500961
driven_lanedir_consec_mean2.4113035261961207
driven_lanedir_consec_min1.4671481017742547
driven_lanedir_max5.23771106878828
driven_lanedir_mean3.5266740937765384
driven_lanedir_median3.19107534500961
driven_lanedir_min2.9477006110150783
in-drivable-lane_max2.3500000000000068
in-drivable-lane_mean1.2100000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.3794181453548604, "sim_physics": 0.08734477361043294, "survival_time": 14.950000000000076, "driven_lanedir": 3.0204077421680315, "sim_render-ego": 0.010276526610056558, "in-drivable-lane": 2.3500000000000068, "agent_compute-ego": 0.03775029977162679, "deviation-heading": 4.226281606103549, "set_robot_commands": 0.00865989605585734, "deviation-center-line": 0.7963032412216196, "driven_lanedir_consec": 2.015127549439696, "sim_compute_sim_state": 0.00455410639444987, "sim_compute_performance-ego": 0.006131358941396077, "sim_compute_robot_state-ego": 0.007573603789011637}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.3820268815680654, "sim_physics": 0.08860843261082967, "survival_time": 14.950000000000076, "driven_lanedir": 3.19107534500961, "sim_render-ego": 0.01115455945332845, "in-drivable-lane": 0, "agent_compute-ego": 0.04259537220001221, "deviation-heading": 4.039058998258742, "set_robot_commands": 0.008181280295054117, "deviation-center-line": 0.8934554815345344, "driven_lanedir_consec": 3.19107534500961, "sim_compute_sim_state": 0.004353891213734945, "sim_compute_performance-ego": 0.006054995854695638, "sim_compute_robot_state-ego": 0.007587855656941732}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2787653269303436, "sim_physics": 0.08320077737172445, "survival_time": 14.950000000000076, "driven_lanedir": 2.9477006110150783, "sim_render-ego": 0.010338839689890545, "in-drivable-lane": 1.2000000000000108, "agent_compute-ego": 0.04197781801223755, "deviation-heading": 3.860457001033693, "set_robot_commands": 0.0082988174756368, "deviation-center-line": 0.9898755193873684, "driven_lanedir_consec": 2.9477006110150783, "sim_compute_sim_state": 0.0042795292536417645, "sim_compute_performance-ego": 0.006109546820322672, "sim_compute_robot_state-ego": 0.007564590771993001}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4855784471522218, "sim_physics": 0.08029953241348267, "survival_time": 14.950000000000076, "driven_lanedir": 3.236475701901691, "sim_render-ego": 0.010137260754903158, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.041252509752909346, "deviation-heading": 4.396544275990978, "set_robot_commands": 0.008069198131561279, "deviation-center-line": 0.7922603755608142, "driven_lanedir_consec": 1.4671481017742547, "sim_compute_sim_state": 0.00414323886235555, "sim_compute_performance-ego": 0.005790747801462809, "sim_compute_robot_state-ego": 0.0072436817487080895}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.489896448211993, "sim_physics": 0.055249823729197185, "survival_time": 14.950000000000076, "driven_lanedir": 5.23771106878828, "sim_render-ego": 0.007209922472635905, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.03290367603302002, "deviation-heading": 2.0381181057458764, "set_robot_commands": 0.005210026899973552, "deviation-center-line": 0.6714863017182602, "driven_lanedir_consec": 2.435466023741965, "sim_compute_sim_state": 0.002984054883321126, "sim_compute_performance-ego": 0.004110891024271647, "sim_compute_robot_state-ego": 0.005091866652170817}}
set_robot_commands_max0.00865989605585734
set_robot_commands_mean0.007683843771616618
set_robot_commands_median0.008181280295054117
set_robot_commands_min0.005210026899973552
sim_compute_performance-ego_max0.006131358941396077
sim_compute_performance-ego_mean0.005639508088429769
sim_compute_performance-ego_median0.006054995854695638
sim_compute_performance-ego_min0.004110891024271647
sim_compute_robot_state-ego_max0.007587855656941732
sim_compute_robot_state-ego_mean0.007012319723765055
sim_compute_robot_state-ego_median0.007564590771993001
sim_compute_robot_state-ego_min0.005091866652170817
sim_compute_sim_state_max0.00455410639444987
sim_compute_sim_state_mean0.00406296412150065
sim_compute_sim_state_median0.0042795292536417645
sim_compute_sim_state_min0.002984054883321126
sim_physics_max0.08860843261082967
sim_physics_mean0.07894066794713336
sim_physics_median0.08320077737172445
sim_physics_min0.055249823729197185
sim_render-ego_max0.01115455945332845
sim_render-ego_mean0.009823421796162924
sim_render-ego_median0.010276526610056558
sim_render-ego_min0.007209922472635905
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
278445023Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.88091756442516
survival_time_median14.950000000000076
deviation-center-line_median0.8198706592388438
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0424854310353597
agent_compute-ego_mean0.03635452731450399
agent_compute-ego_median0.04116872549057007
agent_compute-ego_min0.023627088864644367
deviation-center-line_max1.0959522191846025
deviation-center-line_mean0.8365232153915553
deviation-center-line_min0.5725654222342834
deviation-heading_max4.812683052195715
deviation-heading_mean3.6042325480905126
deviation-heading_median3.308381292348495
deviation-heading_min2.5279119394208616
driven_any_max4.917102512736959
driven_any_mean3.846414518137986
driven_any_median4.072073683336259
driven_any_min2.754009616944566
driven_lanedir_consec_max4.8249409713350975
driven_lanedir_consec_mean3.675481003004408
driven_lanedir_consec_min2.5642957873591925
driven_lanedir_max4.8249409713350975
driven_lanedir_mean3.6756970570272274
driven_lanedir_median3.88091756442516
driven_lanedir_min2.5642957873591925
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.40000000000000513
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.754009616944566, "sim_physics": 0.08348033905029296, "survival_time": 14.950000000000076, "driven_lanedir": 2.5642957873591925, "sim_render-ego": 0.010523370901743573, "in-drivable-lane": 0, "agent_compute-ego": 0.023627088864644367, "deviation-heading": 4.812683052195715, "set_robot_commands": 0.010427837371826173, "deviation-center-line": 0.8745357752385806, "driven_lanedir_consec": 2.5642957873591925, "sim_compute_sim_state": 0.004749066829681396, "sim_compute_performance-ego": 0.006473093827565511, "sim_compute_robot_state-ego": 0.007721192836761474}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.988927245740048, "sim_physics": 0.08166781107584635, "survival_time": 14.950000000000076, "driven_lanedir": 2.7293388122361075, "sim_render-ego": 0.010472841262817384, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.03326275904973348, "deviation-heading": 4.300460306355853, "set_robot_commands": 0.009087942441304524, "deviation-center-line": 0.8196920010614656, "driven_lanedir_consec": 2.728258542122015, "sim_compute_sim_state": 0.0043737037976582845, "sim_compute_performance-ego": 0.006048166751861572, "sim_compute_robot_state-ego": 0.007466605504353841}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.072073683336259, "sim_physics": 0.0820729676882426, "survival_time": 14.950000000000076, "driven_lanedir": 3.88091756442516, "sim_render-ego": 0.010532199541727702, "in-drivable-lane": 0.750000000000008, "agent_compute-ego": 0.04122863213221232, "deviation-heading": 3.308381292348495, "set_robot_commands": 0.008079315821329753, "deviation-center-line": 1.0959522191846025, "driven_lanedir_consec": 3.88091756442516, "sim_compute_sim_state": 0.004208645820617676, "sim_compute_performance-ego": 0.006081251303354899, "sim_compute_robot_state-ego": 0.007521571318308513}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.917102512736959, "sim_physics": 0.0803532886505127, "survival_time": 14.950000000000076, "driven_lanedir": 4.8249409713350975, "sim_render-ego": 0.010000206629435222, "in-drivable-lane": 0, "agent_compute-ego": 0.04116872549057007, "deviation-heading": 2.5279119394208616, "set_robot_commands": 0.007759404182434082, "deviation-center-line": 0.5725654222342834, "driven_lanedir_consec": 4.8249409713350975, "sim_compute_sim_state": 0.004139446417490642, "sim_compute_performance-ego": 0.005780499776204427, "sim_compute_robot_state-ego": 0.007247493267059326}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.499959531932098, "sim_physics": 0.08694627046585084, "survival_time": 14.950000000000076, "driven_lanedir": 4.378992149780578, "sim_render-ego": 0.01032231330871582, "in-drivable-lane": 0, "agent_compute-ego": 0.0424854310353597, "deviation-heading": 3.0717261501316377, "set_robot_commands": 0.007980189323425292, "deviation-center-line": 0.8198706592388438, "driven_lanedir_consec": 4.378992149780578, "sim_compute_sim_state": 0.004206948280334473, "sim_compute_performance-ego": 0.005954264799753825, "sim_compute_robot_state-ego": 0.007477086385091146}}
set_robot_commands_max0.010427837371826173
set_robot_commands_mean0.008666937828063964
set_robot_commands_median0.008079315821329753
set_robot_commands_min0.007759404182434082
sim_compute_performance-ego_max0.006473093827565511
sim_compute_performance-ego_mean0.006067455291748047
sim_compute_performance-ego_median0.006048166751861572
sim_compute_performance-ego_min0.005780499776204427
sim_compute_robot_state-ego_max0.007721192836761474
sim_compute_robot_state-ego_mean0.007486789862314861
sim_compute_robot_state-ego_median0.007477086385091146
sim_compute_robot_state-ego_min0.007247493267059326
sim_compute_sim_state_max0.004749066829681396
sim_compute_sim_state_mean0.004335562229156494
sim_compute_sim_state_median0.004208645820617676
sim_compute_sim_state_min0.004139446417490642
sim_physics_max0.08694627046585084
sim_physics_mean0.08290413538614909
sim_physics_median0.0820729676882426
sim_physics_min0.0803532886505127
sim_render-ego_max0.010532199541727702
sim_render-ego_mean0.01037018632888794
sim_render-ego_median0.010472841262817384
sim_render-ego_min0.010000206629435222
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
278285016Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.075751964957316
survival_time_median14.950000000000076
deviation-center-line_median0.7861024963711597
in-drivable-lane_median1.149999999999996


other stats
agent_compute-ego_max0.01611863056818644
agent_compute-ego_mean0.015643232663472492
agent_compute-ego_median0.015604691505432129
agent_compute-ego_min0.015323188304901123
deviation-center-line_max1.0272854124173467
deviation-center-line_mean0.7769690331051045
deviation-center-line_min0.5920159457234467
deviation-heading_max3.905962708725884
deviation-heading_mean3.751284662315419
deviation-heading_median3.848648260222411
deviation-heading_min3.510861419153114
driven_any_max4.132053598286885
driven_any_mean3.7878773976756057
driven_any_median3.807275233835156
driven_any_min3.2268639251071254
driven_lanedir_consec_max4.0083425171237455
driven_lanedir_consec_mean3.0678649225309207
driven_lanedir_consec_min2.391505280282734
driven_lanedir_max4.0083425171237455
driven_lanedir_mean3.5039644999501105
driven_lanedir_median3.4029424166223503
driven_lanedir_min3.075751964957316
in-drivable-lane_max2.7500000000000178
in-drivable-lane_mean1.3300000000000056
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.807275233835156, "sim_physics": 0.05792152563730875, "survival_time": 14.950000000000076, "driven_lanedir": 3.3731304120476024, "sim_render-ego": 0.006997803052266439, "in-drivable-lane": 2.7500000000000178, "agent_compute-ego": 0.015612005392710368, "deviation-heading": 3.600458407581376, "set_robot_commands": 0.007183709939320882, "deviation-center-line": 0.6887508334703316, "driven_lanedir_consec": 2.4607824336684567, "sim_compute_sim_state": 0.0034939169883728026, "sim_compute_performance-ego": 0.004168352286020915, "sim_compute_robot_state-ego": 0.005068352222442627}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.2268639251071254, "sim_physics": 0.06059439818064371, "survival_time": 14.950000000000076, "driven_lanedir": 3.075751964957316, "sim_render-ego": 0.007236797014872233, "in-drivable-lane": 0, "agent_compute-ego": 0.015604691505432129, "deviation-heading": 3.905962708725884, "set_robot_commands": 0.007391703128814697, "deviation-center-line": 0.7861024963711597, "driven_lanedir_consec": 3.075751964957316, "sim_compute_sim_state": 0.0037141307195027663, "sim_compute_performance-ego": 0.004119860331217448, "sim_compute_robot_state-ego": 0.005133479436238607}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.6510841440280535, "sim_physics": 0.056779442628224694, "survival_time": 14.950000000000076, "driven_lanedir": 3.4029424166223503, "sim_render-ego": 0.007236793041229248, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.015557647546132406, "deviation-heading": 3.848648260222411, "set_robot_commands": 0.0071833133697509766, "deviation-center-line": 1.0272854124173467, "driven_lanedir_consec": 3.4029424166223503, "sim_compute_sim_state": 0.00353911558787028, "sim_compute_performance-ego": 0.004130924542744954, "sim_compute_robot_state-ego": 0.0051137137413024905}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.1221100871208085, "sim_physics": 0.05904759645462036, "survival_time": 14.950000000000076, "driven_lanedir": 4.0083425171237455, "sim_render-ego": 0.007257060209910075, "in-drivable-lane": 0, "agent_compute-ego": 0.01611863056818644, "deviation-heading": 3.510861419153114, "set_robot_commands": 0.007591749827067057, "deviation-center-line": 0.7906904775432374, "driven_lanedir_consec": 4.0083425171237455, "sim_compute_sim_state": 0.0036085136731465657, "sim_compute_performance-ego": 0.0041925533612569175, "sim_compute_robot_state-ego": 0.005217878818511963}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.132053598286885, "sim_physics": 0.05512598276138306, "survival_time": 14.950000000000076, "driven_lanedir": 3.6596551889995377, "sim_render-ego": 0.007161142031351726, "in-drivable-lane": 2.750000000000014, "agent_compute-ego": 0.015323188304901123, "deviation-heading": 3.8904925158943096, "set_robot_commands": 0.00714630921681722, "deviation-center-line": 0.5920159457234467, "driven_lanedir_consec": 2.391505280282734, "sim_compute_sim_state": 0.0034796635309855143, "sim_compute_performance-ego": 0.004123863379160563, "sim_compute_robot_state-ego": 0.005108181635538737}}
set_robot_commands_max0.007591749827067057
set_robot_commands_mean0.007299357096354167
set_robot_commands_median0.007183709939320882
set_robot_commands_min0.00714630921681722
sim_compute_performance-ego_max0.0041925533612569175
sim_compute_performance-ego_mean0.004147110780080159
sim_compute_performance-ego_median0.004130924542744954
sim_compute_performance-ego_min0.004119860331217448
sim_compute_robot_state-ego_max0.005217878818511963
sim_compute_robot_state-ego_mean0.005128321170806884
sim_compute_robot_state-ego_median0.0051137137413024905
sim_compute_robot_state-ego_min0.005068352222442627
sim_compute_sim_state_max0.0037141307195027663
sim_compute_sim_state_mean0.0035670680999755856
sim_compute_sim_state_median0.00353911558787028
sim_compute_sim_state_min0.0034796635309855143
sim_physics_max0.06059439818064371
sim_physics_mean0.057893789132436126
sim_physics_median0.05792152563730875
sim_physics_min0.05512598276138306
sim_render-ego_max0.007257060209910075
sim_render-ego_mean0.007177919069925945
sim_render-ego_median0.007236793041229248
sim_render-ego_min0.006997803052266439
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
278205012Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1753457634548297
survival_time_median14.950000000000076
deviation-center-line_median0.7960263244639628
in-drivable-lane_median0.8000000000000114


other stats
agent_compute-ego_max0.04070848147074382
agent_compute-ego_mean0.03471462996800741
agent_compute-ego_median0.03451296408971151
agent_compute-ego_min0.0297196356455485
deviation-center-line_max0.902410344780198
deviation-center-line_mean0.7929667246217743
deviation-center-line_min0.6850793588811734
deviation-heading_max4.329106059361706
deviation-heading_mean3.5243565216581283
deviation-heading_median3.646884396154172
deviation-heading_min2.78597725269611
driven_any_max4.5640932064712025
driven_any_mean3.85077692651389
driven_any_median3.4326931530933447
driven_any_min3.3311967618154035
driven_lanedir_consec_max4.44650575698612
driven_lanedir_consec_mean3.543010163709164
driven_lanedir_consec_min2.646855901243775
driven_lanedir_max4.44650575698612
driven_lanedir_mean3.6642822239941113
driven_lanedir_median3.2532162026685096
driven_lanedir_min3.0425075390193546
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean0.7300000000000051
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.4227658924083397, "sim_physics": 0.05581973314285278, "survival_time": 14.950000000000076, "driven_lanedir": 3.0425075390193546, "sim_render-ego": 0.00694481611251831, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.0297196356455485, "deviation-heading": 4.024622500212203, "set_robot_commands": 0.005720094839731852, "deviation-center-line": 0.7559071249258347, "driven_lanedir_consec": 3.0425075390193546, "sim_compute_sim_state": 0.003111296494801839, "sim_compute_performance-ego": 0.0041334335009257, "sim_compute_robot_state-ego": 0.0050781432787577315}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4326931530933447, "sim_physics": 0.05545426209767659, "survival_time": 14.950000000000076, "driven_lanedir": 3.2532162026685096, "sim_render-ego": 0.007141746679941813, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.03451296408971151, "deviation-heading": 3.646884396154172, "set_robot_commands": 0.005081884066263835, "deviation-center-line": 0.8254104700577033, "driven_lanedir_consec": 2.646855901243775, "sim_compute_sim_state": 0.0029681483904520673, "sim_compute_performance-ego": 0.004099506537119548, "sim_compute_robot_state-ego": 0.005025351842244466}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.5640932064712025, "sim_physics": 0.05611233472824097, "survival_time": 14.950000000000076, "driven_lanedir": 4.44650575698612, "sim_render-ego": 0.007176520824432373, "in-drivable-lane": 0, "agent_compute-ego": 0.03465540965398153, "deviation-heading": 2.78597725269611, "set_robot_commands": 0.005187794367472331, "deviation-center-line": 0.902410344780198, "driven_lanedir_consec": 4.44650575698612, "sim_compute_sim_state": 0.003033913771311442, "sim_compute_performance-ego": 0.004088715712229411, "sim_compute_robot_state-ego": 0.005133043924967448}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.503135618781158, "sim_physics": 0.055894585450490315, "survival_time": 14.950000000000076, "driven_lanedir": 4.4038358578417425, "sim_render-ego": 0.007094103495279948, "in-drivable-lane": 0, "agent_compute-ego": 0.03397665898005168, "deviation-heading": 2.835192399866448, "set_robot_commands": 0.005161999066670735, "deviation-center-line": 0.6850793588811734, "driven_lanedir_consec": 4.4038358578417425, "sim_compute_sim_state": 0.003019604682922363, "sim_compute_performance-ego": 0.004063034852345784, "sim_compute_robot_state-ego": 0.005076518853505452}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3311967618154035, "sim_physics": 0.07625706752141316, "survival_time": 14.950000000000076, "driven_lanedir": 3.1753457634548297, "sim_render-ego": 0.009622236092885336, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.04070848147074382, "deviation-heading": 4.329106059361706, "set_robot_commands": 0.007351142565409342, "deviation-center-line": 0.7960263244639628, "driven_lanedir_consec": 3.1753457634548297, "sim_compute_sim_state": 0.003920369942982991, "sim_compute_performance-ego": 0.005599777698516845, "sim_compute_robot_state-ego": 0.007003994782765707}}
set_robot_commands_max0.007351142565409342
set_robot_commands_mean0.005700582981109619
set_robot_commands_median0.005187794367472331
set_robot_commands_min0.005081884066263835
sim_compute_performance-ego_max0.005599777698516845
sim_compute_performance-ego_mean0.004396893660227458
sim_compute_performance-ego_median0.004099506537119548
sim_compute_performance-ego_min0.004063034852345784
sim_compute_robot_state-ego_max0.007003994782765707
sim_compute_robot_state-ego_mean0.00546341053644816
sim_compute_robot_state-ego_median0.0050781432787577315
sim_compute_robot_state-ego_min0.005025351842244466
sim_compute_sim_state_max0.003920369942982991
sim_compute_sim_state_mean0.0032106666564941403
sim_compute_sim_state_median0.003033913771311442
sim_compute_sim_state_min0.0029681483904520673
sim_physics_max0.07625706752141316
sim_physics_mean0.05990759658813476
sim_physics_median0.055894585450490315
sim_physics_min0.05545426209767659
sim_render-ego_max0.009622236092885336
sim_render-ego_mean0.007595884641011556
sim_render-ego_median0.007141746679941813
sim_render-ego_min0.00694481611251831
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
277474979Dhaivat Bhatt 🇨🇦whattheduckaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-35-218-104900:07:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4979/step1-simulation-ip-172-31-35-218-10490-job27747/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-1-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
277404976Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8258507631732632
survival_time_median14.950000000000076
deviation-center-line_median0.721482383551805
in-drivable-lane_median1.299999999999999


other stats
agent_compute-ego_max0.01600584824879964
agent_compute-ego_mean0.01585447613398234
agent_compute-ego_median0.01587325652440389
agent_compute-ego_min0.015542104244232175
deviation-center-line_max0.8287042969568417
deviation-center-line_mean0.7412543662011545
deviation-center-line_min0.6670653107644919
deviation-heading_max4.04559393926846
deviation-heading_mean3.1945435304565413
deviation-heading_median3.2732662615847414
deviation-heading_min2.4109622270469067
driven_any_max3.9157379654842104
driven_any_mean3.327647576578748
driven_any_median3.220929728126201
driven_any_min3.0669995378718893
driven_lanedir_consec_max3.847617849165682
driven_lanedir_consec_mean2.6074060760928406
driven_lanedir_consec_min1.3888821132761635
driven_lanedir_max3.847617849165682
driven_lanedir_mean3.1356432774394833
driven_lanedir_median2.930584896896135
driven_lanedir_min2.8258507631732632
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean1.0900000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0669995378718893, "sim_physics": 0.05979003190994263, "survival_time": 14.950000000000076, "driven_lanedir": 2.8258507631732632, "sim_render-ego": 0.007072029908498128, "in-drivable-lane": 1.299999999999999, "agent_compute-ego": 0.01600584824879964, "deviation-heading": 3.4426512679745653, "set_robot_commands": 0.00732463280359904, "deviation-center-line": 0.8287042969568417, "driven_lanedir_consec": 2.8258507631732632, "sim_compute_sim_state": 0.003729605674743653, "sim_compute_performance-ego": 0.004181588490804036, "sim_compute_robot_state-ego": 0.005123170216878256}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.200967026022534, "sim_physics": 0.058681055704752606, "survival_time": 14.950000000000076, "driven_lanedir": 2.9083675151061095, "sim_render-ego": 0.007957918643951416, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.015542104244232175, "deviation-heading": 3.2732662615847414, "set_robot_commands": 0.007225263118743897, "deviation-center-line": 0.721482383551805, "driven_lanedir_consec": 1.8088842919928672, "sim_compute_sim_state": 0.003513700167338054, "sim_compute_performance-ego": 0.004112598896026612, "sim_compute_robot_state-ego": 0.0051418908437093095}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.9157379654842104, "sim_physics": 0.059384984175364176, "survival_time": 14.950000000000076, "driven_lanedir": 3.847617849165682, "sim_render-ego": 0.007250518004099528, "in-drivable-lane": 0, "agent_compute-ego": 0.01587325652440389, "deviation-heading": 2.4109622270469067, "set_robot_commands": 0.007416712443033854, "deviation-center-line": 0.689424139300687, "driven_lanedir_consec": 3.847617849165682, "sim_compute_sim_state": 0.003625381787618001, "sim_compute_performance-ego": 0.0041515938440958656, "sim_compute_robot_state-ego": 0.005180619557698568}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.220929728126201, "sim_physics": 0.05929757515589396, "survival_time": 14.950000000000076, "driven_lanedir": 2.930584896896135, "sim_render-ego": 0.007212897936503092, "in-drivable-lane": 2.0000000000000027, "agent_compute-ego": 0.016000719865163167, "deviation-heading": 4.04559393926846, "set_robot_commands": 0.007502594788869222, "deviation-center-line": 0.7995957004319465, "driven_lanedir_consec": 1.3888821132761635, "sim_compute_sim_state": 0.003732635974884033, "sim_compute_performance-ego": 0.004108444054921468, "sim_compute_robot_state-ego": 0.0051348741849263505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.233603625388904, "sim_physics": 0.060225077470143634, "survival_time": 14.950000000000076, "driven_lanedir": 3.1657953628562265, "sim_render-ego": 0.007156662940979004, "in-drivable-lane": 0, "agent_compute-ego": 0.015850451787312824, "deviation-heading": 2.800243956408036, "set_robot_commands": 0.007515796820322673, "deviation-center-line": 0.6670653107644919, "driven_lanedir_consec": 3.1657953628562265, "sim_compute_sim_state": 0.003633577028910319, "sim_compute_performance-ego": 0.004114975929260254, "sim_compute_robot_state-ego": 0.005160559018452963}}
set_robot_commands_max0.007515796820322673
set_robot_commands_mean0.007396999994913736
set_robot_commands_median0.007416712443033854
set_robot_commands_min0.007225263118743897
sim_compute_performance-ego_max0.004181588490804036
sim_compute_performance-ego_mean0.004133840243021647
sim_compute_performance-ego_median0.004114975929260254
sim_compute_performance-ego_min0.004108444054921468
sim_compute_robot_state-ego_max0.005180619557698568
sim_compute_robot_state-ego_mean0.005148222764333089
sim_compute_robot_state-ego_median0.0051418908437093095
sim_compute_robot_state-ego_min0.005123170216878256
sim_compute_sim_state_max0.003732635974884033
sim_compute_sim_state_mean0.0036469801266988114
sim_compute_sim_state_median0.003633577028910319
sim_compute_sim_state_min0.003513700167338054
sim_physics_max0.060225077470143634
sim_physics_mean0.05947574488321941
sim_physics_median0.059384984175364176
sim_physics_min0.058681055704752606
sim_render-ego_max0.007957918643951416
sim_render-ego_mean0.007330005486806235
sim_render-ego_median0.007212897936503092
sim_render-ego_min0.007072029908498128
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
277384974Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2743142296373917
survival_time_median14.950000000000076
deviation-center-line_median0.5926137629059026
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016215458710988364
agent_compute-ego_mean0.01592434597015381
agent_compute-ego_median0.016045633951822916
agent_compute-ego_min0.01552013397216797
deviation-center-line_max0.6774012168835593
deviation-center-line_mean0.5987700870504802
deviation-center-line_min0.5409677451772285
deviation-heading_max3.473427938297886
deviation-heading_mean2.808604095653239
deviation-heading_median2.4751079167558356
deviation-heading_min2.427224973495696
driven_any_max3.5921716212135157
driven_any_mean3.3335431822987736
driven_any_median3.429682865655992
driven_any_min2.866612997333109
driven_lanedir_consec_max3.5132670172246083
driven_lanedir_consec_mean3.1882298361891768
driven_lanedir_consec_min2.75911587550298
driven_lanedir_max3.5132670172246083
driven_lanedir_mean3.1882298361891768
driven_lanedir_median3.2743142296373917
driven_lanedir_min2.75911587550298
in-drivable-lane_max2.84999999999999
in-drivable-lane_mean0.6999999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.866612997333109, "sim_physics": 0.05716587622960408, "survival_time": 14.950000000000076, "driven_lanedir": 2.75911587550298, "sim_render-ego": 0.007079368432362875, "in-drivable-lane": 0, "agent_compute-ego": 0.016215458710988364, "deviation-heading": 3.473427938297886, "set_robot_commands": 0.007328330675760905, "deviation-center-line": 0.5960714358515903, "driven_lanedir_consec": 2.75911587550298, "sim_compute_sim_state": 0.0037327273686726887, "sim_compute_performance-ego": 0.004158182144165039, "sim_compute_robot_state-ego": 0.005132411321004232}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.5496069411434186, "sim_physics": 0.05767105897267659, "survival_time": 14.950000000000076, "driven_lanedir": 3.4505619370199554, "sim_render-ego": 0.007203120390574138, "in-drivable-lane": 0, "agent_compute-ego": 0.015732224782307944, "deviation-heading": 3.1921710693464656, "set_robot_commands": 0.007238961060841878, "deviation-center-line": 0.5867962744341204, "driven_lanedir_consec": 3.4505619370199554, "sim_compute_sim_state": 0.003687370618184407, "sim_compute_performance-ego": 0.004090603987375895, "sim_compute_robot_state-ego": 0.0051622732480367025}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2296414861478353, "sim_physics": 0.05439457098642985, "survival_time": 14.950000000000076, "driven_lanedir": 2.943890121560947, "sim_render-ego": 0.007135542233784994, "in-drivable-lane": 2.84999999999999, "agent_compute-ego": 0.01552013397216797, "deviation-heading": 2.4750885803703153, "set_robot_commands": 0.007099634806315105, "deviation-center-line": 0.6774012168835593, "driven_lanedir_consec": 2.943890121560947, "sim_compute_sim_state": 0.003582642873128255, "sim_compute_performance-ego": 0.004120505650838216, "sim_compute_robot_state-ego": 0.0051208082834879555}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.5921716212135157, "sim_physics": 0.05773464441299438, "survival_time": 14.950000000000076, "driven_lanedir": 3.5132670172246083, "sim_render-ego": 0.007166225115458171, "in-drivable-lane": 0, "agent_compute-ego": 0.016045633951822916, "deviation-heading": 2.427224973495696, "set_robot_commands": 0.007475938002268473, "deviation-center-line": 0.5926137629059026, "driven_lanedir_consec": 3.5132670172246083, "sim_compute_sim_state": 0.0035213836034139, "sim_compute_performance-ego": 0.0041312774022420245, "sim_compute_robot_state-ego": 0.005092163880666097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.429682865655992, "sim_physics": 0.05762169043223063, "survival_time": 14.950000000000076, "driven_lanedir": 3.2743142296373917, "sim_render-ego": 0.007192750771840413, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.01610827843348185, "deviation-heading": 2.4751079167558356, "set_robot_commands": 0.007324035167694092, "deviation-center-line": 0.5409677451772285, "driven_lanedir_consec": 3.2743142296373917, "sim_compute_sim_state": 0.003830533822377523, "sim_compute_performance-ego": 0.004095314343770345, "sim_compute_robot_state-ego": 0.005083723068237305}}
set_robot_commands_max0.007475938002268473
set_robot_commands_mean0.007293379942576091
set_robot_commands_median0.007324035167694092
set_robot_commands_min0.007099634806315105
sim_compute_performance-ego_max0.004158182144165039
sim_compute_performance-ego_mean0.004119176705678304
sim_compute_performance-ego_median0.004120505650838216
sim_compute_performance-ego_min0.004090603987375895
sim_compute_robot_state-ego_max0.0051622732480367025
sim_compute_robot_state-ego_mean0.005118275960286458
sim_compute_robot_state-ego_median0.0051208082834879555
sim_compute_robot_state-ego_min0.005083723068237305
sim_compute_sim_state_max0.003830533822377523
sim_compute_sim_state_mean0.0036709316571553545
sim_compute_sim_state_median0.003687370618184407
sim_compute_sim_state_min0.0035213836034139
sim_physics_max0.05773464441299438
sim_physics_mean0.0569175682067871
sim_physics_median0.05762169043223063
sim_physics_min0.05439457098642985
sim_render-ego_max0.007203120390574138
sim_render-ego_mean0.007155401388804118
sim_render-ego_median0.007166225115458171
sim_render-ego_min0.007079368432362875
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
277304970Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.720509663050134
survival_time_median14.950000000000076
deviation-center-line_median0.9555131379003144
in-drivable-lane_median0.7500000000000107


other stats
agent_compute-ego_max0.016510759989420573
agent_compute-ego_mean0.01592898718516032
agent_compute-ego_median0.01589400847752889
agent_compute-ego_min0.015539913177490237
deviation-center-line_max1.107955947131201
deviation-center-line_mean0.9345780987337132
deviation-center-line_min0.6987847559116942
deviation-heading_max5.035810899779035
deviation-heading_mean4.2934856404145965
deviation-heading_median4.357233408547839
deviation-heading_min3.022459095495539
driven_any_max3.835995266742936
driven_any_mean3.093826882591892
driven_any_median3.004117389294141
driven_any_min2.719679439073045
driven_lanedir_consec_max3.622129213406999
driven_lanedir_consec_mean2.671019829399948
driven_lanedir_consec_min1.8404758093905944
driven_lanedir_max3.622129213406999
driven_lanedir_mean2.811185457657955
driven_lanedir_median2.720509663050134
driven_lanedir_min2.4487219648204452
in-drivable-lane_max2.650000000000035
in-drivable-lane_mean0.8700000000000088
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.004117389294141, "sim_physics": 0.057885733445485435, "survival_time": 14.950000000000076, "driven_lanedir": 2.7551032117470156, "sim_render-ego": 0.007108834584554037, "in-drivable-lane": 0, "agent_compute-ego": 0.016510759989420573, "deviation-heading": 4.926410438826841, "set_robot_commands": 0.007469641367594401, "deviation-center-line": 0.998314147669416, "driven_lanedir_consec": 2.7551032117470156, "sim_compute_sim_state": 0.003690818150838216, "sim_compute_performance-ego": 0.0042054510116577145, "sim_compute_robot_state-ego": 0.0051532729466756185}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.019717241504951, "sim_physics": 0.05834857622782389, "survival_time": 14.950000000000076, "driven_lanedir": 2.5094632352651804, "sim_render-ego": 0.007337749004364014, "in-drivable-lane": 2.650000000000035, "agent_compute-ego": 0.015790510177612304, "deviation-heading": 4.357233408547839, "set_robot_commands": 0.0071915348370869955, "deviation-center-line": 0.6987847559116942, "driven_lanedir_consec": 1.8404758093905944, "sim_compute_sim_state": 0.003580628236134847, "sim_compute_performance-ego": 0.004151723384857178, "sim_compute_robot_state-ego": 0.005162513256072998}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.835995266742936, "sim_physics": 0.056141177813212075, "survival_time": 14.950000000000076, "driven_lanedir": 3.622129213406999, "sim_render-ego": 0.00718506654103597, "in-drivable-lane": 0.9499999999999984, "agent_compute-ego": 0.015539913177490237, "deviation-heading": 3.022459095495539, "set_robot_commands": 0.007278947035471598, "deviation-center-line": 1.107955947131201, "driven_lanedir_consec": 3.622129213406999, "sim_compute_sim_state": 0.003627638022104899, "sim_compute_performance-ego": 0.004092999299367269, "sim_compute_robot_state-ego": 0.005126488208770752}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.8896250763443874, "sim_physics": 0.05561023791631063, "survival_time": 14.950000000000076, "driven_lanedir": 2.720509663050134, "sim_render-ego": 0.0071479066212972, "in-drivable-lane": 0, "agent_compute-ego": 0.015909744103749592, "deviation-heading": 4.12551435942373, "set_robot_commands": 0.00720573902130127, "deviation-center-line": 0.9555131379003144, "driven_lanedir_consec": 2.720509663050134, "sim_compute_sim_state": 0.003559855620066325, "sim_compute_performance-ego": 0.004079337120056152, "sim_compute_robot_state-ego": 0.005093336900075277}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.719679439073045, "sim_physics": 0.0576911989847819, "survival_time": 14.950000000000076, "driven_lanedir": 2.4487219648204452, "sim_render-ego": 0.00720458984375, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.01589400847752889, "deviation-heading": 5.035810899779035, "set_robot_commands": 0.007180782159169515, "deviation-center-line": 0.9123225050559408, "driven_lanedir_consec": 2.416881249404999, "sim_compute_sim_state": 0.0037760186195373536, "sim_compute_performance-ego": 0.004147090117136637, "sim_compute_robot_state-ego": 0.005133813222249349}}
set_robot_commands_max0.007469641367594401
set_robot_commands_mean0.007265328884124756
set_robot_commands_median0.00720573902130127
set_robot_commands_min0.007180782159169515
sim_compute_performance-ego_max0.0042054510116577145
sim_compute_performance-ego_mean0.0041353201866149904
sim_compute_performance-ego_median0.004147090117136637
sim_compute_performance-ego_min0.004079337120056152
sim_compute_robot_state-ego_max0.005162513256072998
sim_compute_robot_state-ego_mean0.005133884906768799
sim_compute_robot_state-ego_median0.005133813222249349
sim_compute_robot_state-ego_min0.005093336900075277
sim_compute_sim_state_max0.0037760186195373536
sim_compute_sim_state_mean0.003646991729736328
sim_compute_sim_state_median0.003627638022104899
sim_compute_sim_state_min0.003559855620066325
sim_physics_max0.05834857622782389
sim_physics_mean0.05713538487752279
sim_physics_median0.0576911989847819
sim_physics_min0.05561023791631063
sim_render-ego_max0.007337749004364014
sim_render-ego_mean0.007196829319000245
sim_render-ego_median0.00718506654103597
sim_render-ego_min0.007108834584554037
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
277234964Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:02:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
277214962Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8712752459677153
survival_time_median14.950000000000076
deviation-center-line_median0.7996381173026165
in-drivable-lane_median0.9500000000000136


other stats
agent_compute-ego_max0.01605297644933065
agent_compute-ego_mean0.01578350483493888
agent_compute-ego_median0.015836830933888754
agent_compute-ego_min0.015475356733644164
deviation-center-line_max0.9356888333888536
deviation-center-line_mean0.7787278714236014
deviation-center-line_min0.4950343064139048
deviation-heading_max5.599609059219674
deviation-heading_mean3.751546137469613
deviation-heading_median3.6174891646782146
deviation-heading_min2.040289998476919
driven_any_max5.190847692323534
driven_any_mean3.389711230967518
driven_any_median3.1450461708150343
driven_any_min2.2711285297953485
driven_lanedir_consec_max5.05948194104809
driven_lanedir_consec_mean3.0925749895952532
driven_lanedir_consec_min1.8505346447295157
driven_lanedir_max5.05948194104809
driven_lanedir_mean3.109866512153556
driven_lanedir_median2.8712752459677153
driven_lanedir_min1.9333211346302264
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean0.850000000000007
in-drivable-lane_min0.4000000000000057
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1450461708150343, "sim_physics": 0.05699222962061564, "survival_time": 14.950000000000076, "driven_lanedir": 2.8712752459677153, "sim_render-ego": 0.007113696734110515, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.01605297644933065, "deviation-heading": 3.6174891646782146, "set_robot_commands": 0.007448921998341879, "deviation-center-line": 0.7996381173026165, "driven_lanedir_consec": 2.8712752459677153, "sim_compute_sim_state": 0.003763856887817383, "sim_compute_performance-ego": 0.004184317588806152, "sim_compute_robot_state-ego": 0.005104180971781413}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2711285297953485, "sim_physics": 0.055908571084340414, "survival_time": 14.950000000000076, "driven_lanedir": 1.9333211346302264, "sim_render-ego": 0.0071924090385437015, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.01553068240483602, "deviation-heading": 5.599609059219674, "set_robot_commands": 0.007123939990997315, "deviation-center-line": 0.9356888333888536, "driven_lanedir_consec": 1.8505346447295157, "sim_compute_sim_state": 0.003540062109629313, "sim_compute_performance-ego": 0.004092578093210856, "sim_compute_robot_state-ego": 0.0050819579760233565}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.190847692323534, "sim_physics": 0.05508726040522258, "survival_time": 14.950000000000076, "driven_lanedir": 5.05948194104809, "sim_render-ego": 0.007103703022003174, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.015836830933888754, "deviation-heading": 2.040289998476919, "set_robot_commands": 0.007114308675130208, "deviation-center-line": 0.7361173630383431, "driven_lanedir_consec": 5.05948194104809, "sim_compute_sim_state": 0.003511929512023926, "sim_compute_performance-ego": 0.00406319538752238, "sim_compute_robot_state-ego": 0.00506203571955363}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.686049912940682, "sim_physics": 0.05555484612782796, "survival_time": 14.950000000000076, "driven_lanedir": 2.4002263237273187, "sim_render-ego": 0.007224682172139485, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.01602167765299479, "deviation-heading": 5.328307404486737, "set_robot_commands": 0.0072672239939371745, "deviation-center-line": 0.927160736974289, "driven_lanedir_consec": 2.3965552008365174, "sim_compute_sim_state": 0.0034757804870605468, "sim_compute_performance-ego": 0.0041178297996521, "sim_compute_robot_state-ego": 0.005060102144877116}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.655483848962992, "sim_physics": 0.05654362682656292, "survival_time": 11.55000000000003, "driven_lanedir": 3.2850279153944277, "sim_render-ego": 0.007058345910274621, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.015475356733644164, "deviation-heading": 2.1720350604865204, "set_robot_commands": 0.00732308342343285, "deviation-center-line": 0.4950343064139048, "driven_lanedir_consec": 3.2850279153944277, "sim_compute_sim_state": 0.003607921270064978, "sim_compute_performance-ego": 0.004035687549805745, "sim_compute_robot_state-ego": 0.0050743472524535605}}
set_robot_commands_max0.007448921998341879
set_robot_commands_mean0.007255495616367885
set_robot_commands_median0.0072672239939371745
set_robot_commands_min0.007114308675130208
sim_compute_performance-ego_max0.004184317588806152
sim_compute_performance-ego_mean0.004098721683799447
sim_compute_performance-ego_median0.004092578093210856
sim_compute_performance-ego_min0.004035687549805745
sim_compute_robot_state-ego_max0.005104180971781413
sim_compute_robot_state-ego_mean0.005076524812937815
sim_compute_robot_state-ego_median0.0050743472524535605
sim_compute_robot_state-ego_min0.005060102144877116
sim_compute_sim_state_max0.003763856887817383
sim_compute_sim_state_mean0.0035799100533192288
sim_compute_sim_state_median0.003540062109629313
sim_compute_sim_state_min0.0034757804870605468
sim_physics_max0.05699222962061564
sim_physics_mean0.056017306812913906
sim_physics_median0.055908571084340414
sim_physics_min0.05508726040522258
sim_render-ego_max0.007224682172139485
sim_render-ego_mean0.0071385673754143
sim_render-ego_median0.007113696734110515
sim_render-ego_min0.007058345910274621
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.270000000000069
survival_time_min11.55000000000003
No reset possible
277174960Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7450000344715315
survival_time_median14.950000000000076
deviation-center-line_median0.6670142305580457
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02272400935490926
agent_compute-ego_mean0.01947109937667847
agent_compute-ego_median0.02027956247329712
agent_compute-ego_min0.016047983964284262
deviation-center-line_max0.7606137107493964
deviation-center-line_mean0.6477834393424009
deviation-center-line_min0.5170532007793461
deviation-heading_max3.6509677396173665
deviation-heading_mean3.187175713590534
deviation-heading_median3.1060962231993985
deviation-heading_min2.7246036630863406
driven_any_max3.696272048731442
driven_any_mean3.0276324531671737
driven_any_median2.8307552483343215
driven_any_min2.592410023113029
driven_lanedir_consec_max3.6189682782628942
driven_lanedir_consec_mean2.884757114708896
driven_lanedir_consec_min2.4918859039075407
driven_lanedir_max3.6189682782628942
driven_lanedir_mean2.884757114708896
driven_lanedir_median2.7450000344715315
driven_lanedir_min2.4918859039075407
in-drivable-lane_max3.100000000000014
in-drivable-lane_mean0.6200000000000028
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6951707993822827, "sim_physics": 0.08554356892903646, "survival_time": 14.950000000000076, "driven_lanedir": 2.591308278349155, "sim_render-ego": 0.009756418863932291, "in-drivable-lane": 0, "agent_compute-ego": 0.02272400935490926, "deviation-heading": 3.378336226346032, "set_robot_commands": 0.01003561019897461, "deviation-center-line": 0.5647416695581148, "driven_lanedir_consec": 2.591308278349155, "sim_compute_sim_state": 0.004871836503346761, "sim_compute_performance-ego": 0.005865761439005534, "sim_compute_robot_state-ego": 0.007276071707407634}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.592410023113029, "sim_physics": 0.08278915405273438, "survival_time": 14.950000000000076, "driven_lanedir": 2.4918859039075407, "sim_render-ego": 0.010150575637817382, "in-drivable-lane": 0, "agent_compute-ego": 0.02224982500076294, "deviation-heading": 3.6509677396173665, "set_robot_commands": 0.009846307436625163, "deviation-center-line": 0.7294943850671015, "driven_lanedir_consec": 2.4918859039075407, "sim_compute_sim_state": 0.0049761231740315754, "sim_compute_performance-ego": 0.005785721143086751, "sim_compute_robot_state-ego": 0.007265958786010742}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.3235541462747933, "sim_physics": 0.07231166442235311, "survival_time": 14.950000000000076, "driven_lanedir": 2.9766230785533607, "sim_render-ego": 0.009246244430541992, "in-drivable-lane": 3.100000000000014, "agent_compute-ego": 0.02027956247329712, "deviation-heading": 3.1060962231993985, "set_robot_commands": 0.008894601662953694, "deviation-center-line": 0.6670142305580457, "driven_lanedir_consec": 2.9766230785533607, "sim_compute_sim_state": 0.0044479807217915855, "sim_compute_performance-ego": 0.005389446417490641, "sim_compute_robot_state-ego": 0.0066767247517903645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.696272048731442, "sim_physics": 0.05831819136937459, "survival_time": 14.950000000000076, "driven_lanedir": 3.6189682782628942, "sim_render-ego": 0.007192159493764241, "in-drivable-lane": 0, "agent_compute-ego": 0.016054116090138754, "deviation-heading": 2.7246036630863406, "set_robot_commands": 0.007626736958821614, "deviation-center-line": 0.5170532007793461, "driven_lanedir_consec": 3.6189682782628942, "sim_compute_sim_state": 0.0035928813616434734, "sim_compute_performance-ego": 0.004094896316528321, "sim_compute_robot_state-ego": 0.005111301740010579}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8307552483343215, "sim_physics": 0.05770303964614868, "survival_time": 14.950000000000076, "driven_lanedir": 2.7450000344715315, "sim_render-ego": 0.007134482065836589, "in-drivable-lane": 0, "agent_compute-ego": 0.016047983964284262, "deviation-heading": 3.0758747157035304, "set_robot_commands": 0.007583510875701904, "deviation-center-line": 0.7606137107493964, "driven_lanedir_consec": 2.7450000344715315, "sim_compute_sim_state": 0.0038317505518595378, "sim_compute_performance-ego": 0.004103876749674479, "sim_compute_robot_state-ego": 0.005112138589223226}}
set_robot_commands_max0.01003561019897461
set_robot_commands_mean0.008797353426615397
set_robot_commands_median0.008894601662953694
set_robot_commands_min0.007583510875701904
sim_compute_performance-ego_max0.005865761439005534
sim_compute_performance-ego_mean0.0050479404131571455
sim_compute_performance-ego_median0.005389446417490641
sim_compute_performance-ego_min0.004094896316528321
sim_compute_robot_state-ego_max0.007276071707407634
sim_compute_robot_state-ego_mean0.00628843911488851
sim_compute_robot_state-ego_median0.0066767247517903645
sim_compute_robot_state-ego_min0.005111301740010579
sim_compute_sim_state_max0.0049761231740315754
sim_compute_sim_state_mean0.0043441144625345875
sim_compute_sim_state_median0.0044479807217915855
sim_compute_sim_state_min0.0035928813616434734
sim_physics_max0.08554356892903646
sim_physics_mean0.07133312368392944
sim_physics_median0.07231166442235311
sim_physics_min0.05770303964614868
sim_render-ego_max0.010150575637817382
sim_render-ego_mean0.0086959760983785
sim_render-ego_median0.009246244430541992
sim_render-ego_min0.007134482065836589
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
276324251Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:27:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2550849323393731
survival_time_median8.249999999999982
deviation-center-line_median0.37229154302268774
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.059559880301009775
agent_compute-ego_mean0.048524361418222375
agent_compute-ego_median0.05299615288922887
agent_compute-ego_min0.017716568394711144
deviation-center-line_max1.0982082282447856
deviation-center-line_mean0.5275788675292311
deviation-center-line_min0.1387234853060718
deviation-heading_max4.719493510100608
deviation-heading_mean1.742836215230653
deviation-heading_median1.1576024012774773
deviation-heading_min0.7129330652033525
driven_any_max2.349167018804396
driven_any_mean1.4190725825417212
driven_any_median1.2722765131203675
driven_any_min0.4525355383646139
driven_lanedir_consec_max2.343559207501656
driven_lanedir_consec_mean1.2974364301633583
driven_lanedir_consec_min0.12241326637900828
driven_lanedir_max2.343559207501656
driven_lanedir_mean1.301407876140764
driven_lanedir_median1.2550849323393731
driven_lanedir_min0.18198495604008913
in-drivable-lane_max2.300000000000023
in-drivable-lane_mean0.3700000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7020976822049053, "sim_physics": 0.06321318275050113, "survival_time": 4.749999999999991, "driven_lanedir": 0.6729441334688258, "sim_render-ego": 0.007784075486032586, "in-drivable-lane": 0, "agent_compute-ego": 0.017716568394711144, "deviation-heading": 0.9827943652800996, "set_robot_commands": 0.007687646464297646, "deviation-center-line": 0.15593349549427704, "driven_lanedir_consec": 0.6729441334688258, "sim_compute_sim_state": 0.0040597388618870784, "sim_compute_performance-ego": 0.004590443560951635, "sim_compute_robot_state-ego": 0.0055216638665450245}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8428520684867389, "sim_physics": 0.09609201398946472, "survival_time": 11.800000000000033, "driven_lanedir": 1.7248415088769462, "sim_render-ego": 0.010668012045197567, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.02275251230951083, "deviation-heading": 1.7573378933344592, "set_robot_commands": 0.009212968713146145, "deviation-center-line": 0.6465365735017606, "driven_lanedir_consec": 1.7248415088769462, "sim_compute_sim_state": 0.0048763256962016475, "sim_compute_performance-ego": 0.0062019885596582445, "sim_compute_robot_state-ego": 0.007706107729572361}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3489917543547723, "sim_physics": 0.1045912265777588, "survival_time": 14.950000000000076, "driven_lanedir": 2.0747993331238086, "sim_render-ego": 0.012390456199645995, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.0368688170115153, "deviation-heading": 4.719493510100608, "set_robot_commands": 0.010745414892832438, "deviation-center-line": 1.0982082282447856, "driven_lanedir_consec": 2.0747993331238086, "sim_compute_sim_state": 0.005280049641927084, "sim_compute_performance-ego": 0.00722879409790039, "sim_compute_robot_state-ego": 0.00910160541534424}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2883484210844036, "sim_physics": 0.11377981322968078, "survival_time": 8.349999999999984, "driven_lanedir": 1.2679274388635962, "sim_render-ego": 0.013470351339100364, "in-drivable-lane": 0, "agent_compute-ego": 0.05299615288922887, "deviation-heading": 1.1576024012774773, "set_robot_commands": 0.009980213142440703, "deviation-center-line": 0.3558024296895111, "driven_lanedir_consec": 1.2679274388635962, "sim_compute_sim_state": 0.005632333412855685, "sim_compute_performance-ego": 0.007999140345407817, "sim_compute_robot_state-ego": 0.009730644568711698}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349167018804396, "sim_physics": 0.12539001703262329, "survival_time": 14.950000000000076, "driven_lanedir": 2.334614121118701, "sim_render-ego": 0.013892832597096762, "in-drivable-lane": 0, "agent_compute-ego": 0.0587439759572347, "deviation-heading": 1.2294189075508486, "set_robot_commands": 0.010224985281626384, "deviation-center-line": 0.7591395641663713, "driven_lanedir_consec": 2.334614121118701, "sim_compute_sim_state": 0.006052364508310953, "sim_compute_performance-ego": 0.008575085798899333, "sim_compute_robot_state-ego": 0.01029404878616333}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.6936709426462555, "sim_physics": 0.11728254954020184, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6263051327309392, "sim_render-ego": 0.01326443559379988, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05296755093400196, "deviation-heading": 0.9640925046455484, "set_robot_commands": 0.010377055855207543, "deviation-center-line": 0.2225198763501324, "driven_lanedir_consec": 0.6263051327309392, "sim_compute_sim_state": 0.0058469285247146445, "sim_compute_performance-ego": 0.00806432129234396, "sim_compute_robot_state-ego": 0.010134458541870115}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.2722765131203675, "sim_physics": 0.09336541493733724, "survival_time": 8.249999999999982, "driven_lanedir": 1.2550849323393731, "sim_render-ego": 0.011283617308645535, "in-drivable-lane": 0, "agent_compute-ego": 0.04565353827043013, "deviation-heading": 1.0855954469206055, "set_robot_commands": 0.009062209273829605, "deviation-center-line": 0.6475238400439601, "driven_lanedir_consec": 1.2550849323393731, "sim_compute_sim_state": 0.0046246673121596825, "sim_compute_performance-ego": 0.006555183006055427, "sim_compute_robot_state-ego": 0.008237645120331736}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.348997566199907, "sim_physics": 0.11639624754587807, "survival_time": 14.950000000000076, "driven_lanedir": 1.8424382894898144, "sim_render-ego": 0.013420255184173583, "in-drivable-lane": 2.300000000000023, "agent_compute-ego": 0.05657237609227499, "deviation-heading": 3.635481049838835, "set_robot_commands": 0.010577924251556396, "deviation-center-line": 0.9166863460198512, "driven_lanedir_consec": 1.8424382894898144, "sim_compute_sim_state": 0.005552105108896891, "sim_compute_performance-ego": 0.0080739959081014, "sim_compute_robot_state-ego": 0.00996898333231608}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6856277644569782, "sim_physics": 0.121486220670783, "survival_time": 4.599999999999992, "driven_lanedir": 0.5931682493512274, "sim_render-ego": 0.0133107822874318, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.056452992169753365, "deviation-heading": 0.931308920036376, "set_robot_commands": 0.01003649960393491, "deviation-center-line": 0.1387234853060718, "driven_lanedir_consec": 0.5931682493512274, "sim_compute_sim_state": 0.005610110967055611, "sim_compute_performance-ego": 0.00791605400002521, "sim_compute_robot_state-ego": 0.009549765483192776}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.3490099338026154, "sim_physics": 0.13808612108230592, "survival_time": 14.950000000000076, "driven_lanedir": 2.196651422466944, "sim_render-ego": 0.014135638872782389, "in-drivable-lane": 0, "agent_compute-ego": 0.05854233980178833, "deviation-heading": 4.305518093615306, "set_robot_commands": 0.011573319435119628, "deviation-center-line": 0.7816810717302192, "driven_lanedir_consec": 2.196651422466944, "sim_compute_sim_state": 0.005752147038777669, "sim_compute_performance-ego": 0.00847601334253947, "sim_compute_robot_state-ego": 0.010804129441579184}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.4525355383646139, "sim_physics": 0.12307948914785234, "survival_time": 3.149999999999997, "driven_lanedir": 0.18198495604008913, "sim_render-ego": 0.01413539099314856, "in-drivable-lane": 1.199999999999999, "agent_compute-ego": 0.05625708141024151, "deviation-heading": 1.291397143700792, "set_robot_commands": 0.0102722720494346, "deviation-center-line": 0.21587317741357925, "driven_lanedir_consec": 0.12241326637900828, "sim_compute_sim_state": 0.005324337217542861, "sim_compute_performance-ego": 0.008045332772391183, "sim_compute_robot_state-ego": 0.00994972198728531}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.7418491220160638, "sim_physics": 0.11252453832915336, "survival_time": 4.94999999999999, "driven_lanedir": 0.6848053429706473, "sim_render-ego": 0.012631698088212446, "in-drivable-lane": 0, "agent_compute-ego": 0.05212260255909929, "deviation-heading": 1.4498900546030384, "set_robot_commands": 0.011025611800376816, "deviation-center-line": 0.31909368118096393, "driven_lanedir_consec": 0.6848053429706473, "sim_compute_sim_state": 0.005540741814507378, "sim_compute_performance-ego": 0.007653128017078747, "sim_compute_robot_state-ego": 0.010097140013569534}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.2240707595283244, "sim_physics": 0.09367118991395962, "survival_time": 7.94999999999998, "driven_lanedir": 1.1374540564768234, "sim_render-ego": 0.011219961838152425, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.04551142266711349, "deviation-heading": 0.8660610377389406, "set_robot_commands": 0.008779932118061953, "deviation-center-line": 0.37229154302268774, "driven_lanedir_consec": 1.1374540564768234, "sim_compute_sim_state": 0.004658427628331214, "sim_compute_performance-ego": 0.0067348480224609375, "sim_compute_robot_state-ego": 0.008036070649728834}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.6374295895951925, "sim_physics": 0.13338075127712515, "survival_time": 4.299999999999993, "driven_lanedir": 0.5845400172920647, "sim_render-ego": 0.015394920526548872, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.059559880301009775, "deviation-heading": 1.0536188346135056, "set_robot_commands": 0.010439875514008278, "deviation-center-line": 0.25849217575413486, "driven_lanedir_consec": 0.5845400172920647, "sim_compute_sim_state": 0.005737856377002804, "sim_compute_performance-ego": 0.008351622625838879, "sim_compute_robot_state-ego": 0.010390653166660045}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.349164063460285, "sim_physics": 0.11794145345687866, "survival_time": 14.950000000000076, "driven_lanedir": 2.343559207501656, "sim_render-ego": 0.013045730590820311, "in-drivable-lane": 0, "agent_compute-ego": 0.055147610505421954, "deviation-heading": 0.7129330652033525, "set_robot_commands": 0.010774727662404376, "deviation-center-line": 1.025177525020162, "driven_lanedir_consec": 2.343559207501656, "sim_compute_sim_state": 0.0054447102546691896, "sim_compute_performance-ego": 0.008257261912027995, "sim_compute_robot_state-ego": 0.010166380405426024}}
set_robot_commands_max0.011573319435119628
set_robot_commands_mean0.010051377070551828
set_robot_commands_median0.0102722720494346
set_robot_commands_min0.007687646464297646
sim_compute_performance-ego_max0.008575085798899333
sim_compute_performance-ego_mean0.007514880884112043
sim_compute_performance-ego_median0.007999140345407817
sim_compute_performance-ego_min0.004590443560951635
sim_compute_robot_state-ego_max0.010804129441579184
sim_compute_robot_state-ego_mean0.00931260123388642
sim_compute_robot_state-ego_median0.00994972198728531
sim_compute_robot_state-ego_min0.0055216638665450245
sim_compute_sim_state_max0.006052364508310953
sim_compute_sim_state_mean0.00533285629098936
sim_compute_sim_state_median0.005540741814507378
sim_compute_sim_state_min0.0040597388618870784
sim_physics_max0.13808612108230592
sim_physics_mean0.11135201529876693
sim_physics_median0.11639624754587807
sim_physics_min0.06321318275050113
sim_render-ego_max0.015394920526548872
sim_render-ego_mean0.012669877263385938
sim_render-ego_median0.01326443559379988
sim_render-ego_min0.007784075486032586
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.166666666666687
survival_time_min3.149999999999997
No reset possible
276124272Riza Velioglu 🇩🇪Uni Bielefeldaido3-LFV-sim-testingstep1-simulationerroryesip-172-31-35-218-104900:02:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
276094276Riza Velioglu 🇩🇪Uni Bielefeldaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
275464373Peter Almasi 🇭🇺reinforcement-learning-submissionaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:27:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.227061769114418
survival_time_median14.950000000000076
deviation-center-line_median0.510127227839222
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04090332984924317
agent_compute-ego_mean0.03709713862117314
agent_compute-ego_median0.03702206412951151
agent_compute-ego_min0.030190658569335935
deviation-center-line_max0.7420710465658784
deviation-center-line_mean0.44886981913533247
deviation-center-line_min0.17218392997259363
deviation-heading_max4.305765147746565
deviation-heading_mean2.319684929020779
deviation-heading_median2.4602868741899524
deviation-heading_min1.094622822937565
driven_any_max1.7856467033614434
driven_any_mean1.140351326213066
driven_any_median1.5423073216899672
driven_any_min0.25892672581699006
driven_lanedir_consec_max1.7391141210202683
driven_lanedir_consec_mean1.069212948055782
driven_lanedir_consec_min0.1888885201141215
driven_lanedir_max1.7391141210202683
driven_lanedir_mean1.079220891569917
driven_lanedir_median1.3771809218264437
driven_lanedir_min0.1888885201141215
in-drivable-lane_max0.70000000000001
in-drivable-lane_mean0.1166666666666676
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4479235112997356, "sim_physics": 0.09962177017460698, "survival_time": 4.599999999999992, "driven_lanedir": 0.417111527392399, "sim_render-ego": 0.012109181155329165, "in-drivable-lane": 0, "agent_compute-ego": 0.03878318226855734, "deviation-heading": 1.296405777962936, "set_robot_commands": 0.010064684826394788, "deviation-center-line": 0.22068934157057213, "driven_lanedir_consec": 0.417111527392399, "sim_compute_sim_state": 0.005175670851831851, "sim_compute_performance-ego": 0.007195742233939793, "sim_compute_robot_state-ego": 0.008300237033678137}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5458446397857215, "sim_physics": 0.08886418183644612, "survival_time": 14.950000000000076, "driven_lanedir": 1.51533859501622, "sim_render-ego": 0.010158063570658366, "in-drivable-lane": 0, "agent_compute-ego": 0.03273362239201864, "deviation-heading": 2.6146404604926254, "set_robot_commands": 0.00825933853785197, "deviation-center-line": 0.6226923119452951, "driven_lanedir_consec": 1.51533859501622, "sim_compute_sim_state": 0.004331901868184407, "sim_compute_performance-ego": 0.005929043292999267, "sim_compute_robot_state-ego": 0.00754003922144572}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7856467033614434, "sim_physics": 0.07540239493052164, "survival_time": 14.950000000000076, "driven_lanedir": 1.7391141210202683, "sim_render-ego": 0.009498870372772215, "in-drivable-lane": 0, "agent_compute-ego": 0.030190658569335935, "deviation-heading": 2.597935124781688, "set_robot_commands": 0.007326820691426595, "deviation-center-line": 0.7420710465658784, "driven_lanedir_consec": 1.7391141210202683, "sim_compute_sim_state": 0.0039419968922932945, "sim_compute_performance-ego": 0.00553153117497762, "sim_compute_robot_state-ego": 0.007087587515513102}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5903187198571775, "sim_physics": 0.1061788845062256, "survival_time": 14.950000000000076, "driven_lanedir": 1.3771809218264437, "sim_render-ego": 0.012082643508911133, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.0393466321627299, "deviation-heading": 4.305765147746565, "set_robot_commands": 0.009802579085032143, "deviation-center-line": 0.543361067658397, "driven_lanedir_consec": 1.227061769114418, "sim_compute_sim_state": 0.004864684740702311, "sim_compute_performance-ego": 0.007183465162913004, "sim_compute_robot_state-ego": 0.00924185832341512}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5423073216899672, "sim_physics": 0.10539637088775634, "survival_time": 14.950000000000076, "driven_lanedir": 1.516649494328571, "sim_render-ego": 0.012011749744415283, "in-drivable-lane": 0, "agent_compute-ego": 0.036991974512736, "deviation-heading": 2.4602868741899524, "set_robot_commands": 0.00995993455251058, "deviation-center-line": 0.2811387126868929, "driven_lanedir_consec": 1.516649494328571, "sim_compute_sim_state": 0.005215726693471273, "sim_compute_performance-ego": 0.0073069198926289875, "sim_compute_robot_state-ego": 0.008946200211842855}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4584229130344688, "sim_physics": 0.1137324241881675, "survival_time": 4.699999999999991, "driven_lanedir": 0.4166027153999541, "sim_render-ego": 0.012937690349335366, "in-drivable-lane": 0, "agent_compute-ego": 0.04090332984924317, "deviation-heading": 1.47464233459559, "set_robot_commands": 0.010832903232980282, "deviation-center-line": 0.21317101742988195, "driven_lanedir_consec": 0.4166027153999541, "sim_compute_sim_state": 0.005329307089460657, "sim_compute_performance-ego": 0.007759730866614809, "sim_compute_robot_state-ego": 0.009399530735421689}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7996581393554686, "sim_physics": 0.10398863696452208, "survival_time": 7.94999999999998, "driven_lanedir": 0.765110635056424, "sim_render-ego": 0.013598128684661674, "in-drivable-lane": 0, "agent_compute-ego": 0.03754309738207163, "deviation-heading": 1.729015346703225, "set_robot_commands": 0.009951793922568269, "deviation-center-line": 0.5521951557520979, "driven_lanedir_consec": 0.765110635056424, "sim_compute_sim_state": 0.00515288676855699, "sim_compute_performance-ego": 0.007450139747475678, "sim_compute_robot_state-ego": 0.008831321068529813}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.6850208271230769, "sim_physics": 0.10938859144846598, "survival_time": 14.950000000000076, "driven_lanedir": 1.635251841780427, "sim_render-ego": 0.012255139350891111, "in-drivable-lane": 0, "agent_compute-ego": 0.03694674571355184, "deviation-heading": 2.95688402943684, "set_robot_commands": 0.009794120788574218, "deviation-center-line": 0.5287029796375375, "driven_lanedir_consec": 1.635251841780427, "sim_compute_sim_state": 0.005112086931864421, "sim_compute_performance-ego": 0.0071408915519714355, "sim_compute_robot_state-ego": 0.008863521416982016}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.4590034079323972, "sim_physics": 0.111078401829334, "survival_time": 4.699999999999991, "driven_lanedir": 0.4310323328251464, "sim_render-ego": 0.012039090724701575, "in-drivable-lane": 0, "agent_compute-ego": 0.03702610350669699, "deviation-heading": 1.094622822937565, "set_robot_commands": 0.009564255146270104, "deviation-center-line": 0.30715069320278143, "driven_lanedir_consec": 0.4310323328251464, "sim_compute_sim_state": 0.0052221506199938185, "sim_compute_performance-ego": 0.007755591514262747, "sim_compute_robot_state-ego": 0.008880047087973736}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6089168842978865, "sim_physics": 0.1089121413230896, "survival_time": 14.950000000000076, "driven_lanedir": 1.551020916027832, "sim_render-ego": 0.011881484985351562, "in-drivable-lane": 0, "agent_compute-ego": 0.03652219851811727, "deviation-heading": 3.267619371086542, "set_robot_commands": 0.009644661744435628, "deviation-center-line": 0.7111602747324737, "driven_lanedir_consec": 1.551020916027832, "sim_compute_sim_state": 0.005026402473449707, "sim_compute_performance-ego": 0.007206318378448487, "sim_compute_robot_state-ego": 0.008877925078074137}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.6778660170448634, "sim_physics": 0.09349996169408162, "survival_time": 14.950000000000076, "driven_lanedir": 1.628787395237059, "sim_render-ego": 0.011120007832845053, "in-drivable-lane": 0, "agent_compute-ego": 0.03503980795542399, "deviation-heading": 2.851155889205524, "set_robot_commands": 0.009027602672576905, "deviation-center-line": 0.7403775740655798, "driven_lanedir_consec": 1.628787395237059, "sim_compute_sim_state": 0.004670545260111491, "sim_compute_performance-ego": 0.0066739702224731445, "sim_compute_robot_state-ego": 0.00845519224802653}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5233035553034031, "sim_physics": 0.1174249421982538, "survival_time": 5.249999999999989, "driven_lanedir": 0.4245267853777387, "sim_render-ego": 0.01334367933727446, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.04035134996686663, "deviation-heading": 1.540977695363679, "set_robot_commands": 0.01494599978129069, "deviation-center-line": 0.3127321463873123, "driven_lanedir_consec": 0.4245267853777387, "sim_compute_sim_state": 0.005279436565580822, "sim_compute_performance-ego": 0.007880247206914992, "sim_compute_robot_state-ego": 0.009656649544125512}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.143588452280058, "sim_physics": 0.10613713330692714, "survival_time": 10.800000000000018, "driven_lanedir": 1.028089156329691, "sim_render-ego": 0.01218602944303442, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.03702206412951151, "deviation-heading": 2.6199260216071583, "set_robot_commands": 0.009946695080509892, "deviation-center-line": 0.510127227839222, "driven_lanedir_consec": 1.028089156329691, "sim_compute_sim_state": 0.005012362091629593, "sim_compute_performance-ego": 0.007305406861835056, "sim_compute_robot_state-ego": 0.00883473621474372}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.25892672581699006, "sim_physics": 0.12515189817973546, "survival_time": 2.799999999999998, "driven_lanedir": 0.1888885201141215, "sim_render-ego": 0.013406123433794296, "in-drivable-lane": 0, "agent_compute-ego": 0.04037239296095712, "deviation-heading": 1.641412456355402, "set_robot_commands": 0.011238455772399902, "deviation-center-line": 0.17218392997259363, "driven_lanedir_consec": 0.1888885201141215, "sim_compute_sim_state": 0.005949305636542184, "sim_compute_performance-ego": 0.007725762469427926, "sim_compute_robot_state-ego": 0.009308189153671265}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.578522075013335, "sim_physics": 0.101174205938975, "survival_time": 14.950000000000076, "driven_lanedir": 1.5536084158164616, "sim_render-ego": 0.012197692394256592, "in-drivable-lane": 0, "agent_compute-ego": 0.036683919429779055, "deviation-heading": 2.3439845828463883, "set_robot_commands": 0.009489519596099854, "deviation-center-line": 0.275293807583472, "driven_lanedir_consec": 1.5536084158164616, "sim_compute_sim_state": 0.004973065058390299, "sim_compute_performance-ego": 0.007275051275889079, "sim_compute_robot_state-ego": 0.00887547254562378}}
set_robot_commands_max0.01494599978129069
set_robot_commands_mean0.009989957695394788
set_robot_commands_median0.009802579085032143
set_robot_commands_min0.007326820691426595
sim_compute_performance-ego_max0.007880247206914992
sim_compute_performance-ego_mean0.007154654123518135
sim_compute_performance-ego_median0.007275051275889079
sim_compute_performance-ego_min0.00553153117497762
sim_compute_robot_state-ego_max0.009656649544125512
sim_compute_robot_state-ego_mean0.008739900493271143
sim_compute_robot_state-ego_median0.00887547254562378
sim_compute_robot_state-ego_min0.007087587515513102
sim_compute_sim_state_max0.005949305636542184
sim_compute_sim_state_mean0.005017168636137543
sim_compute_sim_state_median0.005112086931864421
sim_compute_sim_state_min0.0039419968922932945
sim_physics_max0.12515189817973546
sim_physics_mean0.10439679596047394
sim_physics_median0.10613713330692714
sim_physics_min0.07540239493052164
sim_render-ego_max0.013598128684661674
sim_render-ego_mean0.012055038325882152
sim_render-ego_median0.012109181155329165
sim_render-ego_min0.009498870372772215
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.693333333333372
survival_time_min2.799999999999998
No reset possible
275014460Frank (Chude) Qian 🇨🇦Frank custom server testaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:26:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.17688072065719185
survival_time_median13.550000000000058
deviation-center-line_median0.2857900550324427
in-drivable-lane_median6.550000000000029


other stats
agent_compute-ego_max0.02930337905883789
agent_compute-ego_mean0.026956998320798356
agent_compute-ego_median0.02723172405988968
agent_compute-ego_min0.023466389179229736
deviation-center-line_max0.8643566339069733
deviation-center-line_mean0.3321418643295754
deviation-center-line_min0.14581203883095545
deviation-heading_max6.264763733089175
deviation-heading_mean4.323899843681209
deviation-heading_median5.141430291776464
deviation-heading_min1.119598463861732
driven_any_max1.2241058919676604
driven_any_mean0.5047026232194736
driven_any_median0.4700025077338644
driven_any_min0.1535977710324016
driven_lanedir_consec_max0.3878748048021099
driven_lanedir_consec_mean0.20389409387860424
driven_lanedir_consec_min0.06150209590441058
driven_lanedir_max0.3878748048021099
driven_lanedir_mean0.20389409387860424
driven_lanedir_median0.17688072065719185
driven_lanedir_min0.06150209590441058
in-drivable-lane_max7.25000000000004
in-drivable-lane_mean5.123333333333351
in-drivable-lane_min1.1999999999999988
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8255242846594939, "sim_physics": 0.11675010840098064, "survival_time": 14.950000000000076, "driven_lanedir": 0.31169570911061784, "sim_render-ego": 0.012691828409830729, "in-drivable-lane": 7.000000000000039, "agent_compute-ego": 0.02839246193567912, "deviation-heading": 6.264763733089175, "set_robot_commands": 0.01027698278427124, "deviation-center-line": 0.25341871674022326, "driven_lanedir_consec": 0.31169570911061784, "sim_compute_sim_state": 0.005204679171244304, "sim_compute_performance-ego": 0.007763063907623291, "sim_compute_robot_state-ego": 0.00977514108022054}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.25679454836729415, "sim_physics": 0.10164673626422882, "survival_time": 8.79999999999999, "driven_lanedir": 0.1319078205255546, "sim_render-ego": 0.011682407422499224, "in-drivable-lane": 4.199999999999996, "agent_compute-ego": 0.02602579647844488, "deviation-heading": 3.479399886433004, "set_robot_commands": 0.009090514345602556, "deviation-center-line": 0.37308427830331153, "driven_lanedir_consec": 0.1319078205255546, "sim_compute_sim_state": 0.004822725599462336, "sim_compute_performance-ego": 0.006957451050931757, "sim_compute_robot_state-ego": 0.008518069982528687}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2241058919676604, "sim_physics": 0.10924437046051023, "survival_time": 14.950000000000076, "driven_lanedir": 0.3473984303663542, "sim_render-ego": 0.012182546456654867, "in-drivable-lane": 7.200000000000047, "agent_compute-ego": 0.026803582509358725, "deviation-heading": 5.381469932590386, "set_robot_commands": 0.009647144476572672, "deviation-center-line": 0.8643566339069733, "driven_lanedir_consec": 0.3473984303663542, "sim_compute_sim_state": 0.004904592037200927, "sim_compute_performance-ego": 0.0071777129173278805, "sim_compute_robot_state-ego": 0.00905737320582072}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2734361154596629, "sim_physics": 0.11639386329098024, "survival_time": 6.8999999999999835, "driven_lanedir": 0.15284215615816787, "sim_render-ego": 0.013242398483165796, "in-drivable-lane": 2.9499999999999917, "agent_compute-ego": 0.028472998867864193, "deviation-heading": 2.7758206417441524, "set_robot_commands": 0.010434491046960804, "deviation-center-line": 0.24462754142364165, "driven_lanedir_consec": 0.15284215615816787, "sim_compute_sim_state": 0.00514562233634617, "sim_compute_performance-ego": 0.007588065188864003, "sim_compute_robot_state-ego": 0.009259711141171663}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.443011356137014, "sim_physics": 0.1086827039718628, "survival_time": 14.950000000000076, "driven_lanedir": 0.15502676371898727, "sim_render-ego": 0.012583864529927572, "in-drivable-lane": 7.000000000000037, "agent_compute-ego": 0.028873353799184164, "deviation-heading": 5.967098500943357, "set_robot_commands": 0.009953544934590658, "deviation-center-line": 0.5132137897874948, "driven_lanedir_consec": 0.15502676371898727, "sim_compute_sim_state": 0.00505309263865153, "sim_compute_performance-ego": 0.0074079410235087075, "sim_compute_robot_state-ego": 0.00948450803756714}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.49147906282111825, "sim_physics": 0.11255876252572036, "survival_time": 13.550000000000058, "driven_lanedir": 0.1935330693219668, "sim_render-ego": 0.01255005488096568, "in-drivable-lane": 6.550000000000029, "agent_compute-ego": 0.02723172405988968, "deviation-heading": 5.141430291776464, "set_robot_commands": 0.00989967958513661, "deviation-center-line": 0.34072709193916806, "driven_lanedir_consec": 0.1935330693219668, "sim_compute_sim_state": 0.005138310999008122, "sim_compute_performance-ego": 0.007350878521964999, "sim_compute_robot_state-ego": 0.009154464925787106}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.194263112326018, "sim_physics": 0.13116018295288087, "survival_time": 3.7499999999999942, "driven_lanedir": 0.06150209590441058, "sim_render-ego": 0.01402803103129069, "in-drivable-lane": 1.6499999999999977, "agent_compute-ego": 0.02930337905883789, "deviation-heading": 1.3929177652243314, "set_robot_commands": 0.011676486333211262, "deviation-center-line": 0.17690030484414515, "driven_lanedir_consec": 0.06150209590441058, "sim_compute_sim_state": 0.0054979292551676434, "sim_compute_performance-ego": 0.008144121170043945, "sim_compute_robot_state-ego": 0.009885670344034833}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1535977710324016, "sim_physics": 0.10628195149557931, "survival_time": 6.999999999999983, "driven_lanedir": 0.08351849780740839, "sim_render-ego": 0.01253082411629813, "in-drivable-lane": 3.3499999999999917, "agent_compute-ego": 0.027548262051173614, "deviation-heading": 2.5706701230900477, "set_robot_commands": 0.009941203253609794, "deviation-center-line": 0.35767196855789063, "driven_lanedir_consec": 0.08351849780740839, "sim_compute_sim_state": 0.005033699103764125, "sim_compute_performance-ego": 0.007088795730045863, "sim_compute_robot_state-ego": 0.00959822280066354}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.15445572913780825, "sim_physics": 0.09872843890354552, "survival_time": 2.8999999999999977, "driven_lanedir": 0.07553396695052417, "sim_render-ego": 0.01097337952975569, "in-drivable-lane": 1.1999999999999988, "agent_compute-ego": 0.02615272176676783, "deviation-heading": 1.119598463861732, "set_robot_commands": 0.00933740467860781, "deviation-center-line": 0.14581203883095545, "driven_lanedir_consec": 0.07553396695052417, "sim_compute_sim_state": 0.004582474971639699, "sim_compute_performance-ego": 0.006408777730218296, "sim_compute_robot_state-ego": 0.007839975685908877}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.3452836435746031, "sim_physics": 0.08636794249216716, "survival_time": 14.950000000000076, "driven_lanedir": 0.17688072065719185, "sim_render-ego": 0.01069764773050944, "in-drivable-lane": 6.950000000000038, "agent_compute-ego": 0.02400698184967041, "deviation-heading": 6.16694125986921, "set_robot_commands": 0.008322113355000814, "deviation-center-line": 0.26822500552171624, "driven_lanedir_consec": 0.17688072065719185, "sim_compute_sim_state": 0.004581044514973959, "sim_compute_performance-ego": 0.006618583997090657, "sim_compute_robot_state-ego": 0.00798521359761556}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5646194788498025, "sim_physics": 0.11315487305323282, "survival_time": 14.950000000000076, "driven_lanedir": 0.32065311861398327, "sim_render-ego": 0.0125297482808431, "in-drivable-lane": 7.000000000000039, "agent_compute-ego": 0.026860610644022623, "deviation-heading": 5.91194833506553, "set_robot_commands": 0.010097010135650637, "deviation-center-line": 0.3698344648968963, "driven_lanedir_consec": 0.32065311861398327, "sim_compute_sim_state": 0.0051141858100891115, "sim_compute_performance-ego": 0.007504550615946451, "sim_compute_robot_state-ego": 0.00937049150466919}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5694454194161396, "sim_physics": 0.12454924382359148, "survival_time": 8.299999999999983, "driven_lanedir": 0.2381022346997128, "sim_render-ego": 0.0131521368601236, "in-drivable-lane": 3.699999999999993, "agent_compute-ego": 0.02900545137474336, "deviation-heading": 3.1280622178295117, "set_robot_commands": 0.010711138506969774, "deviation-center-line": 0.2857900550324427, "driven_lanedir_consec": 0.2381022346997128, "sim_compute_sim_state": 0.005318153335387449, "sim_compute_performance-ego": 0.00796076906732766, "sim_compute_robot_state-ego": 0.009587297956627536}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.4700025077338644, "sim_physics": 0.08954917186151737, "survival_time": 9.45, "driven_lanedir": 0.245092201041873, "sim_render-ego": 0.010976433123230303, "in-drivable-lane": 3.899999999999999, "agent_compute-ego": 0.024117513939186375, "deviation-heading": 3.607694199092572, "set_robot_commands": 0.008348447305184824, "deviation-center-line": 0.24437038567730632, "driven_lanedir_consec": 0.245092201041873, "sim_compute_sim_state": 0.0046641019286302035, "sim_compute_performance-ego": 0.006607411399720207, "sim_compute_robot_state-ego": 0.008093437820515305}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.084360655631106, "sim_physics": 0.10959434270858764, "survival_time": 14.950000000000076, "driven_lanedir": 0.3878748048021099, "sim_render-ego": 0.012562118371327716, "in-drivable-lane": 6.950000000000038, "agent_compute-ego": 0.02809374729792277, "deviation-heading": 6.06719269223123, "set_robot_commands": 0.010326260725657146, "deviation-center-line": 0.3259746664690939, "driven_lanedir_consec": 0.3878748048021099, "sim_compute_sim_state": 0.004999723434448242, "sim_compute_performance-ego": 0.007521148522694906, "sim_compute_robot_state-ego": 0.00908588965733846}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5201597711781162, "sim_physics": 0.07992495854695637, "survival_time": 14.950000000000076, "driven_lanedir": 0.17684981850020054, "sim_render-ego": 0.009532817204793294, "in-drivable-lane": 7.25000000000004, "agent_compute-ego": 0.023466389179229736, "deviation-heading": 5.883489612377438, "set_robot_commands": 0.007540191809336344, "deviation-center-line": 0.21812102301237168, "driven_lanedir_consec": 0.17684981850020054, "sim_compute_sim_state": 0.003900245825449626, "sim_compute_performance-ego": 0.005501297314961752, "sim_compute_robot_state-ego": 0.0069316347440083826}}
set_robot_commands_max0.011676486333211262
set_robot_commands_mean0.009706840885090865
set_robot_commands_median0.009941203253609794
set_robot_commands_min0.007540191809336344
sim_compute_performance-ego_max0.008144121170043945
sim_compute_performance-ego_mean0.007173371210551358
sim_compute_performance-ego_median0.007350878521964999
sim_compute_performance-ego_min0.005501297314961752
sim_compute_robot_state-ego_max0.009885670344034833
sim_compute_robot_state-ego_mean0.008908473498965168
sim_compute_robot_state-ego_median0.009154464925787106
sim_compute_robot_state-ego_min0.0069316347440083826
sim_compute_sim_state_max0.0054979292551676434
sim_compute_sim_state_mean0.004930705397430897
sim_compute_sim_state_median0.005033699103764125
sim_compute_sim_state_min0.003900245825449626
sim_physics_max0.13116018295288087
sim_physics_mean0.10697251005015612
sim_physics_median0.10924437046051023
sim_physics_min0.07992495854695637
sim_render-ego_max0.01402803103129069
sim_render-ego_mean0.012127749095414388
sim_render-ego_median0.01253082411629813
sim_render-ego_min0.009532817204793294
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.020000000000037
survival_time_min2.8999999999999977
No reset possible
274764551Robert Moni 🇭🇺kaland-22405aido3-LF-sim-testingstep1-simulationabortednoip-172-31-35-218-104900:19:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
274594399Peter Almasi 🇭🇺reinforcement-learning-submissionaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5904711847138471
survival_time_median6.099999999999986
deviation-center-line_median0.3840780746118429
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.039050311577029345
agent_compute-ego_mean0.03659979084044821
agent_compute-ego_median0.038251949138328675
agent_compute-ego_min0.03289985890481986
deviation-center-line_max0.506431004958263
deviation-center-line_mean0.35975741855180504
deviation-center-line_min0.20485694817998495
deviation-heading_max2.9218198703815097
deviation-heading_mean1.6867384260409608
deviation-heading_median1.276314487931575
deviation-heading_min1.1140007283359774
driven_any_max1.5606905930292354
driven_any_mean0.789125284849652
driven_any_median0.6054180635188668
driven_any_min0.3481795119275774
driven_lanedir_consec_max1.519185579715271
driven_lanedir_consec_mean0.7538217125541087
driven_lanedir_consec_min0.31226172821833287
driven_lanedir_max1.519185579715271
driven_lanedir_mean0.7538217125541087
driven_lanedir_median0.5904711847138471
driven_lanedir_min0.31226172821833287
in-drivable-lane_max0.15000000000000213
in-drivable-lane_mean0.07000000000000028
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3481795119275774, "sim_physics": 0.10565809680990976, "survival_time": 3.649999999999995, "driven_lanedir": 0.31226172821833287, "sim_render-ego": 0.01229292725863522, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.03839776940541725, "deviation-heading": 1.276314487931575, "set_robot_commands": 0.009573635989672516, "deviation-center-line": 0.20485694817998495, "driven_lanedir_consec": 0.31226172821833287, "sim_compute_sim_state": 0.00483051064896257, "sim_compute_performance-ego": 0.007345565377849422, "sim_compute_robot_state-ego": 0.00870674930206717}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3954258755670448, "sim_physics": 0.11227938605517876, "survival_time": 4.099999999999993, "driven_lanedir": 0.3573509303661486, "sim_render-ego": 0.013242061545209186, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.039050311577029345, "deviation-heading": 1.16299054583407, "set_robot_commands": 0.01038081762267322, "deviation-center-line": 0.3124060931956145, "driven_lanedir_consec": 0.3573509303661486, "sim_compute_sim_state": 0.005397226752304449, "sim_compute_performance-ego": 0.0076604238370569745, "sim_compute_robot_state-ego": 0.009658074960476014}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5606905930292354, "sim_physics": 0.10082101424535116, "survival_time": 14.950000000000076, "driven_lanedir": 1.519185579715271, "sim_render-ego": 0.0114470370610555, "in-drivable-lane": 0, "agent_compute-ego": 0.03439906517664591, "deviation-heading": 2.9218198703815097, "set_robot_commands": 0.009274169603983562, "deviation-center-line": 0.39101497181332, "driven_lanedir_consec": 1.519185579715271, "sim_compute_sim_state": 0.004804388682047526, "sim_compute_performance-ego": 0.006790463129679362, "sim_compute_robot_state-ego": 0.00856540044148763}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6054180635188668, "sim_physics": 0.11607189256636824, "survival_time": 6.099999999999986, "driven_lanedir": 0.5904711847138471, "sim_render-ego": 0.01267550030692679, "in-drivable-lane": 0, "agent_compute-ego": 0.038251949138328675, "deviation-heading": 1.1140007283359774, "set_robot_commands": 0.01012893973803911, "deviation-center-line": 0.3840780746118429, "driven_lanedir_consec": 0.5904711847138471, "sim_compute_sim_state": 0.0053299997673660025, "sim_compute_performance-ego": 0.00755227198366259, "sim_compute_robot_state-ego": 0.009599062262988482}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.035912380205536, "sim_physics": 0.08760357019948024, "survival_time": 10.20000000000001, "driven_lanedir": 0.9898391397569436, "sim_render-ego": 0.010774010536717431, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.03289985890481986, "deviation-heading": 1.9585664977216708, "set_robot_commands": 0.00846547706454408, "deviation-center-line": 0.506431004958263, "driven_lanedir_consec": 0.9898391397569436, "sim_compute_sim_state": 0.00462795238868863, "sim_compute_performance-ego": 0.0064764186447741935, "sim_compute_robot_state-ego": 0.007819353365430645}}
set_robot_commands_max0.01038081762267322
set_robot_commands_mean0.009564608003782496
set_robot_commands_median0.009573635989672516
set_robot_commands_min0.00846547706454408
sim_compute_performance-ego_max0.0076604238370569745
sim_compute_performance-ego_mean0.007165028594604508
sim_compute_performance-ego_median0.007345565377849422
sim_compute_performance-ego_min0.0064764186447741935
sim_compute_robot_state-ego_max0.009658074960476014
sim_compute_robot_state-ego_mean0.00886972806648999
sim_compute_robot_state-ego_median0.00870674930206717
sim_compute_robot_state-ego_min0.007819353365430645
sim_compute_sim_state_max0.005397226752304449
sim_compute_sim_state_mean0.004998015647873836
sim_compute_sim_state_median0.00483051064896257
sim_compute_sim_state_min0.00462795238868863
sim_physics_max0.11607189256636824
sim_physics_mean0.10448679197525763
sim_physics_median0.10565809680990976
sim_physics_min0.08760357019948024
sim_render-ego_max0.013242061545209186
sim_render-ego_mean0.012086307341708827
sim_render-ego_median0.01229292725863522
sim_render-ego_min0.010774010536717431
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.800000000000013
survival_time_min3.649999999999995
No reset possible
274214456Peter Almasi 🇭🇺reinforcement-learning-submissionaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:11:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8643015230485246
survival_time_median14.950000000000076
deviation-center-line_median0.35554932119636595
in-drivable-lane_median9.10000000000009


other stats
agent_compute-ego_max0.039167893703446185
agent_compute-ego_mean0.03509302118013532
agent_compute-ego_median0.035513715744018556
agent_compute-ego_min0.029954964075333032
deviation-center-line_max1.2103881978766688
deviation-center-line_mean0.5293811948481174
deviation-center-line_min0.31980576584405107
deviation-heading_max4.4671272081786615
deviation-heading_mean2.825253247094264
deviation-heading_median2.45835427973584
deviation-heading_min2.1817445713910346
driven_any_max3.27173561290712
driven_any_mean2.8419885128674
driven_any_median3.076970324478843
driven_any_min2.121300623738545
driven_lanedir_consec_max1.7936198946561497
driven_lanedir_consec_mean1.037898193942787
driven_lanedir_consec_min0.6846900498356951
driven_lanedir_max1.7936198946561497
driven_lanedir_mean1.037898193942787
driven_lanedir_median0.8643015230485246
driven_lanedir_min0.6846900498356951
in-drivable-lane_max10.600000000000046
in-drivable-lane_mean7.460000000000038
in-drivable-lane_min2.600000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.076970324478843, "sim_physics": 0.09412768363952637, "survival_time": 14.950000000000076, "driven_lanedir": 0.8643015230485246, "sim_render-ego": 0.011342413425445556, "in-drivable-lane": 9.700000000000024, "agent_compute-ego": 0.035513715744018556, "deviation-heading": 2.45835427973584, "set_robot_commands": 0.009294902483622232, "deviation-center-line": 0.4253489931409886, "driven_lanedir_consec": 0.8643015230485246, "sim_compute_sim_state": 0.004779890378316243, "sim_compute_performance-ego": 0.00686358372370402, "sim_compute_robot_state-ego": 0.008717311223347983}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.159034748976186, "sim_physics": 0.10561240514119466, "survival_time": 14.950000000000076, "driven_lanedir": 1.1260845042274257, "sim_render-ego": 0.01222100019454956, "in-drivable-lane": 9.10000000000009, "agent_compute-ego": 0.036910564104715986, "deviation-heading": 2.1817445713910346, "set_robot_commands": 0.009808770815531411, "deviation-center-line": 0.335813696182513, "driven_lanedir_consec": 1.1260845042274257, "sim_compute_sim_state": 0.004976331392923991, "sim_compute_performance-ego": 0.007332690556844075, "sim_compute_robot_state-ego": 0.009008936882019043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.580901254236304, "sim_physics": 0.11498883921837172, "survival_time": 13.150000000000052, "driven_lanedir": 1.7936198946561497, "sim_render-ego": 0.012664144030088708, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.039167893703446185, "deviation-heading": 4.4671272081786615, "set_robot_commands": 0.010430155598165418, "deviation-center-line": 1.2103881978766688, "driven_lanedir_consec": 1.7936198946561497, "sim_compute_sim_state": 0.0054142030926258395, "sim_compute_performance-ego": 0.007772131111232047, "sim_compute_robot_state-ego": 0.009793009594819392}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.121300623738545, "sim_physics": 0.07996731048975235, "survival_time": 9.750000000000004, "driven_lanedir": 0.6846900498356951, "sim_render-ego": 0.009507503264989609, "in-drivable-lane": 5.299999999999994, "agent_compute-ego": 0.029954964075333032, "deviation-heading": 2.717386930697361, "set_robot_commands": 0.007411604661207933, "deviation-center-line": 0.35554932119636595, "driven_lanedir_consec": 0.6846900498356951, "sim_compute_sim_state": 0.004077785443036984, "sim_compute_performance-ego": 0.005619613940899188, "sim_compute_robot_state-ego": 0.006795358657836914}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.27173561290712, "sim_physics": 0.09707825342814128, "survival_time": 14.950000000000076, "driven_lanedir": 0.7207949979461399, "sim_render-ego": 0.010802637736002605, "in-drivable-lane": 10.600000000000046, "agent_compute-ego": 0.03391796827316284, "deviation-heading": 2.301653245468424, "set_robot_commands": 0.008632736206054687, "deviation-center-line": 0.31980576584405107, "driven_lanedir_consec": 0.7207949979461399, "sim_compute_sim_state": 0.004573610623677572, "sim_compute_performance-ego": 0.006292744477589925, "sim_compute_robot_state-ego": 0.008048793474833171}}
set_robot_commands_max0.010430155598165418
set_robot_commands_mean0.009115633952916338
set_robot_commands_median0.009294902483622232
set_robot_commands_min0.007411604661207933
sim_compute_performance-ego_max0.007772131111232047
sim_compute_performance-ego_mean0.006776152762053851
sim_compute_performance-ego_median0.00686358372370402
sim_compute_performance-ego_min0.005619613940899188
sim_compute_robot_state-ego_max0.009793009594819392
sim_compute_robot_state-ego_mean0.008472681966571301
sim_compute_robot_state-ego_median0.008717311223347983
sim_compute_robot_state-ego_min0.006795358657836914
sim_compute_sim_state_max0.0054142030926258395
sim_compute_sim_state_mean0.004764364186116127
sim_compute_sim_state_median0.004779890378316243
sim_compute_sim_state_min0.004077785443036984
sim_physics_max0.11498883921837172
sim_physics_mean0.09835489838339728
sim_physics_median0.09707825342814128
sim_physics_min0.07996731048975235
sim_render-ego_max0.012664144030088708
sim_render-ego_mean0.011307539730215208
sim_render-ego_median0.011342413425445556
sim_render-ego_min0.009507503264989609
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.550000000000058
survival_time_min9.750000000000004
No reset possible
274034470Mikita Sazanovich 🇷🇺chameleonaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2414379745718294
survival_time_median3.7499999999999942
deviation-center-line_median0.21493906270965568
in-drivable-lane_median0.9999999999999978


other stats
agent_compute-ego_max0.07499038048510281
agent_compute-ego_mean0.059888043186222394
agent_compute-ego_median0.05613093651258028
agent_compute-ego_min0.04491103808085123
deviation-center-line_max0.3147326412297343
deviation-center-line_mean0.1917920359962712
deviation-center-line_min0.06308677039024169
deviation-heading_max1.856909931694952
deviation-heading_mean0.917540797306268
deviation-heading_median0.7347517208799438
deviation-heading_min0.3849857238160124
driven_any_max4.318494245014383
driven_any_mean2.189603432534651
driven_any_median1.6055656945002652
driven_any_min1.0700802854209197
driven_lanedir_consec_max1.5958929899779768
driven_lanedir_consec_mean1.1686973583549962
driven_lanedir_consec_min0.6172410971748287
driven_lanedir_max1.5958929899779768
driven_lanedir_mean1.1686973583549962
driven_lanedir_median1.2414379745718294
driven_lanedir_min0.6172410971748287
in-drivable-lane_max5.349999999999997
in-drivable-lane_mean1.999999999999997
in-drivable-lane_min0.25
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.070945153682945, "sim_physics": 0.1277979184996407, "survival_time": 2.6499999999999986, "driven_lanedir": 0.6172410971748287, "sim_render-ego": 0.01348072627805314, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.07499038048510281, "deviation-heading": 0.3849857238160124, "set_robot_commands": 0.01040352515454562, "deviation-center-line": 0.06308677039024169, "driven_lanedir_consec": 0.6172410971748287, "sim_compute_sim_state": 0.00517760582689969, "sim_compute_performance-ego": 0.008152714315450416, "sim_compute_robot_state-ego": 0.010382746750453734}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.318494245014383, "sim_physics": 0.11137390770810716, "survival_time": 9.4, "driven_lanedir": 1.5117490746373603, "sim_render-ego": 0.01266272524569897, "in-drivable-lane": 5.349999999999997, "agent_compute-ego": 0.07023613376820341, "deviation-heading": 1.856909931694952, "set_robot_commands": 0.00963875080676789, "deviation-center-line": 0.3147326412297343, "driven_lanedir_consec": 1.5117490746373603, "sim_compute_sim_state": 0.00505914586655637, "sim_compute_performance-ego": 0.007620171029516992, "sim_compute_robot_state-ego": 0.009635477624040968}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0700802854209197, "sim_physics": 0.08829401548092182, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8771656554129863, "sim_render-ego": 0.011382671502920298, "in-drivable-lane": 0.25, "agent_compute-ego": 0.05613093651258028, "deviation-heading": 0.7347517208799438, "set_robot_commands": 0.008879501086014967, "deviation-center-line": 0.2296522868666681, "driven_lanedir_consec": 0.8771656554129863, "sim_compute_sim_state": 0.004718748422769399, "sim_compute_performance-ego": 0.007016048981593206, "sim_compute_robot_state-ego": 0.008280277252197266}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6055656945002652, "sim_physics": 0.06585361798604329, "survival_time": 3.7499999999999942, "driven_lanedir": 1.2414379745718294, "sim_render-ego": 0.0082526429494222, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.04491103808085123, "deviation-heading": 0.6158605450851627, "set_robot_commands": 0.005715338389078776, "deviation-center-line": 0.13654941878505608, "driven_lanedir_consec": 1.2414379745718294, "sim_compute_sim_state": 0.0034626293182373046, "sim_compute_performance-ego": 0.004617242813110351, "sim_compute_robot_state-ego": 0.005640773773193359}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8829317840547413, "sim_physics": 0.08780309950658517, "survival_time": 6.449999999999985, "driven_lanedir": 1.5958929899779768, "sim_render-ego": 0.010512272516886393, "in-drivable-lane": 2.699999999999992, "agent_compute-ego": 0.053171727084374246, "deviation-heading": 0.995196065055268, "set_robot_commands": 0.007586743480475374, "deviation-center-line": 0.21493906270965568, "driven_lanedir_consec": 1.5958929899779768, "sim_compute_sim_state": 0.0041431271752645805, "sim_compute_performance-ego": 0.006049158037170883, "sim_compute_robot_state-ego": 0.007408737212188484}}
set_robot_commands_max0.01040352515454562
set_robot_commands_mean0.008444771783376525
set_robot_commands_median0.008879501086014967
set_robot_commands_min0.005715338389078776
sim_compute_performance-ego_max0.008152714315450416
sim_compute_performance-ego_mean0.00669106703536837
sim_compute_performance-ego_median0.007016048981593206
sim_compute_performance-ego_min0.004617242813110351
sim_compute_robot_state-ego_max0.010382746750453734
sim_compute_robot_state-ego_mean0.008269602522414762
sim_compute_robot_state-ego_median0.008280277252197266
sim_compute_robot_state-ego_min0.005640773773193359
sim_compute_sim_state_max0.00517760582689969
sim_compute_sim_state_mean0.004512251321945469
sim_compute_sim_state_median0.004718748422769399
sim_compute_sim_state_min0.0034626293182373046
sim_physics_max0.1277979184996407
sim_physics_mean0.09622451183625962
sim_physics_median0.08829401548092182
sim_physics_min0.06585361798604329
sim_render-ego_max0.01348072627805314
sim_render-ego_mean0.0112582076985962
sim_render-ego_median0.011382671502920298
sim_render-ego_min0.0082526429494222
simulation-passed1
survival_time_max9.4
survival_time_mean4.969999999999995
survival_time_min2.5999999999999988
No reset possible
274024576Abderrahim Khalifa 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-35-218-104900:00:09
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling simulator      ... 
stderr | Pulling evaluator      ... 
stderr | Pulling scenario_maker ... done
stderr | 
stderr | ERROR: for solution  manifest for ai404/aido-submissions:2019_11_27_00_01_45 not found
stderr | manifest for ai404/aido-submissions:2019_11_27_00_01_45 not found
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
273694519Robert Moni 🇭🇺kaland-2240saido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:12:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.007913858556636
survival_time_median14.950000000000076
deviation-center-line_median0.5814621804881903
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04163678884506226
agent_compute-ego_mean0.03926784926588817
agent_compute-ego_median0.040321913457685904
agent_compute-ego_min0.03275009075800578
deviation-center-line_max0.8008969072526197
deviation-center-line_mean0.5580203358603543
deviation-center-line_min0.2949621119242242
deviation-heading_max3.897729649333049
deviation-heading_mean3.1241475904942297
deviation-heading_median3.5946735910843985
deviation-heading_min1.325827940405102
driven_any_max4.314586496966628
driven_any_mean3.676678380781194
driven_any_median4.172167085156137
driven_any_min1.6343538573546983
driven_lanedir_consec_max4.095196789922046
driven_lanedir_consec_mean3.5251128059522836
driven_lanedir_consec_min1.5716665606427993
driven_lanedir_max4.095196789922046
driven_lanedir_mean3.5251128059522836
driven_lanedir_median4.007913858556636
driven_lanedir_min1.5716665606427993
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.314586496966628, "sim_physics": 0.11636840343475342, "survival_time": 14.950000000000076, "driven_lanedir": 4.095196789922046, "sim_render-ego": 0.013025503158569336, "in-drivable-lane": 0, "agent_compute-ego": 0.04140563170115153, "deviation-heading": 3.897729649333049, "set_robot_commands": 0.010048031012217204, "deviation-center-line": 0.5851920532138658, "driven_lanedir_consec": 4.095196789922046, "sim_compute_sim_state": 0.0052160350481669105, "sim_compute_performance-ego": 0.007812548478444417, "sim_compute_robot_state-ego": 0.009324141343434652}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.172167085156137, "sim_physics": 0.08078543980916342, "survival_time": 14.950000000000076, "driven_lanedir": 4.0441811349666805, "sim_render-ego": 0.009812235832214355, "in-drivable-lane": 0, "agent_compute-ego": 0.03275009075800578, "deviation-heading": 3.1371180380491737, "set_robot_commands": 0.007644957701365153, "deviation-center-line": 0.5275884264228708, "driven_lanedir_consec": 4.0441811349666805, "sim_compute_sim_state": 0.004042814572652181, "sim_compute_performance-ego": 0.0057038648923238115, "sim_compute_robot_state-ego": 0.0070506103833516435}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.1853058308292095, "sim_physics": 0.11861403226852416, "survival_time": 14.950000000000076, "driven_lanedir": 4.007913858556636, "sim_render-ego": 0.013003275394439698, "in-drivable-lane": 0, "agent_compute-ego": 0.0402248215675354, "deviation-heading": 3.665388733599424, "set_robot_commands": 0.010492750803629556, "deviation-center-line": 0.5814621804881903, "driven_lanedir_consec": 4.007913858556636, "sim_compute_sim_state": 0.0052944413820902505, "sim_compute_performance-ego": 0.007862730026245117, "sim_compute_robot_state-ego": 0.009525146484375}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6343538573546983, "sim_physics": 0.112721570076481, "survival_time": 6.199999999999986, "driven_lanedir": 1.5716665606427993, "sim_render-ego": 0.012901752225814326, "in-drivable-lane": 0, "agent_compute-ego": 0.040321913457685904, "deviation-heading": 1.325827940405102, "set_robot_commands": 0.010033451741741547, "deviation-center-line": 0.2949621119242242, "driven_lanedir_consec": 1.5716665606427993, "sim_compute_sim_state": 0.005175415546663346, "sim_compute_performance-ego": 0.007689712509032219, "sim_compute_robot_state-ego": 0.009295726976087016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.076978633599295, "sim_physics": 0.1255971137682597, "survival_time": 14.950000000000076, "driven_lanedir": 3.9066056856732567, "sim_render-ego": 0.013299439748128255, "in-drivable-lane": 0, "agent_compute-ego": 0.04163678884506226, "deviation-heading": 3.5946735910843985, "set_robot_commands": 0.010820693174997963, "deviation-center-line": 0.8008969072526197, "driven_lanedir_consec": 3.9066056856732567, "sim_compute_sim_state": 0.005504168669382731, "sim_compute_performance-ego": 0.007992153167724609, "sim_compute_robot_state-ego": 0.00995314598083496}}
set_robot_commands_max0.010820693174997963
set_robot_commands_mean0.009807976886790288
set_robot_commands_median0.010048031012217204
set_robot_commands_min0.007644957701365153
sim_compute_performance-ego_max0.007992153167724609
sim_compute_performance-ego_mean0.0074122018147540335
sim_compute_performance-ego_median0.007812548478444417
sim_compute_performance-ego_min0.0057038648923238115
sim_compute_robot_state-ego_max0.00995314598083496
sim_compute_robot_state-ego_mean0.009029754233616651
sim_compute_robot_state-ego_median0.009324141343434652
sim_compute_robot_state-ego_min0.0070506103833516435
sim_compute_sim_state_max0.005504168669382731
sim_compute_sim_state_mean0.005046575043791084
sim_compute_sim_state_median0.0052160350481669105
sim_compute_sim_state_min0.004042814572652181
sim_physics_max0.1255971137682597
sim_physics_mean0.11081731187143631
sim_physics_median0.11636840343475342
sim_physics_min0.08078543980916342
sim_render-ego_max0.013299439748128255
sim_render-ego_mean0.012408441271833194
sim_render-ego_median0.013003275394439698
sim_render-ego_min0.009812235832214355
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.20000000000006
survival_time_min6.199999999999986
No reset possible
273584527Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|10kaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-35-218-104900:00:28
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 894, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1277, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 306, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 287, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4527/step1-simulation-ip-172-31-35-218-10490-job27358': '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4527/step1-simulation-ip-172-31-35-218-10490-job27358'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
273224574Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:11:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7763403114296663
survival_time_median11.60000000000003
deviation-center-line_median0.555395797249596
in-drivable-lane_median0


other stats
agent_compute-ego_max0.058519793351491295
agent_compute-ego_mean0.04628297833424958
agent_compute-ego_median0.04891043284843708
agent_compute-ego_min0.0268156462853108
deviation-center-line_max0.8933035596458022
deviation-center-line_mean0.5449540877910829
deviation-center-line_min0.14198164659922036
deviation-heading_max3.2901477530009524
deviation-heading_mean1.782052171815962
deviation-heading_median1.370436746295015
deviation-heading_min0.9764729420089971
driven_any_max2.3491423495072343
driven_any_mean1.7288082564946703
driven_any_median1.8107198742945108
driven_any_min0.8145563054833724
driven_lanedir_consec_max2.3171792318655715
driven_lanedir_consec_mean1.6829525841102615
driven_lanedir_consec_min0.764098081795913
driven_lanedir_max2.3171792318655715
driven_lanedir_mean1.6829525841102615
driven_lanedir_median1.7763403114296663
driven_lanedir_min0.764098081795913
in-drivable-lane_max0.05000000000000071
in-drivable-lane_mean0.010000000000000142
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8145563054833724, "sim_physics": 0.10426055400743398, "survival_time": 5.449999999999989, "driven_lanedir": 0.764098081795913, "sim_render-ego": 0.011730638119058872, "in-drivable-lane": 0, "agent_compute-ego": 0.0268156462853108, "deviation-heading": 1.2696668454618625, "set_robot_commands": 0.010847588197900614, "deviation-center-line": 0.14198164659922036, "driven_lanedir_consec": 0.764098081795913, "sim_compute_sim_state": 0.005399111214034054, "sim_compute_performance-ego": 0.007857838901904744, "sim_compute_robot_state-ego": 0.008901025177141942}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8107198742945108, "sim_physics": 0.12474309473202148, "survival_time": 11.60000000000003, "driven_lanedir": 1.7763403114296663, "sim_render-ego": 0.01311840271127635, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.04891043284843708, "deviation-heading": 1.370436746295015, "set_robot_commands": 0.011386211576132938, "deviation-center-line": 0.6506810448911529, "driven_lanedir_consec": 1.7763403114296663, "sim_compute_sim_state": 0.00571285239581404, "sim_compute_performance-ego": 0.008012366705927355, "sim_compute_robot_state-ego": 0.01017453855481641}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3491215550116973, "sim_physics": 0.08084459861119588, "survival_time": 14.950000000000076, "driven_lanedir": 2.2498348436993534, "sim_render-ego": 0.009933223724365234, "in-drivable-lane": 0, "agent_compute-ego": 0.04147864977518718, "deviation-heading": 3.2901477530009524, "set_robot_commands": 0.007262570063273112, "deviation-center-line": 0.8933035596458022, "driven_lanedir_consec": 2.2498348436993534, "sim_compute_sim_state": 0.004105753898620605, "sim_compute_performance-ego": 0.00580506165822347, "sim_compute_robot_state-ego": 0.007342481613159179}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320501198176538, "sim_physics": 0.11598535587913111, "survival_time": 8.549999999999986, "driven_lanedir": 1.307310451760805, "sim_render-ego": 0.012378349638821786, "in-drivable-lane": 0, "agent_compute-ego": 0.05569036941082157, "deviation-heading": 0.9764729420089971, "set_robot_commands": 0.009920111873693634, "deviation-center-line": 0.555395797249596, "driven_lanedir_consec": 1.307310451760805, "sim_compute_sim_state": 0.004948228423358404, "sim_compute_performance-ego": 0.006935864164118181, "sim_compute_robot_state-ego": 0.009403292895757665}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491423495072343, "sim_physics": 0.13129886309305827, "survival_time": 14.950000000000076, "driven_lanedir": 2.3171792318655715, "sim_render-ego": 0.013959408601125082, "in-drivable-lane": 0, "agent_compute-ego": 0.058519793351491295, "deviation-heading": 2.0035365723129828, "set_robot_commands": 0.011349159081776935, "deviation-center-line": 0.48340839056964297, "driven_lanedir_consec": 2.3171792318655715, "sim_compute_sim_state": 0.005540979703267415, "sim_compute_performance-ego": 0.007893847624460855, "sim_compute_robot_state-ego": 0.01023794968922933}}
set_robot_commands_max0.011386211576132938
set_robot_commands_mean0.010153128158555447
set_robot_commands_median0.010847588197900614
set_robot_commands_min0.007262570063273112
sim_compute_performance-ego_max0.008012366705927355
sim_compute_performance-ego_mean0.00730099581092692
sim_compute_performance-ego_median0.007857838901904744
sim_compute_performance-ego_min0.00580506165822347
sim_compute_robot_state-ego_max0.01023794968922933
sim_compute_robot_state-ego_mean0.009211857586020906
sim_compute_robot_state-ego_median0.009403292895757665
sim_compute_robot_state-ego_min0.007342481613159179
sim_compute_sim_state_max0.00571285239581404
sim_compute_sim_state_mean0.005141385127018903
sim_compute_sim_state_median0.005399111214034054
sim_compute_sim_state_min0.004105753898620605
sim_physics_max0.13129886309305827
sim_physics_mean0.11142649326456816
sim_physics_median0.11598535587913111
sim_physics_min0.08084459861119588
sim_render-ego_max0.013959408601125082
sim_render-ego_mean0.012224004558929464
sim_render-ego_median0.012378349638821786
sim_render-ego_min0.009933223724365234
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.100000000000032
survival_time_min5.449999999999989
No reset possible
273164581Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
273084582Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272794607Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-35-218-104900:03:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 52 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272724613Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272694617César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272534626César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272454628César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationfailedyesip-172-31-35-218-104900:01:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 300, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 26, in on_received_observations
               ||     blur = cv2.GaussianBlur(img,(5,5),1)
               || NameError: name 'cv2' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
272154651Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9076907136527792
survival_time_median8.04999999999998
deviation-center-line_median0.5310614966265171
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.028197903382150752
agent_compute-ego_mean0.025864325606460545
agent_compute-ego_median0.026291408894224936
agent_compute-ego_min0.021984915802444237
deviation-center-line_max1.0904929382438002
deviation-center-line_mean0.5443658756276877
deviation-center-line_min0.0785890803762598
deviation-heading_max2.4060558997968102
deviation-heading_mean1.598276423212218
deviation-heading_median2.188799514738721
deviation-heading_min0.3682004251656486
driven_any_max5.5876777112829545
driven_any_mean2.730628320797166
driven_any_median2.2744583839627657
driven_any_min0.3832153603203879
driven_lanedir_consec_max4.855815932415377
driven_lanedir_consec_mean2.3522771620581056
driven_lanedir_consec_min0.3635329141034904
driven_lanedir_max4.855815932415377
driven_lanedir_mean2.3522771620581056
driven_lanedir_median1.9076907136527792
driven_lanedir_min0.3635329141034904
in-drivable-lane_max4.2000000000000055
in-drivable-lane_mean1.9900000000000069
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0080957941210469, "sim_physics": 0.12991267338133694, "survival_time": 2.849999999999998, "driven_lanedir": 0.6555873527137577, "sim_render-ego": 0.01353513148793003, "in-drivable-lane": 0.9999999999999968, "agent_compute-ego": 0.028197903382150752, "deviation-heading": 0.7816594239495988, "set_robot_commands": 0.012368942561902498, "deviation-center-line": 0.11705939072992456, "driven_lanedir_consec": 0.6555873527137577, "sim_compute_sim_state": 0.005855961849814967, "sim_compute_performance-ego": 0.008394655428434672, "sim_compute_robot_state-ego": 0.01017022551151744}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2744583839627657, "sim_physics": 0.10558236311681522, "survival_time": 8.04999999999998, "driven_lanedir": 1.9076907136527792, "sim_render-ego": 0.012291344056218309, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.026291408894224936, "deviation-heading": 2.246666852410311, "set_robot_commands": 0.01170285740254088, "deviation-center-line": 0.5310614966265171, "driven_lanedir_consec": 1.9076907136527792, "sim_compute_sim_state": 0.005750339223731378, "sim_compute_performance-ego": 0.007336545434797772, "sim_compute_robot_state-ego": 0.009314776947779683}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.5876777112829545, "sim_physics": 0.10064863840738932, "survival_time": 14.950000000000076, "driven_lanedir": 4.855815932415377, "sim_render-ego": 0.011838351885477702, "in-drivable-lane": 4.2000000000000055, "agent_compute-ego": 0.025056065718332927, "deviation-heading": 2.4060558997968102, "set_robot_commands": 0.011467080116271972, "deviation-center-line": 0.9046264721619366, "driven_lanedir_consec": 4.855815932415377, "sim_compute_sim_state": 0.005077841281890869, "sim_compute_performance-ego": 0.00709565003712972, "sim_compute_robot_state-ego": 0.008989055951436361}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.399694354298674, "sim_physics": 0.0778635921685592, "survival_time": 13.80000000000006, "driven_lanedir": 3.978758897405122, "sim_render-ego": 0.010142975959224976, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.021984915802444237, "deviation-heading": 2.188799514738721, "set_robot_commands": 0.00967781699222067, "deviation-center-line": 1.0904929382438002, "driven_lanedir_consec": 3.978758897405122, "sim_compute_sim_state": 0.004603119000144627, "sim_compute_performance-ego": 0.0059400304504062815, "sim_compute_robot_state-ego": 0.007297830305237701}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3832153603203879, "sim_physics": 0.15298281545224396, "survival_time": 1.1500000000000004, "driven_lanedir": 0.3635329141034904, "sim_render-ego": 0.014954826106195864, "in-drivable-lane": 0, "agent_compute-ego": 0.02779133423514988, "deviation-heading": 0.3682004251656486, "set_robot_commands": 0.013443936472353727, "deviation-center-line": 0.0785890803762598, "driven_lanedir_consec": 0.3635329141034904, "sim_compute_sim_state": 0.005733013153076172, "sim_compute_performance-ego": 0.008539303489353346, "sim_compute_robot_state-ego": 0.010392531104709791}}
set_robot_commands_max0.013443936472353727
set_robot_commands_mean0.01173212670905795
set_robot_commands_median0.01170285740254088
set_robot_commands_min0.00967781699222067
sim_compute_performance-ego_max0.008539303489353346
sim_compute_performance-ego_mean0.007461236968024358
sim_compute_performance-ego_median0.007336545434797772
sim_compute_performance-ego_min0.0059400304504062815
sim_compute_robot_state-ego_max0.010392531104709791
sim_compute_robot_state-ego_mean0.009232883964136195
sim_compute_robot_state-ego_median0.009314776947779683
sim_compute_robot_state-ego_min0.007297830305237701
sim_compute_sim_state_max0.005855961849814967
sim_compute_sim_state_mean0.005404054901731603
sim_compute_sim_state_median0.005733013153076172
sim_compute_sim_state_min0.004603119000144627
sim_physics_max0.15298281545224396
sim_physics_mean0.11339801650526896
sim_physics_median0.10558236311681522
sim_physics_min0.0778635921685592
sim_render-ego_max0.014954826106195864
sim_render-ego_mean0.012552525899009376
sim_render-ego_median0.012291344056218309
sim_render-ego_min0.010142975959224976
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.160000000000023
survival_time_min1.1500000000000004
No reset possible
271854675Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:13:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.092842101110679
survival_time_median14.950000000000076
deviation-center-line_median0.8254981678756057
in-drivable-lane_median0.9500000000000136


other stats
agent_compute-ego_max0.027289580504099527
agent_compute-ego_mean0.02662095761433833
agent_compute-ego_median0.027044581572214763
agent_compute-ego_min0.024771639506022135
deviation-center-line_max0.9806137616339224
deviation-center-line_mean0.7806977781015372
deviation-center-line_min0.502378021033561
deviation-heading_max3.706204651068703
deviation-heading_mean3.137167880601952
deviation-heading_median3.4266458687992354
deviation-heading_min2.5115900368452357
driven_any_max5.266181718178144
driven_any_mean4.221779692088572
driven_any_median4.525291443981622
driven_any_min2.67472177863296
driven_lanedir_consec_max4.8410960018754245
driven_lanedir_consec_mean3.804436160323113
driven_lanedir_consec_min2.404787305729357
driven_lanedir_max4.8410960018754245
driven_lanedir_mean3.804436160323113
driven_lanedir_median4.092842101110679
driven_lanedir_min2.404787305729357
in-drivable-lane_max2.4500000000000224
in-drivable-lane_mean1.0400000000000105
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.831142358457658, "sim_physics": 0.11138466993967693, "survival_time": 14.950000000000076, "driven_lanedir": 3.0493388596080133, "sim_render-ego": 0.012209182580312092, "in-drivable-lane": 2.4500000000000224, "agent_compute-ego": 0.027044581572214763, "deviation-heading": 3.706204651068703, "set_robot_commands": 0.011568723519643147, "deviation-center-line": 0.8389719206711702, "driven_lanedir_consec": 3.0493388596080133, "sim_compute_sim_state": 0.005815258026123047, "sim_compute_performance-ego": 0.007542778650919596, "sim_compute_robot_state-ego": 0.00903201977411906}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.525291443981622, "sim_physics": 0.10824188947677613, "survival_time": 14.950000000000076, "driven_lanedir": 4.092842101110679, "sim_render-ego": 0.012627732753753665, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.026944016615549723, "deviation-heading": 3.465592889839691, "set_robot_commands": 0.011471652189890545, "deviation-center-line": 0.8254981678756057, "driven_lanedir_consec": 4.092842101110679, "sim_compute_sim_state": 0.0058927647272745765, "sim_compute_performance-ego": 0.007361807823181152, "sim_compute_robot_state-ego": 0.009086020787556966}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.811561161192475, "sim_physics": 0.09370697895685833, "survival_time": 14.950000000000076, "driven_lanedir": 4.634116533292091, "sim_render-ego": 0.014159721533457438, "in-drivable-lane": 0, "agent_compute-ego": 0.024771639506022135, "deviation-heading": 3.4266458687992354, "set_robot_commands": 0.01094716231028239, "deviation-center-line": 0.9806137616339224, "driven_lanedir_consec": 4.634116533292091, "sim_compute_sim_state": 0.005477170944213867, "sim_compute_performance-ego": 0.006774951616923014, "sim_compute_robot_state-ego": 0.008293143113454183}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.67472177863296, "sim_physics": 0.11016021205880548, "survival_time": 8.84999999999999, "driven_lanedir": 2.404787305729357, "sim_render-ego": 0.012948848433413748, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.027054969873805505, "deviation-heading": 2.5115900368452357, "set_robot_commands": 0.011665610943810417, "deviation-center-line": 0.502378021033561, "driven_lanedir_consec": 2.404787305729357, "sim_compute_sim_state": 0.005701955428904733, "sim_compute_performance-ego": 0.007543411632042147, "sim_compute_robot_state-ego": 0.009517661595748643}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.266181718178144, "sim_physics": 0.11288455804189046, "survival_time": 14.950000000000076, "driven_lanedir": 4.8410960018754245, "sim_render-ego": 0.012356530825297038, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.027289580504099527, "deviation-heading": 2.5758059564568945, "set_robot_commands": 0.01230661153793335, "deviation-center-line": 0.756027019293427, "driven_lanedir_consec": 4.8410960018754245, "sim_compute_sim_state": 0.005836993853251139, "sim_compute_performance-ego": 0.0075474278132120765, "sim_compute_robot_state-ego": 0.009399987856547038}}
set_robot_commands_max0.01230661153793335
set_robot_commands_mean0.011591952100311966
set_robot_commands_median0.011568723519643147
set_robot_commands_min0.01094716231028239
sim_compute_performance-ego_max0.0075474278132120765
sim_compute_performance-ego_mean0.007354075507255598
sim_compute_performance-ego_median0.007542778650919596
sim_compute_performance-ego_min0.006774951616923014
sim_compute_robot_state-ego_max0.009517661595748643
sim_compute_robot_state-ego_mean0.00906576662548518
sim_compute_robot_state-ego_median0.009086020787556966
sim_compute_robot_state-ego_min0.008293143113454183
sim_compute_sim_state_max0.0058927647272745765
sim_compute_sim_state_mean0.005744828595953473
sim_compute_sim_state_median0.005815258026123047
sim_compute_sim_state_min0.005477170944213867
sim_physics_max0.11288455804189046
sim_physics_mean0.10727566169480145
sim_physics_median0.11016021205880548
sim_physics_min0.09370697895685833
sim_render-ego_max0.014159721533457438
sim_render-ego_mean0.012860403225246796
sim_render-ego_median0.012627732753753665
sim_render-ego_min0.012209182580312092
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.73000000000006
survival_time_min8.84999999999999
No reset possible
271434712Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:12:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.027930319309582563
survival_time_median14.950000000000076
deviation-center-line_median0.22114519010691172
in-drivable-lane_median6.650000000000031


other stats
agent_compute-ego_max0.09232365632358984
agent_compute-ego_mean0.08161022413632035
agent_compute-ego_median0.08288167715072632
agent_compute-ego_min0.07155734539031983
deviation-center-line_max0.8905300335777596
deviation-center-line_mean0.3653817533944647
deviation-center-line_min0.18847383904857937
deviation-heading_max6.531604949736297
deviation-heading_mean5.194191956380594
deviation-heading_median5.826191524298616
deviation-heading_min1.589185108066658
driven_any_max0.47885662575180216
driven_any_mean0.339757226235652
driven_any_median0.3748523919438069
driven_any_min0.1091330231589711
driven_lanedir_consec_max0.04232832833961364
driven_lanedir_consec_mean-0.01673016926214621
driven_lanedir_consec_min-0.15639850293261226
driven_lanedir_max0.04232832833961364
driven_lanedir_mean-0.01673016926214621
driven_lanedir_median0.027930319309582563
driven_lanedir_min-0.15639850293261226
in-drivable-lane_max7.750000000000036
in-drivable-lane_mean6.000000000000027
in-drivable-lane_min1.7999999999999976
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3748523919438069, "sim_physics": 0.10722933451334636, "survival_time": 14.950000000000076, "driven_lanedir": -0.03219922472956127, "sim_render-ego": 0.012579973538716632, "in-drivable-lane": 7.350000000000038, "agent_compute-ego": 0.07155734539031983, "deviation-heading": 5.826191524298616, "set_robot_commands": 0.009847409725189209, "deviation-center-line": 0.1948558228727816, "driven_lanedir_consec": -0.03219922472956127, "sim_compute_sim_state": 0.005229208469390869, "sim_compute_performance-ego": 0.007971065044403076, "sim_compute_robot_state-ego": 0.009491880734761557}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1091330231589711, "sim_physics": 0.1290389978432957, "survival_time": 3.949999999999994, "driven_lanedir": 0.04232832833961364, "sim_render-ego": 0.013953685760498049, "in-drivable-lane": 1.7999999999999976, "agent_compute-ego": 0.09232365632358984, "deviation-heading": 1.589185108066658, "set_robot_commands": 0.011003642142573489, "deviation-center-line": 0.18847383904857937, "driven_lanedir_consec": 0.04232832833961364, "sim_compute_sim_state": 0.0054282327241535425, "sim_compute_performance-ego": 0.007821538780308977, "sim_compute_robot_state-ego": 0.010079616232763362}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.47885662575180216, "sim_physics": 0.11722948630650838, "survival_time": 14.950000000000076, "driven_lanedir": -0.15639850293261226, "sim_render-ego": 0.012701677481333414, "in-drivable-lane": 7.750000000000036, "agent_compute-ego": 0.07458187182744344, "deviation-heading": 5.587544507509578, "set_robot_commands": 0.009877678553263346, "deviation-center-line": 0.8905300335777596, "driven_lanedir_consec": -0.15639850293261226, "sim_compute_sim_state": 0.005046066443125407, "sim_compute_performance-ego": 0.00783373753229777, "sim_compute_robot_state-ego": 0.009622414906819662}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.31580207138605965, "sim_physics": 0.11973960638046265, "survival_time": 14.950000000000076, "driven_lanedir": 0.034688233702246274, "sim_render-ego": 0.013595605691274009, "in-drivable-lane": 6.4500000000000295, "agent_compute-ego": 0.08288167715072632, "deviation-heading": 6.436433692291823, "set_robot_commands": 0.01040498415629069, "deviation-center-line": 0.22114519010691172, "driven_lanedir_consec": 0.034688233702246274, "sim_compute_sim_state": 0.005626925627390544, "sim_compute_performance-ego": 0.008338120778401693, "sim_compute_robot_state-ego": 0.010269717375437418}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4201420189376203, "sim_physics": 0.11769240776697797, "survival_time": 14.950000000000076, "driven_lanedir": 0.027930319309582563, "sim_render-ego": 0.013229455947875977, "in-drivable-lane": 6.650000000000031, "agent_compute-ego": 0.0867065699895223, "deviation-heading": 6.531604949736297, "set_robot_commands": 0.010315959453582765, "deviation-center-line": 0.33190388136629134, "driven_lanedir_consec": 0.027930319309582563, "sim_compute_sim_state": 0.005178283055623373, "sim_compute_performance-ego": 0.007844769954681396, "sim_compute_robot_state-ego": 0.009614461263020834}}
set_robot_commands_max0.011003642142573489
set_robot_commands_mean0.010289934806179898
set_robot_commands_median0.010315959453582765
set_robot_commands_min0.009847409725189209
sim_compute_performance-ego_max0.008338120778401693
sim_compute_performance-ego_mean0.007961846418018583
sim_compute_performance-ego_median0.007844769954681396
sim_compute_performance-ego_min0.007821538780308977
sim_compute_robot_state-ego_max0.010269717375437418
sim_compute_robot_state-ego_mean0.009815618102560566
sim_compute_robot_state-ego_median0.009622414906819662
sim_compute_robot_state-ego_min0.009491880734761557
sim_compute_sim_state_max0.005626925627390544
sim_compute_sim_state_mean0.005301743263936747
sim_compute_sim_state_median0.005229208469390869
sim_compute_sim_state_min0.005046066443125407
sim_physics_max0.1290389978432957
sim_physics_mean0.11818596656211822
sim_physics_median0.11769240776697797
sim_physics_min0.10722933451334636
sim_render-ego_max0.013953685760498049
sim_render-ego_mean0.013212079683939617
sim_render-ego_median0.013229455947875977
sim_render-ego_min0.012579973538716632
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.75000000000006
survival_time_min3.949999999999994
No reset possible
271124737Nikolaus Howechallenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationhost-erroryesip-172-31-35-218-104900:12:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 40, in copy_to_cache
    msg = "Copying %s to cache %s" % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4737/step1-simulation-ip-172-31-35-218-10490-job27112/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-1-0/drawing.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
270864753Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3603309781625814
survival_time_median7.599999999999981
deviation-center-line_median0.49851425052334875
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05164346214412719
agent_compute-ego_mean0.03604519050774686
agent_compute-ego_median0.026359550288466156
agent_compute-ego_min0.02471320390701294
deviation-center-line_max0.8933812239795618
deviation-center-line_mean0.5498843740280217
deviation-center-line_min0.13216205556222854
deviation-heading_max2.7280073261008293
deviation-heading_mean1.7583924021264252
deviation-heading_median1.3739831042287796
deviation-heading_min0.9122263138833008
driven_any_max4.9700007010165645
driven_any_mean3.0229424100980333
driven_any_median2.4047770562908557
driven_any_min0.6400018006667945
driven_lanedir_consec_max4.6765127767691865
driven_lanedir_consec_mean2.858719586662913
driven_lanedir_consec_min0.6054123043430527
driven_lanedir_max4.6765127767691865
driven_lanedir_mean2.858719586662913
driven_lanedir_median2.3603309781625814
driven_lanedir_min0.6054123043430527
in-drivable-lane_max2.6499999999999906
in-drivable-lane_mean0.5299999999999981
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6400018006667945, "sim_physics": 0.10567208977996326, "survival_time": 3.049999999999997, "driven_lanedir": 0.6054123043430527, "sim_render-ego": 0.012277782940473712, "in-drivable-lane": 0, "agent_compute-ego": 0.026359550288466156, "deviation-heading": 0.9122263138833008, "set_robot_commands": 0.0119547218572898, "deviation-center-line": 0.13216205556222854, "driven_lanedir_consec": 0.6054123043430527, "sim_compute_sim_state": 0.005424089119082592, "sim_compute_performance-ego": 0.007581288697289639, "sim_compute_robot_state-ego": 0.009102700186557455}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.4047770562908557, "sim_physics": 0.104806208296826, "survival_time": 7.599999999999981, "driven_lanedir": 2.3603309781625814, "sim_render-ego": 0.012442399012415032, "in-drivable-lane": 0, "agent_compute-ego": 0.025963844437348216, "deviation-heading": 1.3739831042287796, "set_robot_commands": 0.011509609849829424, "deviation-center-line": 0.49851425052334875, "driven_lanedir_consec": 2.3603309781625814, "sim_compute_sim_state": 0.005667019831506829, "sim_compute_performance-ego": 0.007197031849309018, "sim_compute_robot_state-ego": 0.009104382050664802}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.9700007010165645, "sim_physics": 0.10400357007980349, "survival_time": 14.950000000000076, "driven_lanedir": 4.389119232857058, "sim_render-ego": 0.012771203517913818, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.02471320390701294, "deviation-heading": 2.5098857489907176, "set_robot_commands": 0.011775008042653402, "deviation-center-line": 0.8873121929489732, "driven_lanedir_consec": 4.389119232857058, "sim_compute_sim_state": 0.005254761377970377, "sim_compute_performance-ego": 0.007262330849965413, "sim_compute_robot_state-ego": 0.008936197757720947}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.78139939622942, "sim_physics": 0.11893417994181316, "survival_time": 14.950000000000076, "driven_lanedir": 4.6765127767691865, "sim_render-ego": 0.013608303864796957, "in-drivable-lane": 0, "agent_compute-ego": 0.05154589176177979, "deviation-heading": 2.7280073261008293, "set_robot_commands": 0.011305357615152997, "deviation-center-line": 0.8933812239795618, "driven_lanedir_consec": 4.6765127767691865, "sim_compute_sim_state": 0.005423568884531657, "sim_compute_performance-ego": 0.007908511161804199, "sim_compute_robot_state-ego": 0.010353412628173828}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3185330962865316, "sim_physics": 0.1291383754375369, "survival_time": 6.449999999999985, "driven_lanedir": 2.262222641182686, "sim_render-ego": 0.01363981232162594, "in-drivable-lane": 0, "agent_compute-ego": 0.05164346214412719, "deviation-heading": 1.267859517428498, "set_robot_commands": 0.01059490580891454, "deviation-center-line": 0.33805214712599635, "driven_lanedir_consec": 2.262222641182686, "sim_compute_sim_state": 0.005579567694848822, "sim_compute_performance-ego": 0.008323817290076915, "sim_compute_robot_state-ego": 0.010574821353882782}}
set_robot_commands_max0.0119547218572898
set_robot_commands_mean0.011427920634768033
set_robot_commands_median0.011509609849829424
set_robot_commands_min0.01059490580891454
sim_compute_performance-ego_max0.008323817290076915
sim_compute_performance-ego_mean0.007654595969689036
sim_compute_performance-ego_median0.007581288697289639
sim_compute_performance-ego_min0.007197031849309018
sim_compute_robot_state-ego_max0.010574821353882782
sim_compute_robot_state-ego_mean0.009614302795399965
sim_compute_robot_state-ego_median0.009104382050664802
sim_compute_robot_state-ego_min0.008936197757720947
sim_compute_sim_state_max0.005667019831506829
sim_compute_sim_state_mean0.005469801381588055
sim_compute_sim_state_median0.005424089119082592
sim_compute_sim_state_min0.005254761377970377
sim_physics_max0.1291383754375369
sim_physics_mean0.11251088470718856
sim_physics_median0.10567208977996326
sim_physics_min0.10400357007980349
sim_render-ego_max0.01363981232162594
sim_render-ego_mean0.012947900331445092
sim_render-ego_median0.012771203517913818
sim_render-ego_min0.012277782940473712
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.400000000000023
survival_time_min3.049999999999997
No reset possible
270754762Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5427441176927543
survival_time_median7.7499999999999805
deviation-center-line_median0.3998372525930087
in-drivable-lane_median0.8999999999999968


other stats
agent_compute-ego_max0.04698639462707909
agent_compute-ego_mean0.03732489973364247
agent_compute-ego_median0.03388013420524178
agent_compute-ego_min0.032152937304589055
deviation-center-line_max0.5245299769020382
deviation-center-line_mean0.35452818920788953
deviation-center-line_min0.13033123532509114
deviation-heading_max1.8019931726440137
deviation-heading_mean1.3810074838281232
deviation-heading_median1.6087406079220832
deviation-heading_min0.2877727218131133
driven_any_max3.2976838812017206
driven_any_mean2.213897929090631
driven_any_median2.1948636740518093
driven_any_min0.8177951250007318
driven_lanedir_consec_max3.21454248074505
driven_lanedir_consec_mean1.8734516655607416
driven_lanedir_consec_min0.8066555986235853
driven_lanedir_max3.21454248074505
driven_lanedir_mean1.8734516655607416
driven_lanedir_median1.5427441176927543
driven_lanedir_min0.8066555986235853
in-drivable-lane_max2.499999999999991
in-drivable-lane_mean0.9799999999999964
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1948636740518093, "sim_physics": 0.12904456618485177, "survival_time": 7.84999999999998, "driven_lanedir": 1.4433403560998974, "sim_render-ego": 0.01383761084003813, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.04698639462707909, "deviation-heading": 1.5394611777044698, "set_robot_commands": 0.01022260659819196, "deviation-center-line": 0.419215009870593, "driven_lanedir_consec": 1.4433403560998974, "sim_compute_sim_state": 0.005393710106041781, "sim_compute_performance-ego": 0.008042818421770813, "sim_compute_robot_state-ego": 0.010175197747102968}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8177951250007318, "sim_physics": 0.13037980857648349, "survival_time": 1.900000000000001, "driven_lanedir": 0.8066555986235853, "sim_render-ego": 0.013513690546939247, "in-drivable-lane": 0, "agent_compute-ego": 0.04022433255848132, "deviation-heading": 0.2877727218131133, "set_robot_commands": 0.010729833653098658, "deviation-center-line": 0.13033123532509114, "driven_lanedir_consec": 0.8066555986235853, "sim_compute_sim_state": 0.005541694791693436, "sim_compute_performance-ego": 0.0077426182596307055, "sim_compute_robot_state-ego": 0.01030986560018439}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2976838812017206, "sim_physics": 0.11322785995818756, "survival_time": 9.099999999999994, "driven_lanedir": 3.21454248074505, "sim_render-ego": 0.012777733278798532, "in-drivable-lane": 0, "agent_compute-ego": 0.03388013420524178, "deviation-heading": 1.6087406079220832, "set_robot_commands": 0.010125878093006848, "deviation-center-line": 0.5245299769020382, "driven_lanedir_consec": 3.21454248074505, "sim_compute_sim_state": 0.005121571677071708, "sim_compute_performance-ego": 0.007520348161131472, "sim_compute_robot_state-ego": 0.009393202079521433}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9118655188702605, "sim_physics": 0.11379176531082544, "survival_time": 5.849999999999987, "driven_lanedir": 1.5427441176927543, "sim_render-ego": 0.013212167299710788, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.033380699972821094, "deviation-heading": 1.6670697390569371, "set_robot_commands": 0.009756196258414503, "deviation-center-line": 0.2987274713487167, "driven_lanedir_consec": 1.5427441176927543, "sim_compute_sim_state": 0.005164309444590512, "sim_compute_performance-ego": 0.007693702339107155, "sim_compute_robot_state-ego": 0.00937984336135734}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.847281446328631, "sim_physics": 0.10516678902410692, "survival_time": 7.7499999999999805, "driven_lanedir": 2.3599757746424213, "sim_render-ego": 0.012365215055404171, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.032152937304589055, "deviation-heading": 1.8019931726440137, "set_robot_commands": 0.009334325790405272, "deviation-center-line": 0.3998372525930087, "driven_lanedir_consec": 2.3599757746424213, "sim_compute_sim_state": 0.005105884613529329, "sim_compute_performance-ego": 0.007421550443095545, "sim_compute_robot_state-ego": 0.00962988176653462}}
set_robot_commands_max0.010729833653098658
set_robot_commands_mean0.010033768078623448
set_robot_commands_median0.010125878093006848
set_robot_commands_min0.009334325790405272
sim_compute_performance-ego_max0.008042818421770813
sim_compute_performance-ego_mean0.007684207524947138
sim_compute_performance-ego_median0.007693702339107155
sim_compute_performance-ego_min0.007421550443095545
sim_compute_robot_state-ego_max0.01030986560018439
sim_compute_robot_state-ego_mean0.00977759811094015
sim_compute_robot_state-ego_median0.00962988176653462
sim_compute_robot_state-ego_min0.00937984336135734
sim_compute_sim_state_max0.005541694791693436
sim_compute_sim_state_mean0.005265434126585354
sim_compute_sim_state_median0.005164309444590512
sim_compute_sim_state_min0.005105884613529329
sim_physics_max0.13037980857648349
sim_physics_mean0.11832215781089106
sim_physics_median0.11379176531082544
sim_physics_min0.10516678902410692
sim_render-ego_max0.01383761084003813
sim_render-ego_mean0.013141283404178172
sim_render-ego_median0.013212167299710788
sim_render-ego_min0.012365215055404171
simulation-passed1
survival_time_max9.099999999999994
survival_time_mean6.489999999999988
survival_time_min1.900000000000001
No reset possible
270454783Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:13:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.517907576006117
survival_time_median14.950000000000076
deviation-center-line_median0.8835605173833351
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02996242602666219
agent_compute-ego_mean0.027889727363012783
agent_compute-ego_median0.027538272539774575
agent_compute-ego_min0.02706014633178711
deviation-center-line_max1.0926837371583522
deviation-center-line_mean0.832552473725513
deviation-center-line_min0.3646938774798537
deviation-heading_max4.031856298000186
deviation-heading_mean2.6109177032083624
deviation-heading_median2.574488450768757
deviation-heading_min1.2770136675098454
driven_any_max5.268427370719724
driven_any_mean4.12918282867239
driven_any_median4.63091125656963
driven_any_min2.184489658579124
driven_lanedir_consec_max4.676137640562332
driven_lanedir_consec_mean3.78448986265101
driven_lanedir_consec_min2.137986705007918
driven_lanedir_max4.676137640562332
driven_lanedir_mean3.78448986265101
driven_lanedir_median4.517907576006117
driven_lanedir_min2.137986705007918
in-drivable-lane_max1.8500000000000083
in-drivable-lane_mean0.6300000000000054
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.804383665189832, "sim_physics": 0.11584981282552084, "survival_time": 14.950000000000076, "driven_lanedir": 3.042338853679546, "sim_render-ego": 0.012543486754099527, "in-drivable-lane": 1.8500000000000083, "agent_compute-ego": 0.02996242602666219, "deviation-heading": 4.031856298000186, "set_robot_commands": 0.012145947615305583, "deviation-center-line": 1.0166861175980522, "driven_lanedir_consec": 3.042338853679546, "sim_compute_sim_state": 0.00578039805094401, "sim_compute_performance-ego": 0.007640981674194336, "sim_compute_robot_state-ego": 0.009445122083028158}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.63091125656963, "sim_physics": 0.12044962247212727, "survival_time": 14.950000000000076, "driven_lanedir": 4.548078537999137, "sim_render-ego": 0.01318719228108724, "in-drivable-lane": 0, "agent_compute-ego": 0.027538272539774575, "deviation-heading": 2.6276752928048386, "set_robot_commands": 0.012302440007527667, "deviation-center-line": 0.8835605173833351, "driven_lanedir_consec": 4.548078537999137, "sim_compute_sim_state": 0.006174270311991374, "sim_compute_performance-ego": 0.008083014488220215, "sim_compute_robot_state-ego": 0.009782872994740803}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.268427370719724, "sim_physics": 0.12003369410832725, "survival_time": 14.950000000000076, "driven_lanedir": 4.517907576006117, "sim_render-ego": 0.01319893757502238, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.02774977922439575, "deviation-heading": 2.574488450768757, "set_robot_commands": 0.013288097381591797, "deviation-center-line": 1.0926837371583522, "driven_lanedir_consec": 4.517907576006117, "sim_compute_sim_state": 0.00597803274790446, "sim_compute_performance-ego": 0.007683498859405518, "sim_compute_robot_state-ego": 0.009836244583129882}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.184489658579124, "sim_physics": 0.11046529533271504, "survival_time": 6.649999999999984, "driven_lanedir": 2.137986705007918, "sim_render-ego": 0.012471053833351996, "in-drivable-lane": 0, "agent_compute-ego": 0.027138012692444303, "deviation-heading": 1.2770136675098454, "set_robot_commands": 0.011739963875677353, "deviation-center-line": 0.3646938774798537, "driven_lanedir_consec": 2.137986705007918, "sim_compute_sim_state": 0.00584791298199417, "sim_compute_performance-ego": 0.007851968134256234, "sim_compute_robot_state-ego": 0.009169505054789378}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.757702192303644, "sim_physics": 0.11245270331700642, "survival_time": 14.950000000000076, "driven_lanedir": 4.676137640562332, "sim_render-ego": 0.012512497107187909, "in-drivable-lane": 0, "agent_compute-ego": 0.02706014633178711, "deviation-heading": 2.5435548069581846, "set_robot_commands": 0.01201624075571696, "deviation-center-line": 0.8051381190079715, "driven_lanedir_consec": 4.676137640562332, "sim_compute_sim_state": 0.005928298632303874, "sim_compute_performance-ego": 0.007767682075500488, "sim_compute_robot_state-ego": 0.009696194330851235}}
set_robot_commands_max0.013288097381591797
set_robot_commands_mean0.012298537927163872
set_robot_commands_median0.012145947615305583
set_robot_commands_min0.011739963875677353
sim_compute_performance-ego_max0.008083014488220215
sim_compute_performance-ego_mean0.007805429046315357
sim_compute_performance-ego_median0.007767682075500488
sim_compute_performance-ego_min0.007640981674194336
sim_compute_robot_state-ego_max0.009836244583129882
sim_compute_robot_state-ego_mean0.009585987809307892
sim_compute_robot_state-ego_median0.009696194330851235
sim_compute_robot_state-ego_min0.009169505054789378
sim_compute_sim_state_max0.006174270311991374
sim_compute_sim_state_mean0.005941782545027578
sim_compute_sim_state_median0.005928298632303874
sim_compute_sim_state_min0.00578039805094401
sim_physics_max0.12044962247212727
sim_physics_mean0.11585022561113936
sim_physics_median0.11584981282552084
sim_physics_min0.11046529533271504
sim_render-ego_max0.01319893757502238
sim_render-ego_mean0.01278263351014981
sim_render-ego_median0.012543486754099527
sim_render-ego_min0.012471053833351996
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.29000000000006
survival_time_min6.649999999999984
No reset possible
270174813Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:14:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4005012141206543
survival_time_median14.950000000000076
deviation-center-line_median0.6383116313673224
in-drivable-lane_median3.700000000000016


other stats
agent_compute-ego_max0.05289337635040283
agent_compute-ego_mean0.03722539137224111
agent_compute-ego_median0.029937657515207928
agent_compute-ego_min0.02589803369938101
deviation-center-line_max1.0020447924239246
deviation-center-line_mean0.7632324525801082
deviation-center-line_min0.5745726684252671
deviation-heading_max4.7346788060361495
deviation-heading_mean3.422222342819331
deviation-heading_median2.995165138618269
deviation-heading_min2.524791037620961
driven_any_max5.529664556046606
driven_any_mean3.786005356362205
driven_any_median3.6337357320375623
driven_any_min2.695173761237616
driven_lanedir_consec_max3.1596889549552754
driven_lanedir_consec_mean2.290765460287613
driven_lanedir_consec_min1.3653848440298906
driven_lanedir_max5.083740760353487
driven_lanedir_mean3.2295714722859272
driven_lanedir_median2.984607361113544
driven_lanedir_min2.297151501596278
in-drivable-lane_max4.450000000000006
in-drivable-lane_mean3.620000000000015
in-drivable-lane_min2.7500000000000178
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.3847767139549445, "sim_physics": 0.1159508752822876, "survival_time": 14.950000000000076, "driven_lanedir": 2.62266878341105, "sim_render-ego": 0.012989635467529298, "in-drivable-lane": 3.850000000000024, "agent_compute-ego": 0.027509737014770507, "deviation-heading": 3.882813180305416, "set_robot_commands": 0.011948684851328531, "deviation-center-line": 0.991428379657426, "driven_lanedir_consec": 2.62266878341105, "sim_compute_sim_state": 0.005991753737131755, "sim_compute_performance-ego": 0.008038485050201416, "sim_compute_robot_state-ego": 0.00973387638727824}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.695173761237616, "sim_physics": 0.10881421595443914, "survival_time": 12.150000000000038, "driven_lanedir": 2.297151501596278, "sim_render-ego": 0.012340362179917071, "in-drivable-lane": 3.350000000000013, "agent_compute-ego": 0.02589803369938101, "deviation-heading": 2.995165138618269, "set_robot_commands": 0.011657579445544583, "deviation-center-line": 0.609804791026601, "driven_lanedir_consec": 1.9055835049211944, "sim_compute_sim_state": 0.005755907223548418, "sim_compute_performance-ego": 0.007230387793646919, "sim_compute_robot_state-ego": 0.009274615181816949}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.686676018534295, "sim_physics": 0.11893357197443644, "survival_time": 14.950000000000076, "driven_lanedir": 3.1596889549552754, "sim_render-ego": 0.013339946269989014, "in-drivable-lane": 3.700000000000016, "agent_compute-ego": 0.029937657515207928, "deviation-heading": 2.524791037620961, "set_robot_commands": 0.012707760334014892, "deviation-center-line": 1.0020447924239246, "driven_lanedir_consec": 3.1596889549552754, "sim_compute_sim_state": 0.005768986543019613, "sim_compute_performance-ego": 0.008179867267608642, "sim_compute_robot_state-ego": 0.010267279148101806}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.6337357320375623, "sim_physics": 0.1212960394223531, "survival_time": 14.950000000000076, "driven_lanedir": 2.984607361113544, "sim_render-ego": 0.013516674041748049, "in-drivable-lane": 4.450000000000006, "agent_compute-ego": 0.05289337635040283, "deviation-heading": 4.7346788060361495, "set_robot_commands": 0.010763208071390787, "deviation-center-line": 0.6383116313673224, "driven_lanedir_consec": 1.3653848440298906, "sim_compute_sim_state": 0.005387269655863444, "sim_compute_performance-ego": 0.008179391225179036, "sim_compute_robot_state-ego": 0.010236573219299315}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.529664556046606, "sim_physics": 0.11822864691416422, "survival_time": 14.950000000000076, "driven_lanedir": 5.083740760353487, "sim_render-ego": 0.013182710806528728, "in-drivable-lane": 2.7500000000000178, "agent_compute-ego": 0.04988815228144328, "deviation-heading": 2.97366355151586, "set_robot_commands": 0.011135355631510416, "deviation-center-line": 0.5745726684252671, "driven_lanedir_consec": 2.4005012141206543, "sim_compute_sim_state": 0.005207959810892741, "sim_compute_performance-ego": 0.007892576058705648, "sim_compute_robot_state-ego": 0.009899969895680745}}
set_robot_commands_max0.012707760334014892
set_robot_commands_mean0.011642517666757843
set_robot_commands_median0.011657579445544583
set_robot_commands_min0.010763208071390787
sim_compute_performance-ego_max0.008179867267608642
sim_compute_performance-ego_mean0.007904141479068334
sim_compute_performance-ego_median0.008038485050201416
sim_compute_performance-ego_min0.007230387793646919
sim_compute_robot_state-ego_max0.010267279148101806
sim_compute_robot_state-ego_mean0.009882462766435412
sim_compute_robot_state-ego_median0.009899969895680745
sim_compute_robot_state-ego_min0.009274615181816949
sim_compute_sim_state_max0.005991753737131755
sim_compute_sim_state_mean0.005622375394091194
sim_compute_sim_state_median0.005755907223548418
sim_compute_sim_state_min0.005207959810892741
sim_physics_max0.1212960394223531
sim_physics_mean0.1166446699095361
sim_physics_median0.11822864691416422
sim_physics_min0.10881421595443914
sim_render-ego_max0.013516674041748049
sim_render-ego_mean0.013073865753142433
sim_render-ego_median0.013182710806528728
sim_render-ego_min0.012340362179917071
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.390000000000068
survival_time_min12.150000000000038
No reset possible
269864833Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:09:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
269674845Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:07:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.785849948172707
survival_time_median3.999999999999994
deviation-center-line_median0.1564317089055924
in-drivable-lane_median1.400000000000011


other stats
agent_compute-ego_max0.05190580031451057
agent_compute-ego_mean0.03816209547801234
agent_compute-ego_median0.03608924448490143
agent_compute-ego_min0.03076551681341127
deviation-center-line_max0.687372540892343
deviation-center-line_mean0.3021610547056179
deviation-center-line_min0.10616522881433452
deviation-heading_max3.6456385031487897
deviation-heading_mean1.384378283645041
deviation-heading_median0.5616927345744096
deviation-heading_min0.24124851922404997
driven_any_max4.2240517622103875
driven_any_mean1.7223523481145295
driven_any_median1.01580331404012
driven_any_min0.6205357391652511
driven_lanedir_consec_max3.485052656242538
driven_lanedir_consec_mean1.440705873106738
driven_lanedir_consec_min0.6129614925393738
driven_lanedir_max3.485052656242538
driven_lanedir_mean1.440705873106738
driven_lanedir_median0.785849948172707
driven_lanedir_min0.6129614925393738
in-drivable-lane_max2.499999999999991
in-drivable-lane_mean1.0999999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9274414982773056, "sim_physics": 0.12920336350382372, "survival_time": 8.949999999999992, "driven_lanedir": 1.6052620850874977, "sim_render-ego": 0.014126043745925307, "in-drivable-lane": 1.400000000000011, "agent_compute-ego": 0.03956727741816856, "deviation-heading": 1.918349583992388, "set_robot_commands": 0.010923991656170213, "deviation-center-line": 0.4204211501934108, "driven_lanedir_consec": 1.6052620850874977, "sim_compute_sim_state": 0.005294703904476911, "sim_compute_performance-ego": 0.008510436425661908, "sim_compute_robot_state-ego": 0.010406201112203755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6205357391652511, "sim_physics": 0.1338283945532406, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6129614925393738, "sim_render-ego": 0.014823689180261949, "in-drivable-lane": 0, "agent_compute-ego": 0.05190580031451057, "deviation-heading": 0.24124851922404997, "set_robot_commands": 0.009763815823723288, "deviation-center-line": 0.14041464472240892, "driven_lanedir_consec": 0.6129614925393738, "sim_compute_sim_state": 0.005326530512641458, "sim_compute_performance-ego": 0.008341536802404067, "sim_compute_robot_state-ego": 0.011185716180240406}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.01580331404012, "sim_physics": 0.10986014306545258, "survival_time": 3.999999999999994, "driven_lanedir": 0.7144031834915743, "sim_render-ego": 0.013519972562789915, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.03608924448490143, "deviation-heading": 0.5549620772855681, "set_robot_commands": 0.010462474822998048, "deviation-center-line": 0.1564317089055924, "driven_lanedir_consec": 0.7144031834915743, "sim_compute_sim_state": 0.0051368802785873415, "sim_compute_performance-ego": 0.008111414313316346, "sim_compute_robot_state-ego": 0.009886020421981811}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.2240517622103875, "sim_physics": 0.10600514650344849, "survival_time": 14.950000000000076, "driven_lanedir": 3.485052656242538, "sim_render-ego": 0.012615001996358236, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.032482638359069824, "deviation-heading": 3.6456385031487897, "set_robot_commands": 0.009585110346476236, "deviation-center-line": 0.687372540892343, "driven_lanedir_consec": 3.485052656242538, "sim_compute_sim_state": 0.0048906715710957845, "sim_compute_performance-ego": 0.007593327363332112, "sim_compute_robot_state-ego": 0.009327487150828043}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8239294268795843, "sim_physics": 0.10471846891003986, "survival_time": 2.1500000000000004, "driven_lanedir": 0.785849948172707, "sim_render-ego": 0.012215381444886672, "in-drivable-lane": 0, "agent_compute-ego": 0.03076551681341127, "deviation-heading": 0.5616927345744096, "set_robot_commands": 0.008701962093974268, "deviation-center-line": 0.10616522881433452, "driven_lanedir_consec": 0.785849948172707, "sim_compute_sim_state": 0.0045664643132409385, "sim_compute_performance-ego": 0.00736387385878452, "sim_compute_robot_state-ego": 0.008977047232694404}}
set_robot_commands_max0.010923991656170213
set_robot_commands_mean0.00988747094866841
set_robot_commands_median0.009763815823723288
set_robot_commands_min0.008701962093974268
sim_compute_performance-ego_max0.008510436425661908
sim_compute_performance-ego_mean0.007984117752699792
sim_compute_performance-ego_median0.008111414313316346
sim_compute_performance-ego_min0.00736387385878452
sim_compute_robot_state-ego_max0.011185716180240406
sim_compute_robot_state-ego_mean0.009956494419589684
sim_compute_robot_state-ego_median0.009886020421981811
sim_compute_robot_state-ego_min0.008977047232694404
sim_compute_sim_state_max0.005326530512641458
sim_compute_sim_state_mean0.005043050116008487
sim_compute_sim_state_median0.0051368802785873415
sim_compute_sim_state_min0.0045664643132409385
sim_physics_max0.1338283945532406
sim_physics_mean0.11672310330720106
sim_physics_median0.10986014306545258
sim_physics_min0.10471846891003986
sim_render-ego_max0.014823689180261949
sim_render-ego_mean0.013460017786044417
sim_render-ego_median0.013519972562789915
sim_render-ego_min0.012215381444886672
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.350000000000013
survival_time_min1.7000000000000008
No reset possible
269504858Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5026746432091005
survival_time_median7.299999999999982
deviation-center-line_median0.3041411588583943
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.039269519646962486
agent_compute-ego_mean0.032515986024516906
agent_compute-ego_median0.03383155107498169
agent_compute-ego_min0.022795479591578655
deviation-center-line_max0.9650896689717124
deviation-center-line_mean0.5327354770376651
deviation-center-line_min0.25100128958048723
deviation-heading_max3.7067446581949257
deviation-heading_mean2.115096376856034
deviation-heading_median1.7646153450560675
deviation-heading_min0.9302935823619076
driven_any_max3.988212246677212
driven_any_mean2.272649444714598
driven_any_median1.6528071729333502
driven_any_min1.0100889993977271
driven_lanedir_consec_max3.44621394822118
driven_lanedir_consec_mean2.0261497463976257
driven_lanedir_consec_min0.8757064093777227
driven_lanedir_max3.44621394822118
driven_lanedir_mean2.0261497463976257
driven_lanedir_median1.5026746432091005
driven_lanedir_min0.8757064093777227
in-drivable-lane_max1.7500000000000249
in-drivable-lane_mean0.8100000000000034
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.163467987884384, "sim_physics": 0.12490130583445232, "survival_time": 14.950000000000076, "driven_lanedir": 3.030162666154667, "sim_render-ego": 0.012907214959462484, "in-drivable-lane": 0, "agent_compute-ego": 0.03383155107498169, "deviation-heading": 3.7067446581949257, "set_robot_commands": 0.010601500670115152, "deviation-center-line": 0.8707932542930803, "driven_lanedir_consec": 3.030162666154667, "sim_compute_sim_state": 0.00523147980372111, "sim_compute_performance-ego": 0.007728633880615235, "sim_compute_robot_state-ego": 0.009848500887552895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.548670816680319, "sim_physics": 0.1348265912797716, "survival_time": 4.499999999999992, "driven_lanedir": 1.5026746432091005, "sim_render-ego": 0.013068095842997233, "in-drivable-lane": 0, "agent_compute-ego": 0.03488694561852349, "deviation-heading": 0.9808017561649212, "set_robot_commands": 0.009983441564771864, "deviation-center-line": 0.3041411588583943, "driven_lanedir_consec": 1.5026746432091005, "sim_compute_sim_state": 0.005291313595241971, "sim_compute_performance-ego": 0.007570868068271213, "sim_compute_robot_state-ego": 0.009637075000339085}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0100889993977271, "sim_physics": 0.09382769531673855, "survival_time": 4.499999999999992, "driven_lanedir": 0.8757064093777227, "sim_render-ego": 0.012478229734632704, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.031796434190538195, "deviation-heading": 0.9302935823619076, "set_robot_commands": 0.008955934312608507, "deviation-center-line": 0.25100128958048723, "driven_lanedir_consec": 0.8757064093777227, "sim_compute_sim_state": 0.004719824261135526, "sim_compute_performance-ego": 0.007421464390224881, "sim_compute_robot_state-ego": 0.008683109283447265}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6528071729333502, "sim_physics": 0.06889842960932484, "survival_time": 7.299999999999982, "driven_lanedir": 1.2759910650254591, "sim_render-ego": 0.008966723533525858, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.022795479591578655, "deviation-heading": 1.7646153450560675, "set_robot_commands": 0.006424974088799463, "deviation-center-line": 0.2726520134846516, "driven_lanedir_consec": 1.2759910650254591, "sim_compute_sim_state": 0.0035631477016292205, "sim_compute_performance-ego": 0.005103047579935152, "sim_compute_robot_state-ego": 0.0062957005958034565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.988212246677212, "sim_physics": 0.10545201857884724, "survival_time": 14.950000000000076, "driven_lanedir": 3.44621394822118, "sim_render-ego": 0.011987297534942628, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.039269519646962486, "deviation-heading": 3.193026542502347, "set_robot_commands": 0.009586507479349773, "deviation-center-line": 0.9650896689717124, "driven_lanedir_consec": 3.44621394822118, "sim_compute_sim_state": 0.004929316838582357, "sim_compute_performance-ego": 0.006982089678446452, "sim_compute_robot_state-ego": 0.008897606531778972}}
set_robot_commands_max0.010601500670115152
set_robot_commands_mean0.009110471623128951
set_robot_commands_median0.009586507479349773
set_robot_commands_min0.006424974088799463
sim_compute_performance-ego_max0.007728633880615235
sim_compute_performance-ego_mean0.006961220719498587
sim_compute_performance-ego_median0.007421464390224881
sim_compute_performance-ego_min0.005103047579935152
sim_compute_robot_state-ego_max0.009848500887552895
sim_compute_robot_state-ego_mean0.008672398459784335
sim_compute_robot_state-ego_median0.008897606531778972
sim_compute_robot_state-ego_min0.0062957005958034565
sim_compute_sim_state_max0.005291313595241971
sim_compute_sim_state_mean0.004747016440062037
sim_compute_sim_state_median0.004929316838582357
sim_compute_sim_state_min0.0035631477016292205
sim_physics_max0.1348265912797716
sim_physics_mean0.10558120812382692
sim_physics_median0.10545201857884724
sim_physics_min0.06889842960932484
sim_render-ego_max0.013068095842997233
sim_render-ego_mean0.01188151232111218
sim_render-ego_median0.012478229734632704
sim_render-ego_min0.008966723533525858
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.240000000000023
survival_time_min4.499999999999992
No reset possible
269244880Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:15:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.976353581075778
survival_time_median14.950000000000076
deviation-center-line_median0.5895691097595815
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05173537810643514
agent_compute-ego_mean0.049936232566833494
agent_compute-ego_median0.04967763264973958
agent_compute-ego_min0.0480362327893575
deviation-center-line_max0.9552607462100634
deviation-center-line_mean0.6975197783953933
deviation-center-line_min0.5190116179652606
deviation-heading_max3.8853851031590954
deviation-heading_mean2.9481401747523988
deviation-heading_median2.9401812775879588
deviation-heading_min2.2222072539897795
driven_any_max4.257168096461857
driven_any_mean3.883253247731188
driven_any_median4.037219965884471
driven_any_min3.2264669287224024
driven_lanedir_consec_max4.149830789279018
driven_lanedir_consec_mean3.77106905247318
driven_lanedir_consec_min3.0829490596073
driven_lanedir_max4.149830789279018
driven_lanedir_mean3.77106905247318
driven_lanedir_median3.976353581075778
driven_lanedir_min3.0829490596073
in-drivable-lane_max0.9500000000000136
in-drivable-lane_mean0.1900000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2264669287224024, "sim_physics": 0.11807632128397624, "survival_time": 14.950000000000076, "driven_lanedir": 3.0829490596073, "sim_render-ego": 0.012866204579671223, "in-drivable-lane": 0, "agent_compute-ego": 0.05088976701100667, "deviation-heading": 3.8853851031590954, "set_robot_commands": 0.011486483414967856, "deviation-center-line": 0.8645749935303566, "driven_lanedir_consec": 3.0829490596073, "sim_compute_sim_state": 0.005405550797780355, "sim_compute_performance-ego": 0.007812140782674153, "sim_compute_robot_state-ego": 0.00953041394551595}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.759915190562403, "sim_physics": 0.12096357663472491, "survival_time": 14.950000000000076, "driven_lanedir": 3.6344974515628743, "sim_render-ego": 0.013716479142506918, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.04967763264973958, "deviation-heading": 2.562564605182301, "set_robot_commands": 0.010895044803619384, "deviation-center-line": 0.5591824245117041, "driven_lanedir_consec": 3.6344974515628743, "sim_compute_sim_state": 0.005349078973134359, "sim_compute_performance-ego": 0.007835952440897624, "sim_compute_robot_state-ego": 0.009807151953379311}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.135496057024805, "sim_physics": 0.1274192547798157, "survival_time": 14.950000000000076, "driven_lanedir": 4.011714380840932, "sim_render-ego": 0.013760964075724283, "in-drivable-lane": 0, "agent_compute-ego": 0.04934215227762858, "deviation-heading": 2.9401812775879588, "set_robot_commands": 0.011427724361419676, "deviation-center-line": 0.9552607462100634, "driven_lanedir_consec": 4.011714380840932, "sim_compute_sim_state": 0.005417333443959554, "sim_compute_performance-ego": 0.00827252229054769, "sim_compute_robot_state-ego": 0.01019034226735433}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.037219965884471, "sim_physics": 0.10946616093317668, "survival_time": 14.950000000000076, "driven_lanedir": 3.976353581075778, "sim_render-ego": 0.012368489106496176, "in-drivable-lane": 0, "agent_compute-ego": 0.0480362327893575, "deviation-heading": 2.2222072539897795, "set_robot_commands": 0.009886554876963298, "deviation-center-line": 0.5190116179652606, "driven_lanedir_consec": 3.976353581075778, "sim_compute_sim_state": 0.004966944058736165, "sim_compute_performance-ego": 0.0072002696990966794, "sim_compute_robot_state-ego": 0.009045639038085938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.257168096461857, "sim_physics": 0.12774285157521567, "survival_time": 14.950000000000076, "driven_lanedir": 4.149830789279018, "sim_render-ego": 0.015277597904205322, "in-drivable-lane": 0, "agent_compute-ego": 0.05173537810643514, "deviation-heading": 3.13036263384286, "set_robot_commands": 0.01164036750793457, "deviation-center-line": 0.5895691097595815, "driven_lanedir_consec": 4.149830789279018, "sim_compute_sim_state": 0.005520826975504558, "sim_compute_performance-ego": 0.008145588239034017, "sim_compute_robot_state-ego": 0.010180690288543702}}
set_robot_commands_max0.01164036750793457
set_robot_commands_mean0.011067234992980957
set_robot_commands_median0.011427724361419676
set_robot_commands_min0.009886554876963298
sim_compute_performance-ego_max0.00827252229054769
sim_compute_performance-ego_mean0.007853294690450032
sim_compute_performance-ego_median0.007835952440897624
sim_compute_performance-ego_min0.0072002696990966794
sim_compute_robot_state-ego_max0.01019034226735433
sim_compute_robot_state-ego_mean0.009750847498575847
sim_compute_robot_state-ego_median0.009807151953379311
sim_compute_robot_state-ego_min0.009045639038085938
sim_compute_sim_state_max0.005520826975504558
sim_compute_sim_state_mean0.005331946849822999
sim_compute_sim_state_median0.005405550797780355
sim_compute_sim_state_min0.004966944058736165
sim_physics_max0.12774285157521567
sim_physics_mean0.12073363304138182
sim_physics_median0.12096357663472491
sim_physics_min0.10946616093317668
sim_render-ego_max0.015277597904205322
sim_render-ego_mean0.013597946961720784
sim_render-ego_median0.013716479142506918
sim_render-ego_min0.012368489106496176
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
268994894Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:14:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.281600466138849
survival_time_median14.950000000000076
deviation-center-line_median0.7829475393729841
in-drivable-lane_median1.1999999999999955


other stats
agent_compute-ego_max0.02821295102437337
agent_compute-ego_mean0.027457265853881835
agent_compute-ego_median0.02721102237701416
agent_compute-ego_min0.02677378495534261
deviation-center-line_max0.8531628272732272
deviation-center-line_mean0.7611977496187323
deviation-center-line_min0.6078746635900869
deviation-heading_max4.4258293404432845
deviation-heading_mean3.713026556553865
deviation-heading_median3.4778415733073555
deviation-heading_min3.0236274844737063
driven_any_max3.650853549548368
driven_any_mean3.4208142269173436
driven_any_median3.6329187447173377
driven_any_min3.064243142337604
driven_lanedir_consec_max3.523869726671712
driven_lanedir_consec_mean3.0929524366985195
driven_lanedir_consec_min2.611220472577261
driven_lanedir_max3.523869726671712
driven_lanedir_mean3.1408082806491353
driven_lanedir_median3.401018595664015
driven_lanedir_min2.611220472577261
in-drivable-lane_max2.9500000000000135
in-drivable-lane_mean1.4700000000000109
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.064243142337604, "sim_physics": 0.1120812471707662, "survival_time": 14.950000000000076, "driven_lanedir": 2.611220472577261, "sim_render-ego": 0.01320314089457194, "in-drivable-lane": 2.9500000000000135, "agent_compute-ego": 0.02821295102437337, "deviation-heading": 3.322359582889945, "set_robot_commands": 0.012359169324239095, "deviation-center-line": 0.6078746635900869, "driven_lanedir_consec": 2.611220472577261, "sim_compute_sim_state": 0.005789374510447184, "sim_compute_performance-ego": 0.007800767421722412, "sim_compute_robot_state-ego": 0.009636536439259848}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.109979316646019, "sim_physics": 0.1116700037320455, "survival_time": 14.950000000000076, "driven_lanedir": 2.7504840679222964, "sim_render-ego": 0.01300753911336263, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.02677378495534261, "deviation-heading": 4.4258293404432845, "set_robot_commands": 0.012242814699808756, "deviation-center-line": 0.7829475393729841, "driven_lanedir_consec": 2.6306229776943817, "sim_compute_sim_state": 0.00602439562479655, "sim_compute_performance-ego": 0.008016489346822102, "sim_compute_robot_state-ego": 0.009705909887949626}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.6329187447173377, "sim_physics": 0.1114701501528422, "survival_time": 14.950000000000076, "driven_lanedir": 3.4174485404103914, "sim_render-ego": 0.013104696273803711, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.02721102237701416, "deviation-heading": 3.0236274844737063, "set_robot_commands": 0.011930983861287436, "deviation-center-line": 0.8501440327154218, "driven_lanedir_consec": 3.4174485404103914, "sim_compute_sim_state": 0.00583689292271932, "sim_compute_performance-ego": 0.007731680075327555, "sim_compute_robot_state-ego": 0.009599146842956542}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.650853549548368, "sim_physics": 0.11595556259155274, "survival_time": 14.950000000000076, "driven_lanedir": 3.523869726671712, "sim_render-ego": 0.013102580706278484, "in-drivable-lane": 0, "agent_compute-ego": 0.02788357973098755, "deviation-heading": 3.4778415733073555, "set_robot_commands": 0.012558817068735758, "deviation-center-line": 0.8531628272732272, "driven_lanedir_consec": 3.523869726671712, "sim_compute_sim_state": 0.005938275655110677, "sim_compute_performance-ego": 0.007655789852142334, "sim_compute_robot_state-ego": 0.009670607248942056}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.6460763813373855, "sim_physics": 0.10680884440739948, "survival_time": 14.950000000000076, "driven_lanedir": 3.401018595664015, "sim_render-ego": 0.0127333935101827, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.02720499118169149, "deviation-heading": 4.31547480165503, "set_robot_commands": 0.012020227114359535, "deviation-center-line": 0.7118596851419419, "driven_lanedir_consec": 3.281600466138849, "sim_compute_sim_state": 0.005840897560119629, "sim_compute_performance-ego": 0.0077196319897969564, "sim_compute_robot_state-ego": 0.009390512307484944}}
set_robot_commands_max0.012558817068735758
set_robot_commands_mean0.012222402413686115
set_robot_commands_median0.012242814699808756
set_robot_commands_min0.011930983861287436
sim_compute_performance-ego_max0.008016489346822102
sim_compute_performance-ego_mean0.007784871737162272
sim_compute_performance-ego_median0.007731680075327555
sim_compute_performance-ego_min0.007655789852142334
sim_compute_robot_state-ego_max0.009705909887949626
sim_compute_robot_state-ego_mean0.009600542545318605
sim_compute_robot_state-ego_median0.009636536439259848
sim_compute_robot_state-ego_min0.009390512307484944
sim_compute_sim_state_max0.00602439562479655
sim_compute_sim_state_mean0.005885967254638672
sim_compute_sim_state_median0.005840897560119629
sim_compute_sim_state_min0.005789374510447184
sim_physics_max0.11595556259155274
sim_physics_mean0.11159716161092122
sim_physics_median0.1116700037320455
sim_physics_min0.10680884440739948
sim_render-ego_max0.01320314089457194
sim_render-ego_mean0.013030270099639894
sim_render-ego_median0.013102580706278484
sim_render-ego_min0.0127333935101827
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
268834909Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerroryesip-172-31-35-218-104900:10:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
268414288Gianmarco BernasconiBaseline-IL-logs-tensorflowaido3-LF-sim-validationstep1-simulationsuccessyesip-172-31-35-218-104900:17:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.05484970082732987
survival_time_median14.950000000000076
deviation-center-line_median0.4063554643569982
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10671499093373615
agent_compute-ego_mean0.09432874250411988
agent_compute-ego_median0.09916320641835533
agent_compute-ego_min0.06754204750061035
deviation-center-line_max1.0989872966223595
deviation-center-line_mean0.5005454427004186
deviation-center-line_min0.14299885919247624
deviation-heading_max6.79021714816505
deviation-heading_mean4.490883340009008
deviation-heading_median4.457672568066597
deviation-heading_min2.5603137459435668
driven_any_max0.2372980960229018
driven_any_mean0.12180000809294451
driven_any_median0.12487838631255328
driven_any_min0.0475238868892071
driven_lanedir_consec_max0.003101869279813929
driven_lanedir_consec_mean-0.06263475277738276
driven_lanedir_consec_min-0.1467533349034067
driven_lanedir_max0.003101869279813929
driven_lanedir_mean-0.06263475277738276
driven_lanedir_median-0.05484970082732987
driven_lanedir_min-0.1467533349034067
in-drivable-lane_max4.650000000000066
in-drivable-lane_mean0.9300000000000131
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.0475238868892071, "sim_physics": 0.1288737924893697, "survival_time": 14.950000000000076, "driven_lanedir": -0.018821882329698725, "sim_render-ego": 0.01375624418258667, "in-drivable-lane": 0, "agent_compute-ego": 0.10671499093373615, "deviation-heading": 4.457672568066597, "set_robot_commands": 0.010947322845458985, "deviation-center-line": 0.4063554643569982, "driven_lanedir_consec": -0.018821882329698725, "sim_compute_sim_state": 0.0052807275454203285, "sim_compute_performance-ego": 0.008243350982666016, "sim_compute_robot_state-ego": 0.010356578826904297}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15114860255532436, "sim_physics": 0.08321129242579142, "survival_time": 14.950000000000076, "driven_lanedir": -0.1467533349034067, "sim_render-ego": 0.0103618852297465, "in-drivable-lane": 0, "agent_compute-ego": 0.06754204750061035, "deviation-heading": 2.5603137459435668, "set_robot_commands": 0.008046444257100422, "deviation-center-line": 0.27520627601540476, "driven_lanedir_consec": -0.1467533349034067, "sim_compute_sim_state": 0.004210117657979329, "sim_compute_performance-ego": 0.006030834515889485, "sim_compute_robot_state-ego": 0.007427278359731038}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2372980960229018, "sim_physics": 0.12167298714319864, "survival_time": 14.950000000000076, "driven_lanedir": -0.0958507151062924, "sim_render-ego": 0.013260969320933024, "in-drivable-lane": 4.650000000000066, "agent_compute-ego": 0.09978843053181966, "deviation-heading": 6.79021714816505, "set_robot_commands": 0.01013170560201009, "deviation-center-line": 1.0989872966223595, "driven_lanedir_consec": -0.0958507151062924, "sim_compute_sim_state": 0.005164040724436442, "sim_compute_performance-ego": 0.007891128063201905, "sim_compute_robot_state-ego": 0.009789675076802572}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.12487838631255328, "sim_physics": 0.11922191858291624, "survival_time": 14.950000000000076, "driven_lanedir": -0.05484970082732987, "sim_render-ego": 0.013762239615122478, "in-drivable-lane": 0, "agent_compute-ego": 0.09843503713607787, "deviation-heading": 3.9398822982081296, "set_robot_commands": 0.010342148939768474, "deviation-center-line": 0.14299885919247624, "driven_lanedir_consec": -0.05484970082732987, "sim_compute_sim_state": 0.005322868824005127, "sim_compute_performance-ego": 0.00810741662979126, "sim_compute_robot_state-ego": 0.01016326109568278}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.04815106868473604, "sim_physics": 0.11913353125254313, "survival_time": 14.950000000000076, "driven_lanedir": 0.003101869279813929, "sim_render-ego": 0.013157989184061686, "in-drivable-lane": 0, "agent_compute-ego": 0.09916320641835533, "deviation-heading": 4.706330939661696, "set_robot_commands": 0.010222845872243246, "deviation-center-line": 0.5791793173148535, "driven_lanedir_consec": 0.003101869279813929, "sim_compute_sim_state": 0.005110100110371907, "sim_compute_performance-ego": 0.0077923305829366045, "sim_compute_robot_state-ego": 0.009756143093109132}}
set_robot_commands_max0.010947322845458985
set_robot_commands_mean0.009938093503316245
set_robot_commands_median0.010222845872243246
set_robot_commands_min0.008046444257100422
sim_compute_performance-ego_max0.008243350982666016
sim_compute_performance-ego_mean0.007613012154897053
sim_compute_performance-ego_median0.007891128063201905
sim_compute_performance-ego_min0.006030834515889485
sim_compute_robot_state-ego_max0.010356578826904297
sim_compute_robot_state-ego_mean0.009498587290445963
sim_compute_robot_state-ego_median0.009789675076802572
sim_compute_robot_state-ego_min0.007427278359731038
sim_compute_sim_state_max0.005322868824005127
sim_compute_sim_state_mean0.005017570972442627
sim_compute_sim_state_median0.005164040724436442
sim_compute_sim_state_min0.004210117657979329
sim_physics_max0.1288737924893697
sim_physics_mean0.11442270437876384
sim_physics_median0.11922191858291624
sim_physics_min0.08321129242579142
sim_render-ego_max0.013762239615122478
sim_render-ego_mean0.012859865506490074
sim_render-ego_median0.013260969320933024
sim_render-ego_min0.0103618852297465
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
268234930Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:15:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.55567804594644
survival_time_median14.950000000000076
deviation-center-line_median0.7223686327486399
in-drivable-lane_median0.05000000000000071


other stats
agent_compute-ego_max0.06377536694208781
agent_compute-ego_mean0.036207927227020265
agent_compute-ego_median0.021572391986846923
agent_compute-ego_min0.021529706319173177
deviation-center-line_max0.7672373425188705
deviation-center-line_mean0.6674212219177408
deviation-center-line_min0.5148667983757774
deviation-heading_max4.265321538980428
deviation-heading_mean3.2429374563505093
deviation-heading_median2.881505490157994
deviation-heading_min2.6069958324614015
driven_any_max4.571287423633674
driven_any_mean3.726014268025137
driven_any_median3.635616034074154
driven_any_min3.1197387835210835
driven_lanedir_consec_max4.462258856311946
driven_lanedir_consec_mean3.533881152587857
driven_lanedir_consec_min2.854758846657116
driven_lanedir_max4.462258856311946
driven_lanedir_mean3.533881152587857
driven_lanedir_median3.55567804594644
driven_lanedir_min2.854758846657116
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean0.5899999999999981
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.306443944617945, "sim_physics": 0.08000278870264689, "survival_time": 14.950000000000076, "driven_lanedir": 2.875456824732515, "sim_render-ego": 0.009242330392201742, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.021572391986846923, "deviation-heading": 4.265321538980428, "set_robot_commands": 0.009552072683970134, "deviation-center-line": 0.7489413293134499, "driven_lanedir_consec": 2.875456824732515, "sim_compute_sim_state": 0.00449026346206665, "sim_compute_performance-ego": 0.005569692452748617, "sim_compute_robot_state-ego": 0.006893887519836426}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.635616034074154, "sim_physics": 0.08293453375498454, "survival_time": 14.950000000000076, "driven_lanedir": 3.55567804594644, "sim_render-ego": 0.01023927132288615, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.021570059458414715, "deviation-heading": 2.6069958324614015, "set_robot_commands": 0.00946048895517985, "deviation-center-line": 0.7672373425188705, "driven_lanedir_consec": 3.55567804594644, "sim_compute_sim_state": 0.004677142302195231, "sim_compute_performance-ego": 0.005940597057342529, "sim_compute_robot_state-ego": 0.007216878732045491}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1197387835210835, "sim_physics": 0.0755360468228658, "survival_time": 14.950000000000076, "driven_lanedir": 2.854758846657116, "sim_render-ego": 0.009613518714904784, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.021529706319173177, "deviation-heading": 3.787796643020845, "set_robot_commands": 0.009305864175160728, "deviation-center-line": 0.7223686327486399, "driven_lanedir_consec": 2.854758846657116, "sim_compute_sim_state": 0.004547092914581299, "sim_compute_performance-ego": 0.005468064943949381, "sim_compute_robot_state-ego": 0.006997551123301188}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.996985154278824, "sim_physics": 0.10879313866297403, "survival_time": 14.950000000000076, "driven_lanedir": 3.92125318929127, "sim_render-ego": 0.013103543122609456, "in-drivable-lane": 0, "agent_compute-ego": 0.0525921114285787, "deviation-heading": 2.673067777131877, "set_robot_commands": 0.010505877335866292, "deviation-center-line": 0.5148667983757774, "driven_lanedir_consec": 3.92125318929127, "sim_compute_sim_state": 0.005478588740030924, "sim_compute_performance-ego": 0.007774172623952229, "sim_compute_robot_state-ego": 0.00951157569885254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.571287423633674, "sim_physics": 0.14235901991526287, "survival_time": 14.950000000000076, "driven_lanedir": 4.462258856311946, "sim_render-ego": 0.015298087596893313, "in-drivable-lane": 0, "agent_compute-ego": 0.06377536694208781, "deviation-heading": 2.881505490157994, "set_robot_commands": 0.013459241390228272, "deviation-center-line": 0.5836920066319655, "driven_lanedir_consec": 4.462258856311946, "sim_compute_sim_state": 0.005890845457712809, "sim_compute_performance-ego": 0.00911244789759318, "sim_compute_robot_state-ego": 0.011684192021687826}}
set_robot_commands_max0.013459241390228272
set_robot_commands_mean0.010456708908081052
set_robot_commands_median0.009552072683970134
set_robot_commands_min0.009305864175160728
sim_compute_performance-ego_max0.00911244789759318
sim_compute_performance-ego_mean0.0067729949951171875
sim_compute_performance-ego_median0.005940597057342529
sim_compute_performance-ego_min0.005468064943949381
sim_compute_robot_state-ego_max0.011684192021687826
sim_compute_robot_state-ego_mean0.008460817019144695
sim_compute_robot_state-ego_median0.007216878732045491
sim_compute_robot_state-ego_min0.006893887519836426
sim_compute_sim_state_max0.005890845457712809
sim_compute_sim_state_mean0.005016786575317382
sim_compute_sim_state_median0.004677142302195231
sim_compute_sim_state_min0.00449026346206665
sim_physics_max0.14235901991526287
sim_physics_mean0.09792510557174684
sim_physics_median0.08293453375498454
sim_physics_min0.0755360468228658
sim_render-ego_max0.015298087596893313
sim_render-ego_mean0.011499350229899088
sim_render-ego_median0.01023927132288615
sim_render-ego_min0.009242330392201742
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
267894514Frank (Chude) Qian 🇨🇦2019-11-19|FrankNetaido3-LFV-real-validationeval0-visualizesuccessnoip-172-31-35-218-104900:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.4093702953049552
survival_time6
deviation-center-line0.22188236786335255
in-drivable-lane1.3333000000000004


other stats
deviation-heading0.9673695373451894
driven_any1.8170538041750597
driven_lanedir1.4093702953049552
visualized-eval0-passed1
No reset possible
267414543Robert Moni 🇭🇺kaland-22401aido3-LF-real-validationeval0-visualizesuccessnoip-172-31-35-218-104900:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.1547493762401535
survival_time44
deviation-center-line4.083019565839204
in-drivable-lane6.666599999999999


other stats
deviation-heading4.408735762771872
driven_any2.6746427328040108
driven_lanedir2.1547493762401535
visualized-eval0-passed1
No reset possible
266764886Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.080769200020528
survival_time_median14.950000000000076
deviation-center-line_median0.646382140638538
in-drivable-lane_median0


other stats
agent_compute-ego_max0.034649990399678546
agent_compute-ego_mean0.03331853421529134
agent_compute-ego_median0.03414150396982829
agent_compute-ego_min0.030866924126942953
deviation-center-line_max0.6814415870857558
deviation-center-line_mean0.6095079770976767
deviation-center-line_min0.4323262854273579
deviation-heading_max3.407722141823308
deviation-heading_mean2.7165790424463925
deviation-heading_median2.6454298686609814
deviation-heading_min2.102805113446642
driven_any_max4.638596116752296
driven_any_mean3.977030861963049
driven_any_median4.166011219485282
driven_any_min2.944224105518902
driven_lanedir_consec_max4.400900469109624
driven_lanedir_consec_mean3.8596362919728007
driven_lanedir_consec_min2.834907510559424
driven_lanedir_max4.400900469109624
driven_lanedir_mean3.8596362919728007
driven_lanedir_median4.080769200020528
driven_lanedir_min2.834907510559424
in-drivable-lane_max1.6000000000000003
in-drivable-lane_mean0.43000000000000166
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.944224105518902, "sim_physics": 0.05724739789962768, "survival_time": 14.950000000000076, "driven_lanedir": 2.834907510559424, "sim_render-ego": 0.006991407076517741, "in-drivable-lane": 0, "agent_compute-ego": 0.030866924126942953, "deviation-heading": 3.407722141823308, "set_robot_commands": 0.005739242235819499, "deviation-center-line": 0.6814415870857558, "driven_lanedir_consec": 2.834907510559424, "sim_compute_sim_state": 0.0031575560569763184, "sim_compute_performance-ego": 0.004100368817647298, "sim_compute_robot_state-ego": 0.005042076110839844}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.82493853604424, "sim_physics": 0.05634893258412679, "survival_time": 14.950000000000076, "driven_lanedir": 3.722075771346803, "sim_render-ego": 0.0071391065915425616, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.03440569082895915, "deviation-heading": 2.5624660208316694, "set_robot_commands": 0.005069719155629476, "deviation-center-line": 0.656853925253534, "driven_lanedir_consec": 3.722075771346803, "sim_compute_sim_state": 0.00293413241704305, "sim_compute_performance-ego": 0.004025929768880208, "sim_compute_robot_state-ego": 0.005007161299387614}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.638596116752296, "sim_physics": 0.05434921820958456, "survival_time": 14.950000000000076, "driven_lanedir": 4.400900469109624, "sim_render-ego": 0.007096371650695801, "in-drivable-lane": 1.6000000000000003, "agent_compute-ego": 0.03252856175104777, "deviation-heading": 2.8644720674693605, "set_robot_commands": 0.0051124501228332515, "deviation-center-line": 0.646382140638538, "driven_lanedir_consec": 4.400900469109624, "sim_compute_sim_state": 0.0029373367627461753, "sim_compute_performance-ego": 0.004062449137369792, "sim_compute_robot_state-ego": 0.005012229283650716}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.311384332014524, "sim_physics": 0.05680818080902099, "survival_time": 14.950000000000076, "driven_lanedir": 4.259528508827626, "sim_render-ego": 0.007079220612843831, "in-drivable-lane": 0, "agent_compute-ego": 0.034649990399678546, "deviation-heading": 2.102805113446642, "set_robot_commands": 0.005062768459320069, "deviation-center-line": 0.4323262854273579, "driven_lanedir_consec": 4.259528508827626, "sim_compute_sim_state": 0.002967511812845866, "sim_compute_performance-ego": 0.004027580420176188, "sim_compute_robot_state-ego": 0.005048565069834391}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.166011219485282, "sim_physics": 0.054006560643513994, "survival_time": 14.950000000000076, "driven_lanedir": 4.080769200020528, "sim_render-ego": 0.007015387217203776, "in-drivable-lane": 0, "agent_compute-ego": 0.03414150396982829, "deviation-heading": 2.6454298686609814, "set_robot_commands": 0.005101846059163411, "deviation-center-line": 0.6305359470831975, "driven_lanedir_consec": 4.080769200020528, "sim_compute_sim_state": 0.002955959637959798, "sim_compute_performance-ego": 0.004033746719360351, "sim_compute_robot_state-ego": 0.00501644770304362}}
set_robot_commands_max0.005739242235819499
set_robot_commands_mean0.005217205206553141
set_robot_commands_median0.005101846059163411
set_robot_commands_min0.005062768459320069
sim_compute_performance-ego_max0.004100368817647298
sim_compute_performance-ego_mean0.004050014972686767
sim_compute_performance-ego_median0.004033746719360351
sim_compute_performance-ego_min0.004025929768880208
sim_compute_robot_state-ego_max0.005048565069834391
sim_compute_robot_state-ego_mean0.0050252958933512375
sim_compute_robot_state-ego_median0.00501644770304362
sim_compute_robot_state-ego_min0.005007161299387614
sim_compute_sim_state_max0.0031575560569763184
sim_compute_sim_state_mean0.0029904993375142416
sim_compute_sim_state_median0.002955959637959798
sim_compute_sim_state_min0.00293413241704305
sim_physics_max0.05724739789962768
sim_physics_mean0.0557520580291748
sim_physics_median0.05634893258412679
sim_physics_min0.054006560643513994
sim_render-ego_max0.0071391065915425616
sim_render-ego_mean0.007064298629760742
sim_render-ego_median0.007079220612843831
sim_render-ego_min0.006991407076517741
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
266714881Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.120859849288636
survival_time_median3.7999999999999945
deviation-center-line_median0.1894469303773121
in-drivable-lane_median0.4500000000000064


other stats
agent_compute-ego_max0.018818378448486328
agent_compute-ego_mean0.01833190023427609
agent_compute-ego_median0.018176849683125815
agent_compute-ego_min0.017977196919290644
deviation-center-line_max0.9852906640425748
deviation-center-line_mean0.38625980645183694
deviation-center-line_min0.15890443226288875
deviation-heading_max2.625486801951317
deviation-heading_mean1.3722134362726568
deviation-heading_median0.7081280480563368
deviation-heading_min0.642213104285055
driven_any_max3.0938169495511048
driven_any_mean1.799196411893829
driven_any_median1.1567955309863325
driven_any_min0.858467544776068
driven_lanedir_consec_max2.8716638546917963
driven_lanedir_consec_mean1.5997012092947118
driven_lanedir_consec_min0.6933863594088794
driven_lanedir_max2.8716638546917963
driven_lanedir_mean1.5997012092947118
driven_lanedir_median1.120859849288636
driven_lanedir_min0.6933863594088794
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.44000000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0938169495511048, "sim_physics": 0.05621407544317324, "survival_time": 12.100000000000035, "driven_lanedir": 2.8716638546917963, "sim_render-ego": 0.006938250596858253, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.018818378448486328, "deviation-heading": 2.625486801951317, "set_robot_commands": 0.004950178556205813, "deviation-center-line": 0.9852906640425748, "driven_lanedir_consec": 2.8716638546917963, "sim_compute_sim_state": 0.0028421563550460435, "sim_compute_performance-ego": 0.0040669125958907705, "sim_compute_robot_state-ego": 0.004984725605357777}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1567955309863325, "sim_physics": 0.05699599583943685, "survival_time": 2.9999999999999973, "driven_lanedir": 1.120859849288636, "sim_render-ego": 0.007107102870941162, "in-drivable-lane": 0, "agent_compute-ego": 0.018176849683125815, "deviation-heading": 0.6912716078518811, "set_robot_commands": 0.004925644397735596, "deviation-center-line": 0.1894469303773121, "driven_lanedir_consec": 1.120859849288636, "sim_compute_sim_state": 0.0028425097465515138, "sim_compute_performance-ego": 0.003957927227020264, "sim_compute_robot_state-ego": 0.00495444138844808}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.858467544776068, "sim_physics": 0.05404807391919588, "survival_time": 3.7999999999999945, "driven_lanedir": 0.6933863594088794, "sim_render-ego": 0.007131551441393401, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.017977196919290644, "deviation-heading": 0.7081280480563368, "set_robot_commands": 0.0049218409939816125, "deviation-center-line": 0.16347354743221765, "driven_lanedir_consec": 0.6933863594088794, "sim_compute_sim_state": 0.0028259722810042532, "sim_compute_performance-ego": 0.003996202820225766, "sim_compute_robot_state-ego": 0.004938693423020213}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.9639818587305355, "sim_physics": 0.056373609972827005, "survival_time": 8.649999999999988, "driven_lanedir": 2.4298359635068554, "sim_render-ego": 0.006987497296636504, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.01870868109554225, "deviation-heading": 2.193967619218694, "set_robot_commands": 0.004921510729486543, "deviation-center-line": 0.4341834581441914, "driven_lanedir_consec": 2.4298359635068554, "sim_compute_sim_state": 0.002859646185285094, "sim_compute_performance-ego": 0.0039567451256548045, "sim_compute_robot_state-ego": 0.004942654185212416}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9229201754251054, "sim_physics": 0.05766807993253072, "survival_time": 2.3999999999999995, "driven_lanedir": 0.8827600195773926, "sim_render-ego": 0.00711710254351298, "in-drivable-lane": 0, "agent_compute-ego": 0.017978395024935406, "deviation-heading": 0.642213104285055, "set_robot_commands": 0.00486077864964803, "deviation-center-line": 0.15890443226288875, "driven_lanedir_consec": 0.8827600195773926, "sim_compute_sim_state": 0.002900963028271993, "sim_compute_performance-ego": 0.003944387038548787, "sim_compute_robot_state-ego": 0.00495438277721405}}
set_robot_commands_max0.004950178556205813
set_robot_commands_mean0.004915990665411519
set_robot_commands_median0.0049218409939816125
set_robot_commands_min0.00486077864964803
sim_compute_performance-ego_max0.0040669125958907705
sim_compute_performance-ego_mean0.003984434961468078
sim_compute_performance-ego_median0.003957927227020264
sim_compute_performance-ego_min0.003944387038548787
sim_compute_robot_state-ego_max0.004984725605357777
sim_compute_robot_state-ego_mean0.004954979475850507
sim_compute_robot_state-ego_median0.00495438277721405
sim_compute_robot_state-ego_min0.004938693423020213
sim_compute_sim_state_max0.002900963028271993
sim_compute_sim_state_mean0.0028542495192317796
sim_compute_sim_state_median0.0028425097465515138
sim_compute_sim_state_min0.0028259722810042532
sim_physics_max0.05766807993253072
sim_physics_mean0.056259967021432745
sim_physics_median0.056373609972827005
sim_physics_min0.05404807391919588
sim_render-ego_max0.007131551441393401
sim_render-ego_mean0.007056300949868459
sim_render-ego_median0.007107102870941162
sim_render-ego_min0.006938250596858253
simulation-passed1
survival_time_max12.100000000000035
survival_time_mean5.990000000000003
survival_time_min2.3999999999999995
No reset possible
266674879Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.188064089353434
survival_time_median14.950000000000076
deviation-center-line_median0.9055481637103706
in-drivable-lane_median0


other stats
agent_compute-ego_max0.015856022040049236
agent_compute-ego_mean0.01569049167633057
agent_compute-ego_median0.015689280827840168
agent_compute-ego_min0.015501837730407714
deviation-center-line_max1.1073566605651075
deviation-center-line_mean0.912650083023
deviation-center-line_min0.8026189946704685
deviation-heading_max3.908558397864078
deviation-heading_mean3.1447553944121047
deviation-heading_median3.156914627083073
deviation-heading_min2.3190539043013123
driven_any_max3.7836971239193913
driven_any_mean3.3664346906188385
driven_any_median3.31237469391094
driven_any_min2.822914311066066
driven_lanedir_consec_max3.7167927246068375
driven_lanedir_consec_mean3.046536200888876
driven_lanedir_consec_min2.18781988115101
driven_lanedir_max3.7167927246068375
driven_lanedir_mean3.166170613308264
driven_lanedir_median3.188064089353434
driven_lanedir_min2.7505433198011864
in-drivable-lane_max2.4500000000000117
in-drivable-lane_mean0.9100000000000084
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1508086589586854, "sim_physics": 0.05659882545471191, "survival_time": 14.950000000000076, "driven_lanedir": 2.78599194324795, "sim_render-ego": 0.007011300722757976, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.015722443262736002, "deviation-heading": 3.908558397864078, "set_robot_commands": 0.007297221024831136, "deviation-center-line": 0.9055481637103706, "driven_lanedir_consec": 2.18781988115101, "sim_compute_sim_state": 0.003648279507954915, "sim_compute_performance-ego": 0.004148258368174235, "sim_compute_robot_state-ego": 0.005078701178232828}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.7836971239193913, "sim_physics": 0.05648169914881388, "survival_time": 14.950000000000076, "driven_lanedir": 3.7167927246068375, "sim_render-ego": 0.007088884512583415, "in-drivable-lane": 0, "agent_compute-ego": 0.015856022040049236, "deviation-heading": 2.3190539043013123, "set_robot_commands": 0.00734346071879069, "deviation-center-line": 0.9144276286003594, "driven_lanedir_consec": 3.7167927246068375, "sim_compute_sim_state": 0.0037250336011250816, "sim_compute_performance-ego": 0.00404540220896403, "sim_compute_robot_state-ego": 0.005030256907145182}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.762378665239112, "sim_physics": 0.05752843379974365, "survival_time": 14.950000000000076, "driven_lanedir": 3.3894609895319103, "sim_render-ego": 0.007089237372080485, "in-drivable-lane": 2.4500000000000117, "agent_compute-ego": 0.015501837730407714, "deviation-heading": 3.243651780528296, "set_robot_commands": 0.0071996943155924475, "deviation-center-line": 0.8026189946704685, "driven_lanedir_consec": 3.3894609895319103, "sim_compute_sim_state": 0.0035093442598978677, "sim_compute_performance-ego": 0.004065804481506348, "sim_compute_robot_state-ego": 0.005050110022226969}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.31237469391094, "sim_physics": 0.057216543356577554, "survival_time": 14.950000000000076, "driven_lanedir": 3.188064089353434, "sim_render-ego": 0.007105088233947754, "in-drivable-lane": 0, "agent_compute-ego": 0.01568287452061971, "deviation-heading": 3.095598262283765, "set_robot_commands": 0.0071142927805582686, "deviation-center-line": 0.8332989675686933, "driven_lanedir_consec": 3.188064089353434, "sim_compute_sim_state": 0.003510695298512777, "sim_compute_performance-ego": 0.004048347473144531, "sim_compute_robot_state-ego": 0.005061763922373454}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.822914311066066, "sim_physics": 0.05747094949086507, "survival_time": 14.950000000000076, "driven_lanedir": 2.7505433198011864, "sim_render-ego": 0.007169276873270671, "in-drivable-lane": 0, "agent_compute-ego": 0.015689280827840168, "deviation-heading": 3.156914627083073, "set_robot_commands": 0.00733863115310669, "deviation-center-line": 1.1073566605651075, "driven_lanedir_consec": 2.7505433198011864, "sim_compute_sim_state": 0.003829851945241293, "sim_compute_performance-ego": 0.004094197750091553, "sim_compute_robot_state-ego": 0.005079697767893473}}
set_robot_commands_max0.00734346071879069
set_robot_commands_mean0.007258659998575846
set_robot_commands_median0.007297221024831136
set_robot_commands_min0.0071142927805582686
sim_compute_performance-ego_max0.004148258368174235
sim_compute_performance-ego_mean0.004080402056376139
sim_compute_performance-ego_median0.004065804481506348
sim_compute_performance-ego_min0.00404540220896403
sim_compute_robot_state-ego_max0.005079697767893473
sim_compute_robot_state-ego_mean0.005060105959574382
sim_compute_robot_state-ego_median0.005061763922373454
sim_compute_robot_state-ego_min0.005030256907145182
sim_compute_sim_state_max0.003829851945241293
sim_compute_sim_state_mean0.0036446409225463863
sim_compute_sim_state_median0.003648279507954915
sim_compute_sim_state_min0.0035093442598978677
sim_physics_max0.05752843379974365
sim_physics_mean0.05705929025014241
sim_physics_median0.057216543356577554
sim_physics_min0.05648169914881388
sim_render-ego_max0.007169276873270671
sim_render-ego_mean0.00709275754292806
sim_render-ego_median0.007089237372080485
sim_render-ego_min0.007011300722757976
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
266564872Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3308635735821546
survival_time_median14.950000000000076
deviation-center-line_median0.7894797606044912
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016139477888743082
agent_compute-ego_mean0.015704049746195475
agent_compute-ego_median0.015678716500600178
agent_compute-ego_min0.015371572176615398
deviation-center-line_max0.9874181033204767
deviation-center-line_mean0.7774441968826937
deviation-center-line_min0.5907855004252143
deviation-heading_max3.985982307497584
deviation-heading_mean3.445814442655766
deviation-heading_median3.406942914004033
deviation-heading_min2.9955123405076933
driven_any_max4.015559133473501
driven_any_mean3.447363655124164
driven_any_median3.434471478124466
driven_any_min3.0885986902048463
driven_lanedir_consec_max3.892066077780669
driven_lanedir_consec_mean3.0796194984822294
driven_lanedir_consec_min1.8705690933487824
driven_lanedir_max3.892066077780669
driven_lanedir_mean3.287808699368829
driven_lanedir_median3.3308635735821546
driven_lanedir_min2.9115150977817845
in-drivable-lane_max2.350000000000012
in-drivable-lane_mean0.6200000000000045
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2535081695260875, "sim_physics": 0.05861950476964315, "survival_time": 14.950000000000076, "driven_lanedir": 2.9471417840238914, "sim_render-ego": 0.00708411693572998, "in-drivable-lane": 2.350000000000012, "agent_compute-ego": 0.016139477888743082, "deviation-heading": 3.406942914004033, "set_robot_commands": 0.007249038219451904, "deviation-center-line": 0.5907855004252143, "driven_lanedir_consec": 2.9471417840238914, "sim_compute_sim_state": 0.003790907859802246, "sim_compute_performance-ego": 0.004181228478749593, "sim_compute_robot_state-ego": 0.005162870883941651}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.0885986902048463, "sim_physics": 0.05531550327936808, "survival_time": 14.950000000000076, "driven_lanedir": 2.9115150977817845, "sim_render-ego": 0.007107137044270833, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.015371572176615398, "deviation-heading": 3.985982307497584, "set_robot_commands": 0.006905869642893473, "deviation-center-line": 0.9874181033204767, "driven_lanedir_consec": 1.8705690933487824, "sim_compute_sim_state": 0.003535652955373128, "sim_compute_performance-ego": 0.004040436744689941, "sim_compute_robot_state-ego": 0.0050226616859436034}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.015559133473501, "sim_physics": 0.0566272775332133, "survival_time": 14.950000000000076, "driven_lanedir": 3.892066077780669, "sim_render-ego": 0.00717343807220459, "in-drivable-lane": 0, "agent_compute-ego": 0.015789462725321453, "deviation-heading": 2.9955123405076933, "set_robot_commands": 0.007339613437652588, "deviation-center-line": 0.8886282829027842, "driven_lanedir_consec": 3.892066077780669, "sim_compute_sim_state": 0.0036119508743286135, "sim_compute_performance-ego": 0.004140519301096599, "sim_compute_robot_state-ego": 0.005148494243621826}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4446808042919197, "sim_physics": 0.05746982892354329, "survival_time": 14.950000000000076, "driven_lanedir": 3.3574569636756486, "sim_render-ego": 0.0070710174242655435, "in-drivable-lane": 0, "agent_compute-ego": 0.015541019439697266, "deviation-heading": 3.300456633285082, "set_robot_commands": 0.007182962894439697, "deviation-center-line": 0.7894797606044912, "driven_lanedir_consec": 3.3574569636756486, "sim_compute_sim_state": 0.003669597307840983, "sim_compute_performance-ego": 0.004055910110473633, "sim_compute_robot_state-ego": 0.005050915082295736}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.434471478124466, "sim_physics": 0.05605614344278971, "survival_time": 14.950000000000076, "driven_lanedir": 3.3308635735821546, "sim_render-ego": 0.0070421036084493, "in-drivable-lane": 0, "agent_compute-ego": 0.015678716500600178, "deviation-heading": 3.540178017984443, "set_robot_commands": 0.007271838188171387, "deviation-center-line": 0.6309093371605027, "driven_lanedir_consec": 3.3308635735821546, "sim_compute_sim_state": 0.0038133986790974935, "sim_compute_performance-ego": 0.004035349686940511, "sim_compute_robot_state-ego": 0.005041008790334066}}
set_robot_commands_max0.007339613437652588
set_robot_commands_mean0.00718986447652181
set_robot_commands_median0.007249038219451904
set_robot_commands_min0.006905869642893473
sim_compute_performance-ego_max0.004181228478749593
sim_compute_performance-ego_mean0.0040906888643900555
sim_compute_performance-ego_median0.004055910110473633
sim_compute_performance-ego_min0.004035349686940511
sim_compute_robot_state-ego_max0.005162870883941651
sim_compute_robot_state-ego_mean0.005085190137227377
sim_compute_robot_state-ego_median0.005050915082295736
sim_compute_robot_state-ego_min0.0050226616859436034
sim_compute_sim_state_max0.0038133986790974935
sim_compute_sim_state_mean0.003684301535288493
sim_compute_sim_state_median0.003669597307840983
sim_compute_sim_state_min0.003535652955373128
sim_physics_max0.05861950476964315
sim_physics_mean0.056817651589711506
sim_physics_median0.0566272775332133
sim_physics_min0.05531550327936808
sim_render-ego_max0.00717343807220459
sim_render-ego_mean0.0070955626169840495
sim_render-ego_median0.00708411693572998
sim_render-ego_min0.0070421036084493
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
265994839Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7752040170527417
survival_time_median14.950000000000076
deviation-center-line_median1.0174318147295929
in-drivable-lane_median3.0000000000000258


other stats
agent_compute-ego_max0.015660027662913006
agent_compute-ego_mean0.01540547080522173
agent_compute-ego_median0.01544427474339803
agent_compute-ego_min0.015113048339157964
deviation-center-line_max1.0687127593338588
deviation-center-line_mean0.8477468327809315
deviation-center-line_min0.08052566633081447
deviation-heading_max4.685498705179326
deviation-heading_mean3.1806201833040566
deviation-heading_median4.105145619509184
deviation-heading_min0.460480812141147
driven_any_max3.686218038399684
driven_any_mean2.6276888962687943
driven_any_median3.068318959842579
driven_any_min0.25771378794656485
driven_lanedir_consec_max2.6983341791172633
driven_lanedir_consec_mean1.7139469612447331
driven_lanedir_consec_min0.2352915789630008
driven_lanedir_max3.217241124401661
driven_lanedir_mean2.254134977443628
driven_lanedir_median2.6983341791172633
driven_lanedir_min0.2352915789630008
in-drivable-lane_max4.1500000000000306
in-drivable-lane_mean2.370000000000013
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8633037320535792, "sim_physics": 0.0569391409556071, "survival_time": 14.950000000000076, "driven_lanedir": 2.2398013030749064, "sim_render-ego": 0.00694719394048055, "in-drivable-lane": 3.6500000000000146, "agent_compute-ego": 0.015458237330118816, "deviation-heading": 4.255324004939272, "set_robot_commands": 0.007159144878387451, "deviation-center-line": 1.0687127593338588, "driven_lanedir_consec": 1.4378611518155882, "sim_compute_sim_state": 0.0035017967224121095, "sim_compute_performance-ego": 0.004104750156402588, "sim_compute_robot_state-ego": 0.005037602583567302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.068318959842579, "sim_physics": 0.05444362458218349, "survival_time": 13.350000000000056, "driven_lanedir": 2.880006701661308, "sim_render-ego": 0.007013927238264334, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.015113048339157964, "deviation-heading": 4.105145619509184, "set_robot_commands": 0.007278705804089036, "deviation-center-line": 1.064362147644333, "driven_lanedir_consec": 1.7752040170527417, "sim_compute_sim_state": 0.00347035475884484, "sim_compute_performance-ego": 0.00401583592989918, "sim_compute_robot_state-ego": 0.004951520805501759}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.262889963101564, "sim_physics": 0.055506556034088134, "survival_time": 14.950000000000076, "driven_lanedir": 2.6983341791172633, "sim_render-ego": 0.007072575887044271, "in-drivable-lane": 4.1500000000000306, "agent_compute-ego": 0.01544427474339803, "deviation-heading": 2.396651774751356, "set_robot_commands": 0.007193090915679931, "deviation-center-line": 1.0077017758660587, "driven_lanedir_consec": 2.6983341791172633, "sim_compute_sim_state": 0.0034908580780029295, "sim_compute_performance-ego": 0.004012676874796549, "sim_compute_robot_state-ego": 0.004984858036041259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.25771378794656485, "sim_physics": 0.059095144271850586, "survival_time": 1.800000000000001, "driven_lanedir": 0.2352915789630008, "sim_render-ego": 0.007338556978437636, "in-drivable-lane": 0, "agent_compute-ego": 0.015660027662913006, "deviation-heading": 0.460480812141147, "set_robot_commands": 0.007263130611843533, "deviation-center-line": 0.08052566633081447, "driven_lanedir_consec": 0.2352915789630008, "sim_compute_sim_state": 0.003445267677307129, "sim_compute_performance-ego": 0.0039828552140129935, "sim_compute_robot_state-ego": 0.004895342720879449}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.686218038399684, "sim_physics": 0.05489448785781861, "survival_time": 14.950000000000076, "driven_lanedir": 3.217241124401661, "sim_render-ego": 0.0070239535967508955, "in-drivable-lane": 3.0000000000000258, "agent_compute-ego": 0.015351765950520834, "deviation-heading": 4.685498705179326, "set_robot_commands": 0.0070644402503967285, "deviation-center-line": 1.0174318147295929, "driven_lanedir_consec": 2.423043879275072, "sim_compute_sim_state": 0.0034510548909505207, "sim_compute_performance-ego": 0.0040518069267272945, "sim_compute_robot_state-ego": 0.005029510656992594}}
set_robot_commands_max0.007278705804089036
set_robot_commands_mean0.007191702492079335
set_robot_commands_median0.007193090915679931
set_robot_commands_min0.0070644402503967285
sim_compute_performance-ego_max0.004104750156402588
sim_compute_performance-ego_mean0.004033585020367721
sim_compute_performance-ego_median0.00401583592989918
sim_compute_performance-ego_min0.0039828552140129935
sim_compute_robot_state-ego_max0.005037602583567302
sim_compute_robot_state-ego_mean0.004979766960596472
sim_compute_robot_state-ego_median0.004984858036041259
sim_compute_robot_state-ego_min0.004895342720879449
sim_compute_sim_state_max0.0035017967224121095
sim_compute_sim_state_mean0.003471866425503506
sim_compute_sim_state_median0.00347035475884484
sim_compute_sim_state_min0.003445267677307129
sim_physics_max0.059095144271850586
sim_physics_mean0.05617579074030958
sim_physics_median0.055506556034088134
sim_physics_min0.05444362458218349
sim_render-ego_max0.007338556978437636
sim_render-ego_mean0.007079241528195538
sim_render-ego_median0.0070239535967508955
sim_render-ego_min0.00694719394048055
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.00000000000006
survival_time_min1.800000000000001
No reset possible
265814826Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4254146998230044
survival_time_median14.950000000000076
deviation-center-line_median0.8441031516980358
in-drivable-lane_median1.900000000000027


other stats
agent_compute-ego_max0.0159438427289327
agent_compute-ego_mean0.015625867366790773
agent_compute-ego_median0.01558449109395345
agent_compute-ego_min0.015196234385172524
deviation-center-line_max0.9980592244784938
deviation-center-line_mean0.7824577794456716
deviation-center-line_min0.5332670788490103
deviation-heading_max5.662152463874518
deviation-heading_mean3.3577097754882046
deviation-heading_median3.3197272768490516
deviation-heading_min2.008568230651343
driven_any_max4.763651386226095
driven_any_mean3.8371361738745535
driven_any_median3.9679694997106623
driven_any_min2.614564114861318
driven_lanedir_consec_max4.393204593213283
driven_lanedir_consec_mean2.8291903496396325
driven_lanedir_consec_min1.3524863674233392
driven_lanedir_max4.393204593213283
driven_lanedir_mean3.5019020385396855
driven_lanedir_median3.714254441561221
driven_lanedir_min2.260591646177315
in-drivable-lane_max2.9000000000000075
in-drivable-lane_mean1.9500000000000148
in-drivable-lane_min0.9999999999999992
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.614564114861318, "sim_physics": 0.055683345794677735, "survival_time": 14.950000000000076, "driven_lanedir": 2.260591646177315, "sim_render-ego": 0.007009549140930176, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.01558449109395345, "deviation-heading": 3.480397288639021, "set_robot_commands": 0.007283019224802653, "deviation-center-line": 0.6624560274717741, "driven_lanedir_consec": 2.260591646177315, "sim_compute_sim_state": 0.0035497776667277017, "sim_compute_performance-ego": 0.00411959171295166, "sim_compute_robot_state-ego": 0.004983519713083903}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.9679694997106623, "sim_physics": 0.057305645942687986, "survival_time": 14.950000000000076, "driven_lanedir": 3.714254441561221, "sim_render-ego": 0.0070909571647644045, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.015489479700724285, "deviation-heading": 2.3177036174270893, "set_robot_commands": 0.00735798438390096, "deviation-center-line": 0.5332670788490103, "driven_lanedir_consec": 3.714254441561221, "sim_compute_sim_state": 0.0036305030186971022, "sim_compute_performance-ego": 0.004012055397033691, "sim_compute_robot_state-ego": 0.004986280600229899}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.763651386226095, "sim_physics": 0.056313594977060955, "survival_time": 14.950000000000076, "driven_lanedir": 4.393204593213283, "sim_render-ego": 0.007105207443237305, "in-drivable-lane": 2.1000000000000147, "agent_compute-ego": 0.015915288925170898, "deviation-heading": 2.008568230651343, "set_robot_commands": 0.0071475728352864585, "deviation-center-line": 0.9980592244784938, "driven_lanedir_consec": 4.393204593213283, "sim_compute_sim_state": 0.003485434850056966, "sim_compute_performance-ego": 0.004051058292388916, "sim_compute_robot_state-ego": 0.005031429131825765}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.270774562302061, "sim_physics": 0.0577065634727478, "survival_time": 14.950000000000076, "driven_lanedir": 2.8252528110894226, "sim_render-ego": 0.007161511580149333, "in-drivable-lane": 2.9000000000000075, "agent_compute-ego": 0.0159438427289327, "deviation-heading": 5.662152463874518, "set_robot_commands": 0.007262357870737712, "deviation-center-line": 0.8744034147310437, "driven_lanedir_consec": 1.3524863674233392, "sim_compute_sim_state": 0.003653848965962728, "sim_compute_performance-ego": 0.004058079719543457, "sim_compute_robot_state-ego": 0.005045669078826904}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.568721306272628, "sim_physics": 0.05490679979324341, "survival_time": 14.950000000000076, "driven_lanedir": 4.316206700657188, "sim_render-ego": 0.007067252000172933, "in-drivable-lane": 0.9999999999999992, "agent_compute-ego": 0.015196234385172524, "deviation-heading": 3.3197272768490516, "set_robot_commands": 0.007031815052032471, "deviation-center-line": 0.8441031516980358, "driven_lanedir_consec": 2.4254146998230044, "sim_compute_sim_state": 0.0035806496938069663, "sim_compute_performance-ego": 0.004062112967173259, "sim_compute_robot_state-ego": 0.005016633669535319}}
set_robot_commands_max0.00735798438390096
set_robot_commands_mean0.007216549873352051
set_robot_commands_median0.007262357870737712
set_robot_commands_min0.007031815052032471
sim_compute_performance-ego_max0.00411959171295166
sim_compute_performance-ego_mean0.004060579617818197
sim_compute_performance-ego_median0.004058079719543457
sim_compute_performance-ego_min0.004012055397033691
sim_compute_robot_state-ego_max0.005045669078826904
sim_compute_robot_state-ego_mean0.005012706438700359
sim_compute_robot_state-ego_median0.005016633669535319
sim_compute_robot_state-ego_min0.004983519713083903
sim_compute_sim_state_max0.003653848965962728
sim_compute_sim_state_mean0.003580042839050293
sim_compute_sim_state_median0.0035806496938069663
sim_compute_sim_state_min0.003485434850056966
sim_physics_max0.0577065634727478
sim_physics_mean0.05638318999608357
sim_physics_median0.056313594977060955
sim_physics_min0.05490679979324341
sim_render-ego_max0.007161511580149333
sim_render-ego_mean0.00708689546585083
sim_render-ego_median0.0070909571647644045
sim_render-ego_min0.007009549140930176
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
265764824Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:02:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
265634816Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:10:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3729419373391725
survival_time_median14.950000000000076
deviation-center-line_median0.7461825322921241
in-drivable-lane_median0.8000000000000025


other stats
agent_compute-ego_max0.03969008604685465
agent_compute-ego_mean0.03814108740140314
agent_compute-ego_median0.039144886334737145
agent_compute-ego_min0.035969471278255935
deviation-center-line_max1.111248225171383
deviation-center-line_mean0.7582925557025815
deviation-center-line_min0.40927626114677657
deviation-heading_max5.469324241597688
deviation-heading_mean3.501358593831312
deviation-heading_median3.398000128548176
deviation-heading_min1.714659879490032
driven_any_max5.168775973747799
driven_any_mean3.8517304996288546
driven_any_median4.024048186855792
driven_any_min1.9634994568513169
driven_lanedir_consec_max5.000813977256334
driven_lanedir_consec_mean3.1461786295405396
driven_lanedir_consec_min1.7508807605897094
driven_lanedir_max5.000813977256334
driven_lanedir_mean3.626824891472911
driven_lanedir_median3.77670452431402
driven_lanedir_min1.7508807605897094
in-drivable-lane_max1.8000000000000256
in-drivable-lane_mean0.9000000000000075
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9634994568513169, "sim_physics": 0.09742422299842313, "survival_time": 7.299999999999982, "driven_lanedir": 1.7508807605897094, "sim_render-ego": 0.011330044432862164, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.035969471278255935, "deviation-heading": 2.016505063593607, "set_robot_commands": 0.009850431794989598, "deviation-center-line": 0.40927626114677657, "driven_lanedir_consec": 1.7508807605897094, "sim_compute_sim_state": 0.004770576137385956, "sim_compute_performance-ego": 0.00675608850505254, "sim_compute_robot_state-ego": 0.0081857148915121}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.2328381720275203, "sim_physics": 0.07716546297073364, "survival_time": 14.950000000000076, "driven_lanedir": 2.887886187317898, "sim_render-ego": 0.009142858982086182, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.039326047897338866, "deviation-heading": 5.469324241597688, "set_robot_commands": 0.006893424193064371, "deviation-center-line": 0.5384206155149723, "driven_lanedir_consec": 1.888417464630887, "sim_compute_sim_state": 0.00400141716003418, "sim_compute_performance-ego": 0.005344221591949463, "sim_compute_robot_state-ego": 0.006708576679229737}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.168775973747799, "sim_physics": 0.07694587071736654, "survival_time": 14.950000000000076, "driven_lanedir": 5.000813977256334, "sim_render-ego": 0.009571758111317953, "in-drivable-lane": 1.2000000000000115, "agent_compute-ego": 0.03969008604685465, "deviation-heading": 1.714659879490032, "set_robot_commands": 0.006946295102437337, "deviation-center-line": 0.9863351443876514, "driven_lanedir_consec": 5.000813977256334, "sim_compute_sim_state": 0.003991955121358235, "sim_compute_performance-ego": 0.0056307053565979, "sim_compute_robot_state-ego": 0.006976526578267415}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.869490708661842, "sim_physics": 0.07799224058787028, "survival_time": 14.950000000000076, "driven_lanedir": 4.717839007886596, "sim_render-ego": 0.00930230458577474, "in-drivable-lane": 0, "agent_compute-ego": 0.039144886334737145, "deviation-heading": 3.398000128548176, "set_robot_commands": 0.00687317689259847, "deviation-center-line": 0.7461825322921241, "driven_lanedir_consec": 4.717839007886596, "sim_compute_sim_state": 0.003988041083017985, "sim_compute_performance-ego": 0.005541478792826335, "sim_compute_robot_state-ego": 0.006796247164408366}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.024048186855792, "sim_physics": 0.06739837884902954, "survival_time": 14.950000000000076, "driven_lanedir": 3.77670452431402, "sim_render-ego": 0.008398144245147706, "in-drivable-lane": 0.8000000000000025, "agent_compute-ego": 0.0365749454498291, "deviation-heading": 4.908303655927058, "set_robot_commands": 0.006183546384175618, "deviation-center-line": 1.111248225171383, "driven_lanedir_consec": 2.3729419373391725, "sim_compute_sim_state": 0.0034870012601216633, "sim_compute_performance-ego": 0.004810120264689128, "sim_compute_robot_state-ego": 0.005958903630574545}}
set_robot_commands_max0.009850431794989598
set_robot_commands_mean0.00734937487345308
set_robot_commands_median0.006893424193064371
set_robot_commands_min0.006183546384175618
sim_compute_performance-ego_max0.00675608850505254
sim_compute_performance-ego_mean0.005616522902223073
sim_compute_performance-ego_median0.005541478792826335
sim_compute_performance-ego_min0.004810120264689128
sim_compute_robot_state-ego_max0.0081857148915121
sim_compute_robot_state-ego_mean0.006925193788798432
sim_compute_robot_state-ego_median0.006796247164408366
sim_compute_robot_state-ego_min0.005958903630574545
sim_compute_sim_state_max0.004770576137385956
sim_compute_sim_state_mean0.004047798152383604
sim_compute_sim_state_median0.003991955121358235
sim_compute_sim_state_min0.0034870012601216633
sim_physics_max0.09742422299842313
sim_physics_mean0.07938523522468463
sim_physics_median0.07716546297073364
sim_physics_min0.06739837884902954
sim_render-ego_max0.011330044432862164
sim_render-ego_mean0.009549022071437749
sim_render-ego_median0.00930230458577474
sim_render-ego_min0.008398144245147706
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.42000000000006
survival_time_min7.299999999999982
No reset possible
265534809Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5082964835968777
survival_time_median14.950000000000076
deviation-center-line_median0.928410765959722
in-drivable-lane_median1.0499999999999965


other stats
agent_compute-ego_max0.015668418407440186
agent_compute-ego_mean0.01539780676295498
agent_compute-ego_median0.015359901587168375
agent_compute-ego_min0.015232814153035484
deviation-center-line_max1.1553870315517047
deviation-center-line_mean0.8381448570081481
deviation-center-line_min0.34171085603346074
deviation-heading_max4.0076781767344025
deviation-heading_mean3.3539004410458526
deviation-heading_median3.744741488176579
deviation-heading_min2.1513343047445255
driven_any_max4.731858456728444
driven_any_mean3.703919066039504
driven_any_median3.9505858615292464
driven_any_min2.6785567185249946
driven_lanedir_consec_max3.4023385612244668
driven_lanedir_consec_mean2.6438848642305217
driven_lanedir_consec_min2.2192205756305463
driven_lanedir_max4.445924979814615
driven_lanedir_mean3.312240504596931
driven_lanedir_median3.4023385612244668
driven_lanedir_min2.4831843325727863
in-drivable-lane_max3.350000000000021
in-drivable-lane_mean1.5500000000000045
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.300286447525121, "sim_physics": 0.05910690704981486, "survival_time": 14.950000000000076, "driven_lanedir": 3.721458165775912, "sim_render-ego": 0.0069796220461527505, "in-drivable-lane": 3.350000000000021, "agent_compute-ego": 0.015668418407440186, "deviation-heading": 4.0076781767344025, "set_robot_commands": 0.007135090827941895, "deviation-center-line": 0.8231481578486898, "driven_lanedir_consec": 2.6958561357841098, "sim_compute_sim_state": 0.0034599796930948894, "sim_compute_performance-ego": 0.004125066598256429, "sim_compute_robot_state-ego": 0.0050275039672851565}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.731858456728444, "sim_physics": 0.05636372725168864, "survival_time": 14.950000000000076, "driven_lanedir": 4.445924979814615, "sim_render-ego": 0.0071026325225830075, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.015232814153035484, "deviation-heading": 3.744741488176579, "set_robot_commands": 0.007110296885172526, "deviation-center-line": 0.928410765959722, "driven_lanedir_consec": 2.2192205756305463, "sim_compute_sim_state": 0.0034540685017903647, "sim_compute_performance-ego": 0.004048967361450195, "sim_compute_robot_state-ego": 0.004978431860605876}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.9505858615292464, "sim_physics": 0.05427202939987183, "survival_time": 14.950000000000076, "driven_lanedir": 3.4023385612244668, "sim_render-ego": 0.007062171300252279, "in-drivable-lane": 2.3500000000000076, "agent_compute-ego": 0.015359901587168375, "deviation-heading": 3.874848493717784, "set_robot_commands": 0.007066117127736409, "deviation-center-line": 1.1553870315517047, "driven_lanedir_consec": 3.4023385612244668, "sim_compute_sim_state": 0.0036481459935506183, "sim_compute_performance-ego": 0.004055540561676025, "sim_compute_robot_state-ego": 0.0050280173619588215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6785567185249946, "sim_physics": 0.05502037579202887, "survival_time": 10.15000000000001, "driven_lanedir": 2.5082964835968777, "sim_render-ego": 0.007103477205548968, "in-drivable-lane": 0, "agent_compute-ego": 0.015314406362073174, "deviation-heading": 2.99089974185597, "set_robot_commands": 0.007116483350105474, "deviation-center-line": 0.942067473647163, "driven_lanedir_consec": 2.5082964835968777, "sim_compute_sim_state": 0.003446689380213545, "sim_compute_performance-ego": 0.004035483440154879, "sim_compute_robot_state-ego": 0.004988058447250592}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.858307845889713, "sim_physics": 0.0554450223972271, "survival_time": 7.699999999999981, "driven_lanedir": 2.4831843325727863, "sim_render-ego": 0.00718346509066495, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.015413493305057674, "deviation-heading": 2.1513343047445255, "set_robot_commands": 0.007237678998476499, "deviation-center-line": 0.34171085603346074, "driven_lanedir_consec": 2.3937125649166084, "sim_compute_sim_state": 0.0034984226350660446, "sim_compute_performance-ego": 0.004016128453341397, "sim_compute_robot_state-ego": 0.004985365000638095}}
set_robot_commands_max0.007237678998476499
set_robot_commands_mean0.00713313343788656
set_robot_commands_median0.007116483350105474
set_robot_commands_min0.007066117127736409
sim_compute_performance-ego_max0.004125066598256429
sim_compute_performance-ego_mean0.004056237282975785
sim_compute_performance-ego_median0.004048967361450195
sim_compute_performance-ego_min0.004016128453341397
sim_compute_robot_state-ego_max0.0050280173619588215
sim_compute_robot_state-ego_mean0.005001475327547708
sim_compute_robot_state-ego_median0.004988058447250592
sim_compute_robot_state-ego_min0.004978431860605876
sim_compute_sim_state_max0.0036481459935506183
sim_compute_sim_state_mean0.003501461240743093
sim_compute_sim_state_median0.0034599796930948894
sim_compute_sim_state_min0.003446689380213545
sim_physics_max0.05910690704981486
sim_physics_mean0.05604161237812626
sim_physics_median0.0554450223972271
sim_physics_min0.05427202939987183
sim_render-ego_max0.00718346509066495
sim_render-ego_mean0.007086273633040391
sim_render-ego_median0.0071026325225830075
sim_render-ego_min0.0069796220461527505
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.540000000000044
survival_time_min7.699999999999981
No reset possible
265384800Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6917219824354168
survival_time_median14.250000000000068
deviation-center-line_median0.8832375552097236
in-drivable-lane_median2.0500000000000087


other stats
agent_compute-ego_max0.015938823223114015
agent_compute-ego_mean0.015538955706319284
agent_compute-ego_median0.015481614587294997
agent_compute-ego_min0.015129571403962016
deviation-center-line_max0.9752534573554597
deviation-center-line_mean0.8131716750412983
deviation-center-line_min0.6197466492969499
deviation-heading_max4.344378659292929
deviation-heading_mean3.325420971245997
deviation-heading_median3.3472045686965313
deviation-heading_min2.1558319065521867
driven_any_max4.469162358794999
driven_any_mean3.455938313697517
driven_any_median3.550242332703703
driven_any_min2.557308406767112
driven_lanedir_consec_max3.0362055185349037
driven_lanedir_consec_mean2.0686979540519936
driven_lanedir_consec_min1.50203517748884
driven_lanedir_max3.9246119233020504
driven_lanedir_mean2.776440579946229
driven_lanedir_median3.0362055185349037
driven_lanedir_min1.50203517748884
in-drivable-lane_max4.250000000000003
in-drivable-lane_mean2.5500000000000056
in-drivable-lane_min1.799999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.550242332703703, "sim_physics": 0.057135939598083496, "survival_time": 14.950000000000076, "driven_lanedir": 3.0362055185349037, "sim_render-ego": 0.006970960299173991, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.015938823223114015, "deviation-heading": 4.00885306743737, "set_robot_commands": 0.007367777824401856, "deviation-center-line": 0.966643791344593, "driven_lanedir_consec": 3.0362055185349037, "sim_compute_sim_state": 0.0036709952354431153, "sim_compute_performance-ego": 0.004123742580413818, "sim_compute_robot_state-ego": 0.005063372453053792}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7982432336861, "sim_physics": 0.05494871816999925, "survival_time": 9.149999999999997, "driven_lanedir": 2.185377433235875, "sim_render-ego": 0.007195027148137327, "in-drivable-lane": 1.799999999999998, "agent_compute-ego": 0.015129571403962016, "deviation-heading": 2.770836654250965, "set_robot_commands": 0.00698661152782336, "deviation-center-line": 0.6197466492969499, "driven_lanedir_consec": 1.6917219824354168, "sim_compute_sim_state": 0.003372503760082474, "sim_compute_performance-ego": 0.004038061600565259, "sim_compute_robot_state-ego": 0.005004888023835062}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.557308406767112, "sim_physics": 0.05646103111343767, "survival_time": 9.950000000000006, "driven_lanedir": 1.50203517748884, "sim_render-ego": 0.007173696355005006, "in-drivable-lane": 4.250000000000003, "agent_compute-ego": 0.015481614587294997, "deviation-heading": 2.1558319065521867, "set_robot_commands": 0.007049760626788116, "deviation-center-line": 0.620976921999765, "driven_lanedir_consec": 1.50203517748884, "sim_compute_sim_state": 0.0034310530178510963, "sim_compute_performance-ego": 0.004096975278614754, "sim_compute_robot_state-ego": 0.0051200377881227424}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.904735236535674, "sim_physics": 0.05587863524754842, "survival_time": 14.950000000000076, "driven_lanedir": 3.233972847169474, "sim_render-ego": 0.007041621208190918, "in-drivable-lane": 2.749999999999994, "agent_compute-ego": 0.015829583803812664, "deviation-heading": 4.344378659292929, "set_robot_commands": 0.007338153521219889, "deviation-center-line": 0.8832375552097236, "driven_lanedir_consec": 1.6905237739349517, "sim_compute_sim_state": 0.003533597787221273, "sim_compute_performance-ego": 0.0040371863047281905, "sim_compute_robot_state-ego": 0.005021604696909586}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.469162358794999, "sim_physics": 0.05405022888852839, "survival_time": 14.250000000000068, "driven_lanedir": 3.9246119233020504, "sim_render-ego": 0.007069706498530873, "in-drivable-lane": 2.0500000000000087, "agent_compute-ego": 0.015315185513412745, "deviation-heading": 3.3472045686965313, "set_robot_commands": 0.00701485600387841, "deviation-center-line": 0.9752534573554597, "driven_lanedir_consec": 2.423003317865855, "sim_compute_sim_state": 0.0034522658900210733, "sim_compute_performance-ego": 0.00402791792886299, "sim_compute_robot_state-ego": 0.00500882299322831}}
set_robot_commands_max0.007367777824401856
set_robot_commands_mean0.007151431900822326
set_robot_commands_median0.007049760626788116
set_robot_commands_min0.00698661152782336
sim_compute_performance-ego_max0.004123742580413818
sim_compute_performance-ego_mean0.004064776738637002
sim_compute_performance-ego_median0.004038061600565259
sim_compute_performance-ego_min0.00402791792886299
sim_compute_robot_state-ego_max0.0051200377881227424
sim_compute_robot_state-ego_mean0.005043745191029898
sim_compute_robot_state-ego_median0.005021604696909586
sim_compute_robot_state-ego_min0.005004888023835062
sim_compute_sim_state_max0.0036709952354431153
sim_compute_sim_state_mean0.0034920831381238067
sim_compute_sim_state_median0.0034522658900210733
sim_compute_sim_state_min0.003372503760082474
sim_physics_max0.057135939598083496
sim_physics_mean0.05569491060351944
sim_physics_median0.05587863524754842
sim_physics_min0.05405022888852839
sim_render-ego_max0.007195027148137327
sim_render-ego_mean0.007090202301807623
sim_render-ego_median0.007069706498530873
sim_render-ego_min0.006970960299173991
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.650000000000045
survival_time_min9.149999999999997
No reset possible
265324796Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.714963450554426
survival_time_median14.000000000000064
deviation-center-line_median0.7191831069153677
in-drivable-lane_median1.7999999999999936


other stats
agent_compute-ego_max0.01903667132059733
agent_compute-ego_mean0.018743020453506964
agent_compute-ego_median0.01881429212433951
agent_compute-ego_min0.018152267118043536
deviation-center-line_max0.8123220978138609
deviation-center-line_mean0.6206203275497207
deviation-center-line_min0.2375016263754963
deviation-heading_max3.634579617026674
deviation-heading_mean2.309412590047181
deviation-heading_median2.1804451891295957
deviation-heading_min0.5496769999182514
driven_any_max3.9626068781119983
driven_any_mean2.916523770876
driven_any_median3.437067005182043
driven_any_min1.389804143211341
driven_lanedir_consec_max3.712358609862659
driven_lanedir_consec_mean2.5632157367158506
driven_lanedir_consec_min1.3737760262622458
driven_lanedir_max3.712358609862659
driven_lanedir_mean2.5632157367158506
driven_lanedir_median2.714963450554426
driven_lanedir_min1.3737760262622458
in-drivable-lane_max2.900000000000033
in-drivable-lane_mean1.400000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9978931032004588, "sim_physics": 0.05737779347319581, "survival_time": 10.95000000000002, "driven_lanedir": 1.6051278443573054, "sim_render-ego": 0.007101606560624353, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.01898899579157024, "deviation-heading": 2.140310982410665, "set_robot_commands": 0.005012028837857181, "deviation-center-line": 0.5621130312285875, "driven_lanedir_consec": 1.6051278443573054, "sim_compute_sim_state": 0.0028434659792408007, "sim_compute_performance-ego": 0.004181265286658997, "sim_compute_robot_state-ego": 0.005049180766763208}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.437067005182043, "sim_physics": 0.05495741367340088, "survival_time": 14.950000000000076, "driven_lanedir": 2.714963450554426, "sim_render-ego": 0.006975476741790772, "in-drivable-lane": 2.900000000000033, "agent_compute-ego": 0.01903667132059733, "deviation-heading": 3.0420501617507174, "set_robot_commands": 0.004921624660491944, "deviation-center-line": 0.7191831069153677, "driven_lanedir_consec": 2.714963450554426, "sim_compute_sim_state": 0.0028195095062255857, "sim_compute_performance-ego": 0.00397130012512207, "sim_compute_robot_state-ego": 0.004926939805348714}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.795247724674161, "sim_physics": 0.05487660425049918, "survival_time": 14.000000000000064, "driven_lanedir": 3.712358609862659, "sim_render-ego": 0.006958603858947754, "in-drivable-lane": 0, "agent_compute-ego": 0.01881429212433951, "deviation-heading": 2.1804451891295957, "set_robot_commands": 0.004939418179648263, "deviation-center-line": 0.7719817754152916, "driven_lanedir_consec": 3.712358609862659, "sim_compute_sim_state": 0.0028400727680751255, "sim_compute_performance-ego": 0.003983036109379359, "sim_compute_robot_state-ego": 0.004916689225605556}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9626068781119983, "sim_physics": 0.05462055603663127, "survival_time": 14.950000000000076, "driven_lanedir": 3.409852752542618, "sim_render-ego": 0.006937965552012126, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.018722875912984212, "deviation-heading": 3.634579617026674, "set_robot_commands": 0.004897010326385498, "deviation-center-line": 0.8123220978138609, "driven_lanedir_consec": 3.409852752542618, "sim_compute_sim_state": 0.002832024097442627, "sim_compute_performance-ego": 0.003973912398020426, "sim_compute_robot_state-ego": 0.004949947992960612}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.389804143211341, "sim_physics": 0.057661596732803536, "survival_time": 3.949999999999994, "driven_lanedir": 1.3737760262622458, "sim_render-ego": 0.007082211820385124, "in-drivable-lane": 0, "agent_compute-ego": 0.018152267118043536, "deviation-heading": 0.5496769999182514, "set_robot_commands": 0.004881535904316963, "deviation-center-line": 0.2375016263754963, "driven_lanedir_consec": 1.3737760262622458, "sim_compute_sim_state": 0.0027883294262463533, "sim_compute_performance-ego": 0.003970716573015044, "sim_compute_robot_state-ego": 0.004872358297999901}}
set_robot_commands_max0.005012028837857181
set_robot_commands_mean0.004930323581739971
set_robot_commands_median0.004921624660491944
set_robot_commands_min0.004881535904316963
sim_compute_performance-ego_max0.004181265286658997
sim_compute_performance-ego_mean0.004016046098439179
sim_compute_performance-ego_median0.003973912398020426
sim_compute_performance-ego_min0.003970716573015044
sim_compute_robot_state-ego_max0.005049180766763208
sim_compute_robot_state-ego_mean0.004943023217735598
sim_compute_robot_state-ego_median0.004926939805348714
sim_compute_robot_state-ego_min0.004872358297999901
sim_compute_sim_state_max0.0028434659792408007
sim_compute_sim_state_mean0.0028246803554460983
sim_compute_sim_state_median0.002832024097442627
sim_compute_sim_state_min0.0027883294262463533
sim_physics_max0.057661596732803536
sim_physics_mean0.055898792833306135
sim_physics_median0.05495741367340088
sim_physics_min0.05462055603663127
sim_render-ego_max0.007101606560624353
sim_render-ego_mean0.007011172906752026
sim_render-ego_median0.006975476741790772
sim_render-ego_min0.006937965552012126
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.760000000000046
survival_time_min3.949999999999994
No reset possible
265314795Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2299873115768294
survival_time_median6.299999999999986
deviation-center-line_median0.34475170652495424
in-drivable-lane_median1.8499999999999936


other stats
agent_compute-ego_max0.019298572625432695
agent_compute-ego_mean0.01890447101196476
agent_compute-ego_median0.01898559786024548
agent_compute-ego_min0.018408811092376708
deviation-center-line_max0.472547631422757
deviation-center-line_mean0.3052327106473431
deviation-center-line_min0.14233632841569333
deviation-heading_max1.5630363577918107
deviation-heading_mean1.0593953111902394
deviation-heading_median1.1442307629463493
deviation-heading_min0.3043826881753082
driven_any_max2.8074272551527266
driven_any_mean1.738277844049016
driven_any_median1.5880564521055298
driven_any_min0.7567729943244622
driven_lanedir_consec_max2.3466125105607847
driven_lanedir_consec_mean1.478230307640365
driven_lanedir_consec_min0.7463695491248934
driven_lanedir_max2.3466125105607847
driven_lanedir_mean1.478230307640365
driven_lanedir_median1.2299873115768294
driven_lanedir_min0.7463695491248934
in-drivable-lane_max2.350000000000012
in-drivable-lane_mean1.2400000000000009
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3047141942219471, "sim_physics": 0.05649239889213017, "survival_time": 5.599999999999988, "driven_lanedir": 1.2299873115768294, "sim_render-ego": 0.007163269179207938, "in-drivable-lane": 0, "agent_compute-ego": 0.019298572625432695, "deviation-heading": 1.5630363577918107, "set_robot_commands": 0.00519696729523795, "deviation-center-line": 0.3582294918618673, "driven_lanedir_consec": 1.2299873115768294, "sim_compute_sim_state": 0.00291172308581216, "sim_compute_performance-ego": 0.004252369914736066, "sim_compute_robot_state-ego": 0.005103811621665955}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7567729943244622, "sim_physics": 0.056194853782653806, "survival_time": 2.000000000000001, "driven_lanedir": 0.7463695491248934, "sim_render-ego": 0.007173550128936767, "in-drivable-lane": 0, "agent_compute-ego": 0.018408811092376708, "deviation-heading": 0.3043826881753082, "set_robot_commands": 0.005149167776107788, "deviation-center-line": 0.14233632841569333, "driven_lanedir_consec": 0.7463695491248934, "sim_compute_sim_state": 0.002900606393814087, "sim_compute_performance-ego": 0.004004049301147461, "sim_compute_robot_state-ego": 0.0050756514072418215}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.234418324440414, "sim_physics": 0.055531896296001616, "survival_time": 8.399999999999984, "driven_lanedir": 1.8396877753271248, "sim_render-ego": 0.007063313609077817, "in-drivable-lane": 1.9999999999999991, "agent_compute-ego": 0.01898559786024548, "deviation-heading": 1.1442307629463493, "set_robot_commands": 0.005086887450445266, "deviation-center-line": 0.472547631422757, "driven_lanedir_consec": 1.8396877753271248, "sim_compute_sim_state": 0.002867759693236578, "sim_compute_performance-ego": 0.004129477909633091, "sim_compute_robot_state-ego": 0.005027508451825096}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5880564521055298, "sim_physics": 0.0526127644947597, "survival_time": 6.299999999999986, "driven_lanedir": 1.2284943916121909, "sim_render-ego": 0.007050232281760564, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.018636359108818903, "deviation-heading": 0.8800521938540437, "set_robot_commands": 0.004946882762606182, "deviation-center-line": 0.2082983950114435, "driven_lanedir_consec": 1.2284943916121909, "sim_compute_sim_state": 0.0028131746110462005, "sim_compute_performance-ego": 0.0039998482144068155, "sim_compute_robot_state-ego": 0.004923464759947762}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8074272551527266, "sim_physics": 0.05526450146799502, "survival_time": 9.199999999999996, "driven_lanedir": 2.3466125105607847, "sim_render-ego": 0.007035143997358239, "in-drivable-lane": 2.350000000000012, "agent_compute-ego": 0.019193014372950016, "deviation-heading": 1.4052745531836852, "set_robot_commands": 0.005042884660803754, "deviation-center-line": 0.34475170652495424, "driven_lanedir_consec": 2.3466125105607847, "sim_compute_sim_state": 0.0028991582600966744, "sim_compute_performance-ego": 0.0040301291838936186, "sim_compute_robot_state-ego": 0.005030210899270099}}
set_robot_commands_max0.00519696729523795
set_robot_commands_mean0.005084557989040188
set_robot_commands_median0.005086887450445266
set_robot_commands_min0.004946882762606182
sim_compute_performance-ego_max0.004252369914736066
sim_compute_performance-ego_mean0.00408317490476341
sim_compute_performance-ego_median0.0040301291838936186
sim_compute_performance-ego_min0.0039998482144068155
sim_compute_robot_state-ego_max0.005103811621665955
sim_compute_robot_state-ego_mean0.0050321294279901466
sim_compute_robot_state-ego_median0.005030210899270099
sim_compute_robot_state-ego_min0.004923464759947762
sim_compute_sim_state_max0.00291172308581216
sim_compute_sim_state_mean0.00287848440880114
sim_compute_sim_state_median0.0028991582600966744
sim_compute_sim_state_min0.0028131746110462005
sim_physics_max0.05649239889213017
sim_physics_mean0.05521928298670805
sim_physics_median0.055531896296001616
sim_physics_min0.0526127644947597
sim_render-ego_max0.007173550128936767
sim_render-ego_mean0.007097101839268265
sim_render-ego_median0.007063313609077817
sim_render-ego_min0.007035143997358239
simulation-passed1
survival_time_max9.199999999999996
survival_time_mean6.299999999999991
survival_time_min2.000000000000001
No reset possible
265184785Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.5761124196303165
survival_time_median14.950000000000076
deviation-center-line_median0.9199626308732304
in-drivable-lane_median0


other stats
agent_compute-ego_max0.015961426893870034
agent_compute-ego_mean0.01572480821609497
agent_compute-ego_median0.01569758971532186
agent_compute-ego_min0.015516441663106282
deviation-center-line_max1.32252705962021
deviation-center-line_mean0.9521781998659627
deviation-center-line_min0.6737469803215015
deviation-heading_max3.911548021677835
deviation-heading_mean3.0527205603803624
deviation-heading_median3.012113835309896
deviation-heading_min2.247533350832664
driven_any_max4.826474241076598
driven_any_mean4.489146730297506
driven_any_median4.713439823596785
driven_any_min3.7849587553652135
driven_lanedir_consec_max4.702375813298437
driven_lanedir_consec_mean4.2682126170908665
driven_lanedir_consec_min3.3403988342112014
driven_lanedir_max4.702375813298437
driven_lanedir_mean4.2682126170908665
driven_lanedir_median4.5761124196303165
driven_lanedir_min3.3403988342112014
in-drivable-lane_max1.200000000000017
in-drivable-lane_mean0.350000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7849587553652135, "sim_physics": 0.058157784938812254, "survival_time": 14.950000000000076, "driven_lanedir": 3.3403988342112014, "sim_render-ego": 0.007001159191131592, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.015961426893870034, "deviation-heading": 3.911548021677835, "set_robot_commands": 0.007347057660420736, "deviation-center-line": 1.0560196037752538, "driven_lanedir_consec": 3.3403988342112014, "sim_compute_sim_state": 0.003956654071807861, "sim_compute_performance-ego": 0.0041614349683125815, "sim_compute_robot_state-ego": 0.005073591868082683}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.393363666901105, "sim_physics": 0.057053337891896566, "survival_time": 14.950000000000076, "driven_lanedir": 4.0792957796952845, "sim_render-ego": 0.007978471120198567, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.015838975111643474, "deviation-heading": 3.012113835309896, "set_robot_commands": 0.007395404179890951, "deviation-center-line": 0.788634724739619, "driven_lanedir_consec": 4.0792957796952845, "sim_compute_sim_state": 0.004131011962890625, "sim_compute_performance-ego": 0.004068639278411865, "sim_compute_robot_state-ego": 0.005088922182718913}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.826474241076598, "sim_physics": 0.05617603619893392, "survival_time": 14.950000000000076, "driven_lanedir": 4.702375813298437, "sim_render-ego": 0.007097496191660563, "in-drivable-lane": 0, "agent_compute-ego": 0.015516441663106282, "deviation-heading": 2.676236000574256, "set_robot_commands": 0.007222324212392171, "deviation-center-line": 1.32252705962021, "driven_lanedir_consec": 4.702375813298437, "sim_compute_sim_state": 0.004070042769114176, "sim_compute_performance-ego": 0.004043943087259929, "sim_compute_robot_state-ego": 0.005030825932820638}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.727497164547827, "sim_physics": 0.054728958606719974, "survival_time": 14.950000000000076, "driven_lanedir": 4.5761124196303165, "sim_render-ego": 0.007138189474741618, "in-drivable-lane": 0, "agent_compute-ego": 0.015609607696533204, "deviation-heading": 3.4161715935071593, "set_robot_commands": 0.007289032936096191, "deviation-center-line": 0.9199626308732304, "driven_lanedir_consec": 4.5761124196303165, "sim_compute_sim_state": 0.004048608938852946, "sim_compute_performance-ego": 0.004074716567993164, "sim_compute_robot_state-ego": 0.005049894650777181}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.713439823596785, "sim_physics": 0.057537871996561685, "survival_time": 14.950000000000076, "driven_lanedir": 4.642880238619097, "sim_render-ego": 0.007090140183766683, "in-drivable-lane": 0, "agent_compute-ego": 0.01569758971532186, "deviation-heading": 2.247533350832664, "set_robot_commands": 0.007564014593760173, "deviation-center-line": 0.6737469803215015, "driven_lanedir_consec": 4.642880238619097, "sim_compute_sim_state": 0.0041883079210917155, "sim_compute_performance-ego": 0.0040777023633321125, "sim_compute_robot_state-ego": 0.0050830594698588055}}
set_robot_commands_max0.007564014593760173
set_robot_commands_mean0.007363566716512044
set_robot_commands_median0.007347057660420736
set_robot_commands_min0.007222324212392171
sim_compute_performance-ego_max0.0041614349683125815
sim_compute_performance-ego_mean0.004085287253061931
sim_compute_performance-ego_median0.004074716567993164
sim_compute_performance-ego_min0.004043943087259929
sim_compute_robot_state-ego_max0.005088922182718913
sim_compute_robot_state-ego_mean0.005065258820851644
sim_compute_robot_state-ego_median0.005073591868082683
sim_compute_robot_state-ego_min0.005030825932820638
sim_compute_sim_state_max0.0041883079210917155
sim_compute_sim_state_mean0.004078925132751465
sim_compute_sim_state_median0.004070042769114176
sim_compute_sim_state_min0.003956654071807861
sim_physics_max0.058157784938812254
sim_physics_mean0.056730797926584885
sim_physics_median0.057053337891896566
sim_physics_min0.054728958606719974
sim_render-ego_max0.007978471120198567
sim_render-ego_mean0.007261091232299804
sim_render-ego_median0.007097496191660563
sim_render-ego_min0.007001159191131592
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
264504743Nikolaus Howechallenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.354010010332364
survival_time_median12.000000000000036
deviation-center-line_median0.6692041376950358
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0175369412007958
agent_compute-ego_mean0.016742546864166846
agent_compute-ego_median0.01659225861231486
agent_compute-ego_min0.01637026369571686
deviation-center-line_max0.9285400291625032
deviation-center-line_mean0.5861425842031613
deviation-center-line_min0.1549840557620002
deviation-heading_max4.802611232262713
deviation-heading_mean2.1398873878585327
deviation-heading_median1.331939644422265
deviation-heading_min0.9728101922643094
driven_any_max2.349124538713928
driven_any_mean1.7255550900183798
driven_any_median1.8749977241932572
driven_any_min0.7342331443825015
driven_lanedir_consec_max2.3099279824515255
driven_lanedir_consec_mean1.502379188253427
driven_lanedir_consec_min0.702368715106375
driven_lanedir_max2.3099279824515255
driven_lanedir_mean1.6239687591217369
driven_lanedir_median1.8461308341127027
driven_lanedir_min0.702368715106375
in-drivable-lane_max1.050000000000015
in-drivable-lane_mean0.210000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7342331443825015, "sim_physics": 0.06222232182820638, "survival_time": 4.94999999999999, "driven_lanedir": 0.702368715106375, "sim_render-ego": 0.007530330407499063, "in-drivable-lane": 0, "agent_compute-ego": 0.0175369412007958, "deviation-heading": 0.9728101922643094, "set_robot_commands": 0.007479361813477796, "deviation-center-line": 0.1549840557620002, "driven_lanedir_consec": 0.702368715106375, "sim_compute_sim_state": 0.0036715088468609433, "sim_compute_performance-ego": 0.004581665751909969, "sim_compute_robot_state-ego": 0.005408761477229571}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8749977241932572, "sim_physics": 0.05930009583632152, "survival_time": 12.000000000000036, "driven_lanedir": 1.8461308341127027, "sim_render-ego": 0.007433601220448812, "in-drivable-lane": 0, "agent_compute-ego": 0.01637026369571686, "deviation-heading": 1.331939644422265, "set_robot_commands": 0.007412507136662801, "deviation-center-line": 0.69685830699282, "driven_lanedir_consec": 1.8461308341127027, "sim_compute_sim_state": 0.003613966703414917, "sim_compute_performance-ego": 0.004247875014940897, "sim_compute_robot_state-ego": 0.005362846453984578}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.348912982525061, "sim_physics": 0.05898866891860962, "survival_time": 14.950000000000076, "driven_lanedir": 1.9619578646739124, "sim_render-ego": 0.008164519468943279, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.01659225861231486, "deviation-heading": 4.802611232262713, "set_robot_commands": 0.0074761168162028, "deviation-center-line": 0.9285400291625032, "driven_lanedir_consec": 1.354010010332364, "sim_compute_sim_state": 0.003555693626403809, "sim_compute_performance-ego": 0.004334999720255534, "sim_compute_robot_state-ego": 0.005386718114217122}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3205070602771518, "sim_physics": 0.05567523610522175, "survival_time": 8.549999999999986, "driven_lanedir": 1.2994583992641684, "sim_render-ego": 0.007667867760909231, "in-drivable-lane": 0, "agent_compute-ego": 0.016637209563227427, "deviation-heading": 1.2654890290903271, "set_robot_commands": 0.007365649206596508, "deviation-center-line": 0.48112639140344726, "driven_lanedir_consec": 1.2994583992641684, "sim_compute_sim_state": 0.0036270158332690856, "sim_compute_performance-ego": 0.0043608905279148395, "sim_compute_robot_state-ego": 0.005390879703544037}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349124538713928, "sim_physics": 0.05845653295516968, "survival_time": 14.950000000000076, "driven_lanedir": 2.3099279824515255, "sim_render-ego": 0.007366101741790771, "in-drivable-lane": 0, "agent_compute-ego": 0.016576061248779295, "deviation-heading": 2.3265868412530497, "set_robot_commands": 0.007470606962839762, "deviation-center-line": 0.6692041376950358, "driven_lanedir_consec": 2.3099279824515255, "sim_compute_sim_state": 0.00376144011815389, "sim_compute_performance-ego": 0.004229390621185302, "sim_compute_robot_state-ego": 0.005242027441660563}}
set_robot_commands_max0.007479361813477796
set_robot_commands_mean0.007440848387155934
set_robot_commands_median0.007470606962839762
set_robot_commands_min0.007365649206596508
sim_compute_performance-ego_max0.004581665751909969
sim_compute_performance-ego_mean0.0043509643272413075
sim_compute_performance-ego_median0.004334999720255534
sim_compute_performance-ego_min0.004229390621185302
sim_compute_robot_state-ego_max0.005408761477229571
sim_compute_robot_state-ego_mean0.005358246638127174
sim_compute_robot_state-ego_median0.005386718114217122
sim_compute_robot_state-ego_min0.005242027441660563
sim_compute_sim_state_max0.00376144011815389
sim_compute_sim_state_mean0.003645925025620529
sim_compute_sim_state_median0.0036270158332690856
sim_compute_sim_state_min0.003555693626403809
sim_physics_max0.06222232182820638
sim_physics_mean0.05892857112870579
sim_physics_median0.05898866891860962
sim_physics_min0.05567523610522175
sim_render-ego_max0.008164519468943279
sim_render-ego_mean0.007632484119918232
sim_render-ego_median0.007530330407499063
sim_render-ego_min0.007366101741790771
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.080000000000032
survival_time_min4.94999999999999
No reset possible
264484742Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:07:59
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
264044713Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08397554810493979
survival_time_median1.5500000000000007
deviation-center-line_median0.07468299263504481
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.10930774492375991
agent_compute-ego_mean0.10165471834556856
agent_compute-ego_median0.09870962720168264
agent_compute-ego_min0.09833724268021124
deviation-center-line_max0.09975068600622285
deviation-center-line_mean0.07415051151313848
deviation-center-line_min0.04870322184331012
deviation-heading_max1.096070062394804
deviation-heading_mean0.949499071143456
deviation-heading_median0.9423084611602128
deviation-heading_min0.757696718973934
driven_any_max0.20639729985989796
driven_any_mean0.16674502824929707
driven_any_median0.16391453256324792
driven_any_min0.11744929114596492
driven_lanedir_consec_max0.1381671535372806
driven_lanedir_consec_mean0.095851194518809
driven_lanedir_consec_min0.0716789589978355
driven_lanedir_max0.1381671535372806
driven_lanedir_mean0.095851194518809
driven_lanedir_median0.08397554810493979
driven_lanedir_min0.0716789589978355
in-drivable-lane_max0.3500000000000003
in-drivable-lane_mean0.15000000000000013
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15154356306264244, "sim_physics": 0.06127152904387443, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0716789589978355, "sim_render-ego": 0.007344438183692193, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10338671745792512, "deviation-heading": 0.9423084611602128, "set_robot_commands": 0.005047913520566879, "deviation-center-line": 0.04870322184331012, "driven_lanedir_consec": 0.0716789589978355, "sim_compute_sim_state": 0.0029147209659699472, "sim_compute_performance-ego": 0.004212664019676947, "sim_compute_robot_state-ego": 0.0051076104564051475}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.11744929114596492, "sim_physics": 0.06042549014091492, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07954115531619399, "sim_render-ego": 0.007310499747594197, "in-drivable-lane": 0, "agent_compute-ego": 0.09853225946426392, "deviation-heading": 0.757696718973934, "set_robot_commands": 0.005186835924784343, "deviation-center-line": 0.09975068600622285, "driven_lanedir_consec": 0.07954115531619399, "sim_compute_sim_state": 0.002943485975265503, "sim_compute_performance-ego": 0.0040016571680704755, "sim_compute_robot_state-ego": 0.005146632591883342}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.20639729985989796, "sim_physics": 0.058411083723369395, "survival_time": 1.900000000000001, "driven_lanedir": 0.1058931566377952, "sim_render-ego": 0.007168374563518323, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.09870962720168264, "deviation-heading": 1.0284799984546118, "set_robot_commands": 0.00488188392237613, "deviation-center-line": 0.07881429996598546, "driven_lanedir_consec": 0.1058931566377952, "sim_compute_sim_state": 0.002871243577254446, "sim_compute_performance-ego": 0.003977838315461811, "sim_compute_robot_state-ego": 0.005154961033871299}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19442045461473212, "sim_physics": 0.06044756664949305, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1381671535372806, "sim_render-ego": 0.00719750628751867, "in-drivable-lane": 0, "agent_compute-ego": 0.10930774492375991, "deviation-heading": 0.9229401147337182, "set_robot_commands": 0.005109303137835334, "deviation-center-line": 0.07468299263504481, "driven_lanedir_consec": 0.1381671535372806, "sim_compute_sim_state": 0.002924133749569163, "sim_compute_performance-ego": 0.003943660679985495, "sim_compute_robot_state-ego": 0.004990900264066809}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16391453256324792, "sim_physics": 0.06035404820596018, "survival_time": 1.5500000000000007, "driven_lanedir": 0.08397554810493979, "sim_render-ego": 0.007266552217545048, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.09833724268021124, "deviation-heading": 1.096070062394804, "set_robot_commands": 0.005092928486485635, "deviation-center-line": 0.06880135711512918, "driven_lanedir_consec": 0.08397554810493979, "sim_compute_sim_state": 0.0029403471177624116, "sim_compute_performance-ego": 0.0039952339664582285, "sim_compute_robot_state-ego": 0.005060926560432681}}
set_robot_commands_max0.005186835924784343
set_robot_commands_mean0.005063772998409664
set_robot_commands_median0.005092928486485635
set_robot_commands_min0.00488188392237613
sim_compute_performance-ego_max0.004212664019676947
sim_compute_performance-ego_mean0.00402621082993059
sim_compute_performance-ego_median0.0039952339664582285
sim_compute_performance-ego_min0.003943660679985495
sim_compute_robot_state-ego_max0.005154961033871299
sim_compute_robot_state-ego_mean0.005092206181331856
sim_compute_robot_state-ego_median0.0051076104564051475
sim_compute_robot_state-ego_min0.004990900264066809
sim_compute_sim_state_max0.002943485975265503
sim_compute_sim_state_mean0.002918786277164294
sim_compute_sim_state_median0.002924133749569163
sim_compute_sim_state_min0.002871243577254446
sim_physics_max0.06127152904387443
sim_physics_mean0.0601819435527224
sim_physics_median0.06042549014091492
sim_physics_min0.058411083723369395
sim_render-ego_max0.007344438183692193
sim_render-ego_mean0.007257474199973686
sim_render-ego_median0.007266552217545048
sim_render-ego_min0.007168374563518323
simulation-passed1
survival_time_max1.900000000000001
survival_time_mean1.5800000000000007
survival_time_min1.2000000000000004
No reset possible
264034712Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:06:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08105929894329367
survival_time_median2.000000000000001
deviation-center-line_median0.08288840003629022
in-drivable-lane_median0.8000000000000005


other stats
agent_compute-ego_max0.07778546389411478
agent_compute-ego_mean0.05564799647212535
agent_compute-ego_median0.051463384377328975
agent_compute-ego_min0.046279406547546385
deviation-center-line_max0.4103706870405043
deviation-center-line_mean0.17987322721367444
deviation-center-line_min0.0398313229142911
deviation-heading_max3.8161467447088784
deviation-heading_mean1.9647457076300896
deviation-heading_median0.909800009477752
deviation-heading_min0.785739814179976
driven_any_max1.8044760488049305
driven_any_mean0.7260916355733535
driven_any_median0.17143539166721686
driven_any_min0.11656657367721383
driven_lanedir_consec_max0.20882586219259405
driven_lanedir_consec_mean0.097618692368696
driven_lanedir_consec_min0.05187321612200568
driven_lanedir_max0.2755986282294145
driven_lanedir_mean0.12103335114525623
driven_lanedir_median0.08105929894329367
driven_lanedir_min0.05187321612200568
in-drivable-lane_max11.650000000000064
in-drivable-lane_mean4.240000000000018
in-drivable-lane_min0.5500000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17143539166721686, "sim_physics": 0.0862975559736553, "survival_time": 1.900000000000001, "driven_lanedir": 0.08105929894329367, "sim_render-ego": 0.010018336145501388, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.051463384377328975, "deviation-heading": 0.8867851377600695, "set_robot_commands": 0.00707333338888068, "deviation-center-line": 0.04755857939841996, "driven_lanedir_consec": 0.08105929894329367, "sim_compute_sim_state": 0.0041487405174656915, "sim_compute_performance-ego": 0.0061861778560437656, "sim_compute_robot_state-ego": 0.007927242078279195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.11656657367721383, "sim_physics": 0.10615760438582476, "survival_time": 1.7000000000000008, "driven_lanedir": 0.05187321612200568, "sim_render-ego": 0.012480939135831945, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.07778546389411478, "deviation-heading": 0.785739814179976, "set_robot_commands": 0.010114676812115838, "deviation-center-line": 0.08288840003629022, "driven_lanedir_consec": 0.05187321612200568, "sim_compute_sim_state": 0.0049636714598711796, "sim_compute_performance-ego": 0.0070757304920869716, "sim_compute_robot_state-ego": 0.008954581092385686}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8044760488049305, "sim_physics": 0.0796351687113444, "survival_time": 14.950000000000076, "driven_lanedir": 0.13954985193071856, "sim_render-ego": 0.009103047053019203, "in-drivable-lane": 11.650000000000064, "agent_compute-ego": 0.04851895093917847, "deviation-heading": 3.4252568320237704, "set_robot_commands": 0.006870559056599935, "deviation-center-line": 0.31871714667886647, "driven_lanedir_consec": 0.08924932408473785, "sim_compute_sim_state": 0.003870557149251302, "sim_compute_performance-ego": 0.005404277642567953, "sim_compute_robot_state-ego": 0.006737648646036784}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3700229536954005, "sim_physics": 0.07959234326835571, "survival_time": 12.30000000000004, "driven_lanedir": 0.2755986282294145, "sim_render-ego": 0.009609710879442167, "in-drivable-lane": 7.600000000000028, "agent_compute-ego": 0.05419277660245818, "deviation-heading": 3.8161467447088784, "set_robot_commands": 0.007511817342866727, "deviation-center-line": 0.4103706870405043, "driven_lanedir_consec": 0.20882586219259405, "sim_compute_sim_state": 0.003981988604475812, "sim_compute_performance-ego": 0.005483476127066263, "sim_compute_robot_state-ego": 0.006861076122376977}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16795721002200625, "sim_physics": 0.07213531136512756, "survival_time": 2.000000000000001, "driven_lanedir": 0.05708576050084879, "sim_render-ego": 0.008365947008132934, "in-drivable-lane": 0.8000000000000005, "agent_compute-ego": 0.046279406547546385, "deviation-heading": 0.909800009477752, "set_robot_commands": 0.005739533901214599, "deviation-center-line": 0.0398313229142911, "driven_lanedir_consec": 0.05708576050084879, "sim_compute_sim_state": 0.003451704978942871, "sim_compute_performance-ego": 0.004710245132446289, "sim_compute_robot_state-ego": 0.005865472555160523}}
set_robot_commands_max0.010114676812115838
set_robot_commands_mean0.0074619841003355555
set_robot_commands_median0.00707333338888068
set_robot_commands_min0.005739533901214599
sim_compute_performance-ego_max0.0070757304920869716
sim_compute_performance-ego_mean0.005771981450042248
sim_compute_performance-ego_median0.005483476127066263
sim_compute_performance-ego_min0.004710245132446289
sim_compute_robot_state-ego_max0.008954581092385686
sim_compute_robot_state-ego_mean0.007269204098847834
sim_compute_robot_state-ego_median0.006861076122376977
sim_compute_robot_state-ego_min0.005865472555160523
sim_compute_sim_state_max0.0049636714598711796
sim_compute_sim_state_mean0.004083332542001371
sim_compute_sim_state_median0.003981988604475812
sim_compute_sim_state_min0.003451704978942871
sim_physics_max0.10615760438582476
sim_physics_mean0.08476359674086155
sim_physics_median0.0796351687113444
sim_physics_min0.07213531136512756
sim_render-ego_max0.012480939135831945
sim_render-ego_mean0.009915596044385529
sim_render-ego_median0.009609710879442167
sim_render-ego_min0.008365947008132934
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.570000000000024
survival_time_min1.7000000000000008
No reset possible
263974705Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.4541190086759599
survival_time_median14.950000000000076
deviation-center-line_median0.3152357169716154
in-drivable-lane_median7.45000000000004


other stats
agent_compute-ego_max0.03200206995010376
agent_compute-ego_mean0.03150386476516724
agent_compute-ego_median0.0314507269859314
agent_compute-ego_min0.031010146935780844
deviation-center-line_max0.7517092907797351
deviation-center-line_mean0.44298712470815127
deviation-center-line_min0.15151272589673284
deviation-heading_max5.897095434977862
deviation-heading_mean5.82167691292666
deviation-heading_median5.8931509920484055
deviation-heading_min5.701464330266593
driven_any_max1.6457178883091688
driven_any_mean1.4478575537229976
driven_any_median1.4645265985531346
driven_any_min1.2423472879905284
driven_lanedir_consec_max-0.4100114399275603
driven_lanedir_consec_mean-0.4805180536240536
driven_lanedir_consec_min-0.5829075231506495
driven_lanedir_max-0.4100114399275603
driven_lanedir_mean-0.4805180536240536
driven_lanedir_median-0.4541190086759599
driven_lanedir_min-0.5829075231506495
in-drivable-lane_max7.500000000000041
in-drivable-lane_mean7.400000000000039
in-drivable-lane_min7.250000000000039
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5534610968545304, "sim_physics": 0.05531160831451416, "survival_time": 14.950000000000076, "driven_lanedir": -0.53136737111161, "sim_render-ego": 0.007077845732371012, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.03200206995010376, "deviation-heading": 5.701464330266593, "set_robot_commands": 0.005107423464457194, "deviation-center-line": 0.2798374941532199, "driven_lanedir_consec": -0.53136737111161, "sim_compute_sim_state": 0.0029397972424825033, "sim_compute_performance-ego": 0.004156257311503092, "sim_compute_robot_state-ego": 0.005135066509246826}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2423472879905284, "sim_physics": 0.05724285125732422, "survival_time": 14.950000000000076, "driven_lanedir": -0.4100114399275603, "sim_render-ego": 0.0071239638328552245, "in-drivable-lane": 7.350000000000037, "agent_compute-ego": 0.03163599967956543, "deviation-heading": 5.895554937384304, "set_robot_commands": 0.005056539376576742, "deviation-center-line": 0.15151272589673284, "driven_lanedir_consec": -0.4100114399275603, "sim_compute_sim_state": 0.0029419557253519695, "sim_compute_performance-ego": 0.004043625990549723, "sim_compute_robot_state-ego": 0.0050244013468424475}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6457178883091688, "sim_physics": 0.05542559703191122, "survival_time": 14.950000000000076, "driven_lanedir": -0.5829075231506495, "sim_render-ego": 0.007071978251139323, "in-drivable-lane": 7.45000000000004, "agent_compute-ego": 0.031420380274454755, "deviation-heading": 5.721118869956133, "set_robot_commands": 0.00502257506052653, "deviation-center-line": 0.7517092907797351, "driven_lanedir_consec": -0.5829075231506495, "sim_compute_sim_state": 0.0029558491706848143, "sim_compute_performance-ego": 0.004012231826782227, "sim_compute_robot_state-ego": 0.00500770092010498}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.333234896907626, "sim_physics": 0.05454446792602539, "survival_time": 14.950000000000076, "driven_lanedir": -0.42418492525448825, "sim_render-ego": 0.00783788760503133, "in-drivable-lane": 7.250000000000039, "agent_compute-ego": 0.031010146935780844, "deviation-heading": 5.8931509920484055, "set_robot_commands": 0.005150425434112549, "deviation-center-line": 0.3152357169716154, "driven_lanedir_consec": -0.42418492525448825, "sim_compute_sim_state": 0.0029270100593566896, "sim_compute_performance-ego": 0.004069182872772217, "sim_compute_robot_state-ego": 0.005008360544840495}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4645265985531346, "sim_physics": 0.055774730841318766, "survival_time": 14.950000000000076, "driven_lanedir": -0.4541190086759599, "sim_render-ego": 0.007053831418355306, "in-drivable-lane": 7.450000000000044, "agent_compute-ego": 0.0314507269859314, "deviation-heading": 5.897095434977862, "set_robot_commands": 0.004981165726979574, "deviation-center-line": 0.7166403957394534, "driven_lanedir_consec": -0.4541190086759599, "sim_compute_sim_state": 0.0029288721084594726, "sim_compute_performance-ego": 0.004001069863637289, "sim_compute_robot_state-ego": 0.005000346501668294}}
set_robot_commands_max0.005150425434112549
set_robot_commands_mean0.005063625812530517
set_robot_commands_median0.005056539376576742
set_robot_commands_min0.004981165726979574
sim_compute_performance-ego_max0.004156257311503092
sim_compute_performance-ego_mean0.00405647357304891
sim_compute_performance-ego_median0.004043625990549723
sim_compute_performance-ego_min0.004001069863637289
sim_compute_robot_state-ego_max0.005135066509246826
sim_compute_robot_state-ego_mean0.005035175164540608
sim_compute_robot_state-ego_median0.005008360544840495
sim_compute_robot_state-ego_min0.005000346501668294
sim_compute_sim_state_max0.0029558491706848143
sim_compute_sim_state_mean0.00293869686126709
sim_compute_sim_state_median0.0029397972424825033
sim_compute_sim_state_min0.0029270100593566896
sim_physics_max0.05724285125732422
sim_physics_mean0.055659851074218746
sim_physics_median0.05542559703191122
sim_physics_min0.05454446792602539
sim_render-ego_max0.00783788760503133
sim_render-ego_mean0.00723310136795044
sim_render-ego_median0.007077845732371012
sim_render-ego_min0.007053831418355306
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
263894704Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.123086469141767
survival_time_median14.950000000000076
deviation-center-line_median0.836490385094908
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01604456901550293
agent_compute-ego_mean0.015857579419841873
agent_compute-ego_median0.01588409741719564
agent_compute-ego_min0.015580049355824788
deviation-center-line_max1.0395475996624188
deviation-center-line_mean0.7337506153311304
deviation-center-line_min0.22974261859566109
deviation-heading_max3.3049940067335446
deviation-heading_mean2.562242750599654
deviation-heading_median2.928109737420228
deviation-heading_min0.8804919311146396
driven_any_max4.9658829870219225
driven_any_mean3.971076551095007
driven_any_median4.23859871928094
driven_any_min2.01334413035913
driven_lanedir_consec_max4.842135070012134
driven_lanedir_consec_mean3.761634505883548
driven_lanedir_consec_min1.9850702753340088
driven_lanedir_max4.842135070012134
driven_lanedir_mean3.761634505883548
driven_lanedir_median4.123086469141767
driven_lanedir_min1.9850702753340088
in-drivable-lane_max0.799999999999998
in-drivable-lane_mean0.3100000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.736848782366956, "sim_physics": 0.057751694520314534, "survival_time": 14.950000000000076, "driven_lanedir": 3.4262073759898493, "sim_render-ego": 0.006998139222462972, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.01604456901550293, "deviation-heading": 2.685993114654145, "set_robot_commands": 0.007403639157613119, "deviation-center-line": 0.6886813325562143, "driven_lanedir_consec": 3.4262073759898493, "sim_compute_sim_state": 0.004042120774586996, "sim_compute_performance-ego": 0.004148577054341634, "sim_compute_robot_state-ego": 0.005079348087310791}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.23859871928094, "sim_physics": 0.05841509580612183, "survival_time": 14.950000000000076, "driven_lanedir": 4.123086469141767, "sim_render-ego": 0.007094515164693197, "in-drivable-lane": 0, "agent_compute-ego": 0.015866591930389404, "deviation-heading": 3.3049940067335446, "set_robot_commands": 0.0074287835756937665, "deviation-center-line": 0.8742911407464496, "driven_lanedir_consec": 4.123086469141767, "sim_compute_sim_state": 0.004059939384460449, "sim_compute_performance-ego": 0.004020117123921712, "sim_compute_robot_state-ego": 0.005045743783315023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.9658829870219225, "sim_physics": 0.05600151141484579, "survival_time": 14.950000000000076, "driven_lanedir": 4.842135070012134, "sim_render-ego": 0.007078951994578044, "in-drivable-lane": 0, "agent_compute-ego": 0.015580049355824788, "deviation-heading": 3.0116249630757137, "set_robot_commands": 0.00727841854095459, "deviation-center-line": 1.0395475996624188, "driven_lanedir_consec": 4.842135070012134, "sim_compute_sim_state": 0.004045189221700033, "sim_compute_performance-ego": 0.004068857828776042, "sim_compute_robot_state-ego": 0.005056338310241699}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.01334413035913, "sim_physics": 0.05648180589837543, "survival_time": 5.899999999999987, "driven_lanedir": 1.9850702753340088, "sim_render-ego": 0.007150385339381331, "in-drivable-lane": 0, "agent_compute-ego": 0.01591258938029661, "deviation-heading": 0.8804919311146396, "set_robot_commands": 0.00725097777479786, "deviation-center-line": 0.22974261859566109, "driven_lanedir_consec": 1.9850702753340088, "sim_compute_sim_state": 0.00408137652833583, "sim_compute_performance-ego": 0.004054103867482331, "sim_compute_robot_state-ego": 0.005023707777766858}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.900708136446085, "sim_physics": 0.05700682957967122, "survival_time": 14.950000000000076, "driven_lanedir": 4.431673338939981, "sim_render-ego": 0.00706671158472697, "in-drivable-lane": 0.799999999999998, "agent_compute-ego": 0.01588409741719564, "deviation-heading": 2.928109737420228, "set_robot_commands": 0.007440605163574219, "deviation-center-line": 0.836490385094908, "driven_lanedir_consec": 4.431673338939981, "sim_compute_sim_state": 0.004097124735514323, "sim_compute_performance-ego": 0.0040348331133524575, "sim_compute_robot_state-ego": 0.005051741600036621}}
set_robot_commands_max0.007440605163574219
set_robot_commands_mean0.00736048484252671
set_robot_commands_median0.007403639157613119
set_robot_commands_min0.00725097777479786
sim_compute_performance-ego_max0.004148577054341634
sim_compute_performance-ego_mean0.004065297797574836
sim_compute_performance-ego_median0.004054103867482331
sim_compute_performance-ego_min0.004020117123921712
sim_compute_robot_state-ego_max0.005079348087310791
sim_compute_robot_state-ego_mean0.005051375911734199
sim_compute_robot_state-ego_median0.005051741600036621
sim_compute_robot_state-ego_min0.005023707777766858
sim_compute_sim_state_max0.004097124735514323
sim_compute_sim_state_mean0.004065150128919526
sim_compute_sim_state_median0.004059939384460449
sim_compute_sim_state_min0.004042120774586996
sim_physics_max0.05841509580612183
sim_physics_mean0.05713138744386577
sim_physics_median0.05700682957967122
sim_physics_min0.05600151141484579
sim_render-ego_max0.007150385339381331
sim_render-ego_mean0.007077740661168503
sim_render-ego_median0.007078951994578044
sim_render-ego_min0.006998139222462972
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.14000000000006
survival_time_min5.899999999999987
No reset possible
263874703Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 45, in compute_action
               ||     return action.astype(float)
               || AttributeError: 'Tensor' object has no attribute 'astype'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263734696Ramon Emiliani 🇨🇦challenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:01:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 43, in compute_action
               ||     observation = self.preprocessor.preprocess(observation)
               ||   File "/workspace/wrappers.py", line 17, in preprocess
               ||     observation = Image.fromarray(cv2.resize(observation, dsize=self.shape[:-1]))
               || TypeError: Expected cv::UMat for argument 'src'
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
               || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7f8330cd6150>>.
               || │       f: instance of method:
               || │          <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7f8330cd6150>>
               || │    args: dict
               || │          │ context:
               || │          │ instance of ConcreteContext:
               || │          │ <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f82cd906f90>
               || │ argspec: <class 'inspect.FullArgSpec'>
               || │          #0 [`self`, `context`]
               || │          #1 None
               || │          #2 None
               || │          #3 None
               || │          #4 []
               || │          #5 None
               || │          #6 dict
               || │             │ context: <class 'zuper_nodes_wrapper.interface.Context'>
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263434565Frank (Chude) Qian 🇨🇦2019-11-19|FrankNet|Andrew_Activationaido3-LF-real-validationeval1-videossuccessnoip-172-31-35-218-104900:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263234684Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:06:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.435222856243646
survival_time_median12.35000000000004
deviation-center-line_median0.6620502786675849
in-drivable-lane_median0


other stats
agent_compute-ego_max0.01809331855258426
agent_compute-ego_mean0.01609360727542896
agent_compute-ego_median0.01570769441806204
agent_compute-ego_min0.015239143371582033
deviation-center-line_max0.8571133107464955
deviation-center-line_mean0.5925029009281825
deviation-center-line_min0.2492524136288127
deviation-heading_max3.130577302628549
deviation-heading_mean2.214411397948512
deviation-heading_median2.625146079857375
deviation-heading_min0.8415816295804834
driven_any_max4.873364401189323
driven_any_mean3.0875461097681627
driven_any_median3.559021514061351
driven_any_min1.185935512481271
driven_lanedir_consec_max4.476249117867285
driven_lanedir_consec_mean2.901129296966702
driven_lanedir_consec_min1.1463802787161328
driven_lanedir_max4.476249117867285
driven_lanedir_mean2.901129296966702
driven_lanedir_median3.435222856243646
driven_lanedir_min1.1463802787161328
in-drivable-lane_max0.8000000000000114
in-drivable-lane_mean0.2400000000000034
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.559021514061351, "sim_physics": 0.056013710498809814, "survival_time": 14.950000000000076, "driven_lanedir": 3.435222856243646, "sim_render-ego": 0.006986407438913981, "in-drivable-lane": 0, "agent_compute-ego": 0.016000444094340007, "deviation-heading": 3.130577302628549, "set_robot_commands": 0.0075300240516662596, "deviation-center-line": 0.8571133107464955, "driven_lanedir_consec": 3.435222856243646, "sim_compute_sim_state": 0.003956798712412516, "sim_compute_performance-ego": 0.004162920316060384, "sim_compute_robot_state-ego": 0.0050484744707743326}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.185935512481271, "sim_physics": 0.0701000722678932, "survival_time": 3.699999999999995, "driven_lanedir": 1.1463802787161328, "sim_render-ego": 0.008597248309367412, "in-drivable-lane": 0, "agent_compute-ego": 0.01809331855258426, "deviation-heading": 0.8415816295804834, "set_robot_commands": 0.009333716856466756, "deviation-center-line": 0.2492524136288127, "driven_lanedir_consec": 1.1463802787161328, "sim_compute_sim_state": 0.004864132082140124, "sim_compute_performance-ego": 0.0048122534880766996, "sim_compute_robot_state-ego": 0.006095576930690456}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.873364401189323, "sim_physics": 0.05541708787282308, "survival_time": 14.950000000000076, "driven_lanedir": 4.476249117867285, "sim_render-ego": 0.006978800296783447, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.015239143371582033, "deviation-heading": 2.625146079857375, "set_robot_commands": 0.00729315439860026, "deviation-center-line": 0.8196087831939045, "driven_lanedir_consec": 4.476249117867285, "sim_compute_sim_state": 0.003819410006205241, "sim_compute_performance-ego": 0.004067461490631103, "sim_compute_robot_state-ego": 0.00500766118367513}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.8293246067836297, "sim_physics": 0.057567593539774656, "survival_time": 12.35000000000004, "driven_lanedir": 3.5426340307684265, "sim_render-ego": 0.00706845546058315, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.015427435940576467, "deviation-heading": 2.875084742899642, "set_robot_commands": 0.007225281796474688, "deviation-center-line": 0.6620502786675849, "driven_lanedir_consec": 3.5426340307684265, "sim_compute_sim_state": 0.003620478788368133, "sim_compute_performance-ego": 0.00401795248271, "sim_compute_robot_state-ego": 0.004915648626412457}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.990084514325238, "sim_physics": 0.05511346483618263, "survival_time": 6.149999999999986, "driven_lanedir": 1.9051602012380184, "sim_render-ego": 0.00715443370788078, "in-drivable-lane": 0, "agent_compute-ego": 0.01570769441806204, "deviation-heading": 1.5996672347765115, "set_robot_commands": 0.007068827869446297, "deviation-center-line": 0.3744897184041144, "driven_lanedir_consec": 1.9051602012380184, "sim_compute_sim_state": 0.004108717771080452, "sim_compute_performance-ego": 0.004009316607219417, "sim_compute_robot_state-ego": 0.004941494484257892}}
set_robot_commands_max0.009333716856466756
set_robot_commands_mean0.007690200994530853
set_robot_commands_median0.00729315439860026
set_robot_commands_min0.007068827869446297
sim_compute_performance-ego_max0.0048122534880766996
sim_compute_performance-ego_mean0.004213980876939521
sim_compute_performance-ego_median0.004067461490631103
sim_compute_performance-ego_min0.004009316607219417
sim_compute_robot_state-ego_max0.006095576930690456
sim_compute_robot_state-ego_mean0.005201771139162053
sim_compute_robot_state-ego_median0.00500766118367513
sim_compute_robot_state-ego_min0.004915648626412457
sim_compute_sim_state_max0.004864132082140124
sim_compute_sim_state_mean0.004073907472041292
sim_compute_sim_state_median0.003956798712412516
sim_compute_sim_state_min0.003620478788368133
sim_physics_max0.0701000722678932
sim_physics_mean0.05884238580309667
sim_physics_median0.056013710498809814
sim_physics_min0.05511346483618263
sim_render-ego_max0.008597248309367412
sim_render-ego_mean0.007357069042705755
sim_render-ego_median0.00706845546058315
sim_render-ego_min0.006978800296783447
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.420000000000034
survival_time_min3.699999999999995
No reset possible
263194681Soroush Saryazdi 🇨🇦upduckaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3228762949211545
survival_time_median11.00000000000002
deviation-center-line_median0.6279829328693514
in-drivable-lane_median0.8999999999999968


other stats
agent_compute-ego_max0.016158847542075843
agent_compute-ego_mean0.015739565712460348
agent_compute-ego_median0.015747201442718507
agent_compute-ego_min0.015440330865248196
deviation-center-line_max1.0945568664019765
deviation-center-line_mean0.588884351836312
deviation-center-line_min0.16113951470263943
deviation-heading_max3.1056633693236804
deviation-heading_mean2.099625016632799
deviation-heading_median2.151294419744031
deviation-heading_min0.5911866503540908
driven_any_max4.500255803325938
driven_any_mean3.0720518606160403
driven_any_median3.7129890807671218
driven_any_min1.1684023613200707
driven_lanedir_consec_max4.327304705898074
driven_lanedir_consec_mean2.7543825035744094
driven_lanedir_consec_min1.1397181148855051
driven_lanedir_max4.327304705898074
driven_lanedir_mean2.7543825035744094
driven_lanedir_median3.3228762949211545
driven_lanedir_min1.1397181148855051
in-drivable-lane_max2.050000000000016
in-drivable-lane_mean0.8700000000000065
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.983938338232969, "sim_physics": 0.05662675504084234, "survival_time": 14.300000000000068, "driven_lanedir": 3.342209918353974, "sim_render-ego": 0.006984012943881375, "in-drivable-lane": 2.050000000000016, "agent_compute-ego": 0.016158847542075843, "deviation-heading": 2.9039573793251465, "set_robot_commands": 0.007492393880457311, "deviation-center-line": 0.7385444053477398, "driven_lanedir_consec": 3.342209918353974, "sim_compute_sim_state": 0.003938167245237978, "sim_compute_performance-ego": 0.004148634163649766, "sim_compute_robot_state-ego": 0.0050417743362746875}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1684023613200707, "sim_physics": 0.05821266416775978, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1397181148855051, "sim_render-ego": 0.007252216339111328, "in-drivable-lane": 0, "agent_compute-ego": 0.015527337284411417, "deviation-heading": 0.5911866503540908, "set_robot_commands": 0.007281751955969859, "deviation-center-line": 0.16113951470263943, "driven_lanedir_consec": 1.1397181148855051, "sim_compute_sim_state": 0.004393141148454052, "sim_compute_performance-ego": 0.004058938915446653, "sim_compute_robot_state-ego": 0.005048545740418515}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.500255803325938, "sim_physics": 0.055625742786335496, "survival_time": 13.250000000000052, "driven_lanedir": 4.327304705898074, "sim_render-ego": 0.00712134523211785, "in-drivable-lane": 0, "agent_compute-ego": 0.015440330865248196, "deviation-heading": 3.1056633693236804, "set_robot_commands": 0.007406734070687924, "deviation-center-line": 1.0945568664019765, "driven_lanedir_consec": 4.327304705898074, "sim_compute_sim_state": 0.003822640652926463, "sim_compute_performance-ego": 0.004050644388738668, "sim_compute_robot_state-ego": 0.005053095547658093}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9946737194341015, "sim_physics": 0.057295138441671535, "survival_time": 6.349999999999985, "driven_lanedir": 1.6398034838133386, "sim_render-ego": 0.0071861706380769025, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.015824111427847794, "deviation-heading": 1.7460232644170477, "set_robot_commands": 0.007576608282374585, "deviation-center-line": 0.32219803985985296, "driven_lanedir_consec": 1.6398034838133386, "sim_compute_sim_state": 0.0038259085707777127, "sim_compute_performance-ego": 0.004066974159300797, "sim_compute_robot_state-ego": 0.005117422013770877}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.7129890807671218, "sim_physics": 0.05693491805683483, "survival_time": 11.00000000000002, "driven_lanedir": 3.3228762949211545, "sim_render-ego": 0.0070927479050376194, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.015747201442718507, "deviation-heading": 2.151294419744031, "set_robot_commands": 0.0071790424260226166, "deviation-center-line": 0.6279829328693514, "driven_lanedir_consec": 3.3228762949211545, "sim_compute_sim_state": 0.003851846131411466, "sim_compute_performance-ego": 0.004086886752735485, "sim_compute_robot_state-ego": 0.005030268972570246}}
set_robot_commands_max0.007576608282374585
set_robot_commands_mean0.007387306123102458
set_robot_commands_median0.007406734070687924
set_robot_commands_min0.0071790424260226166
sim_compute_performance-ego_max0.004148634163649766
sim_compute_performance-ego_mean0.004082415675974274
sim_compute_performance-ego_median0.004066974159300797
sim_compute_performance-ego_min0.004050644388738668
sim_compute_robot_state-ego_max0.005117422013770877
sim_compute_robot_state-ego_mean0.005058221322138484
sim_compute_robot_state-ego_median0.005048545740418515
sim_compute_robot_state-ego_min0.005030268972570246
sim_compute_sim_state_max0.004393141148454052
sim_compute_sim_state_mean0.003966340749761534
sim_compute_sim_state_median0.003851846131411466
sim_compute_sim_state_min0.003822640652926463
sim_physics_max0.05821266416775978
sim_physics_mean0.0569390436986888
sim_physics_median0.05693491805683483
sim_physics_min0.055625742786335496
sim_render-ego_max0.007252216339111328
sim_render-ego_mean0.007127298611645015
sim_render-ego_median0.00712134523211785
sim_render-ego_min0.006984012943881375
simulation-passed1
survival_time_max14.300000000000068
survival_time_mean9.570000000000023
survival_time_min2.9499999999999975
No reset possible
263174680Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.827515653030981
survival_time_median14.950000000000076
deviation-center-line_median0.6394516364251357
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03428070624669393
agent_compute-ego_mean0.033160562356313074
agent_compute-ego_median0.033864490191141766
agent_compute-ego_min0.030729208787282303
deviation-center-line_max0.7940971299119715
deviation-center-line_mean0.6648214963508765
deviation-center-line_min0.5785250990877087
deviation-heading_max3.635347421553344
deviation-heading_mean3.082823533339404
deviation-heading_median2.9148740510618385
deviation-heading_min2.7264229140183462
driven_any_max4.60066219345241
driven_any_mean3.772256942659073
driven_any_median3.904798743168906
driven_any_min2.889236125581282
driven_lanedir_consec_max4.48885532468193
driven_lanedir_consec_mean3.660045199453585
driven_lanedir_consec_min2.7666075005892483
driven_lanedir_max4.48885532468193
driven_lanedir_mean3.660045199453585
driven_lanedir_median3.827515653030981
driven_lanedir_min2.7666075005892483
in-drivable-lane_max0.7500000000000027
in-drivable-lane_mean0.15000000000000052
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.889236125581282, "sim_physics": 0.057689832846323646, "survival_time": 14.950000000000076, "driven_lanedir": 2.7666075005892483, "sim_render-ego": 0.006979304949442546, "in-drivable-lane": 0, "agent_compute-ego": 0.030729208787282303, "deviation-heading": 3.635347421553344, "set_robot_commands": 0.0057598058382670085, "deviation-center-line": 0.7280270937870896, "driven_lanedir_consec": 2.7666075005892483, "sim_compute_sim_state": 0.003146508534749349, "sim_compute_performance-ego": 0.004128991762797038, "sim_compute_robot_state-ego": 0.005132760206858317}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.222572940682162, "sim_physics": 0.05420129537582397, "survival_time": 14.950000000000076, "driven_lanedir": 3.1125932594186136, "sim_render-ego": 0.007058295408884684, "in-drivable-lane": 0, "agent_compute-ego": 0.03295567353566488, "deviation-heading": 3.2799807438339417, "set_robot_commands": 0.005061736106872558, "deviation-center-line": 0.6394516364251357, "driven_lanedir_consec": 3.1125932594186136, "sim_compute_sim_state": 0.0029422839482625327, "sim_compute_performance-ego": 0.004033904075622558, "sim_compute_robot_state-ego": 0.00500654935836792}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.244014710410602, "sim_physics": 0.056431225935618085, "survival_time": 14.950000000000076, "driven_lanedir": 4.104654259547151, "sim_render-ego": 0.007095261414845785, "in-drivable-lane": 0.7500000000000027, "agent_compute-ego": 0.033864490191141766, "deviation-heading": 2.8574925362295507, "set_robot_commands": 0.005063148339589437, "deviation-center-line": 0.7940971299119715, "driven_lanedir_consec": 4.104654259547151, "sim_compute_sim_state": 0.002988235155741374, "sim_compute_performance-ego": 0.00407535473505656, "sim_compute_robot_state-ego": 0.005006152788798015}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.60066219345241, "sim_physics": 0.05646931250890096, "survival_time": 14.950000000000076, "driven_lanedir": 4.48885532468193, "sim_render-ego": 0.0070630900065104165, "in-drivable-lane": 0, "agent_compute-ego": 0.03397273302078247, "deviation-heading": 2.9148740510618385, "set_robot_commands": 0.005081410408020019, "deviation-center-line": 0.5785250990877087, "driven_lanedir_consec": 4.48885532468193, "sim_compute_sim_state": 0.0029715776443481447, "sim_compute_performance-ego": 0.0040341416994730634, "sim_compute_robot_state-ego": 0.00501125415166219}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.904798743168906, "sim_physics": 0.05407960017522176, "survival_time": 14.950000000000076, "driven_lanedir": 3.827515653030981, "sim_render-ego": 0.007042655150095622, "in-drivable-lane": 0, "agent_compute-ego": 0.03428070624669393, "deviation-heading": 2.7264229140183462, "set_robot_commands": 0.005005136330922444, "deviation-center-line": 0.5840065225424769, "driven_lanedir_consec": 3.827515653030981, "sim_compute_sim_state": 0.0029570825894673666, "sim_compute_performance-ego": 0.004027786254882812, "sim_compute_robot_state-ego": 0.005011540253957112}}
set_robot_commands_max0.0057598058382670085
set_robot_commands_mean0.005194247404734294
set_robot_commands_median0.005063148339589437
set_robot_commands_min0.005005136330922444
sim_compute_performance-ego_max0.004128991762797038
sim_compute_performance-ego_mean0.004060035705566406
sim_compute_performance-ego_median0.0040341416994730634
sim_compute_performance-ego_min0.004027786254882812
sim_compute_robot_state-ego_max0.005132760206858317
sim_compute_robot_state-ego_mean0.005033651351928711
sim_compute_robot_state-ego_median0.00501125415166219
sim_compute_robot_state-ego_min0.005006152788798015
sim_compute_sim_state_max0.003146508534749349
sim_compute_sim_state_mean0.0030011375745137535
sim_compute_sim_state_median0.0029715776443481447
sim_compute_sim_state_min0.0029422839482625327
sim_physics_max0.057689832846323646
sim_physics_mean0.05577425336837769
sim_physics_median0.056431225935618085
sim_physics_min0.05407960017522176
sim_render-ego_max0.007095261414845785
sim_render-ego_mean0.0070477213859558106
sim_render-ego_median0.007058295408884684
sim_render-ego_min0.006979304949442546
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
263054672Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.475902038630964
survival_time_median14.950000000000076
deviation-center-line_median0.804327862451668
in-drivable-lane_median1.8999999999999932


other stats
agent_compute-ego_max0.01576574830447926
agent_compute-ego_mean0.01548943679349492
agent_compute-ego_median0.015536219278971352
agent_compute-ego_min0.015198605615387923
deviation-center-line_max1.0226262782990971
deviation-center-line_mean0.6823856460039925
deviation-center-line_min0.35882218320591386
deviation-heading_max4.05713933784701
deviation-heading_mean2.6663252923132945
deviation-heading_median2.807539594624335
deviation-heading_min1.056387051059574
driven_any_max4.932167259412664
driven_any_mean3.529239240084819
driven_any_median3.916891460846621
driven_any_min1.2873334505357563
driven_lanedir_consec_max4.4592707251711445
driven_lanedir_consec_mean2.589122189043343
driven_lanedir_consec_min1.2258831304385074
driven_lanedir_max4.4592707251711445
driven_lanedir_mean3.120430935882679
driven_lanedir_median3.3961767772428786
driven_lanedir_min1.2258831304385074
in-drivable-lane_max3.700000000000001
in-drivable-lane_mean1.8400000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.678874462525851, "sim_physics": 0.053554519812266034, "survival_time": 14.950000000000076, "driven_lanedir": 4.044922007929901, "sim_render-ego": 0.007052669525146485, "in-drivable-lane": 2.750000000000023, "agent_compute-ego": 0.01569270610809326, "deviation-heading": 3.79832591193179, "set_robot_commands": 0.0073136297861735025, "deviation-center-line": 0.849041248282168, "driven_lanedir_consec": 2.9634013313017205, "sim_compute_sim_state": 0.0035247333844502767, "sim_compute_performance-ego": 0.004151310125986735, "sim_compute_robot_state-ego": 0.005046923160552979}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2873334505357563, "sim_physics": 0.057356893315034754, "survival_time": 4.249999999999993, "driven_lanedir": 1.2258831304385074, "sim_render-ego": 0.007299440047320198, "in-drivable-lane": 0, "agent_compute-ego": 0.01576574830447926, "deviation-heading": 1.056387051059574, "set_robot_commands": 0.007032481361837948, "deviation-center-line": 0.35882218320591386, "driven_lanedir_consec": 1.2258831304385074, "sim_compute_sim_state": 0.0034520513871136834, "sim_compute_performance-ego": 0.004020143957699046, "sim_compute_robot_state-ego": 0.005011188282686122}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.932167259412664, "sim_physics": 0.05325639406840006, "survival_time": 14.950000000000076, "driven_lanedir": 4.4592707251711445, "sim_render-ego": 0.007139437993367513, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.015253904660542808, "deviation-heading": 2.807539594624335, "set_robot_commands": 0.0069965998331705725, "deviation-center-line": 1.0226262782990971, "driven_lanedir_consec": 4.4592707251711445, "sim_compute_sim_state": 0.0033123111724853516, "sim_compute_performance-ego": 0.004034481843312582, "sim_compute_robot_state-ego": 0.005020341873168945}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.916891460846621, "sim_physics": 0.05416081825892131, "survival_time": 14.950000000000076, "driven_lanedir": 3.3961767772428786, "sim_render-ego": 0.007043944994608561, "in-drivable-lane": 3.700000000000001, "agent_compute-ego": 0.015536219278971352, "deviation-heading": 4.05713933784701, "set_robot_commands": 0.00724404493967692, "deviation-center-line": 0.804327862451668, "driven_lanedir_consec": 1.8211537196743763, "sim_compute_sim_state": 0.00350827693939209, "sim_compute_performance-ego": 0.004044106801350911, "sim_compute_robot_state-ego": 0.0050102901458740235}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.830929567103204, "sim_physics": 0.05726141299841539, "survival_time": 7.94999999999998, "driven_lanedir": 2.475902038630964, "sim_render-ego": 0.007076900710099898, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.015198605615387923, "deviation-heading": 1.6122345661037614, "set_robot_commands": 0.007228956282513696, "deviation-center-line": 0.3771106577811157, "driven_lanedir_consec": 2.475902038630964, "sim_compute_sim_state": 0.003380286618598602, "sim_compute_performance-ego": 0.003983990951154217, "sim_compute_robot_state-ego": 0.004911214300671463}}
set_robot_commands_max0.0073136297861735025
set_robot_commands_mean0.007163142440674527
set_robot_commands_median0.007228956282513696
set_robot_commands_min0.0069965998331705725
sim_compute_performance-ego_max0.004151310125986735
sim_compute_performance-ego_mean0.004046806735900699
sim_compute_performance-ego_median0.004034481843312582
sim_compute_performance-ego_min0.003983990951154217
sim_compute_robot_state-ego_max0.005046923160552979
sim_compute_robot_state-ego_mean0.004999991552590706
sim_compute_robot_state-ego_median0.005011188282686122
sim_compute_robot_state-ego_min0.004911214300671463
sim_compute_sim_state_max0.0035247333844502767
sim_compute_sim_state_mean0.003435531900408001
sim_compute_sim_state_median0.0034520513871136834
sim_compute_sim_state_min0.0033123111724853516
sim_physics_max0.057356893315034754
sim_physics_mean0.055118007690607505
sim_physics_median0.05416081825892131
sim_physics_min0.05325639406840006
sim_render-ego_max0.007299440047320198
sim_render-ego_mean0.007122478654108531
sim_render-ego_median0.007076900710099898
sim_render-ego_min0.007043944994608561
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.41000000000004
survival_time_min4.249999999999993
No reset possible
262924665Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.232733146343021
survival_time_median6.699999999999984
deviation-center-line_median0.2961645414386932
in-drivable-lane_median1.049999999999998


other stats
agent_compute-ego_max0.01768384196541526
agent_compute-ego_mean0.015931377802299064
agent_compute-ego_median0.015533389114752048
agent_compute-ego_min0.015381050987477683
deviation-center-line_max0.42126879760095337
deviation-center-line_mean0.24807861056052224
deviation-center-line_min0.06236854737099898
deviation-heading_max2.797013819415316
deviation-heading_mean1.3476455298024974
deviation-heading_median1.05643289490223
deviation-heading_min0.2954100937916634
driven_any_max2.472916405940108
driven_any_mean1.4179104803476985
driven_any_median1.764196841601348
driven_any_min0.41677844074924464
driven_lanedir_consec_max1.8014763821960749
driven_lanedir_consec_mean1.0844813865174614
driven_lanedir_consec_min0.4018681649637882
driven_lanedir_max2.0656622936962807
driven_lanedir_mean1.1596847708384312
driven_lanedir_median1.3445641564476651
driven_lanedir_min0.4018681649637882
in-drivable-lane_max2.7999999999999927
in-drivable-lane_mean1.159999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.41677844074924464, "sim_physics": 0.06259243054823442, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4018681649637882, "sim_render-ego": 0.007550608028065075, "in-drivable-lane": 0, "agent_compute-ego": 0.01768384196541526, "deviation-heading": 0.2954100937916634, "set_robot_commands": 0.007148677652532404, "deviation-center-line": 0.06236854737099898, "driven_lanedir_consec": 0.4018681649637882, "sim_compute_sim_state": 0.003629250959916548, "sim_compute_performance-ego": 0.004603418436917392, "sim_compute_robot_state-ego": 0.005744153803045099}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.472916405940108, "sim_physics": 0.05252705907529117, "survival_time": 8.14999999999998, "driven_lanedir": 2.0656622936962807, "sim_render-ego": 0.007057148986067509, "in-drivable-lane": 1.049999999999998, "agent_compute-ego": 0.015381050987477683, "deviation-heading": 2.797013819415316, "set_robot_commands": 0.007149509125691981, "deviation-center-line": 0.42126879760095337, "driven_lanedir_consec": 1.8014763821960749, "sim_compute_sim_state": 0.003402414497422294, "sim_compute_performance-ego": 0.0040220819367952874, "sim_compute_robot_state-ego": 0.0051270247968427975}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.012839154742751, "sim_physics": 0.05772548113296281, "survival_time": 6.699999999999984, "driven_lanedir": 1.580667922288867, "sim_render-ego": 0.0071196324789702, "in-drivable-lane": 1.9499999999999944, "agent_compute-ego": 0.015519718625652256, "deviation-heading": 1.05643289490223, "set_robot_commands": 0.007289480807176276, "deviation-center-line": 0.2961645414386932, "driven_lanedir_consec": 1.580667922288867, "sim_compute_sim_state": 0.0036536508531712776, "sim_compute_performance-ego": 0.00404512170535415, "sim_compute_robot_state-ego": 0.005047988535752937}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.764196841601348, "sim_physics": 0.05643900720084586, "survival_time": 8.199999999999982, "driven_lanedir": 1.3445641564476651, "sim_render-ego": 0.007146304700432754, "in-drivable-lane": 2.7999999999999927, "agent_compute-ego": 0.015533389114752048, "deviation-heading": 2.1873639076315, "set_robot_commands": 0.007254780792608493, "deviation-center-line": 0.358167702633711, "driven_lanedir_consec": 1.232733146343021, "sim_compute_sim_state": 0.003496263085342035, "sim_compute_performance-ego": 0.004035820321338933, "sim_compute_robot_state-ego": 0.005062987164753239}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4228215587050409, "sim_physics": 0.06087348290852138, "survival_time": 1.4000000000000006, "driven_lanedir": 0.40566131679555584, "sim_render-ego": 0.007312323365892682, "in-drivable-lane": 0, "agent_compute-ego": 0.015538888318198068, "deviation-heading": 0.40200693327177855, "set_robot_commands": 0.007278289113725934, "deviation-center-line": 0.10242346375825476, "driven_lanedir_consec": 0.40566131679555584, "sim_compute_sim_state": 0.0032653467995779856, "sim_compute_performance-ego": 0.004060029983520508, "sim_compute_robot_state-ego": 0.005060579095567975}}
set_robot_commands_max0.007289480807176276
set_robot_commands_mean0.007224147498347018
set_robot_commands_median0.007254780792608493
set_robot_commands_min0.007148677652532404
sim_compute_performance-ego_max0.004603418436917392
sim_compute_performance-ego_mean0.004153294476785254
sim_compute_performance-ego_median0.00404512170535415
sim_compute_performance-ego_min0.0040220819367952874
sim_compute_robot_state-ego_max0.005744153803045099
sim_compute_robot_state-ego_mean0.00520854667919241
sim_compute_robot_state-ego_median0.005062987164753239
sim_compute_robot_state-ego_min0.005047988535752937
sim_compute_sim_state_max0.0036536508531712776
sim_compute_sim_state_mean0.0034893852390860277
sim_compute_sim_state_median0.003496263085342035
sim_compute_sim_state_min0.0032653467995779856
sim_physics_max0.06259243054823442
sim_physics_mean0.05803149217317113
sim_physics_median0.05772548113296281
sim_physics_min0.05252705907529117
sim_render-ego_max0.007550608028065075
sim_render-ego_mean0.007237203511885644
sim_render-ego_median0.007146304700432754
sim_render-ego_min0.007057148986067509
simulation-passed1
survival_time_max8.199999999999982
survival_time_mean5.10999999999999
survival_time_min1.1000000000000003
No reset possible
262844661Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.686319265050002
survival_time_median14.950000000000076
deviation-center-line_median0.8726803003892659
in-drivable-lane_median2.1500000000000083


other stats
agent_compute-ego_max0.03331670840581258
agent_compute-ego_mean0.031958667897341544
agent_compute-ego_median0.03277623812357584
agent_compute-ego_min0.029452975591023764
deviation-center-line_max1.1089639822610298
deviation-center-line_mean0.7689308172459138
deviation-center-line_min0.07709033172900699
deviation-heading_max4.544275055274681
deviation-heading_mean2.7271736478426343
deviation-heading_median3.438266473749626
deviation-heading_min0.3121582874026887
driven_any_max5.486067884262943
driven_any_mean3.921230684066709
driven_any_median4.328399596453506
driven_any_min1.5821020013705984
driven_lanedir_consec_max4.8096957037403545
driven_lanedir_consec_mean2.894399957026747
driven_lanedir_consec_min1.246178560782912
driven_lanedir_max4.8096957037403545
driven_lanedir_mean3.531727178234219
driven_lanedir_median3.836468420050183
driven_lanedir_min1.246178560782912
in-drivable-lane_max4.850000000000009
in-drivable-lane_mean2.380000000000013
in-drivable-lane_min0.9000000000000128
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.436249093321242, "sim_physics": 0.05590171098709106, "survival_time": 14.950000000000076, "driven_lanedir": 4.231381752686434, "sim_render-ego": 0.006964445114135742, "in-drivable-lane": 2.1500000000000083, "agent_compute-ego": 0.029452975591023764, "deviation-heading": 3.438266473749626, "set_robot_commands": 0.005749807357788086, "deviation-center-line": 1.1089639822610298, "driven_lanedir_consec": 3.2670576273023317, "sim_compute_sim_state": 0.00302854061126709, "sim_compute_performance-ego": 0.004129243691762288, "sim_compute_robot_state-ego": 0.005075360139211019}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.773334844925255, "sim_physics": 0.0541441528002421, "survival_time": 14.950000000000076, "driven_lanedir": 3.534911453911213, "sim_render-ego": 0.007906288305918375, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.03323880990346273, "deviation-heading": 4.544275055274681, "set_robot_commands": 0.005180862744649252, "deviation-center-line": 0.9634951300029588, "driven_lanedir_consec": 2.686319265050002, "sim_compute_sim_state": 0.002972687880198161, "sim_compute_performance-ego": 0.004046270847320557, "sim_compute_robot_state-ego": 0.005020194848378499}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.486067884262943, "sim_physics": 0.05381351709365845, "survival_time": 14.950000000000076, "driven_lanedir": 4.8096957037403545, "sim_render-ego": 0.007055219809214274, "in-drivable-lane": 4.850000000000009, "agent_compute-ego": 0.03331670840581258, "deviation-heading": 1.5629854570428812, "set_robot_commands": 0.005062081813812256, "deviation-center-line": 0.8224243418473074, "driven_lanedir_consec": 4.8096957037403545, "sim_compute_sim_state": 0.0029482340812683108, "sim_compute_performance-ego": 0.004039711952209472, "sim_compute_robot_state-ego": 0.00504712184270223}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5821020013705984, "sim_physics": 0.055270979278966, "survival_time": 3.7999999999999945, "driven_lanedir": 1.246178560782912, "sim_render-ego": 0.0072459735368427475, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.031008607462832804, "deviation-heading": 0.3121582874026887, "set_robot_commands": 0.005212843418121338, "deviation-center-line": 0.07709033172900699, "driven_lanedir_consec": 1.246178560782912, "sim_compute_sim_state": 0.003072785703759445, "sim_compute_performance-ego": 0.004042076437096847, "sim_compute_robot_state-ego": 0.005017509585932682}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.328399596453506, "sim_physics": 0.05593352317810059, "survival_time": 14.950000000000076, "driven_lanedir": 3.836468420050183, "sim_render-ego": 0.007093114058176676, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.03277623812357584, "deviation-heading": 3.7781829657432953, "set_robot_commands": 0.005133054256439209, "deviation-center-line": 0.8726803003892659, "driven_lanedir_consec": 2.462748628258137, "sim_compute_sim_state": 0.00296797513961792, "sim_compute_performance-ego": 0.004037610689798991, "sim_compute_robot_state-ego": 0.005059046745300293}}
set_robot_commands_max0.005749807357788086
set_robot_commands_mean0.005267729918162028
set_robot_commands_median0.005180862744649252
set_robot_commands_min0.005062081813812256
sim_compute_performance-ego_max0.004129243691762288
sim_compute_performance-ego_mean0.004058982723637632
sim_compute_performance-ego_median0.004042076437096847
sim_compute_performance-ego_min0.004037610689798991
sim_compute_robot_state-ego_max0.005075360139211019
sim_compute_robot_state-ego_mean0.005043846632304944
sim_compute_robot_state-ego_median0.00504712184270223
sim_compute_robot_state-ego_min0.005017509585932682
sim_compute_sim_state_max0.003072785703759445
sim_compute_sim_state_mean0.0029980446832221855
sim_compute_sim_state_median0.002972687880198161
sim_compute_sim_state_min0.0029482340812683108
sim_physics_max0.05593352317810059
sim_physics_mean0.05501277666761164
sim_physics_median0.055270979278966
sim_physics_min0.05381351709365845
sim_render-ego_max0.007906288305918375
sim_render-ego_mean0.007253008164857563
sim_render-ego_median0.007093114058176676
sim_render-ego_min0.006964445114135742
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.72000000000006
survival_time_min3.7999999999999945
No reset possible
262824658Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.650233261511363
survival_time_median8.449999999999985
deviation-center-line_median0.5242495087591003
in-drivable-lane_median3.1000000000000094


other stats
agent_compute-ego_max0.03325451174868813
agent_compute-ego_mean0.028945772664645937
agent_compute-ego_median0.03046660319618557
agent_compute-ego_min0.019554855754074545
deviation-center-line_max0.5923247201765041
deviation-center-line_mean0.4293843158961993
deviation-center-line_min0.1781951579274623
deviation-heading_max2.751733579523579
deviation-heading_mean1.6846023163988677
deviation-heading_median1.5887185988066288
deviation-heading_min0.7264443665260328
driven_any_max3.791684719440993
driven_any_mean2.329545401688507
driven_any_median2.317910418553599
driven_any_min1.1616833897036312
driven_lanedir_consec_max1.9849064528662892
driven_lanedir_consec_mean1.5374154182749622
driven_lanedir_consec_min0.6456165023792787
driven_lanedir_max2.9958169645546757
driven_lanedir_mean1.8639826398354125
driven_lanedir_median1.9405387673059191
driven_lanedir_min0.7484177529388144
in-drivable-lane_max4.150000000000005
in-drivable-lane_mean2.8699999999999997
in-drivable-lane_min1.7999999999999936
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1616833897036312, "sim_physics": 0.05627894633024642, "survival_time": 5.14999999999999, "driven_lanedir": 0.7484177529388144, "sim_render-ego": 0.007144004395864542, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.019554855754074545, "deviation-heading": 2.027980902410106, "set_robot_commands": 0.006448910074326598, "deviation-center-line": 0.1781951579274623, "driven_lanedir_consec": 0.6456165023792787, "sim_compute_sim_state": 0.0032766212537450696, "sim_compute_performance-ego": 0.00425146852882163, "sim_compute_robot_state-ego": 0.005068839175029866}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.317910418553599, "sim_physics": 0.05417582410327077, "survival_time": 8.449999999999985, "driven_lanedir": 1.9849064528662892, "sim_render-ego": 0.007074556407138441, "in-drivable-lane": 2.0999999999999996, "agent_compute-ego": 0.032603550239427556, "deviation-heading": 1.3281341347279911, "set_robot_commands": 0.005186969711935732, "deviation-center-line": 0.5242495087591003, "driven_lanedir_consec": 1.9849064528662892, "sim_compute_sim_state": 0.002974860061555219, "sim_compute_performance-ego": 0.004042656463984201, "sim_compute_robot_state-ego": 0.005032791893863114}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4144116315488957, "sim_physics": 0.05466324252051276, "survival_time": 7.399999999999982, "driven_lanedir": 1.9405387673059191, "sim_render-ego": 0.00712840460442208, "in-drivable-lane": 3.1999999999999904, "agent_compute-ego": 0.02884934238485388, "deviation-heading": 0.7264443665260328, "set_robot_commands": 0.005109530848425788, "deviation-center-line": 0.2979441957724858, "driven_lanedir_consec": 1.9405387673059191, "sim_compute_sim_state": 0.0029274370219256425, "sim_compute_performance-ego": 0.004040457106925346, "sim_compute_robot_state-ego": 0.005017900789106214}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.791684719440993, "sim_physics": 0.05844359357648761, "survival_time": 11.850000000000032, "driven_lanedir": 2.9958169645546757, "sim_render-ego": 0.00709500393284021, "in-drivable-lane": 4.150000000000005, "agent_compute-ego": 0.03325451174868813, "deviation-heading": 2.751733579523579, "set_robot_commands": 0.005057822802901771, "deviation-center-line": 0.5923247201765041, "driven_lanedir_consec": 1.4657821073119608, "sim_compute_sim_state": 0.0029537094293264395, "sim_compute_performance-ego": 0.004064937181110623, "sim_compute_robot_state-ego": 0.005065663454401845}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.962036849195415, "sim_physics": 0.054220286400421806, "survival_time": 9.199999999999996, "driven_lanedir": 1.650233261511363, "sim_render-ego": 0.007099209920219753, "in-drivable-lane": 3.1000000000000094, "agent_compute-ego": 0.03046660319618557, "deviation-heading": 1.5887185988066288, "set_robot_commands": 0.005089996949486111, "deviation-center-line": 0.554207996845444, "driven_lanedir_consec": 1.650233261511363, "sim_compute_sim_state": 0.002945858499278193, "sim_compute_performance-ego": 0.004038732984791632, "sim_compute_robot_state-ego": 0.005024675441824872}}
set_robot_commands_max0.006448910074326598
set_robot_commands_mean0.005378646077415201
set_robot_commands_median0.005109530848425788
set_robot_commands_min0.005057822802901771
sim_compute_performance-ego_max0.00425146852882163
sim_compute_performance-ego_mean0.0040876504531266854
sim_compute_performance-ego_median0.004042656463984201
sim_compute_performance-ego_min0.004038732984791632
sim_compute_robot_state-ego_max0.005068839175029866
sim_compute_robot_state-ego_mean0.005041974150845182
sim_compute_robot_state-ego_median0.005032791893863114
sim_compute_robot_state-ego_min0.005017900789106214
sim_compute_sim_state_max0.0032766212537450696
sim_compute_sim_state_mean0.003015697253166113
sim_compute_sim_state_median0.0029537094293264395
sim_compute_sim_state_min0.0029274370219256425
sim_physics_max0.05844359357648761
sim_physics_mean0.05555637858618787
sim_physics_median0.05466324252051276
sim_physics_min0.05417582410327077
sim_render-ego_max0.007144004395864542
sim_render-ego_mean0.007108235852097006
sim_render-ego_median0.007099209920219753
sim_render-ego_min0.007074556407138441
simulation-passed1
survival_time_max11.850000000000032
survival_time_mean8.409999999999998
survival_time_min5.14999999999999
No reset possible
262794656Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.849417782455752
survival_time_median6.0499999999999865
deviation-center-line_median0.3350367894789646
in-drivable-lane_median2.2999999999999936


other stats
agent_compute-ego_max0.03395574020616936
agent_compute-ego_mean0.031109845840474493
agent_compute-ego_median0.03257186651229858
agent_compute-ego_min0.02443351901945521
deviation-center-line_max0.9217627897842012
deviation-center-line_mean0.42321826116342753
deviation-center-line_min0.20928851878749047
deviation-heading_max2.760582576139004
deviation-heading_mean1.6121325737988106
deviation-heading_median1.0234535933348954
deviation-heading_min0.814658676930273
driven_any_max5.193329020374289
driven_any_mean2.80337084314099
driven_any_median2.4504009820544153
driven_any_min1.6051678240476774
driven_lanedir_consec_max2.378805076665633
driven_lanedir_consec_mean1.6725466050306934
driven_lanedir_consec_min0.9512100924457256
driven_lanedir_max4.596314191207623
driven_lanedir_mean2.305742046679103
driven_lanedir_median1.8996781861457863
driven_lanedir_min1.2642541110594914
in-drivable-lane_max3.2499999999999982
in-drivable-lane_mean2.1300000000000017
in-drivable-lane_min0.9499999999999966
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5755412876598927, "sim_physics": 0.05544260160519126, "survival_time": 9.149999999999997, "driven_lanedir": 1.8996781861457863, "sim_render-ego": 0.007107656510149846, "in-drivable-lane": 3.2499999999999982, "agent_compute-ego": 0.02443351901945521, "deviation-heading": 2.632405483505402, "set_robot_commands": 0.005823996549095612, "deviation-center-line": 0.35998516890785315, "driven_lanedir_consec": 0.9512100924457256, "sim_compute_sim_state": 0.003150082676788497, "sim_compute_performance-ego": 0.004189685394203728, "sim_compute_robot_state-ego": 0.005040395455282243}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.192415101568674, "sim_physics": 0.0556991225794742, "survival_time": 5.699999999999988, "driven_lanedir": 1.849417782455752, "sim_render-ego": 0.00718794161813301, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03270656811563592, "deviation-heading": 0.8295625390844775, "set_robot_commands": 0.005012704615007367, "deviation-center-line": 0.3350367894789646, "driven_lanedir_consec": 1.849417782455752, "sim_compute_sim_state": 0.002948275783605743, "sim_compute_performance-ego": 0.004042623335855049, "sim_compute_robot_state-ego": 0.005030742862768341}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4504009820544153, "sim_physics": 0.05521192432435091, "survival_time": 6.0499999999999865, "driven_lanedir": 1.9190459625268643, "sim_render-ego": 0.007264889961431834, "in-drivable-lane": 2.2999999999999936, "agent_compute-ego": 0.0318815353488134, "deviation-heading": 0.814658676930273, "set_robot_commands": 0.0050525034754729465, "deviation-center-line": 0.20928851878749047, "driven_lanedir_consec": 1.9190459625268643, "sim_compute_sim_state": 0.00292725799497494, "sim_compute_performance-ego": 0.00408172410381727, "sim_compute_robot_state-ego": 0.005054607864253777}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6051678240476774, "sim_physics": 0.05672916258224333, "survival_time": 4.94999999999999, "driven_lanedir": 1.2642541110594914, "sim_render-ego": 0.0072673763891663214, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.03395574020616936, "deviation-heading": 1.0234535933348954, "set_robot_commands": 0.004907340714425752, "deviation-center-line": 0.2900180388586281, "driven_lanedir_consec": 1.2642541110594914, "sim_compute_sim_state": 0.0030008855492177637, "sim_compute_performance-ego": 0.004015985161367089, "sim_compute_robot_state-ego": 0.004999953086930092}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.193329020374289, "sim_physics": 0.05478223403294881, "survival_time": 14.950000000000076, "driven_lanedir": 4.596314191207623, "sim_render-ego": 0.007109817663828532, "in-drivable-lane": 3.1500000000000243, "agent_compute-ego": 0.03257186651229858, "deviation-heading": 2.760582576139004, "set_robot_commands": 0.005039810339609782, "deviation-center-line": 0.9217627897842012, "driven_lanedir_consec": 2.378805076665633, "sim_compute_sim_state": 0.0029674609502156573, "sim_compute_performance-ego": 0.004024898211161296, "sim_compute_robot_state-ego": 0.00502403974533081}}
set_robot_commands_max0.005823996549095612
set_robot_commands_mean0.005167271138722292
set_robot_commands_median0.005039810339609782
set_robot_commands_min0.004907340714425752
sim_compute_performance-ego_max0.004189685394203728
sim_compute_performance-ego_mean0.004070983241280886
sim_compute_performance-ego_median0.004042623335855049
sim_compute_performance-ego_min0.004015985161367089
sim_compute_robot_state-ego_max0.005054607864253777
sim_compute_robot_state-ego_mean0.005029947802913053
sim_compute_robot_state-ego_median0.005030742862768341
sim_compute_robot_state-ego_min0.004999953086930092
sim_compute_sim_state_max0.003150082676788497
sim_compute_sim_state_mean0.00299879259096052
sim_compute_sim_state_median0.0029674609502156573
sim_compute_sim_state_min0.00292725799497494
sim_physics_max0.05672916258224333
sim_physics_mean0.055573009024841705
sim_physics_median0.05544260160519126
sim_physics_min0.05478223403294881
sim_render-ego_max0.0072673763891663214
sim_render-ego_mean0.007187536428541909
sim_render-ego_median0.00718794161813301
sim_render-ego_min0.007107656510149846
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.160000000000007
survival_time_min4.94999999999999
No reset possible
262714653Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4146648730882997
survival_time_median1.1000000000000003
deviation-center-line_median0.07328904534465618
in-drivable-lane_median0


other stats
agent_compute-ego_max0.033329294573876164
agent_compute-ego_mean0.022432552906527937
agent_compute-ego_median0.017328706654635342
agent_compute-ego_min0.015780350741218117
deviation-center-line_max0.0986364762491484
deviation-center-line_mean0.07552417462771696
deviation-center-line_min0.06247582516977083
deviation-heading_max0.3632425992535491
deviation-heading_mean0.29657378612724117
deviation-heading_median0.29542623413938784
deviation-heading_min0.2158392644736687
driven_any_max0.5759926763130936
driven_any_mean0.4204617930296754
driven_any_median0.43003601432204624
driven_any_min0.2942313547187209
driven_lanedir_consec_max0.5574855891825501
driven_lanedir_consec_mean0.4046946252327858
driven_lanedir_consec_min0.28491574279093457
driven_lanedir_max0.5574855891825501
driven_lanedir_mean0.4046946252327858
driven_lanedir_median0.4146648730882997
driven_lanedir_min0.28491574279093457
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.43003601432204624, "sim_physics": 0.0619712309403853, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4146648730882997, "sim_render-ego": 0.00791523673317649, "in-drivable-lane": 0, "agent_compute-ego": 0.017328706654635342, "deviation-heading": 0.29542623413938784, "set_robot_commands": 0.007213397459550338, "deviation-center-line": 0.06247582516977083, "driven_lanedir_consec": 0.4146648730882997, "sim_compute_sim_state": 0.003843253309076483, "sim_compute_performance-ego": 0.004344463348388672, "sim_compute_robot_state-ego": 0.005348541519858621}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2942313547187209, "sim_physics": 0.06274986267089844, "survival_time": 0.8500000000000002, "driven_lanedir": 0.28491574279093457, "sim_render-ego": 0.007402518216301413, "in-drivable-lane": 0, "agent_compute-ego": 0.015780350741218117, "deviation-heading": 0.2158392644736687, "set_robot_commands": 0.006420738556805779, "deviation-center-line": 0.07328904534465618, "driven_lanedir_consec": 0.28491574279093457, "sim_compute_sim_state": 0.003496534684125115, "sim_compute_performance-ego": 0.004126478643978343, "sim_compute_robot_state-ego": 0.00507964807398179}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5759926763130936, "sim_physics": 0.05970157346417827, "survival_time": 1.5500000000000007, "driven_lanedir": 0.5574855891825501, "sim_render-ego": 0.007056190121558404, "in-drivable-lane": 0, "agent_compute-ego": 0.01631419120296355, "deviation-heading": 0.3272751256843156, "set_robot_commands": 0.006931289549796812, "deviation-center-line": 0.0986364762491484, "driven_lanedir_consec": 0.5574855891825501, "sim_compute_sim_state": 0.0035552901606405933, "sim_compute_performance-ego": 0.003954164443477508, "sim_compute_robot_state-ego": 0.005094182106756395}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4330686296004164, "sim_physics": 0.05937051773071289, "survival_time": 1.5500000000000007, "driven_lanedir": 0.4179678758591787, "sim_render-ego": 0.011235598594911637, "in-drivable-lane": 0, "agent_compute-ego": 0.033329294573876164, "deviation-heading": 0.2810857070852846, "set_robot_commands": 0.004935187678183278, "deviation-center-line": 0.06665666521708537, "driven_lanedir_consec": 0.4179678758591787, "sim_compute_sim_state": 0.0029862388487785093, "sim_compute_performance-ego": 0.003999202482161983, "sim_compute_robot_state-ego": 0.005079777010025517}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36898029019409967, "sim_physics": 0.06264826384457675, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3484390452429662, "sim_render-ego": 0.007334785027937455, "in-drivable-lane": 0, "agent_compute-ego": 0.02941022135994651, "deviation-heading": 0.3632425992535491, "set_robot_commands": 0.005166216330094771, "deviation-center-line": 0.07656286115792406, "driven_lanedir_consec": 0.3484390452429662, "sim_compute_sim_state": 0.00299924070184881, "sim_compute_performance-ego": 0.0039813952012495565, "sim_compute_robot_state-ego": 0.004969813606955789}}
set_robot_commands_max0.007213397459550338
set_robot_commands_mean0.0061333659148861954
set_robot_commands_median0.006420738556805779
set_robot_commands_min0.004935187678183278
sim_compute_performance-ego_max0.004344463348388672
sim_compute_performance-ego_mean0.0040811408238512125
sim_compute_performance-ego_median0.003999202482161983
sim_compute_performance-ego_min0.003954164443477508
sim_compute_robot_state-ego_max0.005348541519858621
sim_compute_robot_state-ego_mean0.005114392463515622
sim_compute_robot_state-ego_median0.005079777010025517
sim_compute_robot_state-ego_min0.004969813606955789
sim_compute_sim_state_max0.003843253309076483
sim_compute_sim_state_mean0.0033761115408939024
sim_compute_sim_state_median0.003496534684125115
sim_compute_sim_state_min0.0029862388487785093
sim_physics_max0.06274986267089844
sim_physics_mean0.061288289730150325
sim_physics_median0.0619712309403853
sim_physics_min0.05937051773071289
sim_render-ego_max0.011235598594911637
sim_render-ego_mean0.00818886573877708
sim_render-ego_median0.007402518216301413
sim_render-ego_min0.007056190121558404
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.2300000000000006
survival_time_min0.8500000000000002
No reset possible
262424634Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:00:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
262394631César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 137, in on_received_get_commands
               ||     if math.fabs(s_angle)<=10 and math.fabs(s_angle)>0:
               || NameError: name 's_angle' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
262324626César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:00:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
262294624César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:00:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
262174619Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:03:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 94 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261934443Bea Baselines 🐤straightaido3-LFV-real-validationeval0-videoserrornoip-172-31-35-218-104900:01:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261834609César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261794607Rey Wiyatno 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:03:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 43 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261744605César Vidarte 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.013846892576951248
agent_compute-ego_mean0.01349414302060421
agent_compute-ego_median0.0135298490524292
agent_compute-ego_min0.0131912301568424
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.06040078860062819, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.007251184720259447, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.013846892576951248, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.0051034368001497705, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.002793390017289382, "sim_compute_performance-ego": 0.004274294926570012, "sim_compute_robot_state-ego": 0.005005451349111704}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06397703886032105, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.0072152972221374515, "in-drivable-lane": 0, "agent_compute-ego": 0.0135298490524292, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.004941177368164062, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.0028734683990478517, "sim_compute_performance-ego": 0.0039888501167297365, "sim_compute_robot_state-ego": 0.0051621198654174805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.06062297961291145, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.007238072507521685, "in-drivable-lane": 0, "agent_compute-ego": 0.0131912301568424, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.005102746626910041, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.0027913626502541933, "sim_compute_performance-ego": 0.003976324025322409, "sim_compute_robot_state-ego": 0.005129786098704618}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.05654541781691254, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.007168730751412814, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.01333311737560835, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.00494026746906218, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.0028423442215215963, "sim_compute_performance-ego": 0.003988891351418417, "sim_compute_robot_state-ego": 0.0049355577249996}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.060396801341663704, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.007323297587308017, "in-drivable-lane": 0, "agent_compute-ego": 0.013569625941189852, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.004848111759532581, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.002821272069757635, "sim_compute_performance-ego": 0.0039575533433394, "sim_compute_robot_state-ego": 0.00515117428519509}}
set_robot_commands_max0.0051034368001497705
set_robot_commands_mean0.004987148004763727
set_robot_commands_median0.004941177368164062
set_robot_commands_min0.004848111759532581
sim_compute_performance-ego_max0.004274294926570012
sim_compute_performance-ego_mean0.004037182752675996
sim_compute_performance-ego_median0.0039888501167297365
sim_compute_performance-ego_min0.0039575533433394
sim_compute_robot_state-ego_max0.0051621198654174805
sim_compute_robot_state-ego_mean0.005076817864685699
sim_compute_robot_state-ego_median0.005129786098704618
sim_compute_robot_state-ego_min0.0049355577249996
sim_compute_sim_state_max0.0028734683990478517
sim_compute_sim_state_mean0.0028243674715741317
sim_compute_sim_state_median0.002821272069757635
sim_compute_sim_state_min0.0027913626502541933
sim_physics_max0.06397703886032105
sim_physics_mean0.060388605246487384
sim_physics_median0.06040078860062819
sim_physics_min0.05654541781691254
sim_render-ego_max0.007323297587308017
sim_render-ego_mean0.007239316557727882
sim_render-ego_median0.007238072507521685
sim_render-ego_min0.007168730751412814
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
261714603Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.891594875676193
survival_time_median2.799999999999998
deviation-center-line_median0.16497448247747812
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.021889949838320415
agent_compute-ego_mean0.021126290445495587
agent_compute-ego_median0.021023396934781755
agent_compute-ego_min0.020318129857381184
deviation-center-line_max0.3043659211882136
deviation-center-line_mean0.18311143100884028
deviation-center-line_min0.04803165188600541
deviation-heading_max1.482828326197424
deviation-heading_mean0.9613431372429222
deviation-heading_median0.8985838603683955
deviation-heading_min0.29521897269636127
driven_any_max2.8472508839780493
driven_any_mean1.3069100996034515
driven_any_median0.9712587980967968
driven_any_min0.38319913662472416
driven_lanedir_consec_max1.3935014147980245
driven_lanedir_consec_mean0.9450211919489232
driven_lanedir_consec_min0.3321373672289145
driven_lanedir_max1.3935014147980245
driven_lanedir_mean0.9450211919489232
driven_lanedir_median0.891594875676193
driven_lanedir_min0.3321373672289145
in-drivable-lane_max3.4999999999999876
in-drivable-lane_mean0.7199999999999974
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9712587980967968, "sim_physics": 0.056645716939653666, "survival_time": 2.799999999999998, "driven_lanedir": 0.891594875676193, "sim_render-ego": 0.0071620941162109375, "in-drivable-lane": 0, "agent_compute-ego": 0.021023396934781755, "deviation-heading": 0.8985838603683955, "set_robot_commands": 0.005005338362285069, "deviation-center-line": 0.16497448247747812, "driven_lanedir_consec": 0.891594875676193, "sim_compute_sim_state": 0.0027874154703957693, "sim_compute_performance-ego": 0.004196609769548688, "sim_compute_robot_state-ego": 0.004976340702601841}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9379602182088056, "sim_physics": 0.05527415374914805, "survival_time": 2.3999999999999995, "driven_lanedir": 0.8868306977982467, "sim_render-ego": 0.007082770268122355, "in-drivable-lane": 0, "agent_compute-ego": 0.021889949838320415, "deviation-heading": 0.6891869180034811, "set_robot_commands": 0.005002910892168681, "deviation-center-line": 0.15704292238636983, "driven_lanedir_consec": 0.8868306977982467, "sim_compute_sim_state": 0.0027672400077184043, "sim_compute_performance-ego": 0.003968204061190288, "sim_compute_robot_state-ego": 0.005059172709782918}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.8472508839780493, "sim_physics": 0.0525135866800944, "survival_time": 7.499999999999981, "driven_lanedir": 1.3935014147980245, "sim_render-ego": 0.0070488293965657554, "in-drivable-lane": 3.4999999999999876, "agent_compute-ego": 0.02070646603902181, "deviation-heading": 1.4408976089489494, "set_robot_commands": 0.005009140968322754, "deviation-center-line": 0.3043659211882136, "driven_lanedir_consec": 1.3935014147980245, "sim_compute_sim_state": 0.002805015246073405, "sim_compute_performance-ego": 0.003990753491719564, "sim_compute_robot_state-ego": 0.004947816530863444}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.38319913662472416, "sim_physics": 0.057662984599237854, "survival_time": 1.1500000000000004, "driven_lanedir": 0.3321373672289145, "sim_render-ego": 0.007158704425977624, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.021693509557972782, "deviation-heading": 0.29521897269636127, "set_robot_commands": 0.004985166632610819, "deviation-center-line": 0.04803165188600541, "driven_lanedir_consec": 0.3321373672289145, "sim_compute_sim_state": 0.002813546553902004, "sim_compute_performance-ego": 0.004003307093744693, "sim_compute_robot_state-ego": 0.0049349743386973505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3948814611088831, "sim_physics": 0.05494838078816732, "survival_time": 3.7499999999999942, "driven_lanedir": 1.2210416042432362, "sim_render-ego": 0.0086455504099528, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.020318129857381184, "deviation-heading": 1.482828326197424, "set_robot_commands": 0.005020739237467448, "deviation-center-line": 0.24114217710613456, "driven_lanedir_consec": 1.2210416042432362, "sim_compute_sim_state": 0.0028255176544189453, "sim_compute_performance-ego": 0.004015665054321289, "sim_compute_robot_state-ego": 0.004927778244018554}}
set_robot_commands_max0.005020739237467448
set_robot_commands_mean0.005004659218570954
set_robot_commands_median0.005005338362285069
set_robot_commands_min0.004985166632610819
sim_compute_performance-ego_max0.004196609769548688
sim_compute_performance-ego_mean0.004034907894104904
sim_compute_performance-ego_median0.004003307093744693
sim_compute_performance-ego_min0.003968204061190288
sim_compute_robot_state-ego_max0.005059172709782918
sim_compute_robot_state-ego_mean0.004969216505192822
sim_compute_robot_state-ego_median0.004947816530863444
sim_compute_robot_state-ego_min0.004927778244018554
sim_compute_sim_state_max0.0028255176544189453
sim_compute_sim_state_mean0.0027997469865017055
sim_compute_sim_state_median0.002805015246073405
sim_compute_sim_state_min0.0027672400077184043
sim_physics_max0.057662984599237854
sim_physics_mean0.05540896455126025
sim_physics_median0.05527415374914805
sim_physics_min0.0525135866800944
sim_render-ego_max0.0086455504099528
sim_render-ego_mean0.007419589723365894
sim_render-ego_median0.007158704425977624
sim_render-ego_min0.0070488293965657554
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean3.5199999999999947
survival_time_min1.1500000000000004
No reset possible
261534595Moustafa Elarabichallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:01:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 52, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 48, in compute_action
               ||     action = self.model.predict(observation)
               ||   File "/workspace/model.py", line 40, in predict
               ||     output = self.model(state).cpu().data.numpy().flatten()
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/usr/local/lib/python3.7/site-packages/torchvision/models/squeezenet.py", line 100, in forward
               ||     x = self.features(x)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/container.py", line 92, in forward
               ||     input = module(input)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 345, in forward
               ||     return self.conv2d_forward(input, self.weight)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 342, in conv2d_forward
               ||     self.padding, self.dilation, self.groups)
               || RuntimeError: Expected 4-dimensional input for 4-dimensional weight 64 3 3 3, but got 3-dimensional input of size [3, 120, 160] instead
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261384587Rey Wiyatno 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.014177945943979116
agent_compute-ego_mean0.013375881578487353
agent_compute-ego_median0.013211977286416977
agent_compute-ego_min0.013043817351846137
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.05788897092525776, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.007217439321371226, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.014177945943979116, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.0048613410729628345, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0028122755197378304, "sim_compute_performance-ego": 0.004288311188037579, "sim_compute_robot_state-ego": 0.005121015585385836}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06054785251617432, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.0071669816970825195, "in-drivable-lane": 0, "agent_compute-ego": 0.01310654878616333, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.005172312259674072, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.0027999401092529295, "sim_compute_performance-ego": 0.004028511047363281, "sim_compute_robot_state-ego": 0.005010282993316651}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.05857326703913072, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.0070229628506828755, "in-drivable-lane": 0, "agent_compute-ego": 0.013043817351846137, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.004816139445585363, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.0027438963160795323, "sim_compute_performance-ego": 0.003918844110825483, "sim_compute_robot_state-ego": 0.004937585662393009}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.056626120551687774, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.007107891020227651, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.013211977286416977, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.004998433785360368, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.002786902130627241, "sim_compute_performance-ego": 0.003972432652457816, "sim_compute_robot_state-ego": 0.0049149599231657435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.0621795654296875, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.007185177369551225, "in-drivable-lane": 0, "agent_compute-ego": 0.013339118524031206, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.005016066811301492, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.0027686140754006124, "sim_compute_performance-ego": 0.003944927995855158, "sim_compute_robot_state-ego": 0.004917892542752353}}
set_robot_commands_max0.005172312259674072
set_robot_commands_mean0.004972858674976826
set_robot_commands_median0.004998433785360368
set_robot_commands_min0.004816139445585363
sim_compute_performance-ego_max0.004288311188037579
sim_compute_performance-ego_mean0.004030605398907863
sim_compute_performance-ego_median0.003972432652457816
sim_compute_performance-ego_min0.003918844110825483
sim_compute_robot_state-ego_max0.005121015585385836
sim_compute_robot_state-ego_mean0.004980347341402718
sim_compute_robot_state-ego_median0.004937585662393009
sim_compute_robot_state-ego_min0.0049149599231657435
sim_compute_sim_state_max0.0028122755197378304
sim_compute_sim_state_mean0.002782325630219629
sim_compute_sim_state_median0.002786902130627241
sim_compute_sim_state_min0.0027438963160795323
sim_physics_max0.0621795654296875
sim_physics_mean0.059163155292387616
sim_physics_median0.05857326703913072
sim_physics_min0.056626120551687774
sim_render-ego_max0.007217439321371226
sim_render-ego_mean0.007140090451783099
sim_render-ego_median0.0071669816970825195
sim_render-ego_min0.0070229628506828755
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
261234580Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
261174552Robert Moni 🇭🇺kaland-22405aido3-LF-real-validationeval0-visualizeabortednoip-172-31-35-218-104900:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.0247114760411522
survival_time15.3333
deviation-center-line0.6412809931489692
in-drivable-lane7.9998999999999985


other stats
deviation-heading3.6373921000458975
driven_any2.344012576621329
driven_lanedir1.0247114760411522
visualized-eval0-passed1
No reset possible
261014576Abderrahim Khalifa 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2753531821363662
survival_time_median10.350000000000012
deviation-center-line_median0.4600414052027927
in-drivable-lane_median0


other stats
agent_compute-ego_max0.017058803577615758
agent_compute-ego_mean0.016516661622245254
agent_compute-ego_median0.01631280048164779
agent_compute-ego_min0.016061105589935745
deviation-center-line_max0.6776758285847488
deviation-center-line_mean0.45035827662903094
deviation-center-line_min0.17301936439978563
deviation-heading_max2.7275127059597426
deviation-heading_mean1.7906621496455304
deviation-heading_median1.9412046707844148
deviation-heading_min0.9342083163577982
driven_any_max2.349119039042834
driven_any_mean1.5728900917822877
driven_any_median1.6097198055816055
driven_any_min0.7342313010635768
driven_lanedir_consec_max2.298180141923262
driven_lanedir_consec_mean1.4694371794220378
driven_lanedir_consec_min0.6926845591951831
driven_lanedir_max2.298180141923262
driven_lanedir_mean1.482637250048615
driven_lanedir_median1.3379135237390305
driven_lanedir_min0.6926845591951831
in-drivable-lane_max1.200000000000017
in-drivable-lane_mean0.27000000000000385
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7342313010635768, "sim_physics": 0.0611995928215258, "survival_time": 4.94999999999999, "driven_lanedir": 0.6926845591951831, "sim_render-ego": 0.007511976993445194, "in-drivable-lane": 0, "agent_compute-ego": 0.017058803577615758, "deviation-heading": 1.1726931949342885, "set_robot_commands": 0.007474456170592645, "deviation-center-line": 0.17301936439978563, "driven_lanedir_consec": 0.6926845591951831, "sim_compute_sim_state": 0.003661124393193409, "sim_compute_performance-ego": 0.004261958478677152, "sim_compute_robot_state-ego": 0.005644831994567254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8830249740273497, "sim_physics": 0.06088229234782492, "survival_time": 12.050000000000036, "driven_lanedir": 1.809054843249232, "sim_render-ego": 0.007487752130912052, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.016251407718262733, "deviation-heading": 1.9412046707844148, "set_robot_commands": 0.007393879514512184, "deviation-center-line": 0.4600414052027927, "driven_lanedir_consec": 1.809054843249232, "sim_compute_sim_state": 0.003713871928171498, "sim_compute_performance-ego": 0.0043190138963248225, "sim_compute_robot_state-ego": 0.00539426585945351}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6097198055816055, "sim_physics": 0.05889802508884006, "survival_time": 10.350000000000012, "driven_lanedir": 1.3379135237390305, "sim_render-ego": 0.007408271089268191, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.016061105589935745, "deviation-heading": 2.1776918601914073, "set_robot_commands": 0.007263628181052093, "deviation-center-line": 0.6776758285847488, "driven_lanedir_consec": 1.271913170606145, "sim_compute_sim_state": 0.0036727011491711017, "sim_compute_performance-ego": 0.004225732047776669, "sim_compute_robot_state-ego": 0.005322560020115065}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.288355339196073, "sim_physics": 0.05887535232269835, "survival_time": 8.349999999999984, "driven_lanedir": 1.2753531821363662, "sim_render-ego": 0.007431123071088048, "in-drivable-lane": 0, "agent_compute-ego": 0.01631280048164779, "deviation-heading": 0.9342083163577982, "set_robot_commands": 0.007064443862366819, "deviation-center-line": 0.5056111430864694, "driven_lanedir_consec": 1.2753531821363662, "sim_compute_sim_state": 0.003717950718131608, "sim_compute_performance-ego": 0.004235701646633491, "sim_compute_robot_state-ego": 0.005269144823451242}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349119039042834, "sim_physics": 0.05873972813288371, "survival_time": 14.950000000000076, "driven_lanedir": 2.298180141923262, "sim_render-ego": 0.007404376665751139, "in-drivable-lane": 0, "agent_compute-ego": 0.016899190743764243, "deviation-heading": 2.7275127059597426, "set_robot_commands": 0.007499837080637614, "deviation-center-line": 0.435443641871358, "driven_lanedir_consec": 2.298180141923262, "sim_compute_sim_state": 0.003718685309092204, "sim_compute_performance-ego": 0.004281791845957438, "sim_compute_robot_state-ego": 0.005361368656158447}}
set_robot_commands_max0.007499837080637614
set_robot_commands_mean0.007339248961832271
set_robot_commands_median0.007393879514512184
set_robot_commands_min0.007064443862366819
sim_compute_performance-ego_max0.0043190138963248225
sim_compute_performance-ego_mean0.004264839583073915
sim_compute_performance-ego_median0.004261958478677152
sim_compute_performance-ego_min0.004225732047776669
sim_compute_robot_state-ego_max0.005644831994567254
sim_compute_robot_state-ego_mean0.0053984342707491025
sim_compute_robot_state-ego_median0.005361368656158447
sim_compute_robot_state-ego_min0.005269144823451242
sim_compute_sim_state_max0.003718685309092204
sim_compute_sim_state_mean0.003696866699551964
sim_compute_sim_state_median0.003713871928171498
sim_compute_sim_state_min0.003661124393193409
sim_physics_max0.0611995928215258
sim_physics_mean0.059718998142754574
sim_physics_median0.05889802508884006
sim_physics_min0.05873972813288371
sim_render-ego_max0.007511976993445194
sim_render-ego_mean0.007448699990092925
sim_render-ego_median0.007431123071088048
sim_render-ego_min0.007404376665751139
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.13000000000002
survival_time_min4.94999999999999
No reset possible
260774573Mikita Sazanovich 🇷🇺chameleon-3aido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:13:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.232595857798085
survival_time_median14.950000000000076
deviation-center-line_median0.9119579891492924
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.1742775551478068
agent_compute-ego_mean0.17156375788616876
agent_compute-ego_median0.1720756737391154
agent_compute-ego_min0.16792944113413494
deviation-center-line_max0.9243841035838366
deviation-center-line_mean0.7911236846957832
deviation-center-line_min0.45032111699566457
deviation-heading_max3.3942345374782588
deviation-heading_mean2.8002450573063387
deviation-heading_median3.1275756675374544
deviation-heading_min1.782416600930299
driven_any_max4.523215683770542
driven_any_mean3.8691308688359056
driven_any_median4.385461902647249
driven_any_min2.0290874139890103
driven_lanedir_consec_max4.403601799199776
driven_lanedir_consec_mean3.612650718775863
driven_lanedir_consec_min1.928733927545888
driven_lanedir_max4.403601799199776
driven_lanedir_mean3.612650718775863
driven_lanedir_median4.232595857798085
driven_lanedir_min1.928733927545888
in-drivable-lane_max2.6500000000000092
in-drivable-lane_mean0.6700000000000037
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0290874139890103, "sim_physics": 0.05831017186564784, "survival_time": 7.7499999999999805, "driven_lanedir": 1.928733927545888, "sim_render-ego": 0.007094821622294765, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.17312078629770586, "deviation-heading": 1.782416600930299, "set_robot_commands": 0.005015893136301348, "deviation-center-line": 0.45032111699566457, "driven_lanedir_consec": 1.928733927545888, "sim_compute_sim_state": 0.002981998074439264, "sim_compute_performance-ego": 0.004154751377720986, "sim_compute_robot_state-ego": 0.005022604234756962}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.890162341196001, "sim_physics": 0.05711525042851766, "survival_time": 14.950000000000076, "driven_lanedir": 3.190911893847552, "sim_render-ego": 0.007049150466918945, "in-drivable-lane": 2.6500000000000092, "agent_compute-ego": 0.1720756737391154, "deviation-heading": 3.3942345374782588, "set_robot_commands": 0.005014615058898926, "deviation-center-line": 0.9119579891492924, "driven_lanedir_consec": 3.190911893847552, "sim_compute_sim_state": 0.002974518934885661, "sim_compute_performance-ego": 0.003993386427561442, "sim_compute_robot_state-ego": 0.005021145343780517}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.385461902647249, "sim_physics": 0.05655909220377604, "survival_time": 14.950000000000076, "driven_lanedir": 4.232595857798085, "sim_render-ego": 0.00703345775604248, "in-drivable-lane": 0, "agent_compute-ego": 0.1742775551478068, "deviation-heading": 3.15678196019884, "set_robot_commands": 0.0050338657697041825, "deviation-center-line": 0.9243841035838366, "driven_lanedir_consec": 4.232595857798085, "sim_compute_sim_state": 0.002987085978190104, "sim_compute_performance-ego": 0.004023933410644531, "sim_compute_robot_state-ego": 0.005042734940846761}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.523215683770542, "sim_physics": 0.05845211426417033, "survival_time": 14.950000000000076, "driven_lanedir": 4.307410115488014, "sim_render-ego": 0.007003432909647624, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.1704153331120809, "deviation-heading": 3.1275756675374544, "set_robot_commands": 0.0049847133954366045, "deviation-center-line": 0.9182893086998968, "driven_lanedir_consec": 4.307410115488014, "sim_compute_sim_state": 0.002954181035359701, "sim_compute_performance-ego": 0.003967824776967366, "sim_compute_robot_state-ego": 0.005002177556355794}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.517727002576726, "sim_physics": 0.056076446374257405, "survival_time": 14.950000000000076, "driven_lanedir": 4.403601799199776, "sim_render-ego": 0.007014686266581217, "in-drivable-lane": 0, "agent_compute-ego": 0.16792944113413494, "deviation-heading": 2.5402165203868425, "set_robot_commands": 0.004968117872873942, "deviation-center-line": 0.7506659050502265, "driven_lanedir_consec": 4.403601799199776, "sim_compute_sim_state": 0.0029114381472269695, "sim_compute_performance-ego": 0.003950467904408773, "sim_compute_robot_state-ego": 0.0049617592493693035}}
set_robot_commands_max0.0050338657697041825
set_robot_commands_mean0.005003441046643
set_robot_commands_median0.005014615058898926
set_robot_commands_min0.004968117872873942
sim_compute_performance-ego_max0.004154751377720986
sim_compute_performance-ego_mean0.0040180727794606194
sim_compute_performance-ego_median0.003993386427561442
sim_compute_performance-ego_min0.003950467904408773
sim_compute_robot_state-ego_max0.005042734940846761
sim_compute_robot_state-ego_mean0.005010084265021868
sim_compute_robot_state-ego_median0.005021145343780517
sim_compute_robot_state-ego_min0.0049617592493693035
sim_compute_sim_state_max0.002987085978190104
sim_compute_sim_state_mean0.00296184443402034
sim_compute_sim_state_median0.002974518934885661
sim_compute_sim_state_min0.0029114381472269695
sim_physics_max0.05845211426417033
sim_physics_mean0.05730261502727385
sim_physics_median0.05711525042851766
sim_physics_min0.056076446374257405
sim_render-ego_max0.007094821622294765
sim_render-ego_mean0.007039109804297006
sim_render-ego_median0.00703345775604248
sim_render-ego_min0.007003432909647624
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.510000000000057
survival_time_min7.7499999999999805
No reset possible
260504568Tobi Carvalho 🇨🇦pp-ftwaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2827336771110347
survival_time_median14.950000000000076
deviation-center-line_median0.34837571831441466
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0164668337504069
agent_compute-ego_mean0.01618386427561442
agent_compute-ego_median0.016197118759155273
agent_compute-ego_min0.015790253480275473
deviation-center-line_max0.6446434236362684
deviation-center-line_mean0.37545904571771704
deviation-center-line_min0.2479852046750654
deviation-heading_max3.1458190986049597
deviation-heading_mean2.19500185578781
deviation-heading_median2.063161304845502
deviation-heading_min1.6126557860771733
driven_any_max2.32469162111011
driven_any_mean2.313541492419705
driven_any_median2.311467230968898
driven_any_min2.3015711307887887
driven_lanedir_consec_max2.288045737472306
driven_lanedir_consec_mean2.2698735559747028
driven_lanedir_consec_min2.2134483599858523
driven_lanedir_max2.288045737472306
driven_lanedir_mean2.2698735559747028
driven_lanedir_median2.2827336771110347
driven_lanedir_min2.2134483599858523
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.318758291649562, "sim_physics": 0.05716036955515544, "survival_time": 14.950000000000076, "driven_lanedir": 2.2830150201681763, "sim_render-ego": 0.007368190288543701, "in-drivable-lane": 0, "agent_compute-ego": 0.0164668337504069, "deviation-heading": 2.063161304845502, "set_robot_commands": 0.007603517373402913, "deviation-center-line": 0.34837571831441466, "driven_lanedir_consec": 2.2830150201681763, "sim_compute_sim_state": 0.0037412198384602865, "sim_compute_performance-ego": 0.004367080529530843, "sim_compute_robot_state-ego": 0.0052777290344238285}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3015711307887887, "sim_physics": 0.05820940732955933, "survival_time": 14.950000000000076, "driven_lanedir": 2.282124985136145, "sim_render-ego": 0.007492508093516032, "in-drivable-lane": 0, "agent_compute-ego": 0.016294538180033367, "deviation-heading": 1.6126557860771733, "set_robot_commands": 0.007311604022979736, "deviation-center-line": 0.34936304160564446, "driven_lanedir_consec": 2.282124985136145, "sim_compute_sim_state": 0.0038231293360392257, "sim_compute_performance-ego": 0.004304961363474528, "sim_compute_robot_state-ego": 0.005346417427062988}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3112191875811647, "sim_physics": 0.058278793493906654, "survival_time": 14.950000000000076, "driven_lanedir": 2.2134483599858523, "sim_render-ego": 0.007413475513458252, "in-drivable-lane": 0, "agent_compute-ego": 0.015790253480275473, "deviation-heading": 3.1458190986049597, "set_robot_commands": 0.007202522754669189, "deviation-center-line": 0.6446434236362684, "driven_lanedir_consec": 2.2134483599858523, "sim_compute_sim_state": 0.003536328474680582, "sim_compute_performance-ego": 0.0042591587702433265, "sim_compute_robot_state-ego": 0.005281735261281332}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.311467230968898, "sim_physics": 0.05950326840082804, "survival_time": 14.950000000000076, "driven_lanedir": 2.2827336771110347, "sim_render-ego": 0.007421883742014567, "in-drivable-lane": 0, "agent_compute-ego": 0.016197118759155273, "deviation-heading": 1.8945580013346224, "set_robot_commands": 0.007167905966440837, "deviation-center-line": 0.2479852046750654, "driven_lanedir_consec": 2.2827336771110347, "sim_compute_sim_state": 0.0037091628710428873, "sim_compute_performance-ego": 0.004228670597076416, "sim_compute_robot_state-ego": 0.005250488917032878}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.32469162111011, "sim_physics": 0.05974296490351359, "survival_time": 14.950000000000076, "driven_lanedir": 2.288045737472306, "sim_render-ego": 0.007441435654958089, "in-drivable-lane": 0, "agent_compute-ego": 0.01617057720820109, "deviation-heading": 2.258815088076792, "set_robot_commands": 0.007321556409200032, "deviation-center-line": 0.28692784035719243, "driven_lanedir_consec": 2.288045737472306, "sim_compute_sim_state": 0.003793210983276367, "sim_compute_performance-ego": 0.004282321929931641, "sim_compute_robot_state-ego": 0.00533782164255778}}
set_robot_commands_max0.007603517373402913
set_robot_commands_mean0.007321421305338541
set_robot_commands_median0.007311604022979736
set_robot_commands_min0.007167905966440837
sim_compute_performance-ego_max0.004367080529530843
sim_compute_performance-ego_mean0.004288438638051352
sim_compute_performance-ego_median0.004282321929931641
sim_compute_performance-ego_min0.004228670597076416
sim_compute_robot_state-ego_max0.005346417427062988
sim_compute_robot_state-ego_mean0.005298838456471762
sim_compute_robot_state-ego_median0.005281735261281332
sim_compute_robot_state-ego_min0.005250488917032878
sim_compute_sim_state_max0.0038231293360392257
sim_compute_sim_state_mean0.0037206103006998696
sim_compute_sim_state_median0.0037412198384602865
sim_compute_sim_state_min0.003536328474680582
sim_physics_max0.05974296490351359
sim_physics_mean0.05857896073659261
sim_physics_median0.058278793493906654
sim_physics_min0.05716036955515544
sim_render-ego_max0.007492508093516032
sim_render-ego_mean0.007427498658498129
sim_render-ego_median0.007421883742014567
sim_render-ego_min0.007368190288543701
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
260424379Soroush Saryazdi 🇨🇦bluejayaido3-LF-real-validationeval2-visualizesuccessnoip-172-31-35-218-104900:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.35435770033896685
survival_time4
deviation-center-line0.09913268202836502
in-drivable-lane2.6667


other stats
deviation-heading0.5259492419977168
driven_any0.9914649779988648
driven_lanedir0.35435770033896685
visualized-eval2-passed1
No reset possible
259194532Riza Velioglu 🇩🇪UniBielefeld-#1aido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.75037622777923
survival_time_median14.950000000000076
deviation-center-line_median0.4426231990173616
in-drivable-lane_median3.500000000000009


other stats
agent_compute-ego_max0.06532036678211109
agent_compute-ego_mean0.06319328905700676
agent_compute-ego_median0.06256364425023397
agent_compute-ego_min0.06235287816900956
deviation-center-line_max0.733013140287303
deviation-center-line_mean0.4661753379104274
deviation-center-line_min0.201905490511177
deviation-heading_max2.351016920108459
deviation-heading_mean1.6526726929497588
deviation-heading_median1.843118537039841
deviation-heading_min0.6348564092729776
driven_any_max4.260741444263651
driven_any_mean3.0175678969656965
driven_any_median3.6114007669531007
driven_any_min1.0702645560406967
driven_lanedir_consec_max3.6111206982855584
driven_lanedir_consec_mean2.3405823129915584
driven_lanedir_consec_min0.841548259728677
driven_lanedir_max3.6111206982855584
driven_lanedir_mean2.3405823129915584
driven_lanedir_median2.75037622777923
driven_lanedir_min0.841548259728677
in-drivable-lane_max4.500000000000059
in-drivable-lane_mean3.1700000000000186
in-drivable-lane_min1.0499999999999965
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.22896987469296, "sim_physics": 0.056392959646276525, "survival_time": 9.249999999999996, "driven_lanedir": 1.469218584003628, "sim_render-ego": 0.00699350253955738, "in-drivable-lane": 3.500000000000009, "agent_compute-ego": 0.06532036678211109, "deviation-heading": 1.569794151873786, "set_robot_commands": 0.005094463760788376, "deviation-center-line": 0.4197495826547882, "driven_lanedir_consec": 1.469218584003628, "sim_compute_sim_state": 0.0029663176149935335, "sim_compute_performance-ego": 0.004130188194481102, "sim_compute_robot_state-ego": 0.00508714366603542}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6114007669531007, "sim_physics": 0.05467114766438802, "survival_time": 14.950000000000076, "driven_lanedir": 2.75037622777923, "sim_render-ego": 0.007020153999328613, "in-drivable-lane": 4.000000000000025, "agent_compute-ego": 0.06256364425023397, "deviation-heading": 2.351016920108459, "set_robot_commands": 0.005109434127807617, "deviation-center-line": 0.733013140287303, "driven_lanedir_consec": 2.75037622777923, "sim_compute_sim_state": 0.0029334513346354167, "sim_compute_performance-ego": 0.004003359476725261, "sim_compute_robot_state-ego": 0.005005041758219401}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0702645560406967, "sim_physics": 0.055868045907271534, "survival_time": 4.749999999999991, "driven_lanedir": 0.841548259728677, "sim_render-ego": 0.007158324592991879, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.06235287816900956, "deviation-heading": 0.6348564092729776, "set_robot_commands": 0.005052393361141807, "deviation-center-line": 0.201905490511177, "driven_lanedir_consec": 0.841548259728677, "sim_compute_sim_state": 0.002953243255615234, "sim_compute_performance-ego": 0.004108833011827971, "sim_compute_robot_state-ego": 0.0050436948475084805}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.260741444263651, "sim_physics": 0.05435327768325806, "survival_time": 14.950000000000076, "driven_lanedir": 3.6111206982855584, "sim_render-ego": 0.0070303567250569665, "in-drivable-lane": 2.8000000000000043, "agent_compute-ego": 0.06251050710678101, "deviation-heading": 1.864577446453731, "set_robot_commands": 0.0050777864456176755, "deviation-center-line": 0.5335852770815075, "driven_lanedir_consec": 3.6111206982855584, "sim_compute_sim_state": 0.002941851615905762, "sim_compute_performance-ego": 0.00402742067972819, "sim_compute_robot_state-ego": 0.0050321221351623535}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.916462842878073, "sim_physics": 0.054707380135854085, "survival_time": 14.950000000000076, "driven_lanedir": 3.0306477951606983, "sim_render-ego": 0.007081276575724284, "in-drivable-lane": 4.500000000000059, "agent_compute-ego": 0.06321904897689819, "deviation-heading": 1.843118537039841, "set_robot_commands": 0.005041645367940267, "deviation-center-line": 0.4426231990173616, "driven_lanedir_consec": 3.0306477951606983, "sim_compute_sim_state": 0.0029341769218444824, "sim_compute_performance-ego": 0.004030311107635498, "sim_compute_robot_state-ego": 0.005032459894816081}}
set_robot_commands_max0.005109434127807617
set_robot_commands_mean0.005075144612659148
set_robot_commands_median0.0050777864456176755
set_robot_commands_min0.005041645367940267
sim_compute_performance-ego_max0.004130188194481102
sim_compute_performance-ego_mean0.004060022494079604
sim_compute_performance-ego_median0.004030311107635498
sim_compute_performance-ego_min0.004003359476725261
sim_compute_robot_state-ego_max0.00508714366603542
sim_compute_robot_state-ego_mean0.0050400924603483475
sim_compute_robot_state-ego_median0.005032459894816081
sim_compute_robot_state-ego_min0.005005041758219401
sim_compute_sim_state_max0.0029663176149935335
sim_compute_sim_state_mean0.0029458081485988856
sim_compute_sim_state_median0.002941851615905762
sim_compute_sim_state_min0.0029334513346354167
sim_physics_max0.056392959646276525
sim_physics_mean0.05519856220740965
sim_physics_median0.054707380135854085
sim_physics_min0.05435327768325806
sim_render-ego_max0.007158324592991879
sim_render-ego_mean0.007056722886531824
sim_render-ego_median0.0070303567250569665
sim_render-ego_min0.00699350253955738
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.770000000000044
survival_time_min4.749999999999991
No reset possible
258854244Manfred DiazBaseline-IL-logs-tensorflowaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:50:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.033729372654836665
survival_time_median14.950000000000076
deviation-center-line_median0.717139968998463
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0818131160736084
agent_compute-ego_mean0.052438021765814885
agent_compute-ego_median0.04821594397226969
agent_compute-ego_min0.047643189430236814
deviation-center-line_max1.304162933042565
deviation-center-line_mean0.6379497374999624
deviation-center-line_min0.07922808097072176
deviation-heading_max5.5418244166860555
deviation-heading_mean2.8268830612328033
deviation-heading_median3.324343270796628
deviation-heading_min0.2937456536556281
driven_any_max0.034741540279716765
driven_any_mean0.034306658219445965
driven_any_median0.03452518945479112
driven_any_min0.03328462469252177
driven_lanedir_consec_max0.034708159444901465
driven_lanedir_consec_mean0.03346338819772485
driven_lanedir_consec_min0.03215440961001681
driven_lanedir_max0.034708159444901465
driven_lanedir_mean0.03346338819772485
driven_lanedir_median0.033729372654836665
driven_lanedir_min0.03215440961001681
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.03385899949596259, "sim_physics": 0.2485296686490377, "survival_time": 14.950000000000076, "driven_lanedir": 0.032175679947905156, "sim_render-ego": 0.011385645866394045, "in-drivable-lane": 0, "agent_compute-ego": 0.0818131160736084, "deviation-heading": 4.704153677194991, "set_robot_commands": 0.00972153902053833, "deviation-center-line": 0.1535248590672495, "driven_lanedir_consec": 0.032175679947905156, "sim_compute_sim_state": 0.004553062915802002, "sim_compute_performance-ego": 0.00635275920232137, "sim_compute_robot_state-ego": 0.008537118434906005, "sim_compute_robot_state-npc0": 0.008971384366353353, "sim_compute_robot_state-npc1": 0.007624338467915853, "sim_compute_robot_state-npc2": 0.00750621239344279, "sim_compute_robot_state-npc3": 0.007409966786702474}, "udem1-1-0": {"driven_any": 0.03463033001382942, "sim_physics": 0.1591771674156189, "survival_time": 14.950000000000076, "driven_lanedir": 0.034471366574775786, "sim_render-ego": 0.008794949054718018, "in-drivable-lane": 0, "agent_compute-ego": 0.05801537354787191, "deviation-heading": 1.356248919536492, "set_robot_commands": 0.006800133387247722, "deviation-center-line": 0.7352169086833698, "driven_lanedir_consec": 0.034471366574775786, "sim_compute_sim_state": 0.003604894479115804, "sim_compute_performance-ego": 0.005084287325541178, "sim_compute_robot_state-ego": 0.006421944300333659, "sim_compute_robot_state-npc0": 0.0063484414418538415, "sim_compute_robot_state-npc1": 0.006071019967397054, "sim_compute_robot_state-npc2": 0.006049116452534993, "sim_compute_robot_state-npc3": 0.006020912329355876}, "udem1-2-0": {"driven_any": 0.034703546883749936, "sim_physics": 0.14984665234883626, "survival_time": 14.950000000000076, "driven_lanedir": 0.03381669280177668, "sim_render-ego": 0.008868151505788168, "in-drivable-lane": 0, "agent_compute-ego": 0.059292304515838626, "deviation-heading": 3.3832714627668383, "set_robot_commands": 0.006746639410654703, "deviation-center-line": 1.304162933042565, "driven_lanedir_consec": 0.03381669280177668, "sim_compute_sim_state": 0.0036687151590983074, "sim_compute_performance-ego": 0.005111726919809977, "sim_compute_robot_state-ego": 0.006477741400400797, "sim_compute_robot_state-npc0": 0.0062698896725972494, "sim_compute_robot_state-npc1": 0.006065980593363444, "sim_compute_robot_state-npc2": 0.00605385700861613, "sim_compute_robot_state-npc3": 0.0060260844230651854}, "udem1-3-0": {"driven_any": 0.034509565668245944, "sim_physics": 0.16554173866907756, "survival_time": 14.950000000000076, "driven_lanedir": 0.03215440961001681, "sim_render-ego": 0.008639448483784994, "in-drivable-lane": 0, "agent_compute-ego": 0.058727707068125405, "deviation-heading": 5.5418244166860555, "set_robot_commands": 0.006816205183664958, "deviation-center-line": 0.08684606367433804, "driven_lanedir_consec": 0.03215440961001681, "sim_compute_sim_state": 0.003456151485443115, "sim_compute_performance-ego": 0.004904119968414306, "sim_compute_robot_state-ego": 0.00632010300954183, "sim_compute_robot_state-npc0": 0.0061706002553304036, "sim_compute_robot_state-npc1": 0.005944455464680989, "sim_compute_robot_state-npc2": 0.0058838637669881184, "sim_compute_robot_state-npc3": 0.00592419703801473}, "udem1-4-0": {"driven_any": 0.03390564205760292, "sim_physics": 0.12528902848561604, "survival_time": 14.950000000000076, "driven_lanedir": 0.032293139750104505, "sim_render-ego": 0.00698923667271932, "in-drivable-lane": 0, "agent_compute-ego": 0.04808916489283244, "deviation-heading": 4.634208764459421, "set_robot_commands": 0.004948241710662842, "deviation-center-line": 0.10096006559739563, "driven_lanedir_consec": 0.032293139750104505, "sim_compute_sim_state": 0.002794481118520101, "sim_compute_performance-ego": 0.003914344310760498, "sim_compute_robot_state-ego": 0.004963444073994954, "sim_compute_robot_state-npc0": 0.004800315697987874, "sim_compute_robot_state-npc1": 0.004621749718983968, "sim_compute_robot_state-npc2": 0.004584769407908122, "sim_compute_robot_state-npc3": 0.004590405623118083}, "udem1-5-0": {"driven_any": 0.03328462469252177, "sim_physics": 0.11357234636942544, "survival_time": 14.950000000000076, "driven_lanedir": 0.0328940775980624, "sim_render-ego": 0.006908046404520671, "in-drivable-lane": 0, "agent_compute-ego": 0.047643189430236814, "deviation-heading": 2.222734504836344, "set_robot_commands": 0.004953859647115071, "deviation-center-line": 0.07922808097072176, "driven_lanedir_consec": 0.0328940775980624, "sim_compute_sim_state": 0.0027901323636372885, "sim_compute_performance-ego": 0.0039055848121643064, "sim_compute_robot_state-ego": 0.00495198647181193, "sim_compute_robot_state-npc0": 0.004789271354675293, "sim_compute_robot_state-npc1": 0.0046028757095336915, "sim_compute_robot_state-npc2": 0.004571991761525472, "sim_compute_robot_state-npc3": 0.004584801197052002}, "udem1-6-0": {"driven_any": 0.03467497714143792, "sim_physics": 0.11960129419962565, "survival_time": 14.950000000000076, "driven_lanedir": 0.033828380050780815, "sim_render-ego": 0.006952636241912842, "in-drivable-lane": 0, "agent_compute-ego": 0.04791504780451457, "deviation-heading": 3.324343270796628, "set_robot_commands": 0.004905800819396972, "deviation-center-line": 0.8616937200242658, "driven_lanedir_consec": 0.033828380050780815, "sim_compute_sim_state": 0.002791737715403239, "sim_compute_performance-ego": 0.003933993180592855, "sim_compute_robot_state-ego": 0.004956057866414388, "sim_compute_robot_state-npc0": 0.004758687019348145, "sim_compute_robot_state-npc1": 0.004605457782745361, "sim_compute_robot_state-npc2": 0.00458403746287028, "sim_compute_robot_state-npc3": 0.004569989045461019}, "udem1-7-0": {"driven_any": 0.034741540279716765, "sim_physics": 0.12945573012034098, "survival_time": 14.950000000000076, "driven_lanedir": 0.034708159444901465, "sim_render-ego": 0.007113813559214274, "in-drivable-lane": 0, "agent_compute-ego": 0.04845713853836059, "deviation-heading": 0.6608607976274126, "set_robot_commands": 0.004984316031138102, "deviation-center-line": 0.6292841214245385, "driven_lanedir_consec": 0.034708159444901465, "sim_compute_sim_state": 0.0028217204411824545, "sim_compute_performance-ego": 0.003965780735015869, "sim_compute_robot_state-ego": 0.004975229899088542, "sim_compute_robot_state-npc0": 0.004813355604807536, "sim_compute_robot_state-npc1": 0.004645923773447673, "sim_compute_robot_state-npc2": 0.004623099168141683, "sim_compute_robot_state-npc3": 0.004642923672993978}, "udem1-8-0": {"driven_any": 0.03381978855079681, "sim_physics": 0.10884405215581258, "survival_time": 14.950000000000076, "driven_lanedir": 0.033778043900323684, "sim_render-ego": 0.006882735093434652, "in-drivable-lane": 0, "agent_compute-ego": 0.04789832830429077, "deviation-heading": 0.6873394708043709, "set_robot_commands": 0.004898053805033366, "deviation-center-line": 1.2111525091836248, "driven_lanedir_consec": 0.033778043900323684, "sim_compute_sim_state": 0.0027672139803568523, "sim_compute_performance-ego": 0.0039121874173482256, "sim_compute_robot_state-ego": 0.0049139579137166345, "sim_compute_robot_state-npc0": 0.0047488530476888025, "sim_compute_robot_state-npc1": 0.004586016337076823, "sim_compute_robot_state-npc2": 0.004554165204366048, "sim_compute_robot_state-npc3": 0.004562673568725586}, "udem1-9-0": {"driven_any": 0.03473123175471644, "sim_physics": 0.13679503122965497, "survival_time": 14.950000000000076, "driven_lanedir": 0.033729372654836665, "sim_render-ego": 0.006975620587666829, "in-drivable-lane": 0, "agent_compute-ego": 0.04825993537902832, "deviation-heading": 3.605860317225601, "set_robot_commands": 0.004900835355122884, "deviation-center-line": 1.0859161771795869, "driven_lanedir_consec": 0.033729372654836665, "sim_compute_sim_state": 0.0027895331382751464, "sim_compute_performance-ego": 0.003909566402435303, "sim_compute_robot_state-ego": 0.004948546091715494, "sim_compute_robot_state-npc0": 0.004776366551717122, "sim_compute_robot_state-npc1": 0.004601204395294189, "sim_compute_robot_state-npc2": 0.004552524884541829, "sim_compute_robot_state-npc3": 0.004583651224772135}, "udem1-10-0": {"driven_any": 0.03452518945479112, "sim_physics": 0.11687998056411744, "survival_time": 14.950000000000076, "driven_lanedir": 0.03305012958235487, "sim_render-ego": 0.00689594030380249, "in-drivable-lane": 0, "agent_compute-ego": 0.04786936203638713, "deviation-heading": 4.3754606795832816, "set_robot_commands": 0.004894856611887614, "deviation-center-line": 0.14734891203806608, "driven_lanedir_consec": 0.03305012958235487, "sim_compute_sim_state": 0.0027970496813456217, "sim_compute_performance-ego": 0.0038922953605651854, "sim_compute_robot_state-ego": 0.005046569506327312, "sim_compute_robot_state-npc0": 0.00476192315419515, "sim_compute_robot_state-npc1": 0.004576754570007324, "sim_compute_robot_state-npc2": 0.004560941060384114, "sim_compute_robot_state-npc3": 0.004559491475423177}, "udem1-11-0": {"driven_any": 0.034688524165476374, "sim_physics": 0.1230683453877767, "survival_time": 14.950000000000076, "driven_lanedir": 0.03466810372695939, "sim_render-ego": 0.0069380458196004234, "in-drivable-lane": 0, "agent_compute-ego": 0.04765223185221354, "deviation-heading": 0.2937456536556281, "set_robot_commands": 0.004909841219584147, "deviation-center-line": 0.8921786897609152, "driven_lanedir_consec": 0.03466810372695939, "sim_compute_sim_state": 0.0028012418746948243, "sim_compute_performance-ego": 0.00389739195505778, "sim_compute_robot_state-ego": 0.004911909103393555, "sim_compute_robot_state-npc0": 0.004739056428273519, "sim_compute_robot_state-npc1": 0.004574769337972005, "sim_compute_robot_state-npc2": 0.004586776892344157, "sim_compute_robot_state-npc3": 0.00456365426381429}, "udem1-12-0": {"driven_any": 0.03352857842306187, "sim_physics": 0.1314850370089213, "survival_time": 14.950000000000076, "driven_lanedir": 0.03340645461210512, "sim_render-ego": 0.006986463864644368, "in-drivable-lane": 0, "agent_compute-ego": 0.04812543948491414, "deviation-heading": 1.192016167590365, "set_robot_commands": 0.004892620245615641, "deviation-center-line": 0.717139968998463, "driven_lanedir_consec": 0.03340645461210512, "sim_compute_sim_state": 0.002784309387207031, "sim_compute_performance-ego": 0.003908796310424805, "sim_compute_robot_state-ego": 0.004966749350229899, "sim_compute_robot_state-npc0": 0.004772306283315023, "sim_compute_robot_state-npc1": 0.0045836861928304036, "sim_compute_robot_state-npc2": 0.00455913225809733, "sim_compute_robot_state-npc3": 0.004572923183441162}, "udem1-13-0": {"driven_any": 0.034542341429407666, "sim_physics": 0.13179669857025147, "survival_time": 14.950000000000076, "driven_lanedir": 0.032713019747977246, "sim_render-ego": 0.006973441441853841, "in-drivable-lane": 0, "agent_compute-ego": 0.04821594397226969, "deviation-heading": 4.859889593556633, "set_robot_commands": 0.0049482361475626626, "deviation-center-line": 0.4430133458692044, "driven_lanedir_consec": 0.032713019747977246, "sim_compute_sim_state": 0.0027849539120992023, "sim_compute_performance-ego": 0.003910682201385498, "sim_compute_robot_state-ego": 0.004965860843658448, "sim_compute_robot_state-npc0": 0.004776223500569662, "sim_compute_robot_state-npc1": 0.004625213146209717, "sim_compute_robot_state-npc2": 0.004626706441243489, "sim_compute_robot_state-npc3": 0.004567848841349284}, "udem1-14-0": {"driven_any": 0.034454993280372014, "sim_physics": 0.13381876866022746, "survival_time": 14.950000000000076, "driven_lanedir": 0.03426379296299209, "sim_render-ego": 0.0069966332117716475, "in-drivable-lane": 0, "agent_compute-ego": 0.048596043586730954, "deviation-heading": 1.5612882221719804, "set_robot_commands": 0.004899928569793701, "deviation-center-line": 1.121579706985133, "driven_lanedir_consec": 0.03426379296299209, "sim_compute_sim_state": 0.0027860093116760256, "sim_compute_performance-ego": 0.00390750249226888, "sim_compute_robot_state-ego": 0.004954930146535238, "sim_compute_robot_state-npc0": 0.004776674906412761, "sim_compute_robot_state-npc1": 0.004600022633870443, "sim_compute_robot_state-npc2": 0.004581003983815511, "sim_compute_robot_state-npc3": 0.004557270208994548}}
set_robot_commands_max0.00972153902053833
set_robot_commands_mean0.005614740477667913
set_robot_commands_median0.0049482361475626626
set_robot_commands_min0.004892620245615641
sim_compute_performance-ego_max0.00635275920232137
sim_compute_performance-ego_mean0.004300734572940402
sim_compute_performance-ego_median0.0039121874173482256
sim_compute_performance-ego_min0.0038922953605651854
sim_compute_robot_state-ego_max0.008537118434906005
sim_compute_robot_state-ego_mean0.005487476560804578
sim_compute_robot_state-ego_median0.004965860843658448
sim_compute_robot_state-ego_min0.004911909103393555
sim_compute_robot_state-npc0_max0.008971384366353353
sim_compute_robot_state-npc0_mean0.005351556619008382
sim_compute_robot_state-npc0_median0.004776674906412761
sim_compute_robot_state-npc0_min0.004739056428273519
sim_compute_robot_state-npc1_max0.007624338467915853
sim_compute_robot_state-npc1_mean0.005088631206088596
sim_compute_robot_state-npc1_median0.004605457782745361
sim_compute_robot_state-npc1_min0.004574769337972005
sim_compute_robot_state-npc2_max0.00750621239344279
sim_compute_robot_state-npc2_mean0.005058546543121338
sim_compute_robot_state-npc2_median0.004584769407908122
sim_compute_robot_state-npc2_min0.004552524884541829
sim_compute_robot_state-npc3_max0.007409966786702474
sim_compute_robot_state-npc3_mean0.005049119525485568
sim_compute_robot_state-npc3_median0.004583651224772135
sim_compute_robot_state-npc3_min0.004557270208994548
sim_compute_sim_state_max0.004553062915802002
sim_compute_sim_state_mean0.003066080464257134
sim_compute_sim_state_median0.002794481118520101
sim_compute_sim_state_min0.0027672139803568523
sim_physics_max0.2485296686490377
sim_physics_mean0.13958010265562268
sim_physics_median0.1314850370089213
sim_physics_min0.10884405215581258
sim_render-ego_max0.011385645866394045
sim_render-ego_mean0.007620053874121771
sim_render-ego_median0.006986463864644368
sim_render-ego_min0.006882735093434652
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
258724266Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-35-218-104900:03:15
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
258704272Riza Velioglu 🇩🇪Uni Bielefeldaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-35-218-104900:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
258674274Riza Velioglu 🇩🇪Uni Bielefeldaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-35-218-104900:02:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
258494382Soroush Saryazdi 🇨🇦bluejayaido3-LFV-sim-testingstep1-simulationfailednoip-172-31-35-218-104900:03:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 84 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
258064521Mikita Sazanovich 🇷🇺chameleon-70aido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0778162991577203
survival_time_median14.950000000000076
deviation-center-line_median0.6936258434431956
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.07663313229878743
agent_compute-ego_mean0.07486056280576944
agent_compute-ego_median0.07445422410964966
agent_compute-ego_min0.07399569123478258
deviation-center-line_max0.9767042650256488
deviation-center-line_mean0.6610284406743997
deviation-center-line_min0.2238353308059685
deviation-heading_max4.309211242102233
deviation-heading_mean3.2010579065295657
deviation-heading_median3.554711784527801
deviation-heading_min1.3365992929714443
driven_any_max3.935477097649207
driven_any_mean3.1236594856603546
driven_any_median3.647669700917703
driven_any_min1.6026819855639316
driven_lanedir_consec_max3.775264449186859
driven_lanedir_consec_mean2.7457494884639155
driven_lanedir_consec_min1.228775981555256
driven_lanedir_max3.775264449186859
driven_lanedir_mean2.746076380070309
driven_lanedir_median3.0778162991577203
driven_lanedir_min1.230410439587222
in-drivable-lane_max1.850000000000013
in-drivable-lane_mean0.9500000000000078
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.647669700917703, "sim_physics": 0.05465301036834717, "survival_time": 14.950000000000076, "driven_lanedir": 3.0778162991577203, "sim_render-ego": 0.006880098183949788, "in-drivable-lane": 1.850000000000013, "agent_compute-ego": 0.07663313229878743, "deviation-heading": 4.309211242102233, "set_robot_commands": 0.005086017449696859, "deviation-center-line": 0.923776699506054, "driven_lanedir_consec": 3.0778162991577203, "sim_compute_sim_state": 0.0028983664512634275, "sim_compute_performance-ego": 0.004077068169911702, "sim_compute_robot_state-ego": 0.0049832892417907716}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.768233518141926, "sim_physics": 0.055454683303833005, "survival_time": 11.00000000000002, "driven_lanedir": 2.253150718678808, "sim_render-ego": 0.008084568110379305, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.07483240040865811, "deviation-heading": 3.007217304092994, "set_robot_commands": 0.005078946460377086, "deviation-center-line": 0.4872000645911312, "driven_lanedir_consec": 2.253150718678808, "sim_compute_sim_state": 0.002907226302407005, "sim_compute_performance-ego": 0.00401712330904874, "sim_compute_robot_state-ego": 0.004935848712921143}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.935477097649207, "sim_physics": 0.054150858720143635, "survival_time": 14.950000000000076, "driven_lanedir": 3.775264449186859, "sim_render-ego": 0.006946886380513509, "in-drivable-lane": 0, "agent_compute-ego": 0.0743873659769694, "deviation-heading": 3.554711784527801, "set_robot_commands": 0.005057703653971354, "deviation-center-line": 0.9767042650256488, "driven_lanedir_consec": 3.775264449186859, "sim_compute_sim_state": 0.0029036959012349447, "sim_compute_performance-ego": 0.0040060846010843915, "sim_compute_robot_state-ego": 0.004921321074167887}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6026819855639316, "sim_physics": 0.053948337748899296, "survival_time": 5.899999999999987, "driven_lanedir": 1.230410439587222, "sim_render-ego": 0.0070514678955078125, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.07399569123478258, "deviation-heading": 1.3365992929714443, "set_robot_commands": 0.005035511517928818, "deviation-center-line": 0.2238353308059685, "driven_lanedir_consec": 1.228775981555256, "sim_compute_sim_state": 0.002877322293944278, "sim_compute_performance-ego": 0.003986669799028817, "sim_compute_robot_state-ego": 0.0049186561067225566}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.6642351260290047, "sim_physics": 0.05388166427612304, "survival_time": 14.950000000000076, "driven_lanedir": 3.3937399937409354, "sim_render-ego": 0.0069662149747212725, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.07445422410964966, "deviation-heading": 3.797549908953358, "set_robot_commands": 0.005066862901051839, "deviation-center-line": 0.6936258434431956, "driven_lanedir_consec": 3.3937399937409354, "sim_compute_sim_state": 0.0029082028071085613, "sim_compute_performance-ego": 0.0039755296707153324, "sim_compute_robot_state-ego": 0.004914263089497884}}
set_robot_commands_max0.005086017449696859
set_robot_commands_mean0.005065008396605191
set_robot_commands_median0.005066862901051839
set_robot_commands_min0.005035511517928818
sim_compute_performance-ego_max0.004077068169911702
sim_compute_performance-ego_mean0.004012495109957796
sim_compute_performance-ego_median0.0040060846010843915
sim_compute_performance-ego_min0.0039755296707153324
sim_compute_robot_state-ego_max0.0049832892417907716
sim_compute_robot_state-ego_mean0.004934675645020048
sim_compute_robot_state-ego_median0.004921321074167887
sim_compute_robot_state-ego_min0.004914263089497884
sim_compute_sim_state_max0.0029082028071085613
sim_compute_sim_state_mean0.002898962751191643
sim_compute_sim_state_median0.0029036959012349447
sim_compute_sim_state_min0.002877322293944278
sim_physics_max0.055454683303833005
sim_physics_mean0.05441771088346923
sim_physics_median0.054150858720143635
sim_physics_min0.05388166427612304
sim_render-ego_max0.008084568110379305
sim_render-ego_mean0.007185847109014337
sim_render-ego_median0.0069662149747212725
sim_render-ego_min0.006880098183949788
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.350000000000048
survival_time_min5.899999999999987
No reset possible
257874519Robert Moni 🇭🇺kaland-2240saido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.7635939826461415
survival_time_median14.950000000000076
deviation-center-line_median0.7693749363980209
in-drivable-lane_median0.2500000000000018


other stats
agent_compute-ego_max0.0232694411277771
agent_compute-ego_mean0.023081183609661753
agent_compute-ego_median0.02317188262939453
agent_compute-ego_min0.022838002926594506
deviation-center-line_max0.8880579036903015
deviation-center-line_mean0.6552043228986708
deviation-center-line_min0.18268408219009383
deviation-heading_max4.342325722139702
deviation-heading_mean3.411919110865277
deviation-heading_median3.854836968063548
deviation-heading_min1.0626019826494626
driven_any_max4.220885275548522
driven_any_mean3.4895079622989345
driven_any_median4.072111926723092
driven_any_min1.034358191926412
driven_lanedir_consec_max3.88781578453746
driven_lanedir_consec_mean3.0984157814208872
driven_lanedir_consec_min0.6942958331771827
driven_lanedir_max3.88781578453746
driven_lanedir_mean3.0984157814208872
driven_lanedir_median3.7635939826461415
driven_lanedir_min0.6942958331771827
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.6000000000000055
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.119155639466962, "sim_physics": 0.054025894006093346, "survival_time": 14.950000000000076, "driven_lanedir": 3.772565465130003, "sim_render-ego": 0.006906975110371908, "in-drivable-lane": 0.2500000000000018, "agent_compute-ego": 0.0232694411277771, "deviation-heading": 4.342325722139702, "set_robot_commands": 0.005052140553792318, "deviation-center-line": 0.8544768877479436, "driven_lanedir_consec": 3.772565465130003, "sim_compute_sim_state": 0.0028406127293904623, "sim_compute_performance-ego": 0.004075568517049153, "sim_compute_robot_state-ego": 0.004951658248901367}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.220885275548522, "sim_physics": 0.05587630351384481, "survival_time": 14.950000000000076, "driven_lanedir": 3.373807841613648, "sim_render-ego": 0.00704725980758667, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.02317188262939453, "deviation-heading": 3.4762771405634783, "set_robot_commands": 0.005045478343963623, "deviation-center-line": 0.5814278044669939, "driven_lanedir_consec": 3.373807841613648, "sim_compute_sim_state": 0.0028911805152893066, "sim_compute_performance-ego": 0.003993362585703532, "sim_compute_robot_state-ego": 0.005000881354014079}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.034358191926412, "sim_physics": 0.05577103511707203, "survival_time": 3.699999999999995, "driven_lanedir": 0.6942958331771827, "sim_render-ego": 0.007135516888386494, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.022838002926594506, "deviation-heading": 1.0626019826494626, "set_robot_commands": 0.0049309472779969915, "deviation-center-line": 0.18268408219009383, "driven_lanedir_consec": 0.6942958331771827, "sim_compute_sim_state": 0.002917222074560217, "sim_compute_performance-ego": 0.003984712265633248, "sim_compute_robot_state-ego": 0.005010131243112925}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.072111926723092, "sim_physics": 0.05457204103469849, "survival_time": 14.950000000000076, "driven_lanedir": 3.88781578453746, "sim_render-ego": 0.007042901515960693, "in-drivable-lane": 0, "agent_compute-ego": 0.023235676288604738, "deviation-heading": 3.854836968063548, "set_robot_commands": 0.005013292630513509, "deviation-center-line": 0.8880579036903015, "driven_lanedir_consec": 3.88781578453746, "sim_compute_sim_state": 0.0029083943367004396, "sim_compute_performance-ego": 0.003998386859893799, "sim_compute_robot_state-ego": 0.004991708596547444}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.001028777829683, "sim_physics": 0.05382084449132283, "survival_time": 14.950000000000076, "driven_lanedir": 3.7635939826461415, "sim_render-ego": 0.006961857477823893, "in-drivable-lane": 0, "agent_compute-ego": 0.022890915075937907, "deviation-heading": 4.323553740910196, "set_robot_commands": 0.005019598801930745, "deviation-center-line": 0.7693749363980209, "driven_lanedir_consec": 3.7635939826461415, "sim_compute_sim_state": 0.00286574920018514, "sim_compute_performance-ego": 0.003967601458231608, "sim_compute_robot_state-ego": 0.004871791998545329}}
set_robot_commands_max0.005052140553792318
set_robot_commands_mean0.005012291521639437
set_robot_commands_median0.005019598801930745
set_robot_commands_min0.0049309472779969915
sim_compute_performance-ego_max0.004075568517049153
sim_compute_performance-ego_mean0.004003926337302269
sim_compute_performance-ego_median0.003993362585703532
sim_compute_performance-ego_min0.003967601458231608
sim_compute_robot_state-ego_max0.005010131243112925
sim_compute_robot_state-ego_mean0.00496523428822423
sim_compute_robot_state-ego_median0.004991708596547444
sim_compute_robot_state-ego_min0.004871791998545329
sim_compute_sim_state_max0.002917222074560217
sim_compute_sim_state_mean0.0028846317712251128
sim_compute_sim_state_median0.0028911805152893066
sim_compute_sim_state_min0.0028406127293904623
sim_physics_max0.05587630351384481
sim_physics_mean0.0548132236326063
sim_physics_median0.05457204103469849
sim_physics_min0.05382084449132283
sim_render-ego_max0.007135516888386494
sim_render-ego_mean0.007018902160025932
sim_render-ego_median0.007042901515960693
sim_render-ego_min0.006906975110371908
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.70000000000006
survival_time_min3.699999999999995
No reset possible
257844517Robert Moni 🇭🇺almasipaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:21:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2252317537545454
survival_time_median14.950000000000076
deviation-center-line_median0.792810724449679
in-drivable-lane_median1.649999999999994


other stats
agent_compute-ego_max0.023464536666870116
agent_compute-ego_mean0.02265127299788366
agent_compute-ego_median0.02258190870285034
agent_compute-ego_min0.02240077018737793
deviation-center-line_max1.2887852156581103
deviation-center-line_mean0.7738523429792531
deviation-center-line_min0.12382835857082536
deviation-heading_max4.324952335598702
deviation-heading_mean2.791193528995844
deviation-heading_median2.8166786792370027
deviation-heading_min0.7629062582145834
driven_any_max3.0586840554950103
driven_any_mean2.537918656761147
driven_any_median3.016902224264439
driven_any_min0.4285969795256148
driven_lanedir_consec_max2.8839903507296514
driven_lanedir_consec_mean1.9451672815371464
driven_lanedir_consec_min0.3962985964012824
driven_lanedir_max2.8839903507296514
driven_lanedir_mean1.9451672815371464
driven_lanedir_median2.2252317537545454
driven_lanedir_min0.3962985964012824
in-drivable-lane_max7.150000000000057
in-drivable-lane_mean2.2533333333333494
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1639876566396357, "sim_physics": 0.05652196804682414, "survival_time": 5.999999999999987, "driven_lanedir": 1.118095613578418, "sim_render-ego": 0.007131801048914591, "in-drivable-lane": 0, "agent_compute-ego": 0.023464536666870116, "deviation-heading": 1.303303565434251, "set_robot_commands": 0.005313517649968466, "deviation-center-line": 0.3296128313883473, "driven_lanedir_consec": 1.118095613578418, "sim_compute_sim_state": 0.0029044270515441893, "sim_compute_performance-ego": 0.004224451382954916, "sim_compute_robot_state-ego": 0.005033367872238159}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0013394151095556, "sim_physics": 0.05546579815092541, "survival_time": 5.249999999999989, "driven_lanedir": 0.922613241635003, "sim_render-ego": 0.0071410338083903, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.022446162360055102, "deviation-heading": 1.628803360993863, "set_robot_commands": 0.005346282323201498, "deviation-center-line": 0.23852160261557576, "driven_lanedir_consec": 0.922613241635003, "sim_compute_sim_state": 0.0029350076402936665, "sim_compute_performance-ego": 0.004028413409278507, "sim_compute_robot_state-ego": 0.004982891536894299}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.016902224264439, "sim_physics": 0.05439854303995768, "survival_time": 14.950000000000076, "driven_lanedir": 2.2252317537545454, "sim_render-ego": 0.007317454814910889, "in-drivable-lane": 3.0000000000000275, "agent_compute-ego": 0.022611205577850343, "deviation-heading": 3.272439984042323, "set_robot_commands": 0.005196320215861003, "deviation-center-line": 0.9283320261037158, "driven_lanedir_consec": 2.2252317537545454, "sim_compute_sim_state": 0.0028786603609720868, "sim_compute_performance-ego": 0.004083135922749837, "sim_compute_robot_state-ego": 0.004998835722605387}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0102603926354137, "sim_physics": 0.0561093266805013, "survival_time": 14.950000000000076, "driven_lanedir": 2.601581568560738, "sim_render-ego": 0.0072064789136250815, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.02258190870285034, "deviation-heading": 4.324952335598702, "set_robot_commands": 0.005276583035786947, "deviation-center-line": 0.6309622064361444, "driven_lanedir_consec": 2.601581568560738, "sim_compute_sim_state": 0.002948118050893148, "sim_compute_performance-ego": 0.004074560801188151, "sim_compute_robot_state-ego": 0.005035046736399333}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4285969795256148, "sim_physics": 0.0566996435324351, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3962985964012824, "sim_render-ego": 0.00718367596467336, "in-drivable-lane": 0, "agent_compute-ego": 0.022679820656776428, "deviation-heading": 0.7629062582145834, "set_robot_commands": 0.005235051115353902, "deviation-center-line": 0.12382835857082536, "driven_lanedir_consec": 0.3962985964012824, "sim_compute_sim_state": 0.002896428108215332, "sim_compute_performance-ego": 0.004007682204246521, "sim_compute_robot_state-ego": 0.004945079485575358}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.020924663485328, "sim_physics": 0.05529304424921672, "survival_time": 14.950000000000076, "driven_lanedir": 2.253933479925565, "sim_render-ego": 0.007025594711303711, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.022824769814809163, "deviation-heading": 2.8166786792370027, "set_robot_commands": 0.005164620876312256, "deviation-center-line": 1.0856836338303002, "driven_lanedir_consec": 2.253933479925565, "sim_compute_sim_state": 0.002925278345743815, "sim_compute_performance-ego": 0.004039350350697835, "sim_compute_robot_state-ego": 0.004993946552276612}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.02009657706415, "sim_physics": 0.05572263399759928, "survival_time": 14.950000000000076, "driven_lanedir": 2.5524979225024507, "sim_render-ego": 0.0069663683573404946, "in-drivable-lane": 1.4000000000000012, "agent_compute-ego": 0.022423590024312337, "deviation-heading": 3.8867576467513567, "set_robot_commands": 0.005172731081644694, "deviation-center-line": 0.630483341171083, "driven_lanedir_consec": 2.5524979225024507, "sim_compute_sim_state": 0.0029418166478474934, "sim_compute_performance-ego": 0.004001551469167073, "sim_compute_robot_state-ego": 0.004966907501220703}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.0586840554950103, "sim_physics": 0.05494205872217814, "survival_time": 14.950000000000076, "driven_lanedir": 1.7385633841929986, "sim_render-ego": 0.007163620789845784, "in-drivable-lane": 5.750000000000024, "agent_compute-ego": 0.02287049929300944, "deviation-heading": 2.3224737582202413, "set_robot_commands": 0.005267236232757568, "deviation-center-line": 1.0623840606441313, "driven_lanedir_consec": 1.7385633841929986, "sim_compute_sim_state": 0.002994391918182373, "sim_compute_performance-ego": 0.004064205487569173, "sim_compute_robot_state-ego": 0.00504895289738973}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.0562396146969832, "sim_physics": 0.053707966009775794, "survival_time": 14.950000000000076, "driven_lanedir": 1.87465318830005, "sim_render-ego": 0.007151680787404378, "in-drivable-lane": 4.500000000000032, "agent_compute-ego": 0.02269252856572469, "deviation-heading": 3.629870840157212, "set_robot_commands": 0.005180883407592774, "deviation-center-line": 1.1021138681668394, "driven_lanedir_consec": 1.87465318830005, "sim_compute_sim_state": 0.0029689478874206543, "sim_compute_performance-ego": 0.004057266712188721, "sim_compute_robot_state-ego": 0.005051239331563314}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.0227859122641925, "sim_physics": 0.05480649709701538, "survival_time": 14.950000000000076, "driven_lanedir": 1.4280587122246222, "sim_render-ego": 0.007108914057413737, "in-drivable-lane": 7.150000000000057, "agent_compute-ego": 0.022899967829386393, "deviation-heading": 2.2564356320899956, "set_robot_commands": 0.0051695919036865235, "deviation-center-line": 0.6834345854590982, "driven_lanedir_consec": 1.4280587122246222, "sim_compute_sim_state": 0.002970160643259684, "sim_compute_performance-ego": 0.004038098653157552, "sim_compute_robot_state-ego": 0.005065213044484457}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.194359409611597, "sim_physics": 0.0545376257462935, "survival_time": 11.00000000000002, "driven_lanedir": 1.775522460268776, "sim_render-ego": 0.00705037767236883, "in-drivable-lane": 1.4999999999999982, "agent_compute-ego": 0.02240978154269132, "deviation-heading": 2.599391657959756, "set_robot_commands": 0.0051670724695379085, "deviation-center-line": 0.792810724449679, "driven_lanedir_consec": 1.775522460268776, "sim_compute_sim_state": 0.002929775281385942, "sim_compute_performance-ego": 0.004011039300398393, "sim_compute_robot_state-ego": 0.005013397606936368}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.038307328235703, "sim_physics": 0.055144932270050045, "survival_time": 14.950000000000076, "driven_lanedir": 2.51229269076985, "sim_render-ego": 0.007007602055867513, "in-drivable-lane": 2.1500000000000243, "agent_compute-ego": 0.0225516676902771, "deviation-heading": 2.4565376198673174, "set_robot_commands": 0.0050939981142679855, "deviation-center-line": 1.2887852156581103, "driven_lanedir_consec": 2.51229269076985, "sim_compute_sim_state": 0.002883443037668864, "sim_compute_performance-ego": 0.004000128110249837, "sim_compute_robot_state-ego": 0.004912120501200358}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 3.001466564514001, "sim_physics": 0.05501031001408895, "survival_time": 14.950000000000076, "driven_lanedir": 2.3817666516993694, "sim_render-ego": 0.006989122231801351, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.022449711163838704, "deviation-heading": 2.9212107909518923, "set_robot_commands": 0.0051417001088460285, "deviation-center-line": 1.1704702570559218, "driven_lanedir_consec": 2.3817666516993694, "sim_compute_sim_state": 0.0028998366991678875, "sim_compute_performance-ego": 0.004037011464436849, "sim_compute_robot_state-ego": 0.004944245020548503}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.013641747592165, "sim_physics": 0.05613949457804362, "survival_time": 14.950000000000076, "driven_lanedir": 2.512409608513885, "sim_render-ego": 0.006953752835591634, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.02240077018737793, "deviation-heading": 3.874494734466981, "set_robot_commands": 0.005093754927317302, "deviation-center-line": 0.8756256019195273, "driven_lanedir_consec": 2.512409608513885, "sim_compute_sim_state": 0.002920850912729899, "sim_compute_performance-ego": 0.0040066933631896975, "sim_compute_robot_state-ego": 0.0049128524462382}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.0211873102834064, "sim_physics": 0.0542187762260437, "survival_time": 14.950000000000076, "driven_lanedir": 2.8839903507296514, "sim_render-ego": 0.0070071244239807125, "in-drivable-lane": 0, "agent_compute-ego": 0.022462174892425538, "deviation-heading": 3.8116460709521895, "set_robot_commands": 0.005156534512837728, "deviation-center-line": 0.6647368312194973, "driven_lanedir_consec": 2.8839903507296514, "sim_compute_sim_state": 0.0029273494084676105, "sim_compute_performance-ego": 0.004062771797180176, "sim_compute_robot_state-ego": 0.004969615936279297}}
set_robot_commands_max0.005346282323201498
set_robot_commands_mean0.005198391864998171
set_robot_commands_median0.005172731081644694
set_robot_commands_min0.005093754927317302
sim_compute_performance-ego_max0.004224451382954916
sim_compute_performance-ego_mean0.00404909069524355
sim_compute_performance-ego_median0.004038098653157552
sim_compute_performance-ego_min0.004000128110249837
sim_compute_robot_state-ego_max0.005065213044484457
sim_compute_robot_state-ego_mean0.004991580812790005
sim_compute_robot_state-ego_median0.004993946552276612
sim_compute_robot_state-ego_min0.004912120501200358
sim_compute_sim_state_max0.002994391918182373
sim_compute_sim_state_mean0.0029282994662528433
sim_compute_sim_state_median0.0029273494084676105
sim_compute_sim_state_min0.0028786603609720868
sim_physics_max0.0566996435324351
sim_physics_mean0.055247907890729905
sim_physics_median0.055144932270050045
sim_physics_min0.053707966009775794
sim_render-ego_max0.007317454814910889
sim_render-ego_mean0.00709364016489549
sim_render-ego_median0.007108914057413737
sim_render-ego_min0.006953752835591634
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.60666666666672
survival_time_min2.3999999999999995
No reset possible
257824516Robert Moni 🇭🇺almasipaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:08:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1262445917006265
survival_time_median14.950000000000076
deviation-center-line_median0.723263797273405
in-drivable-lane_median0


other stats
agent_compute-ego_max0.023395245869954423
agent_compute-ego_mean0.02276522571900312
agent_compute-ego_median0.022569021383921303
agent_compute-ego_min0.022352069966933303
deviation-center-line_max0.9645118915329308
deviation-center-line_mean0.6704648868024171
deviation-center-line_min0.2185195828557015
deviation-heading_max3.9666512717080193
deviation-heading_mean3.107662635752958
deviation-heading_median3.4820343505034423
deviation-heading_min1.0010260891725518
driven_any_max3.0474922903843993
driven_any_mean2.573532025406686
driven_any_median2.996756294569651
driven_any_min0.8271667837007419
driven_lanedir_consec_max2.849848325413491
driven_lanedir_consec_mean2.131890987359408
driven_lanedir_consec_min0.7961889161311537
driven_lanedir_max2.849848325413491
driven_lanedir_mean2.131890987359408
driven_lanedir_median2.1262445917006265
driven_lanedir_min0.7961889161311537
in-drivable-lane_max3.900000000000012
in-drivable-lane_mean1.4900000000000098
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0016915363708288, "sim_physics": 0.0572345248858134, "survival_time": 14.950000000000076, "driven_lanedir": 2.1262445917006265, "sim_render-ego": 0.0069424653053283695, "in-drivable-lane": 3.550000000000037, "agent_compute-ego": 0.023127316633860272, "deviation-heading": 3.198849640858359, "set_robot_commands": 0.0050938987731933595, "deviation-center-line": 0.9645118915329308, "driven_lanedir_consec": 2.1262445917006265, "sim_compute_sim_state": 0.0029940025011698404, "sim_compute_performance-ego": 0.004064458211263021, "sim_compute_robot_state-ego": 0.005019798278808594}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.9945532220078066, "sim_physics": 0.05598692417144775, "survival_time": 14.950000000000076, "driven_lanedir": 2.849848325413491, "sim_render-ego": 0.006998462677001953, "in-drivable-lane": 0, "agent_compute-ego": 0.022382474740346273, "deviation-heading": 3.9666512717080193, "set_robot_commands": 0.00505049467086792, "deviation-center-line": 0.723263797273405, "driven_lanedir_consec": 2.849848325413491, "sim_compute_sim_state": 0.0028966768582661946, "sim_compute_performance-ego": 0.003970785140991211, "sim_compute_robot_state-ego": 0.00492526133855184}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.0474922903843993, "sim_physics": 0.054524771372477215, "survival_time": 14.950000000000076, "driven_lanedir": 2.0408874357058284, "sim_render-ego": 0.0070436318715413416, "in-drivable-lane": 3.900000000000012, "agent_compute-ego": 0.023395245869954423, "deviation-heading": 3.4820343505034423, "set_robot_commands": 0.005235722064971924, "deviation-center-line": 0.8429520082211108, "driven_lanedir_consec": 2.0408874357058284, "sim_compute_sim_state": 0.0029212824503580728, "sim_compute_performance-ego": 0.004004346529642741, "sim_compute_robot_state-ego": 0.004955538908640544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.996756294569651, "sim_physics": 0.05680330276489258, "survival_time": 14.950000000000076, "driven_lanedir": 2.8462856678459407, "sim_render-ego": 0.006952238082885742, "in-drivable-lane": 0, "agent_compute-ego": 0.022569021383921303, "deviation-heading": 3.8897518265224225, "set_robot_commands": 0.005139785607655843, "deviation-center-line": 0.6030771541289376, "driven_lanedir_consec": 2.8462856678459407, "sim_compute_sim_state": 0.002890305519104004, "sim_compute_performance-ego": 0.003968862692515055, "sim_compute_robot_state-ego": 0.004912113348642985}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8271667837007419, "sim_physics": 0.05551758653977338, "survival_time": 4.249999999999993, "driven_lanedir": 0.7961889161311537, "sim_render-ego": 0.007026879927691292, "in-drivable-lane": 0, "agent_compute-ego": 0.022352069966933303, "deviation-heading": 1.0010260891725518, "set_robot_commands": 0.005101170259363511, "deviation-center-line": 0.2185195828557015, "driven_lanedir_consec": 0.7961889161311537, "sim_compute_sim_state": 0.0030043994679170498, "sim_compute_performance-ego": 0.003967024298275218, "sim_compute_robot_state-ego": 0.0048990586224724264}}
set_robot_commands_max0.005235722064971924
set_robot_commands_mean0.005124214275210512
set_robot_commands_median0.005101170259363511
set_robot_commands_min0.00505049467086792
sim_compute_performance-ego_max0.004064458211263021
sim_compute_performance-ego_mean0.003995095374537449
sim_compute_performance-ego_median0.003970785140991211
sim_compute_performance-ego_min0.003967024298275218
sim_compute_robot_state-ego_max0.005019798278808594
sim_compute_robot_state-ego_mean0.004942354099423277
sim_compute_robot_state-ego_median0.00492526133855184
sim_compute_robot_state-ego_min0.0048990586224724264
sim_compute_sim_state_max0.0030043994679170498
sim_compute_sim_state_mean0.0029413333593630324
sim_compute_sim_state_median0.0029212824503580728
sim_compute_sim_state_min0.002890305519104004
sim_physics_max0.0572345248858134
sim_physics_mean0.05601342194688087
sim_physics_median0.05598692417144775
sim_physics_min0.054524771372477215
sim_render-ego_max0.0070436318715413416
sim_render-ego_mean0.00699273557288974
sim_render-ego_median0.006998462677001953
sim_render-ego_min0.0069424653053283695
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.81000000000006
survival_time_min4.249999999999993
No reset possible
257724361Soroush Saryazdi 🇨🇦bluejayaido3-LFV-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
257154485Frank (Chude) Qian 🇨🇦In duckietown we do not endorse DUI...aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:15:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.44816230928357537
survival_time_median3.699999999999995
deviation-center-line_median0.2603647509011997
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.02649060885111491
agent_compute-ego_mean0.02269346525974781
agent_compute-ego_median0.022108030028459503
agent_compute-ego_min0.01938962245333022
deviation-center-line_max1.4654263399997178
deviation-center-line_mean0.4436447383333191
deviation-center-line_min0.09927658584206542
deviation-heading_max4.132704682737517
deviation-heading_mean1.949197987743774
deviation-heading_median1.714551999869241
deviation-heading_min0.6182172961206798
driven_any_max2.6587965356927414
driven_any_mean0.8895269560930342
driven_any_median0.5237110722042646
driven_any_min0.1373071514910847
driven_lanedir_consec_max1.8573201638243173
driven_lanedir_consec_mean0.6628572235286346
driven_lanedir_consec_min0.09842994663143534
driven_lanedir_max1.8573201638243173
driven_lanedir_mean0.6670602919016091
driven_lanedir_median0.44816230928357537
driven_lanedir_min0.09842994663143534
in-drivable-lane_max5.4500000000000215
in-drivable-lane_mean0.946666666666668
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21314201501935465, "sim_physics": 0.0848988691965739, "survival_time": 1.800000000000001, "driven_lanedir": 0.18052314656009283, "sim_render-ego": 0.01050979561275906, "in-drivable-lane": 0, "agent_compute-ego": 0.025444746017456055, "deviation-heading": 0.8095515129075997, "set_robot_commands": 0.007093687852223714, "deviation-center-line": 0.1638105327349524, "driven_lanedir_consec": 0.18052314656009283, "sim_compute_sim_state": 0.003887997733222114, "sim_compute_performance-ego": 0.00685307052400377, "sim_compute_robot_state-ego": 0.007770909203423394}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.388386100689911, "sim_physics": 0.07630278290929021, "survival_time": 3.699999999999995, "driven_lanedir": 0.3816373327890646, "sim_render-ego": 0.010207414627075195, "in-drivable-lane": 0, "agent_compute-ego": 0.02110255408931423, "deviation-heading": 0.6751480526552087, "set_robot_commands": 0.006422944971033045, "deviation-center-line": 0.3728411999746159, "driven_lanedir_consec": 0.3816373327890646, "sim_compute_sim_state": 0.003670727884447252, "sim_compute_performance-ego": 0.004814437917760901, "sim_compute_robot_state-ego": 0.006317734718322754}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.6587965356927414, "sim_physics": 0.07347906192143758, "survival_time": 14.950000000000076, "driven_lanedir": 1.6461556676118485, "sim_render-ego": 0.009126880168914796, "in-drivable-lane": 5.4500000000000215, "agent_compute-ego": 0.021037529309590654, "deviation-heading": 2.7308054078633237, "set_robot_commands": 0.006764692465464274, "deviation-center-line": 1.1494370019861515, "driven_lanedir_consec": 1.6461556676118485, "sim_compute_sim_state": 0.0037886714935302735, "sim_compute_performance-ego": 0.005315766334533691, "sim_compute_robot_state-ego": 0.006604445775349935}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.24119754452384812, "sim_physics": 0.09107152275417162, "survival_time": 2.3, "driven_lanedir": 0.15086927762309243, "sim_render-ego": 0.01030303602633269, "in-drivable-lane": 0, "agent_compute-ego": 0.024999027666838272, "deviation-heading": 1.345969209680326, "set_robot_commands": 0.008530875910883364, "deviation-center-line": 0.10706628038243358, "driven_lanedir_consec": 0.15086927762309243, "sim_compute_sim_state": 0.004382890203724737, "sim_compute_performance-ego": 0.00605463463327159, "sim_compute_robot_state-ego": 0.007698328598685886}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1566063980819417, "sim_physics": 0.0862513922384657, "survival_time": 11.350000000000026, "driven_lanedir": 1.8573201638243173, "sim_render-ego": 0.01028373588024257, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.023626015574921597, "deviation-heading": 4.132704682737517, "set_robot_commands": 0.007963786566309992, "deviation-center-line": 1.0947444840991445, "driven_lanedir_consec": 1.8573201638243173, "sim_compute_sim_state": 0.0041827136724530865, "sim_compute_performance-ego": 0.005965980664223826, "sim_compute_robot_state-ego": 0.007316534739759}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.9490940597687196, "sim_physics": 0.0819309117302062, "survival_time": 6.299999999999986, "driven_lanedir": 0.43844481741168817, "sim_render-ego": 0.010605747737581769, "in-drivable-lane": 2.349999999999995, "agent_compute-ego": 0.0239319366122049, "deviation-heading": 3.255351435248255, "set_robot_commands": 0.008842642345125712, "deviation-center-line": 0.41514918014875335, "driven_lanedir_consec": 0.3753987918170707, "sim_compute_sim_state": 0.004161446813553098, "sim_compute_performance-ego": 0.0061561474724421425, "sim_compute_robot_state-ego": 0.007809612486097548}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1373071514910847, "sim_physics": 0.06824318851743426, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09842994663143534, "sim_render-ego": 0.008716378893171037, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.021547368594578335, "deviation-heading": 0.6705155009265593, "set_robot_commands": 0.006860971450805664, "deviation-center-line": 0.1526179080337486, "driven_lanedir_consec": 0.09842994663143534, "sim_compute_sim_state": 0.0032976269721984863, "sim_compute_performance-ego": 0.004771854196275983, "sim_compute_robot_state-ego": 0.00601649284362793}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.14672929400197868, "sim_physics": 0.06952821214993794, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10205334545909528, "sim_render-ego": 0.008211851119995117, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.019982963800430294, "deviation-heading": 0.6182172961206798, "set_robot_commands": 0.006702214479446411, "deviation-center-line": 0.09927658584206542, "driven_lanedir_consec": 0.10205334545909528, "sim_compute_sim_state": 0.0033710996309916177, "sim_compute_performance-ego": 0.004661401112874349, "sim_compute_robot_state-ego": 0.005928665399551392}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.32071144880836233, "sim_physics": 0.06666945374530295, "survival_time": 3.4499999999999957, "driven_lanedir": 0.2196903186845245, "sim_render-ego": 0.008619961531265923, "in-drivable-lane": 0, "agent_compute-ego": 0.01938962245333022, "deviation-heading": 2.031256074513605, "set_robot_commands": 0.0064828810484513, "deviation-center-line": 0.15935003326298097, "driven_lanedir_consec": 0.2196903186845245, "sim_compute_sim_state": 0.0034853237262670545, "sim_compute_performance-ego": 0.004846092583476633, "sim_compute_robot_state-ego": 0.006207963694696841}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.23050464211839, "sim_physics": 0.07361263944613224, "survival_time": 7.549999999999981, "driven_lanedir": 0.8903302729450502, "sim_render-ego": 0.009340333622812436, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.021149193214264925, "deviation-heading": 1.714551999869241, "set_robot_commands": 0.006879695993385567, "deviation-center-line": 0.26718067163524317, "driven_lanedir_consec": 0.8903302729450502, "sim_compute_sim_state": 0.0038641762259780175, "sim_compute_performance-ego": 0.005435133611919074, "sim_compute_robot_state-ego": 0.006927723916161139}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.1865103478655747, "sim_physics": 0.07713473717371623, "survival_time": 14.950000000000076, "driven_lanedir": 1.7193460595265917, "sim_render-ego": 0.00986914316813151, "in-drivable-lane": 2.4500000000000135, "agent_compute-ego": 0.023278740247090656, "deviation-heading": 3.8279592093025983, "set_robot_commands": 0.007729101975758871, "deviation-center-line": 1.4654263399997178, "driven_lanedir_consec": 1.7193460595265917, "sim_compute_sim_state": 0.003939237594604492, "sim_compute_performance-ego": 0.005678659280141195, "sim_compute_robot_state-ego": 0.007116250991821289}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4965377065186573, "sim_physics": 0.09865573710865444, "survival_time": 3.599999999999995, "driven_lanedir": 0.44816230928357537, "sim_render-ego": 0.011295249064763388, "in-drivable-lane": 0, "agent_compute-ego": 0.025507357385423448, "deviation-heading": 1.3800723662696563, "set_robot_commands": 0.008995559480455186, "deviation-center-line": 0.2603647509011997, "driven_lanedir_consec": 0.44816230928357537, "sim_compute_sim_state": 0.004464858108096653, "sim_compute_performance-ego": 0.006535318162706163, "sim_compute_robot_state-ego": 0.008064197169409858}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.073893300159926, "sim_physics": 0.07806866924937178, "survival_time": 8.199999999999982, "driven_lanedir": 0.820134934593682, "sim_render-ego": 0.009891037533922894, "in-drivable-lane": 0.9999999999999992, "agent_compute-ego": 0.022108030028459503, "deviation-heading": 3.191236996055861, "set_robot_commands": 0.0076558589935302734, "deviation-center-line": 0.4750075577858208, "driven_lanedir_consec": 0.820134934593682, "sim_compute_sim_state": 0.00401430449834684, "sim_compute_performance-ego": 0.005610939933032524, "sim_compute_robot_state-ego": 0.007058709132962111}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5237110722042646, "sim_physics": 0.07620158256628574, "survival_time": 3.899999999999994, "driven_lanedir": 0.4568993232150605, "sim_render-ego": 0.009643453818101147, "in-drivable-lane": 0, "agent_compute-ego": 0.020806285051199105, "deviation-heading": 2.094212278408855, "set_robot_commands": 0.007089403959421011, "deviation-center-line": 0.24055552750056863, "driven_lanedir_consec": 0.4568993232150605, "sim_compute_sim_state": 0.0040360322365394, "sim_compute_performance-ego": 0.00579222043355306, "sim_compute_robot_state-ego": 0.006833165119855831}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6197767244507609, "sim_physics": 0.10177168701634262, "survival_time": 3.2999999999999963, "driven_lanedir": 0.5959074623650196, "sim_render-ego": 0.011472752600005178, "in-drivable-lane": 0, "agent_compute-ego": 0.02649060885111491, "deviation-heading": 0.7604177935973293, "set_robot_commands": 0.008967013070077606, "deviation-center-line": 0.23184302071238955, "driven_lanedir_consec": 0.5959074623650196, "sim_compute_sim_state": 0.00450610030781139, "sim_compute_performance-ego": 0.006632869893854315, "sim_compute_robot_state-ego": 0.00832161758885239}}
set_robot_commands_max0.008995559480455186
set_robot_commands_mean0.007532088704158132
set_robot_commands_median0.007093687852223714
set_robot_commands_min0.006422944971033045
sim_compute_performance-ego_max0.00685307052400377
sim_compute_performance-ego_mean0.00567496845027128
sim_compute_performance-ego_median0.005678659280141195
sim_compute_performance-ego_min0.004661401112874349
sim_compute_robot_state-ego_max0.00832161758885239
sim_compute_robot_state-ego_mean0.00706615675857182
sim_compute_robot_state-ego_median0.007058709132962111
sim_compute_robot_state-ego_min0.005928665399551392
sim_compute_sim_state_max0.00450610030781139
sim_compute_sim_state_mean0.003936880473450967
sim_compute_sim_state_median0.003939237594604492
sim_compute_sim_state_min0.0032976269721984863
sim_physics_max0.10177168701634262
sim_physics_mean0.08025469651488823
sim_physics_median0.07713473717371623
sim_physics_min0.06666945374530295
sim_render-ego_max0.011472752600005178
sim_render-ego_mean0.009873118093671649
sim_render-ego_median0.009891037533922894
sim_render-ego_min0.008211851119995117
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.86333333333334
survival_time_min1.2000000000000004
No reset possible
255784345Gianmarco Bernasconibaseline-IL-sim-tensorflowaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104901:00:29
Waited 3601 seconds [...]
Waited 3601 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
255594472Frank (Chude) Qian 🇨🇦In duckietown we do not endorse DUI...aido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5289579821083561
survival_time_median7.199999999999982
deviation-center-line_median0.26001091295604617
in-drivable-lane_median1.6999999999999986


other stats
agent_compute-ego_max0.025937266910777378
agent_compute-ego_mean0.025255744823433745
agent_compute-ego_median0.025127434730529787
agent_compute-ego_min0.024411696654099684
deviation-center-line_max0.8022745918668799
deviation-center-line_mean0.38348004030287175
deviation-center-line_min0.07681240810093151
deviation-heading_max5.660424591646365
deviation-heading_mean3.1206591258229617
deviation-heading_median2.8374519085489713
deviation-heading_min0.2352776134292706
driven_any_max4.439925050071461
driven_any_mean2.232598785988309
driven_any_median2.1377585441330247
driven_any_min0.736739440737157
driven_lanedir_consec_max0.8560845453834738
driven_lanedir_consec_mean0.5820726668148994
driven_lanedir_consec_min0.21784603370414368
driven_lanedir_max1.64012911834814
driven_lanedir_mean0.9426421228460942
driven_lanedir_median0.8124720243857939
driven_lanedir_min0.21784603370414368
in-drivable-lane_max5.650000000000036
in-drivable-lane_mean2.6400000000000032
in-drivable-lane_min1.4499999999999962
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5662654313398763, "sim_physics": 0.1028916358947754, "survival_time": 8.499999999999986, "driven_lanedir": 1.424402961212166, "sim_render-ego": 0.01226798506344066, "in-drivable-lane": 1.4499999999999962, "agent_compute-ego": 0.025937266910777378, "deviation-heading": 4.957804748675153, "set_robot_commands": 0.009438492270076976, "deviation-center-line": 0.553069241776435, "driven_lanedir_consec": 0.8264336749070118, "sim_compute_sim_state": 0.004864288778866039, "sim_compute_performance-ego": 0.0075622278101304, "sim_compute_robot_state-ego": 0.009159476616803336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.439925050071461, "sim_physics": 0.10564968848992072, "survival_time": 14.050000000000065, "driven_lanedir": 1.64012911834814, "sim_render-ego": 0.012224504531914654, "in-drivable-lane": 5.650000000000036, "agent_compute-ego": 0.025772903313416175, "deviation-heading": 5.660424591646365, "set_robot_commands": 0.009363871876455286, "deviation-center-line": 0.8022745918668799, "driven_lanedir_consec": 0.8560845453834738, "sim_compute_sim_state": 0.004846112159647551, "sim_compute_performance-ego": 0.00783363695246469, "sim_compute_robot_state-ego": 0.008754663195898524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.736739440737157, "sim_physics": 0.09733461875181933, "survival_time": 2.5999999999999988, "driven_lanedir": 0.21784603370414368, "sim_render-ego": 0.011790935809795674, "in-drivable-lane": 1.6999999999999986, "agent_compute-ego": 0.024411696654099684, "deviation-heading": 0.2352776134292706, "set_robot_commands": 0.008206463777101956, "deviation-center-line": 0.07681240810093151, "driven_lanedir_consec": 0.21784603370414368, "sim_compute_sim_state": 0.004568054125859187, "sim_compute_performance-ego": 0.006856102209824782, "sim_compute_robot_state-ego": 0.008008580941420335}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2823054636600255, "sim_physics": 0.1064707350730896, "survival_time": 4.99999999999999, "driven_lanedir": 0.6183604765802271, "sim_render-ego": 0.012220163345336914, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.025127434730529787, "deviation-heading": 1.9123367668150488, "set_robot_commands": 0.009160716533660887, "deviation-center-line": 0.2252330468140661, "driven_lanedir_consec": 0.5289579821083561, "sim_compute_sim_state": 0.004461042881011963, "sim_compute_performance-ego": 0.006930904388427734, "sim_compute_robot_state-ego": 0.008849918842315674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1377585441330247, "sim_physics": 0.09852857887744904, "survival_time": 7.199999999999982, "driven_lanedir": 0.8124720243857939, "sim_render-ego": 0.0117445041735967, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.02502942250834571, "deviation-heading": 2.8374519085489713, "set_robot_commands": 0.008836868736479018, "deviation-center-line": 0.26001091295604617, "driven_lanedir_consec": 0.48104109797151207, "sim_compute_sim_state": 0.004825946357515123, "sim_compute_performance-ego": 0.006893452670839097, "sim_compute_robot_state-ego": 0.008835395177205404}}
set_robot_commands_max0.009438492270076976
set_robot_commands_mean0.009001282638754823
set_robot_commands_median0.009160716533660887
set_robot_commands_min0.008206463777101956
sim_compute_performance-ego_max0.00783363695246469
sim_compute_performance-ego_mean0.0072152648063373405
sim_compute_performance-ego_median0.006930904388427734
sim_compute_performance-ego_min0.006856102209824782
sim_compute_robot_state-ego_max0.009159476616803336
sim_compute_robot_state-ego_mean0.008721606954728654
sim_compute_robot_state-ego_median0.008835395177205404
sim_compute_robot_state-ego_min0.008008580941420335
sim_compute_sim_state_max0.004864288778866039
sim_compute_sim_state_mean0.0047130888605799726
sim_compute_sim_state_median0.004825946357515123
sim_compute_sim_state_min0.004461042881011963
sim_physics_max0.1064707350730896
sim_physics_mean0.10217505141741082
sim_physics_median0.1028916358947754
sim_physics_min0.09733461875181933
sim_render-ego_max0.01226798506344066
sim_render-ego_mean0.012049618584816922
sim_render-ego_median0.012220163345336914
sim_render-ego_min0.0117445041735967
simulation-passed1
survival_time_max14.050000000000065
survival_time_mean7.470000000000004
survival_time_min2.5999999999999988
No reset possible
255184470Mikita Sazanovich 🇷🇺chameleonaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.623149517935553
survival_time_median5.4999999999999885
deviation-center-line_median0.31502759447445094
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.040670433559933224
agent_compute-ego_mean0.03951445581133853
agent_compute-ego_median0.03961698421791418
agent_compute-ego_min0.03787023587660356
deviation-center-line_max0.8519642929729669
deviation-center-line_mean0.3787862727690831
deviation-center-line_min0.06772323367764159
deviation-heading_max3.796602699202559
deviation-heading_mean1.706878548804958
deviation-heading_median1.30080087531374
deviation-heading_min0.37190938684878494
driven_any_max5.970029624435623
driven_any_mean3.11575368660172
driven_any_median2.3823195862584825
driven_any_min1.696094642666834
driven_lanedir_consec_max3.847020149431097
driven_lanedir_consec_mean2.057403877909872
driven_lanedir_consec_min1.2988144861358166
driven_lanedir_max3.847020149431097
driven_lanedir_mean2.057403877909872
driven_lanedir_median1.623149517935553
driven_lanedir_min1.2988144861358166
in-drivable-lane_max3.7000000000000144
in-drivable-lane_mean1.9399999999999984
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2050849418716387, "sim_physics": 0.05742538619685818, "survival_time": 7.399999999999982, "driven_lanedir": 2.0463736693903036, "sim_render-ego": 0.007310706215935784, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.040670433559933224, "deviation-heading": 1.8564482088392256, "set_robot_commands": 0.005075952491244754, "deviation-center-line": 0.3659235318729334, "driven_lanedir_consec": 2.0463736693903036, "sim_compute_sim_state": 0.0030793402646038985, "sim_compute_performance-ego": 0.0043000256693041, "sim_compute_robot_state-ego": 0.0051484800673819876}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3252396377760243, "sim_physics": 0.05674075424124341, "survival_time": 5.449999999999989, "driven_lanedir": 1.4716615666565882, "sim_render-ego": 0.0073620594969583215, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.039196392811766456, "deviation-heading": 1.208631573820481, "set_robot_commands": 0.005097415469108371, "deviation-center-line": 0.31502759447445094, "driven_lanedir_consec": 1.4716615666565882, "sim_compute_sim_state": 0.0031060669400276393, "sim_compute_performance-ego": 0.004103398104326441, "sim_compute_robot_state-ego": 0.005143576805744696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3823195862584825, "sim_physics": 0.05478855913335627, "survival_time": 5.4999999999999885, "driven_lanedir": 1.623149517935553, "sim_render-ego": 0.007235819643194025, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.03787023587660356, "deviation-heading": 1.30080087531374, "set_robot_commands": 0.0050141052766279745, "deviation-center-line": 0.29329271084742253, "driven_lanedir_consec": 1.623149517935553, "sim_compute_sim_state": 0.0030277924104170364, "sim_compute_performance-ego": 0.004056726802479137, "sim_compute_robot_state-ego": 0.005083766850558194}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.696094642666834, "sim_physics": 0.05953659245997299, "survival_time": 4.049999999999994, "driven_lanedir": 1.2988144861358166, "sim_render-ego": 0.007553636291880666, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.0402182325904752, "deviation-heading": 0.37190938684878494, "set_robot_commands": 0.005227498066278152, "deviation-center-line": 0.06772323367764159, "driven_lanedir_consec": 1.2988144861358166, "sim_compute_sim_state": 0.0032462279001871743, "sim_compute_performance-ego": 0.0042065514458550345, "sim_compute_robot_state-ego": 0.005192426987636237}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.970029624435623, "sim_physics": 0.05982882407174182, "survival_time": 13.400000000000055, "driven_lanedir": 3.847020149431097, "sim_render-ego": 0.00732965433775489, "in-drivable-lane": 3.7000000000000144, "agent_compute-ego": 0.03961698421791418, "deviation-heading": 3.796602699202559, "set_robot_commands": 0.004984292521405576, "deviation-center-line": 0.8519642929729669, "driven_lanedir_consec": 3.847020149431097, "sim_compute_sim_state": 0.0031045577419337943, "sim_compute_performance-ego": 0.004133812527158367, "sim_compute_robot_state-ego": 0.005102129124883396}}
set_robot_commands_max0.005227498066278152
set_robot_commands_mean0.005079852764932966
set_robot_commands_median0.005075952491244754
set_robot_commands_min0.004984292521405576
sim_compute_performance-ego_max0.0043000256693041
sim_compute_performance-ego_mean0.0041601029098246155
sim_compute_performance-ego_median0.004133812527158367
sim_compute_performance-ego_min0.004056726802479137
sim_compute_robot_state-ego_max0.005192426987636237
sim_compute_robot_state-ego_mean0.005134075967240902
sim_compute_robot_state-ego_median0.005143576805744696
sim_compute_robot_state-ego_min0.005083766850558194
sim_compute_sim_state_max0.0032462279001871743
sim_compute_sim_state_mean0.003112797051433909
sim_compute_sim_state_median0.0031045577419337943
sim_compute_sim_state_min0.0030277924104170364
sim_physics_max0.05982882407174182
sim_physics_mean0.05766402322063454
sim_physics_median0.05742538619685818
sim_physics_min0.05478855913335627
sim_render-ego_max0.007553636291880666
sim_render-ego_mean0.007358375197144738
sim_render-ego_median0.00732965433775489
sim_render-ego_min0.007235819643194025
simulation-passed1
survival_time_max13.400000000000055
survival_time_mean7.160000000000002
survival_time_min4.049999999999994
No reset possible
254824447Bea Baselines 🐤challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1037481277089891
survival_time_median11.400000000000029
deviation-center-line_median0.7268844917097901
in-drivable-lane_median1.0499999999999965


other stats
agent_compute-ego_max0.04139787991841634
agent_compute-ego_mean0.02486565774358355
agent_compute-ego_median0.023172242033715346
agent_compute-ego_min0.016546367553242465
deviation-center-line_max0.8634341957700175
deviation-center-line_mean0.5361526748900672
deviation-center-line_min0.15333203125960693
deviation-heading_max5.85371445176292
deviation-heading_mean3.1132291708864
deviation-heading_median1.752899955664432
deviation-heading_min0.9053966584437292
driven_any_max2.3487414428052475
driven_any_mean1.466604489774772
driven_any_median1.7785464912521565
driven_any_min0.5735054455158473
driven_lanedir_consec_max1.9476104435828787
driven_lanedir_consec_mean1.0829234160962649
driven_lanedir_consec_min0.12612080163556527
driven_lanedir_max1.9476104435828787
driven_lanedir_mean1.1288072175228003
driven_lanedir_median1.3331671348416665
driven_lanedir_min0.12612080163556527
in-drivable-lane_max2.4499999999999953
in-drivable-lane_mean1.1700000000000008
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5735054455158473, "sim_physics": 0.06395783605454844, "survival_time": 3.949999999999994, "driven_lanedir": 0.48777181331784936, "sim_render-ego": 0.007525374617757676, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.017919483064096187, "deviation-heading": 0.9053966584437292, "set_robot_commands": 0.007318116441557679, "deviation-center-line": 0.18755478498430295, "driven_lanedir_consec": 0.48777181331784936, "sim_compute_sim_state": 0.003768021547341648, "sim_compute_performance-ego": 0.004574150978764401, "sim_compute_robot_state-ego": 0.005401228047624419}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7785464912521565, "sim_physics": 0.06009824966129504, "survival_time": 11.400000000000029, "driven_lanedir": 1.749365894236042, "sim_render-ego": 0.007589624639143024, "in-drivable-lane": 0, "agent_compute-ego": 0.016546367553242465, "deviation-heading": 1.752899955664432, "set_robot_commands": 0.007089208092605858, "deviation-center-line": 0.7495578707266186, "driven_lanedir_consec": 1.749365894236042, "sim_compute_sim_state": 0.003548679644601387, "sim_compute_performance-ego": 0.004364509331552606, "sim_compute_robot_state-ego": 0.005434503680781314}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.995008458931856, "sim_physics": 0.09054102897644042, "survival_time": 12.750000000000046, "driven_lanedir": 1.3331671348416665, "sim_render-ego": 0.01069345380745682, "in-drivable-lane": 2.0000000000000133, "agent_compute-ego": 0.023172242033715346, "deviation-heading": 5.85371445176292, "set_robot_commands": 0.009139709846646178, "deviation-center-line": 0.8634341957700175, "driven_lanedir_consec": 1.1037481277089891, "sim_compute_sim_state": 0.004749098946066464, "sim_compute_performance-ego": 0.006556268766814587, "sim_compute_robot_state-ego": 0.008026828017889285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6372206103687535, "sim_physics": 0.09536454012227612, "survival_time": 4.299999999999993, "driven_lanedir": 0.12612080163556527, "sim_render-ego": 0.0115263351174288, "in-drivable-lane": 2.4499999999999953, "agent_compute-ego": 0.025292316148447437, "deviation-heading": 1.482197156449779, "set_robot_commands": 0.010936537454294603, "deviation-center-line": 0.15333203125960693, "driven_lanedir_consec": 0.12612080163556527, "sim_compute_sim_state": 0.005354088406230128, "sim_compute_performance-ego": 0.007012680519458859, "sim_compute_robot_state-ego": 0.008360025494597679}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3487414428052475, "sim_physics": 0.09739511648813884, "survival_time": 14.950000000000076, "driven_lanedir": 1.9476104435828787, "sim_render-ego": 0.011817036469777425, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.04139787991841634, "deviation-heading": 5.571937632111143, "set_robot_commands": 0.009468505382537842, "deviation-center-line": 0.7268844917097901, "driven_lanedir_consec": 1.9476104435828787, "sim_compute_sim_state": 0.004885569413503011, "sim_compute_performance-ego": 0.006906048456827799, "sim_compute_robot_state-ego": 0.008647233645121256}}
set_robot_commands_max0.010936537454294603
set_robot_commands_mean0.008790415443528432
set_robot_commands_median0.009139709846646178
set_robot_commands_min0.007089208092605858
sim_compute_performance-ego_max0.007012680519458859
sim_compute_performance-ego_mean0.00588273161068365
sim_compute_performance-ego_median0.006556268766814587
sim_compute_performance-ego_min0.004364509331552606
sim_compute_robot_state-ego_max0.008647233645121256
sim_compute_robot_state-ego_mean0.007173963777202791
sim_compute_robot_state-ego_median0.008026828017889285
sim_compute_robot_state-ego_min0.005401228047624419
sim_compute_sim_state_max0.005354088406230128
sim_compute_sim_state_mean0.0044610915915485275
sim_compute_sim_state_median0.004749098946066464
sim_compute_sim_state_min0.003548679644601387
sim_physics_max0.09739511648813884
sim_physics_mean0.08147135426053978
sim_physics_median0.09054102897644042
sim_physics_min0.06009824966129504
sim_render-ego_max0.011817036469777425
sim_render-ego_mean0.009830364930312748
sim_render-ego_median0.01069345380745682
sim_render-ego_min0.007525374617757676
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.470000000000027
survival_time_min3.949999999999994
No reset possible
254794445Frank (Chude) Qian 🇨🇦Frank custom server testaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.226050282428791
survival_time_median3.349999999999996
deviation-center-line_median0.08538446975104098
in-drivable-lane_median0.7999999999999978


other stats
agent_compute-ego_max0.017479231724372275
agent_compute-ego_mean0.016803927924783284
agent_compute-ego_median0.016682551020667666
agent_compute-ego_min0.016506547125700478
deviation-center-line_max0.2927625903223233
deviation-center-line_mean0.14451727528756214
deviation-center-line_min0.07893331429824882
deviation-heading_max0.9831282162429952
deviation-heading_mean0.6165075749460409
deviation-heading_median0.5507094281136309
deviation-heading_min0.35836015638343405
driven_any_max2.2383153120678188
driven_any_mean1.4235093205112497
driven_any_median1.3936168440528105
driven_any_min0.8001085732983775
driven_lanedir_consec_max1.767285372707425
driven_lanedir_consec_mean1.1263287657647072
driven_lanedir_consec_min0.6209965346704438
driven_lanedir_max1.767285372707425
driven_lanedir_mean1.1263287657647072
driven_lanedir_median1.226050282428791
driven_lanedir_min0.6209965346704438
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.5699999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0184176441962114, "sim_physics": 0.060315572298490085, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6209965346704438, "sim_render-ego": 0.007495935146625225, "in-drivable-lane": 0.7999999999999978, "agent_compute-ego": 0.017479231724372275, "deviation-heading": 0.5507094281136309, "set_robot_commands": 0.005194540207202618, "deviation-center-line": 0.07893331429824882, "driven_lanedir_consec": 0.6209965346704438, "sim_compute_sim_state": 0.0031026372542748083, "sim_compute_performance-ego": 0.004346251487731934, "sim_compute_robot_state-ego": 0.005216295902545636}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2383153120678188, "sim_physics": 0.05636517132554099, "survival_time": 5.349999999999989, "driven_lanedir": 1.767285372707425, "sim_render-ego": 0.007328730877314772, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.016506547125700478, "deviation-heading": 0.9831282162429952, "set_robot_commands": 0.005021153209365417, "deviation-center-line": 0.2927625903223233, "driven_lanedir_consec": 1.767285372707425, "sim_compute_sim_state": 0.002985778255997417, "sim_compute_performance-ego": 0.0040883928815895155, "sim_compute_robot_state-ego": 0.005169696896989769}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8001085732983775, "sim_physics": 0.058035243125188915, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6639752696220769, "sim_render-ego": 0.007364738555181594, "in-drivable-lane": 0.24999999999999956, "agent_compute-ego": 0.016682551020667666, "deviation-heading": 0.35836015638343405, "set_robot_commands": 0.005033027558099656, "deviation-center-line": 0.08538446975104098, "driven_lanedir_consec": 0.6639752696220769, "sim_compute_sim_state": 0.0031235558646065848, "sim_compute_performance-ego": 0.004101940563746861, "sim_compute_robot_state-ego": 0.005154081753322056}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6670882289410307, "sim_physics": 0.05853954553604126, "survival_time": 3.999999999999994, "driven_lanedir": 1.226050282428791, "sim_render-ego": 0.007315921783447266, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.016694167256355287, "deviation-heading": 0.4356095120225152, "set_robot_commands": 0.0050935477018356325, "deviation-center-line": 0.08210524807298401, "driven_lanedir_consec": 1.226050282428791, "sim_compute_sim_state": 0.003074893355369568, "sim_compute_performance-ego": 0.004076802730560302, "sim_compute_robot_state-ego": 0.005144491791725159}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3936168440528105, "sim_physics": 0.06076093929917065, "survival_time": 3.349999999999996, "driven_lanedir": 1.3533363693947995, "sim_render-ego": 0.007221033324056597, "in-drivable-lane": 0, "agent_compute-ego": 0.016657142496820706, "deviation-heading": 0.7547305619676296, "set_robot_commands": 0.005128305349776994, "deviation-center-line": 0.18340075399321368, "driven_lanedir_consec": 1.3533363693947995, "sim_compute_sim_state": 0.00304764776087519, "sim_compute_performance-ego": 0.004004756016517753, "sim_compute_robot_state-ego": 0.0051035916627343025}}
set_robot_commands_max0.005194540207202618
set_robot_commands_mean0.0050941148052560635
set_robot_commands_median0.0050935477018356325
set_robot_commands_min0.005021153209365417
sim_compute_performance-ego_max0.004346251487731934
sim_compute_performance-ego_mean0.004123628736029273
sim_compute_performance-ego_median0.0040883928815895155
sim_compute_performance-ego_min0.004004756016517753
sim_compute_robot_state-ego_max0.005216295902545636
sim_compute_robot_state-ego_mean0.005157631601463384
sim_compute_robot_state-ego_median0.005154081753322056
sim_compute_robot_state-ego_min0.0051035916627343025
sim_compute_sim_state_max0.0031235558646065848
sim_compute_sim_state_mean0.0030669024982247135
sim_compute_sim_state_median0.003074893355369568
sim_compute_sim_state_min0.002985778255997417
sim_physics_max0.06076093929917065
sim_physics_mean0.05880329431688639
sim_physics_median0.05853954553604126
sim_physics_min0.05636517132554099
sim_render-ego_max0.007495935146625225
sim_render-ego_mean0.007345271937325091
sim_render-ego_median0.007328730877314772
sim_render-ego_min0.007221033324056597
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean3.4799999999999955
survival_time_min2.1000000000000005
No reset possible
254744440Bea Baselines 🐤straightaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:19:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4457418026847923
survival_time_median6.349999999999985
deviation-center-line_median0.2227296372541947
in-drivable-lane_median1.499999999999995


other stats
agent_compute-ego_max0.014992252109557624
agent_compute-ego_mean0.01430570000518409
agent_compute-ego_median0.014252291785346136
agent_compute-ego_min0.013735829567422673
deviation-center-line_max1.2631416803379316
deviation-center-line_mean0.342871089234744
deviation-center-line_min0.1612683272550955
deviation-heading_max2.1043834490839433
deviation-heading_mean0.952384318481698
deviation-heading_median0.8432812468215765
deviation-heading_min0.46823944403892
driven_any_max2.41759459008384
driven_any_mean0.9974185927319902
driven_any_median0.9928463432572194
driven_any_min0.31735491401313676
driven_lanedir_consec_max2.3714081328644827
driven_lanedir_consec_mean0.6352144379055347
driven_lanedir_consec_min0.24305756068667503
driven_lanedir_max2.3714081328644827
driven_lanedir_mean0.6352144379055347
driven_lanedir_median0.4457418026847923
driven_lanedir_min0.24305756068667503
in-drivable-lane_max8.700000000000092
in-drivable-lane_mean1.980000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4329892855289159, "sim_physics": 0.12269070188877948, "survival_time": 2.9499999999999975, "driven_lanedir": 0.41895655267034937, "sim_render-ego": 0.007654388072127003, "in-drivable-lane": 0, "agent_compute-ego": 0.01481032371520996, "deviation-heading": 0.7560843063940643, "set_robot_commands": 0.0052566609140169826, "deviation-center-line": 0.19764810458264365, "driven_lanedir_consec": 0.41895655267034937, "sim_compute_sim_state": 0.003044972985477771, "sim_compute_performance-ego": 0.0042568384590795484, "sim_compute_robot_state-ego": 0.0053107172755871785, "sim_compute_robot_state-npc0": 0.005114466457043664, "sim_compute_robot_state-npc1": 0.004952976259134583, "sim_compute_robot_state-npc2": 0.004941798872866873, "sim_compute_robot_state-npc3": 0.0048523030038607326}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9928463432572194, "sim_physics": 0.10753000439621332, "survival_time": 6.349999999999985, "driven_lanedir": 0.6672388924780033, "sim_render-ego": 0.00743131750211941, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.014992252109557624, "deviation-heading": 1.1654096008330035, "set_robot_commands": 0.005072711959598571, "deviation-center-line": 0.17732720098681884, "driven_lanedir_consec": 0.6672388924780033, "sim_compute_sim_state": 0.003087263407669668, "sim_compute_performance-ego": 0.004174330103115772, "sim_compute_robot_state-ego": 0.005161152111263726, "sim_compute_robot_state-npc0": 0.005037065566055418, "sim_compute_robot_state-npc1": 0.004913303795761949, "sim_compute_robot_state-npc2": 0.004901386621430164, "sim_compute_robot_state-npc3": 0.004855381222221795}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.249688872261276, "sim_physics": 0.12299579155595997, "survival_time": 7.89999999999998, "driven_lanedir": 0.24305756068667503, "sim_render-ego": 0.007585364052011997, "in-drivable-lane": 6.049999999999979, "agent_compute-ego": 0.014456436603884154, "deviation-heading": 0.46823944403892, "set_robot_commands": 0.005081623415403728, "deviation-center-line": 0.2288047809259315, "driven_lanedir_consec": 0.24305756068667503, "sim_compute_sim_state": 0.003223133992545212, "sim_compute_performance-ego": 0.00433475759964955, "sim_compute_robot_state-ego": 0.005292346205892442, "sim_compute_robot_state-npc0": 0.005171561542945572, "sim_compute_robot_state-npc1": 0.005084098139895668, "sim_compute_robot_state-npc2": 0.005069296571272838, "sim_compute_robot_state-npc3": 0.005034860176376149}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.31768933230030155, "sim_physics": 0.11998487578497992, "survival_time": 2.25, "driven_lanedir": 0.2985260181972271, "sim_render-ego": 0.007603316836886935, "in-drivable-lane": 0, "agent_compute-ego": 0.014286465115017362, "deviation-heading": 0.7840179475951651, "set_robot_commands": 0.004962433709038629, "deviation-center-line": 0.1612683272550955, "driven_lanedir_consec": 0.2985260181972271, "sim_compute_sim_state": 0.002995994355943468, "sim_compute_performance-ego": 0.004146734873453776, "sim_compute_robot_state-ego": 0.005155499776204427, "sim_compute_robot_state-npc0": 0.0049697928958468965, "sim_compute_robot_state-npc1": 0.004865948359171549, "sim_compute_robot_state-npc2": 0.004862213134765625, "sim_compute_robot_state-npc3": 0.004808648427327474}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0448801303363977, "sim_physics": 0.10522591440301192, "survival_time": 6.649999999999984, "driven_lanedir": 0.37391419923137703, "sim_render-ego": 0.007433511260756873, "in-drivable-lane": 3.949999999999986, "agent_compute-ego": 0.014313878869651853, "deviation-heading": 0.8432812468215765, "set_robot_commands": 0.0051093944033285725, "deviation-center-line": 0.20846961693130656, "driven_lanedir_consec": 0.37391419923137703, "sim_compute_sim_state": 0.003066145387807287, "sim_compute_performance-ego": 0.004193115951423358, "sim_compute_robot_state-ego": 0.00521239839998403, "sim_compute_robot_state-npc0": 0.005107829445286801, "sim_compute_robot_state-npc1": 0.004933577731139678, "sim_compute_robot_state-npc2": 0.004866128577325577, "sim_compute_robot_state-npc3": 0.0048640419666032145}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0025370480638232, "sim_physics": 0.10109912417829035, "survival_time": 6.399999999999985, "driven_lanedir": 0.5879267890938082, "sim_render-ego": 0.007308933883905411, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.01419283077120781, "deviation-heading": 0.7775492031495066, "set_robot_commands": 0.005012918263673782, "deviation-center-line": 0.2652920715140952, "driven_lanedir_consec": 0.5879267890938082, "sim_compute_sim_state": 0.003093177452683449, "sim_compute_performance-ego": 0.0041800606995821, "sim_compute_robot_state-ego": 0.00519641675055027, "sim_compute_robot_state-npc0": 0.005117550492286682, "sim_compute_robot_state-npc1": 0.004912091419100761, "sim_compute_robot_state-npc2": 0.004867866635322571, "sim_compute_robot_state-npc3": 0.004891689866781235}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.31735491401313676, "sim_physics": 0.11636346181233724, "survival_time": 2.25, "driven_lanedir": 0.3104426481401483, "sim_render-ego": 0.007820796966552735, "in-drivable-lane": 0, "agent_compute-ego": 0.014835500717163086, "deviation-heading": 0.4694334676490585, "set_robot_commands": 0.00524491204155816, "deviation-center-line": 0.2227296372541947, "driven_lanedir_consec": 0.3104426481401483, "sim_compute_sim_state": 0.0033027172088623048, "sim_compute_performance-ego": 0.004366758134629991, "sim_compute_robot_state-ego": 0.005346828036838108, "sim_compute_robot_state-npc0": 0.005318546295166015, "sim_compute_robot_state-npc1": 0.005192952685885959, "sim_compute_robot_state-npc2": 0.005150779088338216, "sim_compute_robot_state-npc3": 0.0051653120252821184}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.9933021024107224, "sim_physics": 0.10502315881684073, "survival_time": 6.349999999999985, "driven_lanedir": 0.6527338458429284, "sim_render-ego": 0.007309594492274006, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01386182326970138, "deviation-heading": 0.9069266665397084, "set_robot_commands": 0.0050458476299376, "deviation-center-line": 0.1702624973511265, "driven_lanedir_consec": 0.6527338458429284, "sim_compute_sim_state": 0.0030376423062301997, "sim_compute_performance-ego": 0.00411908082136019, "sim_compute_robot_state-ego": 0.005195638326209361, "sim_compute_robot_state-npc0": 0.005005949125515195, "sim_compute_robot_state-npc1": 0.004851791802353746, "sim_compute_robot_state-npc2": 0.004785040232140248, "sim_compute_robot_state-npc3": 0.004798907933272715}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.9890171070915718, "sim_physics": 0.09627077503809851, "survival_time": 6.299999999999986, "driven_lanedir": 0.8185004876290302, "sim_render-ego": 0.007392928713843936, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.014252291785346136, "deviation-heading": 1.2725732848991698, "set_robot_commands": 0.0051842038593594994, "deviation-center-line": 0.510451586767386, "driven_lanedir_consec": 0.8185004876290302, "sim_compute_sim_state": 0.003093679745992025, "sim_compute_performance-ego": 0.004200922118292915, "sim_compute_robot_state-ego": 0.005258261211334713, "sim_compute_robot_state-npc0": 0.005090119346739754, "sim_compute_robot_state-npc1": 0.004957132869296604, "sim_compute_robot_state-npc2": 0.004919918756636363, "sim_compute_robot_state-npc3": 0.004928337203131782}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.022761323287175, "sim_physics": 0.09969945504115178, "survival_time": 6.499999999999985, "driven_lanedir": 0.4457418026847923, "sim_render-ego": 0.009290814399719238, "in-drivable-lane": 2.7499999999999902, "agent_compute-ego": 0.01416636797098013, "deviation-heading": 2.1043834490839433, "set_robot_commands": 0.005101557878347544, "deviation-center-line": 0.4008535939203093, "driven_lanedir_consec": 0.4457418026847923, "sim_compute_sim_state": 0.003058914037851187, "sim_compute_performance-ego": 0.0041545482782217175, "sim_compute_robot_state-ego": 0.005171819833608774, "sim_compute_robot_state-npc0": 0.005121051348172701, "sim_compute_robot_state-npc1": 0.004967383237985464, "sim_compute_robot_state-npc2": 0.004942098030677209, "sim_compute_robot_state-npc3": 0.004897308349609375}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3484915987149802, "sim_physics": 0.09727691630927884, "survival_time": 2.4499999999999993, "driven_lanedir": 0.33388668383012376, "sim_render-ego": 0.007352717068730568, "in-drivable-lane": 0, "agent_compute-ego": 0.013735829567422673, "deviation-heading": 0.7068812272223673, "set_robot_commands": 0.005081585475376674, "deviation-center-line": 0.17895466028241783, "driven_lanedir_consec": 0.33388668383012376, "sim_compute_sim_state": 0.0030256193511340084, "sim_compute_performance-ego": 0.0041547356819619935, "sim_compute_robot_state-ego": 0.005216146002010424, "sim_compute_robot_state-npc0": 0.005095384558852838, "sim_compute_robot_state-npc1": 0.004966370913447166, "sim_compute_robot_state-npc2": 0.004945939900923749, "sim_compute_robot_state-npc3": 0.004841298473124601}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.4152329850615875, "sim_physics": 0.09648241996765136, "survival_time": 14.950000000000076, "driven_lanedir": 2.3714081328644827, "sim_render-ego": 0.007295518716176351, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.014201447168986005, "deviation-heading": 0.5233488222993907, "set_robot_commands": 0.005055894056955973, "deviation-center-line": 1.2631416803379316, "driven_lanedir_consec": 2.3714081328644827, "sim_compute_sim_state": 0.003069485028584798, "sim_compute_performance-ego": 0.004187446435292562, "sim_compute_robot_state-ego": 0.005200858116149902, "sim_compute_robot_state-npc0": 0.0050401743253072106, "sim_compute_robot_state-npc1": 0.004908790588378906, "sim_compute_robot_state-npc2": 0.004911983807881673, "sim_compute_robot_state-npc3": 0.004902373949686686}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.41759459008384, "sim_physics": 0.11189010302225748, "survival_time": 14.950000000000076, "driven_lanedir": 0.9703003871978582, "sim_render-ego": 0.007365454832712809, "in-drivable-lane": 8.700000000000092, "agent_compute-ego": 0.014215680758158366, "deviation-heading": 0.882476286115582, "set_robot_commands": 0.005035121440887452, "deviation-center-line": 0.4639383541046247, "driven_lanedir_consec": 0.9703003871978582, "sim_compute_sim_state": 0.0031127103169759115, "sim_compute_performance-ego": 0.004233212471008301, "sim_compute_robot_state-ego": 0.005208941300710043, "sim_compute_robot_state-npc0": 0.0050620102882385255, "sim_compute_robot_state-npc1": 0.004932146867116292, "sim_compute_robot_state-npc2": 0.004921510219573975, "sim_compute_robot_state-npc3": 0.00493042786916097}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4243481729081477, "sim_physics": 0.09808213957424822, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4061041160209205, "sim_render-ego": 0.007398465584064352, "in-drivable-lane": 0, "agent_compute-ego": 0.013953677539167732, "deviation-heading": 0.857859207789819, "set_robot_commands": 0.0050057789375042095, "deviation-center-line": 0.2015888143261586, "driven_lanedir_consec": 0.4061041160209205, "sim_compute_sim_state": 0.0030706545402263774, "sim_compute_performance-ego": 0.004136299264842066, "sim_compute_robot_state-ego": 0.005202757901158826, "sim_compute_robot_state-npc0": 0.005018320576897983, "sim_compute_robot_state-npc1": 0.004890359681228112, "sim_compute_robot_state-npc2": 0.0048995963458357186, "sim_compute_robot_state-npc3": 0.004913017667573074}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.992545085660759, "sim_physics": 0.10975244289308082, "survival_time": 6.349999999999985, "driven_lanedir": 0.6294784520152947, "sim_render-ego": 0.007216881579301488, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.014310694116307057, "deviation-heading": 1.7673006167941945, "set_robot_commands": 0.006371556304571197, "deviation-center-line": 0.4923354119811209, "driven_lanedir_consec": 0.6294784520152947, "sim_compute_sim_state": 0.003007678535040908, "sim_compute_performance-ego": 0.004145620376106322, "sim_compute_robot_state-ego": 0.005153870019387072, "sim_compute_robot_state-npc0": 0.005021305534783311, "sim_compute_robot_state-npc1": 0.004884515221663347, "sim_compute_robot_state-npc2": 0.0048286971144788846, "sim_compute_robot_state-npc3": 0.004821416899913878}}
set_robot_commands_max0.006371556304571197
set_robot_commands_mean0.005174813352637239
set_robot_commands_median0.005081585475376674
set_robot_commands_min0.004962433709038629
sim_compute_performance-ego_max0.004366758134629991
sim_compute_performance-ego_mean0.004198964084534678
sim_compute_performance-ego_median0.0041800606995821
sim_compute_performance-ego_min0.00411908082136019
sim_compute_robot_state-ego_max0.005346828036838108
sim_compute_robot_state-ego_mean0.005218910084459286
sim_compute_robot_state-ego_median0.005202757901158826
sim_compute_robot_state-ego_min0.005153870019387072
sim_compute_robot_state-npc0_max0.005318546295166015
sim_compute_robot_state-npc0_mean0.005086075186609237
sim_compute_robot_state-npc0_median0.005090119346739754
sim_compute_robot_state-npc0_min0.0049697928958468965
sim_compute_robot_state-npc1_max0.005192952685885959
sim_compute_robot_state-npc1_mean0.004947562638103985
sim_compute_robot_state-npc1_median0.004932146867116292
sim_compute_robot_state-npc1_min0.004851791802353746
sim_compute_robot_state-npc2_max0.005150779088338216
sim_compute_robot_state-npc2_mean0.004920950260631313
sim_compute_robot_state-npc2_median0.004911983807881673
sim_compute_robot_state-npc2_min0.004785040232140248
sim_compute_robot_state-npc3_max0.0051653120252821184
sim_compute_robot_state-npc3_mean0.004900355002261719
sim_compute_robot_state-npc3_median0.004891689866781235
sim_compute_robot_state-npc3_min0.004798907933272715
sim_compute_sim_state_max0.0033027172088623048
sim_compute_sim_state_mean0.003085985910201638
sim_compute_sim_state_median0.003069485028584798
sim_compute_sim_state_min0.002995994355943468
sim_physics_max0.12299579155595997
sim_physics_mean0.10735781897881198
sim_physics_median0.10522591440301192
sim_physics_min0.09627077503809851
sim_render-ego_max0.009290814399719238
sim_render-ego_mean0.007564000264078875
sim_render-ego_median0.007398465584064352
sim_render-ego_min0.007216881579301488
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.366666666666668
survival_time_min2.25
No reset possible
254454242Manfred DiazBaseline-IL-logs-tensorflowaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-35-218-104900:17:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253774258Anastasiya Nikolskaya 🇷🇺betaaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:34:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6842162955974498
survival_time_median9.650000000000002
deviation-center-line_median0.6073729526252555
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.10871266855776889
agent_compute-ego_mean0.0900206563610578
agent_compute-ego_median0.08475698232650757
agent_compute-ego_min0.0733935809135437
deviation-center-line_max0.9616978667205648
deviation-center-line_mean0.5622627267823419
deviation-center-line_min0.25559417134083084
deviation-heading_max6.068927233526385
deviation-heading_mean1.8946008954718372
deviation-heading_median1.098716433135229
deviation-heading_min0.6100628801077635
driven_any_max1.7228859256797326
driven_any_mean1.164802627161325
driven_any_median1.1155886127009185
driven_any_min0.41272095737453346
driven_lanedir_consec_max1.6893116937836616
driven_lanedir_consec_mean0.8577969887427419
driven_lanedir_consec_min0.3978686543735215
driven_lanedir_max1.6893116937836616
driven_lanedir_mean0.8979562900330952
driven_lanedir_median0.7210888154282136
driven_lanedir_min0.3978686543735215
in-drivable-lane_max6.850000000000097
in-drivable-lane_mean1.833333333333342
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.41272095737453346, "sim_physics": 0.10154068934452998, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3978686543735215, "sim_render-ego": 0.013069403635991085, "in-drivable-lane": 0, "agent_compute-ego": 0.08085223916289094, "deviation-heading": 1.0330262129146794, "set_robot_commands": 0.009069256968312449, "deviation-center-line": 0.30742819903127866, "driven_lanedir_consec": 0.3978686543735215, "sim_compute_sim_state": 0.004766380632078493, "sim_compute_performance-ego": 0.00687418355570211, "sim_compute_robot_state-ego": 0.008361296220259233}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4755461796143432, "sim_physics": 0.0957055672009786, "survival_time": 14.950000000000076, "driven_lanedir": 0.7210888154282136, "sim_render-ego": 0.010953039328257242, "in-drivable-lane": 6.850000000000097, "agent_compute-ego": 0.0733935809135437, "deviation-heading": 2.3819740433826824, "set_robot_commands": 0.008699459234873454, "deviation-center-line": 0.6248409516515341, "driven_lanedir_consec": 0.7210888154282136, "sim_compute_sim_state": 0.004447878996531169, "sim_compute_performance-ego": 0.006385744412740072, "sim_compute_robot_state-ego": 0.007919489542643229}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0719682117360971, "sim_physics": 0.11102464495325937, "survival_time": 8.449999999999985, "driven_lanedir": 0.8448135834658173, "sim_render-ego": 0.013100024511122844, "in-drivable-lane": 1.6500000000000012, "agent_compute-ego": 0.09754740839173807, "deviation-heading": 1.0845375824770096, "set_robot_commands": 0.010116928427882447, "deviation-center-line": 0.43499071928940025, "driven_lanedir_consec": 0.8448135834658173, "sim_compute_sim_state": 0.005392128193872215, "sim_compute_performance-ego": 0.007823314892469778, "sim_compute_robot_state-ego": 0.009613254366541755}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5487530935551066, "sim_physics": 0.09733729918797812, "survival_time": 14.950000000000076, "driven_lanedir": 1.3355337391879227, "sim_render-ego": 0.011436504522959391, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.07794365485509237, "deviation-heading": 4.621563970482877, "set_robot_commands": 0.008688219388326009, "deviation-center-line": 0.6355108948497472, "driven_lanedir_consec": 1.2031738862781638, "sim_compute_sim_state": 0.004832620620727539, "sim_compute_performance-ego": 0.006851323445638021, "sim_compute_robot_state-ego": 0.008195745944976806}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6369396014459543, "sim_physics": 0.11002647082010904, "survival_time": 14.950000000000076, "driven_lanedir": 1.616888375513983, "sim_render-ego": 0.012266039848327637, "in-drivable-lane": 0, "agent_compute-ego": 0.08475698232650757, "deviation-heading": 1.8756531978054185, "set_robot_commands": 0.009286266962687174, "deviation-center-line": 0.779418201952735, "driven_lanedir_consec": 1.616888375513983, "sim_compute_sim_state": 0.005132348537445069, "sim_compute_performance-ego": 0.007598795096079508, "sim_compute_robot_state-ego": 0.009187571207682292}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0307646573839642, "sim_physics": 0.10637743605507743, "survival_time": 7.199999999999982, "driven_lanedir": 0.6093185132877377, "sim_render-ego": 0.012206042806307474, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.08643217219246759, "deviation-heading": 0.7455802583230619, "set_robot_commands": 0.0096989373366038, "deviation-center-line": 0.25559417134083084, "driven_lanedir_consec": 0.6093185132877377, "sim_compute_sim_state": 0.005390094386206733, "sim_compute_performance-ego": 0.007656130525800917, "sim_compute_robot_state-ego": 0.008975265754593743}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5242942315010876, "sim_physics": 0.12198361378271604, "survival_time": 5.14999999999999, "driven_lanedir": 0.5192282835196329, "sim_render-ego": 0.013434988781086447, "in-drivable-lane": 0, "agent_compute-ego": 0.10871266855776889, "deviation-heading": 0.6100628801077635, "set_robot_commands": 0.009959424583657272, "deviation-center-line": 0.6073729526252555, "driven_lanedir_consec": 0.5192282835196329, "sim_compute_sim_state": 0.005284598730142834, "sim_compute_performance-ego": 0.007907904467536407, "sim_compute_robot_state-ego": 0.009680947053779676}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.7228859256797326, "sim_physics": 0.1017899495905096, "survival_time": 13.75000000000006, "driven_lanedir": 1.6893116937836616, "sim_render-ego": 0.012319042032415215, "in-drivable-lane": 0, "agent_compute-ego": 0.08453679431568492, "deviation-heading": 2.21968721677423, "set_robot_commands": 0.009367841373790394, "deviation-center-line": 0.9616978667205648, "driven_lanedir_consec": 1.6893116937836616, "sim_compute_sim_state": 0.005134220990267667, "sim_compute_performance-ego": 0.007522167725996538, "sim_compute_robot_state-ego": 0.00921293171969327}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0605290585323404, "sim_physics": 0.0992669305653152, "survival_time": 9.650000000000002, "driven_lanedir": 0.5820522584550145, "sim_render-ego": 0.011804098910000655, "in-drivable-lane": 4.150000000000014, "agent_compute-ego": 0.0786199211456615, "deviation-heading": 1.098716433135229, "set_robot_commands": 0.009147723104051975, "deviation-center-line": 0.28879674081541534, "driven_lanedir_consec": 0.5820522584550145, "sim_compute_sim_state": 0.004793971313713746, "sim_compute_performance-ego": 0.007035569205802957, "sim_compute_robot_state-ego": 0.008651042849288703}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6210129118656974, "sim_physics": 0.11798781698400324, "survival_time": 4.399999999999992, "driven_lanedir": 0.6006890731504293, "sim_render-ego": 0.01432578672062267, "in-drivable-lane": 0, "agent_compute-ego": 0.10246815193783151, "deviation-heading": 1.037067856451136, "set_robot_commands": 0.010838318954814564, "deviation-center-line": 0.3985013988761095, "driven_lanedir_consec": 0.6006890731504293, "sim_compute_sim_state": 0.0054174715822393246, "sim_compute_performance-ego": 0.007845919240604748, "sim_compute_robot_state-ego": 0.009824400598352606}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.6517618820038578, "sim_physics": 0.10636346181233725, "survival_time": 14.950000000000076, "driven_lanedir": 1.0447475832820492, "sim_render-ego": 0.012433597246805829, "in-drivable-lane": 4.3499999999999845, "agent_compute-ego": 0.08294288714726766, "deviation-heading": 2.6839592601573345, "set_robot_commands": 0.009409639040629069, "deviation-center-line": 0.7865720983127177, "driven_lanedir_consec": 1.0447475832820492, "sim_compute_sim_state": 0.0052011577288309735, "sim_compute_performance-ego": 0.007650187015533447, "sim_compute_robot_state-ego": 0.009382208188374838}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.1155886127009185, "sim_physics": 0.10410802283983552, "survival_time": 8.899999999999991, "driven_lanedir": 0.5984082530276836, "sim_render-ego": 0.01311758261048392, "in-drivable-lane": 3.7500000000000018, "agent_compute-ego": 0.08361584015106888, "deviation-heading": 0.8074914280280264, "set_robot_commands": 0.009443734469038716, "deviation-center-line": 0.3764442303401968, "driven_lanedir_consec": 0.5983476620899827, "sim_compute_sim_state": 0.005121922225094913, "sim_compute_performance-ego": 0.007710877429233508, "sim_compute_robot_state-ego": 0.009341257341792074}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.5904776759523642, "sim_physics": 0.12804218830953118, "survival_time": 13.100000000000051, "driven_lanedir": 1.168092813920398, "sim_render-ego": 0.014089251292570855, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.10436118559072946, "deviation-heading": 1.3390916554560257, "set_robot_commands": 0.010346819426267202, "deviation-center-line": 0.51712049608311, "driven_lanedir_consec": 1.164927384065017, "sim_compute_sim_state": 0.005661542179020307, "sim_compute_performance-ego": 0.008193451029653768, "sim_compute_robot_state-ego": 0.010025309242365017}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.3165472872878563, "sim_physics": 0.11620581309000652, "survival_time": 14.950000000000076, "driven_lanedir": 1.0570864145029155, "sim_render-ego": 0.013590235710144043, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.09806706825892132, "deviation-heading": 6.068927233526385, "set_robot_commands": 0.010139122009277343, "deviation-center-line": 0.7438062960466818, "driven_lanedir_consec": 0.590282768850456, "sim_compute_sim_state": 0.005434774557749431, "sim_compute_performance-ego": 0.008763047854105631, "sim_compute_robot_state-ego": 0.011998229026794434}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6922491207860242, "sim_physics": 0.12355488538742064, "survival_time": 6.399999999999985, "driven_lanedir": 0.6842162955974498, "sim_render-ego": 0.013640880584716795, "in-drivable-lane": 0, "agent_compute-ego": 0.10605929046869278, "deviation-heading": 0.8116742030557007, "set_robot_commands": 0.01025673933327198, "deviation-center-line": 0.7158456837995504, "driven_lanedir_consec": 0.6842162955974498, "sim_compute_sim_state": 0.005559567362070084, "sim_compute_performance-ego": 0.0080865528434515, "sim_compute_robot_state-ego": 0.0096892099827528}}
set_robot_commands_max0.010838318954814564
set_robot_commands_mean0.00963122870756559
set_robot_commands_median0.009443734469038716
set_robot_commands_min0.008688219388326009
sim_compute_performance-ego_max0.008763047854105631
sim_compute_performance-ego_mean0.0075936779160232625
sim_compute_performance-ego_median0.007656130525800917
sim_compute_performance-ego_min0.006385744412740072
sim_compute_robot_state-ego_max0.011998229026794434
sim_compute_robot_state-ego_mean0.009337210602659364
sim_compute_robot_state-ego_median0.009341257341792074
sim_compute_robot_state-ego_min0.007919489542643229
sim_compute_sim_state_max0.005661542179020307
sim_compute_sim_state_mean0.0051713785357326994
sim_compute_sim_state_median0.0052011577288309735
sim_compute_sim_state_min0.004447878996531169
sim_physics_max0.12804218830953118
sim_physics_mean0.10942098599490716
sim_physics_median0.10637743605507743
sim_physics_min0.0957055672009786
sim_render-ego_max0.01432578672062267
sim_render-ego_mean0.012785767902787471
sim_render-ego_median0.013069403635991085
sim_render-ego_min0.010953039328257242
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.37333333333336
survival_time_min3.8499999999999943
No reset possible
253624282Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:01:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253454315Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04153421792117032
agent_compute-ego_mean0.022503321915962417
agent_compute-ego_median0.02016955907227563
agent_compute-ego_min0.013914275169372558
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.10219369026330802, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.012229415086599495, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02189359298119178, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.00936357333109929, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.004911766602442815, "sim_compute_performance-ego": 0.007878519021547757, "sim_compute_robot_state-ego": 0.008890679249396691}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06222343444824219, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.007402074337005615, "in-drivable-lane": 0, "agent_compute-ego": 0.013914275169372558, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.006070029735565185, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.002910029888153076, "sim_compute_performance-ego": 0.004171562194824219, "sim_compute_robot_state-ego": 0.005275702476501465}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.06972781349630917, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.007993102073669434, "in-drivable-lane": 0, "agent_compute-ego": 0.015004964435801786, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.006020630107206457, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.003326086437000948, "sim_compute_performance-ego": 0.004457459730260512, "sim_compute_robot_state-ego": 0.006965209456051097}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.09352828635544072, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.011004791885125832, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.02016955907227563, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.008546356294975906, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.004409387463428935, "sim_compute_performance-ego": 0.006422078023191358, "sim_compute_robot_state-ego": 0.007948973139778513}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.0980481667952104, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.010970711708068848, "in-drivable-lane": 0, "agent_compute-ego": 0.04153421792117032, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.008806358684193005, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.004537972536954013, "sim_compute_performance-ego": 0.006637974218888717, "sim_compute_robot_state-ego": 0.008543773130937056}}
set_robot_commands_max0.00936357333109929
set_robot_commands_mean0.007761389630607969
set_robot_commands_median0.008546356294975906
set_robot_commands_min0.006020630107206457
sim_compute_performance-ego_max0.007878519021547757
sim_compute_performance-ego_mean0.005913518637742513
sim_compute_performance-ego_median0.006422078023191358
sim_compute_performance-ego_min0.004171562194824219
sim_compute_robot_state-ego_max0.008890679249396691
sim_compute_robot_state-ego_mean0.007524867490532964
sim_compute_robot_state-ego_median0.007948973139778513
sim_compute_robot_state-ego_min0.005275702476501465
sim_compute_sim_state_max0.004911766602442815
sim_compute_sim_state_mean0.004019048585595957
sim_compute_sim_state_median0.004409387463428935
sim_compute_sim_state_min0.002910029888153076
sim_physics_max0.10219369026330802
sim_physics_mean0.0851442782717021
sim_physics_median0.09352828635544072
sim_physics_min0.06222343444824219
sim_render-ego_max0.012229415086599495
sim_render-ego_mean0.009920019018093845
sim_render-ego_median0.010970711708068848
sim_render-ego_min0.007402074337005615
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
253414414András Kalaposexp2217aido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-35-218-104900:00:06
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling simulator      ... 
stderr | Pulling evaluator      ... 
stderr | Pulling scenario_maker ... done
stderr | 
stderr | ERROR: for solution  pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253374396András Kalaposexp2217aido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-35-218-104900:00:07
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling simulator      ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling evaluator      ... done
stderr | 
stderr | ERROR: for solution  pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
253344396András Kalaposexp2217aido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-35-218-104900:00:08
Error while running [...]

stderr | Pulling solution       ... 
stderr | Pulling simulator      ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling evaluator      ... done
stderr | 
stderr | ERROR: for solution  pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
252894378Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104900:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1777491907894018
survival_time_median11.250000000000025
deviation-center-line_median0.701798518719972
in-drivable-lane_median0.9499999999999986


other stats
agent_compute-ego_max0.05621585565454819
agent_compute-ego_mean0.043867561852230744
agent_compute-ego_median0.043635853926340736
agent_compute-ego_min0.02775470316410065
deviation-center-line_max0.8298767779355644
deviation-center-line_mean0.56437652968324
deviation-center-line_min0.16946933411984763
deviation-heading_max4.199094905752264
deviation-heading_mean2.288646780782402
deviation-heading_median1.9032126256354425
deviation-heading_min0.9160168862409368
driven_any_max2.3489638501129817
driven_any_mean1.532593260178916
driven_any_median1.7544505172484262
driven_any_min0.5815552233317299
driven_lanedir_consec_max1.7231553853380852
driven_lanedir_consec_mean0.9481966088391252
driven_lanedir_consec_min0.17756429113310235
driven_lanedir_max1.828322201516721
driven_lanedir_mean1.1112495618174452
driven_lanedir_median1.1820168742987502
driven_lanedir_min0.3422560452973826
in-drivable-lane_max6.600000000000059
in-drivable-lane_mean1.990000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5815552233317299, "sim_physics": 0.11241554319858552, "survival_time": 3.999999999999994, "driven_lanedir": 0.4804973026362864, "sim_render-ego": 0.011921674013137816, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.02775470316410065, "deviation-heading": 0.9160168862409368, "set_robot_commands": 0.010065111517906188, "deviation-center-line": 0.16946933411984763, "driven_lanedir_consec": 0.4804973026362864, "sim_compute_sim_state": 0.005119621753692627, "sim_compute_performance-ego": 0.007294842600822448, "sim_compute_robot_state-ego": 0.008529463410377502}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7544505172484262, "sim_physics": 0.07546949492560492, "survival_time": 11.250000000000025, "driven_lanedir": 1.7231553853380852, "sim_render-ego": 0.00946512116326226, "in-drivable-lane": 0, "agent_compute-ego": 0.03821453730265299, "deviation-heading": 1.7408979650576462, "set_robot_commands": 0.007161400053236219, "deviation-center-line": 0.8298767779355644, "driven_lanedir_consec": 1.7231553853380852, "sim_compute_sim_state": 0.0039222399393717446, "sim_compute_performance-ego": 0.005403294033474392, "sim_compute_robot_state-ego": 0.006640431086222331}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3489638501129817, "sim_physics": 0.0934961756070455, "survival_time": 14.950000000000076, "driven_lanedir": 1.1820168742987502, "sim_render-ego": 0.01116465409596761, "in-drivable-lane": 6.600000000000059, "agent_compute-ego": 0.043635853926340736, "deviation-heading": 2.684011521225718, "set_robot_commands": 0.008511856396993001, "deviation-center-line": 0.701798518719972, "driven_lanedir_consec": 1.1820168742987502, "sim_compute_sim_state": 0.004565135637919108, "sim_compute_performance-ego": 0.006499292850494384, "sim_compute_robot_state-ego": 0.008021582762400309}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6292132748843506, "sim_physics": 0.10703562568215765, "survival_time": 4.249999999999993, "driven_lanedir": 0.3422560452973826, "sim_render-ego": 0.013196852627922508, "in-drivable-lane": 0.9499999999999986, "agent_compute-ego": 0.05621585565454819, "deviation-heading": 1.9032126256354425, "set_robot_commands": 0.009903290692497702, "deviation-center-line": 0.3826446226855155, "driven_lanedir_consec": 0.17756429113310235, "sim_compute_sim_state": 0.005380103167365579, "sim_compute_performance-ego": 0.007516908645629883, "sim_compute_robot_state-ego": 0.009469363268683938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348783435317092, "sim_physics": 0.11950335025787354, "survival_time": 14.950000000000076, "driven_lanedir": 1.828322201516721, "sim_render-ego": 0.013341885407765706, "in-drivable-lane": 2.0000000000000027, "agent_compute-ego": 0.053516859213511146, "deviation-heading": 4.199094905752264, "set_robot_commands": 0.01085022528966268, "deviation-center-line": 0.7380933949553006, "driven_lanedir_consec": 1.1777491907894018, "sim_compute_sim_state": 0.00561550776163737, "sim_compute_performance-ego": 0.00804994026819865, "sim_compute_robot_state-ego": 0.00978023926417033}}
set_robot_commands_max0.01085022528966268
set_robot_commands_mean0.009298376790059158
set_robot_commands_median0.009903290692497702
set_robot_commands_min0.007161400053236219
sim_compute_performance-ego_max0.00804994026819865
sim_compute_performance-ego_mean0.006952855679723952
sim_compute_performance-ego_median0.007294842600822448
sim_compute_performance-ego_min0.005403294033474392
sim_compute_robot_state-ego_max0.00978023926417033
sim_compute_robot_state-ego_mean0.008488215958370881
sim_compute_robot_state-ego_median0.008529463410377502
sim_compute_robot_state-ego_min0.006640431086222331
sim_compute_sim_state_max0.00561550776163737
sim_compute_sim_state_mean0.004920521651997285
sim_compute_sim_state_median0.005119621753692627
sim_compute_sim_state_min0.0039222399393717446
sim_physics_max0.11950335025787354
sim_physics_mean0.1015840379342534
sim_physics_median0.10703562568215765
sim_physics_min0.07546949492560492
sim_render-ego_max0.013341885407765706
sim_render-ego_mean0.01181803746161118
sim_render-ego_median0.011921674013137816
sim_render-ego_min0.00946512116326226
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.880000000000033
survival_time_min3.999999999999994
No reset possible
252794423Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104900:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 341, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 113, in object_from_ipce_
    raise ZValueError(msg, expected=st, given_object=mj)
zuper_typing.exceptions.ZValueError: Type mismatch for a simple type.
│     expected: float
│ given_object: 0

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 341, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 172, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 353, in object_from_ipce_dataclass_instance
    ) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'motor_right' of PWMCommands.
│ K_annotations: {motor_left: float, motor_right: float}
│   expect_type: float
│         ann_K: float
│        K_name: `PWMCommands`

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 69, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 172, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 353, in object_from_ipce_dataclass_instance
    ) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'wheels' of Duckiebot1Commands.
│ K_annotations: dict
│                │ wheels:
│                │ dataclass aido_schemas.schemas.PWMCommands
│                │  field  motor_left : float 
│                │  field motor_right : float 
│                │ LEDS:
│                │ dataclass aido_schemas.schemas.LEDSCommands
│                │  field      center : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field  front_left : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field front_right : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field   back_left : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field  back_right : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│   expect_type: dataclass aido_schemas.schemas.PWMCommands
│                 field  motor_left : float 
│                 field motor_right : float 
│         ann_K: dataclass aido_schemas.schemas.PWMCommands
│                 field  motor_left : float 
│                 field motor_right : float 
│        K_name: `Duckiebot1Commands`

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 215, in read_one
    data = object_from_ipce(msg[FIELD_DATA], klass)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 88, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.schemas.Duckiebot1Commands
│               field wheels : dataclass aido_schemas.schemas.PWMCommands               
│                               field  motor_left : float                               
│                               field motor_right : float                               
│               field   LEDS : dataclass aido_schemas.schemas.LEDSCommands              
│                               field      center : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field  front_left : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field front_right : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field   back_left : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field  back_right : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
252734424Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104900:00:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
252294410Bea Baselines 🐤straightaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104900:20:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6560635476967971
survival_time_median6.399999999999985
deviation-center-line_median0.27148260816881825
in-drivable-lane_median0.8000000000000114


other stats
agent_compute-ego_max0.0275860745459795
agent_compute-ego_mean0.022188429036982905
agent_compute-ego_median0.022141099419292463
agent_compute-ego_min0.016700644685764505
deviation-center-line_max0.5776323741261321
deviation-center-line_mean0.3308529588630106
deviation-center-line_min0.18924716251623605
deviation-heading_max1.7494505616613916
deviation-heading_mean0.9787407272649066
deviation-heading_median0.936011305830365
deviation-heading_min0.4654133474818109
driven_any_max2.16109280368568
driven_any_mean0.9574545734260044
driven_any_median0.9972689336711068
driven_any_min0.25287994698847327
driven_lanedir_consec_max1.9858473514938235
driven_lanedir_consec_mean0.7281068676846801
driven_lanedir_consec_min0.24477450062639416
driven_lanedir_max1.9858473514938235
driven_lanedir_mean0.7281068676846801
driven_lanedir_median0.6560635476967971
driven_lanedir_min0.24477450062639416
in-drivable-lane_max5.550000000000015
in-drivable-lane_mean1.2000000000000008
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9983629676007618, "sim_physics": 0.07910659350454807, "survival_time": 6.399999999999985, "driven_lanedir": 0.6612439699544281, "sim_render-ego": 0.010153057053685188, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.019207796081900597, "deviation-heading": 0.8424743161949844, "set_robot_commands": 0.007484773173928261, "deviation-center-line": 0.27148260816881825, "driven_lanedir_consec": 0.6612439699544281, "sim_compute_sim_state": 0.00436093844473362, "sim_compute_performance-ego": 0.006288487464189529, "sim_compute_robot_state-ego": 0.007461773231625557}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0104734630164538, "sim_physics": 0.1001438207404558, "survival_time": 6.449999999999985, "driven_lanedir": 0.8781277981963872, "sim_render-ego": 0.012179690738056982, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.021725752556970877, "deviation-heading": 1.7494505616613916, "set_robot_commands": 0.009213917015134826, "deviation-center-line": 0.5036796523004238, "driven_lanedir_consec": 0.8781277981963872, "sim_compute_sim_state": 0.005136959312498107, "sim_compute_performance-ego": 0.007228006688199302, "sim_compute_robot_state-ego": 0.009039546168127726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25287994698847327, "sim_physics": 0.1426748971681337, "survival_time": 1.850000000000001, "driven_lanedir": 0.24477450062639416, "sim_render-ego": 0.014650937673207876, "in-drivable-lane": 0, "agent_compute-ego": 0.023797640929350983, "deviation-heading": 0.4654133474818109, "set_robot_commands": 0.011019758276037269, "deviation-center-line": 0.18924716251623605, "driven_lanedir_consec": 0.24477450062639416, "sim_compute_sim_state": 0.00523892608848778, "sim_compute_performance-ego": 0.007899400350209829, "sim_compute_robot_state-ego": 0.010807791271725216}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.46681514177017097, "sim_physics": 0.13671525567770004, "survival_time": 3.1999999999999966, "driven_lanedir": 0.44681261817527584, "sim_render-ego": 0.01383623480796814, "in-drivable-lane": 0, "agent_compute-ego": 0.02520705014467239, "deviation-heading": 0.9457609057569002, "set_robot_commands": 0.011141255497932434, "deviation-center-line": 0.22270426429865867, "driven_lanedir_consec": 0.44681261817527584, "sim_compute_sim_state": 0.005539603531360626, "sim_compute_performance-ego": 0.008566569536924362, "sim_compute_robot_state-ego": 0.010186579078435898}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59456998306707, "sim_physics": 0.10347014546394348, "survival_time": 10.000000000000009, "driven_lanedir": 0.6723867427890369, "sim_render-ego": 0.012252279520034793, "in-drivable-lane": 5.550000000000015, "agent_compute-ego": 0.022628813982009888, "deviation-heading": 0.5680261660842275, "set_robot_commands": 0.009907560348510742, "deviation-center-line": 0.4336704809208992, "driven_lanedir_consec": 0.6723867427890369, "sim_compute_sim_state": 0.005169978141784668, "sim_compute_performance-ego": 0.0073418676853179935, "sim_compute_robot_state-ego": 0.008933173418045044}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4502778663978059, "sim_physics": 0.09555587612214636, "survival_time": 3.049999999999997, "driven_lanedir": 0.42473620816668456, "sim_render-ego": 0.011052909444590083, "in-drivable-lane": 0, "agent_compute-ego": 0.019764474180878185, "deviation-heading": 1.0307486883987471, "set_robot_commands": 0.008810270028036148, "deviation-center-line": 0.22162525319815604, "driven_lanedir_consec": 0.42473620816668456, "sim_compute_sim_state": 0.0045864816571845385, "sim_compute_performance-ego": 0.0064617805793637136, "sim_compute_robot_state-ego": 0.00815537718475842}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0249159885672616, "sim_physics": 0.09893234085490683, "survival_time": 6.549999999999985, "driven_lanedir": 0.5268281630817326, "sim_render-ego": 0.01209972286952361, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.02121316021635332, "deviation-heading": 0.9438594541209212, "set_robot_commands": 0.008566381367108295, "deviation-center-line": 0.2612430212755324, "driven_lanedir_consec": 0.5268281630817326, "sim_compute_sim_state": 0.004793840510244588, "sim_compute_performance-ego": 0.007295211762872361, "sim_compute_robot_state-ego": 0.009644757700330428}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.29887254237480476, "sim_physics": 0.12631066455397494, "survival_time": 2.1500000000000004, "driven_lanedir": 0.29130420397320256, "sim_render-ego": 0.013825460921886357, "in-drivable-lane": 0, "agent_compute-ego": 0.023616435915924786, "deviation-heading": 0.4824433292526411, "set_robot_commands": 0.011704866276230925, "deviation-center-line": 0.2157439295746972, "driven_lanedir_consec": 0.29130420397320256, "sim_compute_sim_state": 0.005408597546954488, "sim_compute_performance-ego": 0.007891471995863803, "sim_compute_robot_state-ego": 0.010846842166989348}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0249151961125793, "sim_physics": 0.1042588448706474, "survival_time": 6.549999999999985, "driven_lanedir": 1.020461579086688, "sim_render-ego": 0.012109053953913332, "in-drivable-lane": 0, "agent_compute-ego": 0.02207148530101048, "deviation-heading": 0.6148802245256113, "set_robot_commands": 0.00987925238281716, "deviation-center-line": 0.5170353268719433, "driven_lanedir_consec": 1.020461579086688, "sim_compute_sim_state": 0.004886022960866681, "sim_compute_performance-ego": 0.007153101549803756, "sim_compute_robot_state-ego": 0.008968478850735963}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9914297585088672, "sim_physics": 0.109377973661648, "survival_time": 6.349999999999985, "driven_lanedir": 0.6560635476967971, "sim_render-ego": 0.012067492552629606, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.023186625458124117, "deviation-heading": 1.3415373267661517, "set_robot_commands": 0.01015917898163082, "deviation-center-line": 0.29470463014639914, "driven_lanedir_consec": 0.6560635476967971, "sim_compute_sim_state": 0.005034970486257959, "sim_compute_performance-ego": 0.0071861987977516, "sim_compute_robot_state-ego": 0.008761976647564746}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5789466211096623, "sim_physics": 0.07275568475626935, "survival_time": 9.900000000000006, "driven_lanedir": 1.2110781559435606, "sim_render-ego": 0.008928469937257093, "in-drivable-lane": 2.1000000000000254, "agent_compute-ego": 0.016700644685764505, "deviation-heading": 0.936011305830365, "set_robot_commands": 0.006607298899178553, "deviation-center-line": 0.40350144819436445, "driven_lanedir_consec": 1.2110781559435606, "sim_compute_sim_state": 0.00363512472672896, "sim_compute_performance-ego": 0.005089004834493001, "sim_compute_robot_state-ego": 0.006299311464483088}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9972689336711068, "sim_physics": 0.15009424276649952, "survival_time": 6.399999999999985, "driven_lanedir": 0.6426116084323393, "sim_render-ego": 0.015574496239423752, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.0275860745459795, "deviation-heading": 1.726154243367267, "set_robot_commands": 0.011892177164554596, "deviation-center-line": 0.3662609596427402, "driven_lanedir_consec": 0.6426116084323393, "sim_compute_sim_state": 0.006172902882099152, "sim_compute_performance-ego": 0.009370584040880203, "sim_compute_robot_state-ego": 0.011244691908359528}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9894590367067212, "sim_physics": 0.10691713719140916, "survival_time": 6.299999999999986, "driven_lanedir": 0.7469319888602218, "sim_render-ego": 0.013131482260567802, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.0232085973497421, "deviation-heading": 0.8409903862906638, "set_robot_commands": 0.010579875537327355, "deviation-center-line": 0.22961946003299927, "driven_lanedir_consec": 0.7469319888602218, "sim_compute_sim_state": 0.005296044879489475, "sim_compute_performance-ego": 0.007766602531312004, "sim_compute_robot_state-ego": 0.009330564075046116}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5215383518126492, "sim_physics": 0.09751771177564349, "survival_time": 3.4999999999999956, "driven_lanedir": 0.512394578793629, "sim_render-ego": 0.011971385138375418, "in-drivable-lane": 0, "agent_compute-ego": 0.02077078478676932, "deviation-heading": 0.6628668986842967, "set_robot_commands": 0.00867861339024135, "deviation-center-line": 0.2546438116771589, "driven_lanedir_consec": 0.512394578793629, "sim_compute_sim_state": 0.004980291639055524, "sim_compute_performance-ego": 0.007151280130658831, "sim_compute_robot_state-ego": 0.00883925301688058}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.16109280368568, "sim_physics": 0.09961104393005372, "survival_time": 13.450000000000056, "driven_lanedir": 1.9858473514938235, "sim_render-ego": 0.012129360858392538, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.022141099419292463, "deviation-heading": 1.530493754557623, "set_robot_commands": 0.00927249826906339, "deviation-center-line": 0.5776323741261321, "driven_lanedir_consec": 1.9858473514938235, "sim_compute_sim_state": 0.004730790077975248, "sim_compute_performance-ego": 0.006815723327012754, "sim_compute_robot_state-ego": 0.008267365423720122}}
set_robot_commands_max0.011892177164554596
set_robot_commands_mean0.009661178440515474
set_robot_commands_median0.00987925238281716
set_robot_commands_min0.006607298899178553
sim_compute_performance-ego_max0.009370584040880203
sim_compute_performance-ego_mean0.00730035275165687
sim_compute_performance-ego_median0.007228006688199302
sim_compute_performance-ego_min0.005089004834493001
sim_compute_robot_state-ego_max0.011244691908359528
sim_compute_robot_state-ego_mean0.009119165440455185
sim_compute_robot_state-ego_median0.008968478850735963
sim_compute_robot_state-ego_min0.006299311464483088
sim_compute_sim_state_max0.006172902882099152
sim_compute_sim_state_mean0.004998098192381428
sim_compute_sim_state_median0.005034970486257959
sim_compute_sim_state_min0.00363512472672896
sim_physics_max0.15009424276649952
sim_physics_mean0.10822948220253198
sim_physics_median0.10347014546394348
sim_physics_min0.07275568475626935
sim_render-ego_max0.015574496239423752
sim_render-ego_mean0.012397468931300837
sim_render-ego_median0.012129360858392538
sim_render-ego_min0.008928469937257093
simulation-passed1
survival_time_max13.450000000000056
survival_time_mean6.139999999999998
survival_time_min1.850000000000001
No reset possible
252253265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104900:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
252093257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104900:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
252003264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104900:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible