Duckietown Challenges Home Challenges Submissions

Evaluator 922

ID922
evaluatorip-172-31-25-98-2470
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2470
versiond-c:4.0.25;d-c-r:4.0.32;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success5 21721
# timeout
# failed1 21741
# error2 21751
# aborted
# host-error3 21743
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
218833332FANG MEIYI 🇸🇬testaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-24700:16:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7772259761880225
survival_time_median14.950000000000076
deviation-center-line_median0.6886793372946174
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09520350376764931
agent_compute-ego_mean0.09478504202009976
agent_compute-ego_median0.0950096845626831
agent_compute-ego_min0.09386572373651823
deviation-center-line_max0.8011461637936141
deviation-center-line_mean0.5563295642010969
deviation-center-line_min0.25315114630240015
deviation-heading_max3.1010814896105567
deviation-heading_mean1.9456823512401065
deviation-heading_median2.322469992419344
deviation-heading_min0.49645389495290143
driven_any_max2.987807896934149
driven_any_mean2.208396290439719
driven_any_median2.8572070509640315
driven_any_min1.1053087913254784
driven_lanedir_consec_max2.9140758738917336
driven_lanedir_consec_mean2.1614013992771235
driven_lanedir_consec_min1.0942662642612548
driven_lanedir_max2.9140758738917336
driven_lanedir_mean2.1614013992771235
driven_lanedir_median2.7772259761880225
driven_lanedir_min1.0942662642612548
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8572070509640315, "sim_physics": 0.0994339386622111, "survival_time": 14.950000000000076, "driven_lanedir": 2.7772259761880225, "sim_render-ego": 0.03791124184926351, "in-drivable-lane": 0, "agent_compute-ego": 0.0950096845626831, "deviation-heading": 3.1010814896105567, "set_robot_commands": 0.0579776136080424, "deviation-center-line": 0.7426489601662971, "driven_lanedir_consec": 2.7772259761880225, "sim_compute_sim_state": 0.023638909657796223, "sim_compute_performance-ego": 0.04075435717900594, "sim_compute_robot_state-ego": 0.043068251609802245, "sim_compute_robot_state-npc0": 0.04242808659871419, "sim_compute_robot_state-npc1": 0.04138252178827922, "sim_compute_robot_state-npc2": 0.041328999201456704, "sim_compute_robot_state-npc3": 0.041137768427530925}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.987807896934149, "sim_physics": 0.10110339482625326, "survival_time": 14.950000000000076, "driven_lanedir": 2.9140758738917336, "sim_render-ego": 0.03754195769627889, "in-drivable-lane": 0, "agent_compute-ego": 0.09520350376764931, "deviation-heading": 2.857320410858058, "set_robot_commands": 0.05873652935028076, "deviation-center-line": 0.8011461637936141, "driven_lanedir_consec": 2.9140758738917336, "sim_compute_sim_state": 0.02344477653503418, "sim_compute_performance-ego": 0.041063939730326335, "sim_compute_robot_state-ego": 0.04321219046910603, "sim_compute_robot_state-npc0": 0.04261555910110473, "sim_compute_robot_state-npc1": 0.04225796699523926, "sim_compute_robot_state-npc2": 0.04107985417048136, "sim_compute_robot_state-npc3": 0.04125017404556274}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9441342869419023, "sim_physics": 0.09742317994435629, "survival_time": 14.950000000000076, "driven_lanedir": 2.8945385698666266, "sim_render-ego": 0.0374271281560262, "in-drivable-lane": 0, "agent_compute-ego": 0.09513778924942017, "deviation-heading": 2.322469992419344, "set_robot_commands": 0.05844623327255249, "deviation-center-line": 0.6886793372946174, "driven_lanedir_consec": 2.8945385698666266, "sim_compute_sim_state": 0.023068058490753173, "sim_compute_performance-ego": 0.04143399874369303, "sim_compute_robot_state-ego": 0.0431894040107727, "sim_compute_robot_state-npc0": 0.041991685231526694, "sim_compute_robot_state-npc1": 0.04104698578516642, "sim_compute_robot_state-npc2": 0.0410995896657308, "sim_compute_robot_state-npc3": 0.04084968487421672}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1053087913254784, "sim_physics": 0.09910211468687152, "survival_time": 5.04999999999999, "driven_lanedir": 1.0942662642612548, "sim_render-ego": 0.03726338395977964, "in-drivable-lane": 0, "agent_compute-ego": 0.09470850878422804, "deviation-heading": 0.49645389495290143, "set_robot_commands": 0.058248727628500155, "deviation-center-line": 0.2960222134485555, "driven_lanedir_consec": 1.0942662642612548, "sim_compute_sim_state": 0.02309900699275555, "sim_compute_performance-ego": 0.039774991498135105, "sim_compute_robot_state-ego": 0.04307118028697401, "sim_compute_robot_state-npc0": 0.041338701059322545, "sim_compute_robot_state-npc1": 0.041106122555118974, "sim_compute_robot_state-npc2": 0.040310453660417314, "sim_compute_robot_state-npc3": 0.04080673019484718}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.147523426033035, "sim_physics": 0.09453769278737296, "survival_time": 5.649999999999988, "driven_lanedir": 1.1269003121779797, "sim_render-ego": 0.03711345343463189, "in-drivable-lane": 0, "agent_compute-ego": 0.09386572373651823, "deviation-heading": 0.9510859683596712, "set_robot_commands": 0.059163931196769784, "deviation-center-line": 0.25315114630240015, "driven_lanedir_consec": 1.1269003121779797, "sim_compute_sim_state": 0.02334326347418591, "sim_compute_performance-ego": 0.04041326784454616, "sim_compute_robot_state-ego": 0.04267760715653411, "sim_compute_robot_state-npc0": 0.0414219978636345, "sim_compute_robot_state-npc1": 0.04124953472508793, "sim_compute_robot_state-npc2": 0.04031088288906401, "sim_compute_robot_state-npc3": 0.04084282638752355}}
set_robot_commands_max0.059163931196769784
set_robot_commands_mean0.05851460701122911
set_robot_commands_median0.05844623327255249
set_robot_commands_min0.0579776136080424
sim_compute_performance-ego_max0.04143399874369303
sim_compute_performance-ego_mean0.04068811099914131
sim_compute_performance-ego_median0.04075435717900594
sim_compute_performance-ego_min0.039774991498135105
sim_compute_robot_state-ego_max0.04321219046910603
sim_compute_robot_state-ego_mean0.04304372670663782
sim_compute_robot_state-ego_median0.04307118028697401
sim_compute_robot_state-ego_min0.04267760715653411
sim_compute_robot_state-npc0_max0.04261555910110473
sim_compute_robot_state-npc0_mean0.04195920597086054
sim_compute_robot_state-npc0_median0.041991685231526694
sim_compute_robot_state-npc0_min0.041338701059322545
sim_compute_robot_state-npc1_max0.04225796699523926
sim_compute_robot_state-npc1_mean0.041408626369778365
sim_compute_robot_state-npc1_median0.04124953472508793
sim_compute_robot_state-npc1_min0.04104698578516642
sim_compute_robot_state-npc2_max0.041328999201456704
sim_compute_robot_state-npc2_mean0.04082595591743004
sim_compute_robot_state-npc2_median0.04107985417048136
sim_compute_robot_state-npc2_min0.040310453660417314
sim_compute_robot_state-npc3_max0.04125017404556274
sim_compute_robot_state-npc3_mean0.040977436785936225
sim_compute_robot_state-npc3_median0.04084968487421672
sim_compute_robot_state-npc3_min0.04080673019484718
sim_compute_sim_state_max0.023638909657796223
sim_compute_sim_state_mean0.023318803030105008
sim_compute_sim_state_median0.02334326347418591
sim_compute_sim_state_min0.023068058490753173
sim_physics_max0.10110339482625326
sim_physics_mean0.09832006418141302
sim_physics_median0.09910211468687152
sim_physics_min0.09453769278737296
sim_render-ego_max0.03791124184926351
sim_render-ego_mean0.03745143301919603
sim_render-ego_median0.0374271281560262
sim_render-ego_min0.03711345343463189
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.110000000000042
survival_time_min5.04999999999999
No reset possible
218533319jiang pengRL - TH - shiaido2-LF-sim-validationstep1-simulationerrornoip-172-31-25-98-24700:01:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218473315jiang pengRL - TH -hhkaido2-LFV-sim-validationstep1-simulationhost-errornoip-172-31-25-98-24700:05:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3315/step1-simulation-ip-172-31-25-98-2470-job21847/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218293304Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-25-98-24700:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4000903798081257
survival_time_median6.299999999999986
deviation-center-line_median0.6600026624911809
in-drivable-lane_median0.3999999999999986


other stats
agent_compute-ego_max0.06464838792407324
agent_compute-ego_mean0.06238079705611667
agent_compute-ego_median0.06291500727335612
agent_compute-ego_min0.05894526614937731
deviation-center-line_max0.8013780449407473
deviation-center-line_mean0.5540943086251113
deviation-center-line_min0.27175825074418597
deviation-heading_max2.5046766149755593
deviation-heading_mean1.2879972666005144
deviation-heading_median1.1859028847018964
deviation-heading_min0.3120074738996142
driven_any_max2.1073010910603296
driven_any_mean1.4421667677030992
driven_any_median1.4475215176688687
driven_any_min0.6153951446846784
driven_lanedir_consec_max1.8206031115563897
driven_lanedir_consec_mean1.2664569427627983
driven_lanedir_consec_min0.61160573385586
driven_lanedir_max1.8206031115563897
driven_lanedir_mean1.2664569427627983
driven_lanedir_median1.4000903798081257
driven_lanedir_min0.61160573385586
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.4799999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4475215176688687, "sim_physics": 0.06624168252188062, "survival_time": 6.299999999999986, "driven_lanedir": 1.4000903798081257, "sim_render-ego": 0.03898314445737808, "in-drivable-lane": 0, "agent_compute-ego": 0.06464838792407324, "deviation-heading": 1.1859028847018964, "set_robot_commands": 0.05924249641479008, "deviation-center-line": 0.6600026624911809, "driven_lanedir_consec": 1.4000903798081257, "sim_compute_sim_state": 0.025841287204197476, "sim_compute_performance-ego": 0.04314314372955807, "sim_compute_robot_state-ego": 0.044787340694003634}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0556082691036182, "sim_physics": 0.06232281910475864, "survival_time": 4.6499999999999915, "driven_lanedir": 0.7392133244633601, "sim_render-ego": 0.03814648300088862, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.05894526614937731, "deviation-heading": 1.078313702711436, "set_robot_commands": 0.05993864356830556, "deviation-center-line": 0.27175825074418597, "driven_lanedir_consec": 0.7392133244633601, "sim_compute_sim_state": 0.025172413036387453, "sim_compute_performance-ego": 0.04220618227476715, "sim_compute_robot_state-ego": 0.044962416413009805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6153951446846784, "sim_physics": 0.06048068247343365, "survival_time": 2.849999999999998, "driven_lanedir": 0.61160573385586, "sim_render-ego": 0.03887087420413369, "in-drivable-lane": 0, "agent_compute-ego": 0.06291500727335612, "deviation-heading": 0.3120074738996142, "set_robot_commands": 0.05884171368782981, "deviation-center-line": 0.32444662038682315, "driven_lanedir_consec": 0.61160573385586, "sim_compute_sim_state": 0.025178871656719008, "sim_compute_performance-ego": 0.042666372499967874, "sim_compute_robot_state-ego": 0.04475860010113632}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9850078159980011, "sim_physics": 0.06759412189912514, "survival_time": 8.449999999999985, "driven_lanedir": 1.7607721641302567, "sim_render-ego": 0.03912648082484861, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.06121038120879224, "deviation-heading": 2.5046766149755593, "set_robot_commands": 0.059417673821985366, "deviation-center-line": 0.7128859645626198, "driven_lanedir_consec": 1.7607721641302567, "sim_compute_sim_state": 0.025462920849139873, "sim_compute_performance-ego": 0.04243891196843435, "sim_compute_robot_state-ego": 0.04568261507700181}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1073010910603296, "sim_physics": 0.06649850733453334, "survival_time": 8.949999999999992, "driven_lanedir": 1.8206031115563897, "sim_render-ego": 0.03889453078115453, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06418494272498446, "deviation-heading": 1.3590856567140663, "set_robot_commands": 0.06022164675110545, "deviation-center-line": 0.8013780449407473, "driven_lanedir_consec": 1.8206031115563897, "sim_compute_sim_state": 0.02548531580237703, "sim_compute_performance-ego": 0.04290386817974751, "sim_compute_robot_state-ego": 0.04557166685605182}}
set_robot_commands_max0.06022164675110545
set_robot_commands_mean0.05953243484880325
set_robot_commands_median0.059417673821985366
set_robot_commands_min0.05884171368782981
sim_compute_performance-ego_max0.04314314372955807
sim_compute_performance-ego_mean0.04267169573049499
sim_compute_performance-ego_median0.042666372499967874
sim_compute_performance-ego_min0.04220618227476715
sim_compute_robot_state-ego_max0.04568261507700181
sim_compute_robot_state-ego_mean0.04515252782824068
sim_compute_robot_state-ego_median0.044962416413009805
sim_compute_robot_state-ego_min0.04475860010113632
sim_compute_sim_state_max0.025841287204197476
sim_compute_sim_state_mean0.02542816170976417
sim_compute_sim_state_median0.025462920849139873
sim_compute_sim_state_min0.025172413036387453
sim_physics_max0.06759412189912514
sim_physics_mean0.06462756266674627
sim_physics_median0.06624168252188062
sim_physics_min0.06048068247343365
sim_render-ego_max0.03912648082484861
sim_render-ego_mean0.0388043026536807
sim_render-ego_median0.03889453078115453
sim_render-ego_min0.03814648300088862
simulation-passed1
survival_time_max8.949999999999992
survival_time_mean6.23999999999999
survival_time_min2.849999999999998
No reset possible
218093289Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-25-98-24700:06:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5930171722507618
survival_time_median2.9999999999999973
deviation-center-line_median0.2147744293041352
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.06553412119547526
agent_compute-ego_mean0.06260429644346072
agent_compute-ego_median0.06282448371251424
agent_compute-ego_min0.05977276624259302
deviation-center-line_max0.5693263933886759
deviation-center-line_mean0.2796806719886564
deviation-center-line_min0.15085157657752565
deviation-heading_max4.309066207261428
deviation-heading_mean1.5578813703796577
deviation-heading_median0.8951392139420393
deviation-heading_min0.3445476307927864
driven_any_max2.1434142498184454
driven_any_mean0.9161751075463784
driven_any_median0.6402748127143346
driven_any_min0.3219070414439548
driven_lanedir_consec_max0.989556747417114
driven_lanedir_consec_mean0.5963232020913096
driven_lanedir_consec_min0.2853622779233418
driven_lanedir_max1.681732854575128
driven_lanedir_mean0.7347584235229124
driven_lanedir_median0.5930171722507618
driven_lanedir_min0.2853622779233418
in-drivable-lane_max0.8500000000000001
in-drivable-lane_mean0.2599999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6402748127143346, "sim_physics": 0.06405218442281087, "survival_time": 2.9999999999999973, "driven_lanedir": 0.2853622779233418, "sim_render-ego": 0.04013294776280721, "in-drivable-lane": 0.8500000000000001, "agent_compute-ego": 0.06282448371251424, "deviation-heading": 1.410522862054743, "set_robot_commands": 0.05996403694152832, "deviation-center-line": 0.21013996976608385, "driven_lanedir_consec": 0.2853622779233418, "sim_compute_sim_state": 0.026221279303232828, "sim_compute_performance-ego": 0.043362836043039955, "sim_compute_robot_state-ego": 0.04592729409535726}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1434142498184454, "sim_physics": 0.06376226262731867, "survival_time": 9.099999999999994, "driven_lanedir": 1.681732854575128, "sim_render-ego": 0.039212123378292545, "in-drivable-lane": 0.39999999999999947, "agent_compute-ego": 0.06401311303233052, "deviation-heading": 4.309066207261428, "set_robot_commands": 0.05944053812341376, "deviation-center-line": 0.5693263933886759, "driven_lanedir_consec": 0.989556747417114, "sim_compute_sim_state": 0.025821392352764424, "sim_compute_performance-ego": 0.04242899129678915, "sim_compute_robot_state-ego": 0.04570856592157385}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3219070414439548, "sim_physics": 0.06274776747732451, "survival_time": 1.6500000000000008, "driven_lanedir": 0.31249091046561217, "sim_render-ego": 0.03815961606574781, "in-drivable-lane": 0, "agent_compute-ego": 0.060876998034390534, "deviation-heading": 0.3445476307927864, "set_robot_commands": 0.06002731756730513, "deviation-center-line": 0.15085157657752565, "driven_lanedir_consec": 0.31249091046561217, "sim_compute_sim_state": 0.02611002055081454, "sim_compute_performance-ego": 0.04245437275279652, "sim_compute_robot_state-ego": 0.04597135023637251}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6398068972717164, "sim_physics": 0.06459771576574293, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5930171722507618, "sim_render-ego": 0.039253897586111294, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05977276624259302, "deviation-heading": 0.8301309378472901, "set_robot_commands": 0.061137070090083755, "deviation-center-line": 0.2147744293041352, "driven_lanedir_consec": 0.5930171722507618, "sim_compute_sim_state": 0.0254689111547955, "sim_compute_performance-ego": 0.0432906514507229, "sim_compute_robot_state-ego": 0.04454052650322348}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8354725364834403, "sim_physics": 0.06446929613749186, "survival_time": 3.7499999999999942, "driven_lanedir": 0.8011889023997183, "sim_render-ego": 0.03961165428161621, "in-drivable-lane": 0, "agent_compute-ego": 0.06553412119547526, "deviation-heading": 0.8951392139420393, "set_robot_commands": 0.05970444679260254, "deviation-center-line": 0.25331099090686154, "driven_lanedir_consec": 0.8011889023997183, "sim_compute_sim_state": 0.026285670598347983, "sim_compute_performance-ego": 0.042497536341349285, "sim_compute_robot_state-ego": 0.04568578402201335}}
set_robot_commands_max0.061137070090083755
set_robot_commands_mean0.060054681902986705
set_robot_commands_median0.05996403694152832
set_robot_commands_min0.05944053812341376
sim_compute_performance-ego_max0.043362836043039955
sim_compute_performance-ego_mean0.04280687757693956
sim_compute_performance-ego_median0.042497536341349285
sim_compute_performance-ego_min0.04242899129678915
sim_compute_robot_state-ego_max0.04597135023637251
sim_compute_robot_state-ego_mean0.04556670415570809
sim_compute_robot_state-ego_median0.04570856592157385
sim_compute_robot_state-ego_min0.04454052650322348
sim_compute_sim_state_max0.026285670598347983
sim_compute_sim_state_mean0.02598145479199106
sim_compute_sim_state_median0.02611002055081454
sim_compute_sim_state_min0.0254689111547955
sim_physics_max0.06459771576574293
sim_physics_mean0.06392584528613776
sim_physics_median0.06405218442281087
sim_physics_min0.06274776747732451
sim_render-ego_max0.04013294776280721
sim_render-ego_mean0.03927404781491502
sim_render-ego_median0.039253897586111294
sim_render-ego_min0.03815961606574781
simulation-passed1
survival_time_max9.099999999999994
survival_time_mean4.089999999999996
survival_time_min1.6500000000000008
No reset possible
217803078Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-25-98-24700:52:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6337614766727274
survival_time_median11.65000000000003
deviation-center-line_median0.6422400823696148
in-drivable-lane_median2.1500000000000306


other stats
agent_compute-ego_max0.12975841442743938
agent_compute-ego_mean0.12778217778508397
agent_compute-ego_median0.12731950879096984
agent_compute-ego_min0.12598470574644602
deviation-center-line_max1.1321475335290432
deviation-center-line_mean0.6908255556206458
deviation-center-line_min0.3308261889076433
deviation-heading_max5.486897068165592
deviation-heading_mean2.6441815207450063
deviation-heading_median1.6148514170112902
deviation-heading_min0.8312063053272266
driven_any_max1.3770575337634434
driven_any_mean1.034860488638444
driven_any_median1.0648975409775323
driven_any_min0.3919907521128338
driven_lanedir_consec_max1.0807904880422474
driven_lanedir_consec_mean0.6590355236560621
driven_lanedir_consec_min0.2803046703351908
driven_lanedir_max1.366041463151204
driven_lanedir_mean0.7059691602622159
driven_lanedir_median0.6481793319094886
driven_lanedir_min0.2803046703351908
in-drivable-lane_max7.7500000000000275
in-drivable-lane_mean2.7066666666666843
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.374144516770652, "sim_physics": 0.11094276984532674, "survival_time": 14.950000000000076, "driven_lanedir": 1.1664537962271655, "sim_render-ego": 0.03860848506291707, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.12956099589665732, "deviation-heading": 1.0322718729308469, "set_robot_commands": 0.05809466044108073, "deviation-center-line": 1.1321475335290432, "driven_lanedir_consec": 0.932258754070184, "sim_compute_sim_state": 0.02398423512776693, "sim_compute_performance-ego": 0.041359244187672936, "sim_compute_robot_state-ego": 0.04394241650899251, "sim_compute_robot_state-npc0": 0.04299576361974081, "sim_compute_robot_state-npc1": 0.04222326278686524, "sim_compute_robot_state-npc2": 0.04188679536183675, "sim_compute_robot_state-npc3": 0.04203392505645752}, "udem1-1-0": {"driven_any": 0.5230193491145317, "sim_physics": 0.10513591160208492, "survival_time": 5.899999999999987, "driven_lanedir": 0.5033822526040095, "sim_render-ego": 0.038533285512762555, "in-drivable-lane": 0, "agent_compute-ego": 0.12925377538648702, "deviation-heading": 1.6148514170112902, "set_robot_commands": 0.058889673928083, "deviation-center-line": 0.4280010986238305, "driven_lanedir_consec": 0.5033822526040095, "sim_compute_sim_state": 0.02409052242666988, "sim_compute_performance-ego": 0.041527537976281115, "sim_compute_robot_state-ego": 0.04340731289427159, "sim_compute_robot_state-npc0": 0.04252296181048377, "sim_compute_robot_state-npc1": 0.04206332311791889, "sim_compute_robot_state-npc2": 0.04227845345513295, "sim_compute_robot_state-npc3": 0.041562207674576065}, "udem1-2-0": {"driven_any": 1.376182450765798, "sim_physics": 0.10801387866338094, "survival_time": 14.950000000000076, "driven_lanedir": 0.8645535519422314, "sim_render-ego": 0.038907838662465416, "in-drivable-lane": 5.300000000000075, "agent_compute-ego": 0.12914515654246012, "deviation-heading": 1.5928124392659115, "set_robot_commands": 0.058383735815684, "deviation-center-line": 0.639681629802406, "driven_lanedir_consec": 0.8645535519422314, "sim_compute_sim_state": 0.02363042672475179, "sim_compute_performance-ego": 0.04096347173055013, "sim_compute_robot_state-ego": 0.043391149838765464, "sim_compute_robot_state-npc0": 0.04271163781483968, "sim_compute_robot_state-npc1": 0.04191459178924561, "sim_compute_robot_state-npc2": 0.04158368825912476, "sim_compute_robot_state-npc3": 0.0416165026028951}, "udem1-3-0": {"driven_any": 1.3755985963067003, "sim_physics": 0.1076621945699056, "survival_time": 14.950000000000076, "driven_lanedir": 0.8833754214517102, "sim_render-ego": 0.03815464576085408, "in-drivable-lane": 5.1000000000000725, "agent_compute-ego": 0.12975841442743938, "deviation-heading": 1.5585359942484258, "set_robot_commands": 0.05934412638346354, "deviation-center-line": 0.6422400823696148, "driven_lanedir_consec": 0.8833754214517102, "sim_compute_sim_state": 0.02350523233413696, "sim_compute_performance-ego": 0.04103402694066365, "sim_compute_robot_state-ego": 0.04347081899642944, "sim_compute_robot_state-npc0": 0.04291797637939453, "sim_compute_robot_state-npc1": 0.04189968506495158, "sim_compute_robot_state-npc2": 0.041724582513173424, "sim_compute_robot_state-npc3": 0.041821491718292234}, "udem1-4-0": {"driven_any": 0.43826884240006975, "sim_physics": 0.10542601108551024, "survival_time": 4.99999999999999, "driven_lanedir": 0.42792269885208434, "sim_render-ego": 0.03728986740112305, "in-drivable-lane": 0, "agent_compute-ego": 0.1266511845588684, "deviation-heading": 1.0981654503649465, "set_robot_commands": 0.05930493354797363, "deviation-center-line": 0.4022255732010137, "driven_lanedir_consec": 0.42792269885208434, "sim_compute_sim_state": 0.02404052495956421, "sim_compute_performance-ego": 0.04213774919509888, "sim_compute_robot_state-ego": 0.0416766357421875, "sim_compute_robot_state-npc0": 0.041259925365448, "sim_compute_robot_state-npc1": 0.04255271911621094, "sim_compute_robot_state-npc2": 0.04085748434066772, "sim_compute_robot_state-npc3": 0.04171966314315796}, "udem1-5-0": {"driven_any": 1.375277760058882, "sim_physics": 0.10617154995600382, "survival_time": 14.950000000000076, "driven_lanedir": 0.6481793319094886, "sim_render-ego": 0.03886526107788086, "in-drivable-lane": 6.3999999999999995, "agent_compute-ego": 0.12780774116516114, "deviation-heading": 4.312360131918814, "set_robot_commands": 0.05847650766372681, "deviation-center-line": 0.7389974806055806, "driven_lanedir_consec": 0.6481793319094886, "sim_compute_sim_state": 0.02358440081278483, "sim_compute_performance-ego": 0.041290721893310546, "sim_compute_robot_state-ego": 0.04297859032948812, "sim_compute_robot_state-npc0": 0.04230461756388346, "sim_compute_robot_state-npc1": 0.04183050553003947, "sim_compute_robot_state-npc2": 0.04132681210835775, "sim_compute_robot_state-npc3": 0.041428647836049395}, "udem1-6-0": {"driven_any": 1.3770575337634434, "sim_physics": 0.1085748306910197, "survival_time": 14.950000000000076, "driven_lanedir": 1.366041463151204, "sim_render-ego": 0.037994335492451986, "in-drivable-lane": 0, "agent_compute-ego": 0.12890971660614017, "deviation-heading": 1.58320271171348, "set_robot_commands": 0.060703641573588055, "deviation-center-line": 0.8738763426216024, "driven_lanedir_consec": 1.0807904880422474, "sim_compute_sim_state": 0.023524428208669027, "sim_compute_performance-ego": 0.04124545733133952, "sim_compute_robot_state-ego": 0.04402076959609985, "sim_compute_robot_state-npc0": 0.04234258969624837, "sim_compute_robot_state-npc1": 0.04205529928207397, "sim_compute_robot_state-npc2": 0.04128893534342448, "sim_compute_robot_state-npc3": 0.04165403366088867}, "udem1-7-0": {"driven_any": 1.0350686381921947, "sim_physics": 0.11469378975519524, "survival_time": 11.350000000000026, "driven_lanedir": 0.9409144033164444, "sim_render-ego": 0.03784192396155538, "in-drivable-lane": 0, "agent_compute-ego": 0.12797276879197175, "deviation-heading": 3.930103300640355, "set_robot_commands": 0.059072889420429514, "deviation-center-line": 0.8636827315826098, "driven_lanedir_consec": 0.9289599368884918, "sim_compute_sim_state": 0.02355067425362339, "sim_compute_performance-ego": 0.04214135665725506, "sim_compute_robot_state-ego": 0.043147700473600545, "sim_compute_robot_state-npc0": 0.04260257897398021, "sim_compute_robot_state-npc1": 0.04189436551232695, "sim_compute_robot_state-npc2": 0.041480404689973674, "sim_compute_robot_state-npc3": 0.04152456674281721}, "udem1-8-0": {"driven_any": 1.0648975409775323, "sim_physics": 0.10586320586470575, "survival_time": 11.65000000000003, "driven_lanedir": 0.5087736992768859, "sim_render-ego": 0.03837080165551968, "in-drivable-lane": 4.649999999999993, "agent_compute-ego": 0.1262097297308271, "deviation-heading": 3.8071961886619, "set_robot_commands": 0.05856571790998074, "deviation-center-line": 0.6575225407927267, "driven_lanedir_consec": 0.5087736992768859, "sim_compute_sim_state": 0.023550920732031563, "sim_compute_performance-ego": 0.04076369842234599, "sim_compute_robot_state-ego": 0.04349466147852558, "sim_compute_robot_state-npc0": 0.04272269895660007, "sim_compute_robot_state-npc1": 0.041650213397112015, "sim_compute_robot_state-npc2": 0.041785545103539726, "sim_compute_robot_state-npc3": 0.04149806345992846}, "udem1-9-0": {"driven_any": 1.095718960370873, "sim_physics": 0.11615265707174936, "survival_time": 12.000000000000036, "driven_lanedir": 0.7569846119103361, "sim_render-ego": 0.03791733880837758, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.12731950879096984, "deviation-heading": 5.322658284949616, "set_robot_commands": 0.058223165074984234, "deviation-center-line": 1.030133244034308, "driven_lanedir_consec": 0.6337614766727274, "sim_compute_sim_state": 0.023356255888938905, "sim_compute_performance-ego": 0.04096704324086507, "sim_compute_robot_state-ego": 0.04323982298374176, "sim_compute_robot_state-npc0": 0.04281625548998515, "sim_compute_robot_state-npc1": 0.041509397824605304, "sim_compute_robot_state-npc2": 0.04111770490805308, "sim_compute_robot_state-npc3": 0.041410032908121744}, "udem1-10-0": {"driven_any": 0.3919907521128338, "sim_physics": 0.1109732230504354, "survival_time": 4.499999999999992, "driven_lanedir": 0.37579901442923225, "sim_render-ego": 0.037574606471591526, "in-drivable-lane": 0, "agent_compute-ego": 0.12723713450961643, "deviation-heading": 1.3085113201884948, "set_robot_commands": 0.05785232384999593, "deviation-center-line": 0.3308261889076433, "driven_lanedir_consec": 0.37579901442923225, "sim_compute_sim_state": 0.023745187123616535, "sim_compute_performance-ego": 0.04129392570919461, "sim_compute_robot_state-ego": 0.0431816922293769, "sim_compute_robot_state-npc0": 0.04210162427690294, "sim_compute_robot_state-npc1": 0.04207962618933784, "sim_compute_robot_state-npc2": 0.041239198048909506, "sim_compute_robot_state-npc3": 0.04191334247589111}, "udem1-11-0": {"driven_any": 0.9904521654945392, "sim_physics": 0.09889811634468045, "survival_time": 10.85000000000002, "driven_lanedir": 0.6761250735194344, "sim_render-ego": 0.03856685524162609, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.12672270058486867, "deviation-heading": 5.486897068165592, "set_robot_commands": 0.05758476586935157, "deviation-center-line": 1.1093785568784411, "driven_lanedir_consec": 0.6267441433586265, "sim_compute_sim_state": 0.023576196986958727, "sim_compute_performance-ego": 0.040781213391211726, "sim_compute_robot_state-ego": 0.04371627354951498, "sim_compute_robot_state-npc0": 0.04310971361151489, "sim_compute_robot_state-npc1": 0.04219545197377007, "sim_compute_robot_state-npc2": 0.04204379468469576, "sim_compute_robot_state-npc3": 0.04127547927715811}, "udem1-12-0": {"driven_any": 1.0182349091390714, "sim_physics": 0.11143600887247264, "survival_time": 11.150000000000023, "driven_lanedir": 0.2803046703351908, "sim_render-ego": 0.03866624297582515, "in-drivable-lane": 7.7500000000000275, "agent_compute-ego": 0.12710601759598394, "deviation-heading": 0.8312063053272266, "set_robot_commands": 0.057269958102649635, "deviation-center-line": 0.405982586442027, "driven_lanedir_consec": 0.2803046703351908, "sim_compute_sim_state": 0.024443198747164465, "sim_compute_performance-ego": 0.040382099793096295, "sim_compute_robot_state-ego": 0.043992444538749384, "sim_compute_robot_state-npc0": 0.04311586923128821, "sim_compute_robot_state-npc1": 0.041313979657776154, "sim_compute_robot_state-npc2": 0.042112227512582, "sim_compute_robot_state-npc3": 0.04157213672928746}, "udem1-13-0": {"driven_any": 0.991360951118871, "sim_physics": 0.10488304046735372, "survival_time": 10.95000000000002, "driven_lanedir": 0.6415857563800818, "sim_render-ego": 0.03739156570608757, "in-drivable-lane": 3.0500000000000407, "agent_compute-ego": 0.12598470574644602, "deviation-heading": 1.9371601428131664, "set_robot_commands": 0.058138328055812885, "deviation-center-line": 0.4894834784438976, "driven_lanedir_consec": 0.6415857563800818, "sim_compute_sim_state": 0.02351102219324678, "sim_compute_performance-ego": 0.04198630977439009, "sim_compute_robot_state-ego": 0.042739716839028274, "sim_compute_robot_state-npc0": 0.04201354392587322, "sim_compute_robot_state-npc1": 0.04256544592173677, "sim_compute_robot_state-npc2": 0.04112820538211631, "sim_compute_robot_state-npc3": 0.04281551979448153}, "udem1-14-0": {"driven_any": 1.0956343629906689, "sim_physics": 0.11650780042012532, "survival_time": 12.000000000000036, "driven_lanedir": 0.5491416586277404, "sim_render-ego": 0.03838518559932709, "in-drivable-lane": 4.45, "agent_compute-ego": 0.12709311644236246, "deviation-heading": 4.246790182975028, "set_robot_commands": 0.05763966739177704, "deviation-center-line": 0.6182042664749414, "driven_lanedir_consec": 0.5491416586277404, "sim_compute_sim_state": 0.023636673887570694, "sim_compute_performance-ego": 0.04114862481753032, "sim_compute_robot_state-ego": 0.04364632566769918, "sim_compute_robot_state-npc0": 0.0429810752471288, "sim_compute_robot_state-npc1": 0.04158123135566712, "sim_compute_robot_state-npc2": 0.04152155220508576, "sim_compute_robot_state-npc3": 0.04157968759536743}}
set_robot_commands_max0.060703641573588055
set_robot_commands_mean0.0585029396685721
set_robot_commands_median0.058383735815684
set_robot_commands_min0.057269958102649635
sim_compute_performance-ego_max0.04214135665725506
sim_compute_performance-ego_mean0.04126816540405373
sim_compute_performance-ego_median0.04124545733133952
sim_compute_performance-ego_min0.040382099793096295
sim_compute_robot_state-ego_max0.04402076959609985
sim_compute_robot_state-ego_mean0.04333642211109808
sim_compute_robot_state-ego_median0.04340731289427159
sim_compute_robot_state-ego_min0.0416766357421875
sim_compute_robot_state-npc0_max0.04311586923128821
sim_compute_robot_state-npc0_mean0.04256792213088747
sim_compute_robot_state-npc0_median0.04271163781483968
sim_compute_robot_state-npc0_min0.041259925365448
sim_compute_robot_state-npc1_max0.04256544592173677
sim_compute_robot_state-npc1_mean0.041955273234642536
sim_compute_robot_state-npc1_median0.04191459178924561
sim_compute_robot_state-npc1_min0.041313979657776154
sim_compute_robot_state-npc2_max0.04227845345513295
sim_compute_robot_state-npc2_mean0.041558358927778254
sim_compute_robot_state-npc2_median0.04152155220508576
sim_compute_robot_state-npc2_min0.04085748434066772
sim_compute_robot_state-npc3_max0.04281551979448153
sim_compute_robot_state-npc3_mean0.04169502004502467
sim_compute_robot_state-npc3_median0.04157968759536743
sim_compute_robot_state-npc3_min0.04127547927715811
sim_compute_sim_state_max0.024443198747164465
sim_compute_sim_state_mean0.023715326693832983
sim_compute_sim_state_median0.02358440081278483
sim_compute_sim_state_min0.023356255888938905
sim_physics_max0.11650780042012532
sim_physics_mean0.10875566588399668
sim_physics_median0.10801387866338094
sim_physics_min0.09889811634468045
sim_render-ego_max0.038907838662465416
sim_render-ego_mean0.038204549292691
sim_render-ego_median0.03837080165551968
sim_render-ego_min0.03728986740112305
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.340000000000035
survival_time_min4.499999999999992
No reset possible
217572981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-25-98-24701:00:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-25-98-2470-job21757/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217512436Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-25-98-24700:01:00
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217432762Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-25-98-24700:23:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2762/step1-simulation-ip-172-31-25-98-2470-job21743/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217412799Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationfailednoip-172-31-25-98-24700:02:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217212636Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-25-98-24700:32:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1717676749596229
agent_compute-ego_mean0.1651030654541521
agent_compute-ego_median0.1659930506839028
agent_compute-ego_min0.157235633243214
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.21696655056144615, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.07059207747254191, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1659930506839028, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10303248031229913, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04076840605916856, "sim_compute_performance-ego": 0.08001194422758079, "sim_compute_robot_state-ego": 0.07967054994800422, "sim_compute_robot_state-npc0": 0.07165908209885223, "sim_compute_robot_state-npc1": 0.07223384591597545, "sim_compute_robot_state-npc2": 0.07355227953271021, "sim_compute_robot_state-npc3": 0.08028841018676758}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2229541965893337, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.07040889774050031, "in-drivable-lane": 0, "agent_compute-ego": 0.16081609896251134, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.1030624338558742, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.041752287319728305, "sim_compute_performance-ego": 0.07474792855126518, "sim_compute_robot_state-ego": 0.08595418930053711, "sim_compute_robot_state-npc0": 0.07370150940758842, "sim_compute_robot_state-npc1": 0.07262436832700457, "sim_compute_robot_state-npc2": 0.07082946811403547, "sim_compute_robot_state-npc3": 0.07121837990624565}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20554757349699448, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06716191421434717, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16655270567218078, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10530779894115856, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.0412509163606514, "sim_compute_performance-ego": 0.07402755681750844, "sim_compute_robot_state-ego": 0.07789465524617908, "sim_compute_robot_state-npc0": 0.07261833635348718, "sim_compute_robot_state-npc1": 0.07287173595243288, "sim_compute_robot_state-npc2": 0.07460048129257646, "sim_compute_robot_state-npc3": 0.07382838702896266}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.23704286416371664, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06383873522281647, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15762297809123993, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10228850444157918, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04077564676602682, "sim_compute_performance-ego": 0.07708728313446045, "sim_compute_robot_state-ego": 0.08491217593352, "sim_compute_robot_state-npc0": 0.07637691994508107, "sim_compute_robot_state-npc1": 0.07377832631270091, "sim_compute_robot_state-npc2": 0.07271310687065125, "sim_compute_robot_state-npc3": 0.0722543994585673}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2375287441980271, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.07115080243065244, "in-drivable-lane": 0, "agent_compute-ego": 0.1642279965536935, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10214726130167644, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03919703619820731, "sim_compute_performance-ego": 0.07453827630905878, "sim_compute_robot_state-ego": 0.08138166155133929, "sim_compute_robot_state-npc0": 0.07362719944545201, "sim_compute_robot_state-npc1": 0.07157879783993676, "sim_compute_robot_state-npc2": 0.07443155561174665, "sim_compute_robot_state-npc3": 0.06850793248131162}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.20030563177462823, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06737822829606291, "in-drivable-lane": 2, "agent_compute-ego": 0.16534085616380154, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10498730722301734, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04128154880272414, "sim_compute_performance-ego": 0.07180746872268037, "sim_compute_robot_state-ego": 0.07848857120125594, "sim_compute_robot_state-npc0": 0.07309661368410031, "sim_compute_robot_state-npc1": 0.07228046120283846, "sim_compute_robot_state-npc2": 0.07145844391006195, "sim_compute_robot_state-npc3": 0.07283230741580803}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2351854703958752, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06757245017486868, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1668477475064472, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10763955810695018, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.042796822427545934, "sim_compute_performance-ego": 0.07316867587635818, "sim_compute_robot_state-ego": 0.081314598472373, "sim_compute_robot_state-npc0": 0.07678429825792035, "sim_compute_robot_state-npc1": 0.07496873846331846, "sim_compute_robot_state-npc2": 0.07494966960647731, "sim_compute_robot_state-npc3": 0.07223848926210866}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.23411115169525143, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.07039656162261963, "in-drivable-lane": 0, "agent_compute-ego": 0.17009078979492187, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.1038096284866333, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.04162086963653564, "sim_compute_performance-ego": 0.07199901103973388, "sim_compute_robot_state-ego": 0.08658706665039062, "sim_compute_robot_state-npc0": 0.07452454090118409, "sim_compute_robot_state-npc1": 0.07481395244598389, "sim_compute_robot_state-npc2": 0.07512150764465332, "sim_compute_robot_state-npc3": 0.07371798038482666}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.22843636916233945, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.067318856716156, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16768552706791803, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10261386632919312, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.042745860723348766, "sim_compute_performance-ego": 0.07497632045012254, "sim_compute_robot_state-ego": 0.08719295263290405, "sim_compute_robot_state-npc0": 0.07357477224790133, "sim_compute_robot_state-npc1": 0.07169181566972, "sim_compute_robot_state-npc2": 0.07285461058983436, "sim_compute_robot_state-npc3": 0.07472909413851224}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2476384456341083, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06402788712428166, "in-drivable-lane": 0, "agent_compute-ego": 0.16519193465893084, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09907031976259673, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.04014476446005014, "sim_compute_performance-ego": 0.07328892671144925, "sim_compute_robot_state-ego": 0.07494469789358285, "sim_compute_robot_state-npc0": 0.07165645636045016, "sim_compute_robot_state-npc1": 0.07432007789611816, "sim_compute_robot_state-npc2": 0.07719078430762658, "sim_compute_robot_state-npc3": 0.07564070591559777}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.23526707562533292, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.07195635275407271, "in-drivable-lane": 0, "agent_compute-ego": 0.157235633243214, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10112810134887695, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04113513773137873, "sim_compute_performance-ego": 0.07966610518368808, "sim_compute_robot_state-ego": 0.08322741768576881, "sim_compute_robot_state-npc0": 0.07598536664789374, "sim_compute_robot_state-npc1": 0.07208063385703346, "sim_compute_robot_state-npc2": 0.07507241855968129, "sim_compute_robot_state-npc3": 0.07182607867501}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.20407988071441652, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.067702956199646, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16834551811218262, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.10213175296783449, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.042399544715881345, "sim_compute_performance-ego": 0.07252811908721923, "sim_compute_robot_state-ego": 0.0830009365081787, "sim_compute_robot_state-npc0": 0.07188828468322754, "sim_compute_robot_state-npc1": 0.07259899139404297, "sim_compute_robot_state-npc2": 0.07285954475402832, "sim_compute_robot_state-npc3": 0.07210844039916992}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.21323919042627865, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06605780124664307, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.16256192136318126, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.10287747230935604, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04120424453248369, "sim_compute_performance-ego": 0.07020986080169678, "sim_compute_robot_state-ego": 0.08083586997174202, "sim_compute_robot_state-npc0": 0.07410012661142552, "sim_compute_robot_state-npc1": 0.07375960908037552, "sim_compute_robot_state-npc2": 0.07398968808194424, "sim_compute_robot_state-npc3": 0.07516802625453219}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.22572604509500355, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06729081502327552, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1717676749596229, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.101147500368265, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.05543484596105722, "sim_compute_performance-ego": 0.07791285789929904, "sim_compute_robot_state-ego": 0.08182194599738488, "sim_compute_robot_state-npc0": 0.07588573602529672, "sim_compute_robot_state-npc1": 0.07562160950440627, "sim_compute_robot_state-npc2": 0.07555811680280246, "sim_compute_robot_state-npc3": 0.07271376481423011}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.20307895342508953, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06258452052161807, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.16626554897853307, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.10102444603329612, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03928682690575009, "sim_compute_performance-ego": 0.070817840666998, "sim_compute_robot_state-ego": 0.07916290419442314, "sim_compute_robot_state-npc0": 0.0694842883518764, "sim_compute_robot_state-npc1": 0.07001324154081799, "sim_compute_robot_state-npc2": 0.07216733069646926, "sim_compute_robot_state-npc3": 0.07071769351050967}}
set_robot_commands_max0.10763955810695018
set_robot_commands_mean0.10281789545257376
set_robot_commands_median0.10261386632919312
set_robot_commands_min0.09907031976259673
sim_compute_performance-ego_max0.08001194422758079
sim_compute_performance-ego_mean0.07445254503194126
sim_compute_performance-ego_median0.07402755681750844
sim_compute_performance-ego_min0.07020986080169678
sim_compute_robot_state-ego_max0.08719295263290405
sim_compute_robot_state-ego_mean0.08175934621250557
sim_compute_robot_state-ego_median0.08138166155133929
sim_compute_robot_state-ego_min0.07494469789358285
sim_compute_robot_state-npc0_max0.07678429825792035
sim_compute_robot_state-npc0_mean0.07366423540144913
sim_compute_robot_state-npc0_median0.07362719944545201
sim_compute_robot_state-npc0_min0.0694842883518764
sim_compute_robot_state-npc1_max0.07562160950440627
sim_compute_robot_state-npc1_mean0.07301574702684704
sim_compute_robot_state-npc1_median0.07262436832700457
sim_compute_robot_state-npc1_min0.07001324154081799
sim_compute_robot_state-npc2_max0.07719078430762658
sim_compute_robot_state-npc2_mean0.0738232670916866
sim_compute_robot_state-npc2_median0.07398968808194424
sim_compute_robot_state-npc2_min0.07082946811403547
sim_compute_robot_state-npc3_max0.08028841018676758
sim_compute_robot_state-npc3_mean0.07318600598881068
sim_compute_robot_state-npc3_median0.07271376481423011
sim_compute_robot_state-npc3_min0.06850793248131162
sim_compute_sim_state_max0.05543484596105722
sim_compute_sim_state_mean0.04211965057336921
sim_compute_sim_state_median0.0412509163606514
sim_compute_sim_state_min0.03919703619820731
sim_physics_max0.2476384456341083
sim_physics_mean0.22314054286385612
sim_physics_median0.22572604509500355
sim_physics_min0.20030563177462823
sim_render-ego_max0.07195635275407271
sim_render-ego_mean0.06769592378400685
sim_render-ego_median0.06737822829606291
sim_render-ego_min0.06258452052161807
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible