Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 191812912Thies Lennart Alff challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-24 12:01:33+00:00 2019-04-24 12:03:50+00:00 0:02:17 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 173, in main
make_video1(fn, out_video)
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
pg('video_aido', dict(filename=fn, output=output))
File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
model.init()
File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
block.init()
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
self.log = read_simulator_log_cbor(self.get_config('filename'))
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
render_time = read_perfomance(ld)
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
for i, ob in enumerate(read_topic2(ld, 'timing_information')):
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 173, in main
> make_video1(fn, out_video)
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
> pg('video_aido', dict(filename=fn, output=output))
> File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
> model.init()
> File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
> block.init()
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
> self.log = read_simulator_log_cbor(self.get_config('filename'))
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
> render_time = read_perfomance(ld)
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
> for i, ob in enumerate(read_topic2(ld, 'timing_information')):
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
> for ob in ld.objects:
> AttributeError: 'str' object has no attribute 'objects'
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191692966Andrea Censi Python template aido2-AMOD-efficiencystep2-scoring success yes idsc-rudolf-114212019-04-24 09:25:26+00:00 2019-04-24 09:25:46+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency -62.940742558932534
other stats fleet_size -1000000000 service_quality -32.21198563973391
No reset possible 191632966Andrea Censi Python template aido2-AMOD-efficiencystep1-simulation success yes idsc-rudolf-114212019-04-24 09:21:50+00:00 2019-04-24 09:25:13+00:00 0:03:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191592916Claudio Ruch Python template aido2-AMOD-efficiencystep1-simulation success yes idsc-rudolf-114212019-04-24 09:17:28+00:00 2019-04-24 09:20:52+00:00 0:03:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191502298Andrea Censi Python template aido2-AMOD-efficiencystep1-simulation success yes idsc-rudolf-114212019-04-24 09:10:21+00:00 2019-04-24 09:13:21+00:00 0:03:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191422308Andrea Censi Java template aido2-AMOD-fleet_sizestep1-simulation error yes idsc-rudolf-114212019-04-24 09:06:27+00:00 2019-04-24 09:06:58+00:00 0:00:31 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191412309Andrea Censi Java template aido2-AMOD-service_qualitystep1-simulation error yes idsc-rudolf-114212019-04-24 09:05:10+00:00 2019-04-24 09:05:54+00:00 0:00:44 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191172957Julian Zilly Baseline-IL-logs-tensorflow aido2-LF-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-24 05:40:54+00:00 2019-04-24 06:02:03+00:00 0:21:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2041905417314545 survival_time_median 14.950000000000076 deviation-center-line_median 0.3988782700728286 in-drivable-lane_median 1.1999999999999955
other stats agent_compute-ego_max 0.20903821388880411 agent_compute-ego_mean 0.20115401826283777 agent_compute-ego_median 0.20381861533561765 agent_compute-ego_min 0.1904921539624532 deviation-center-line_max 1.1250594969082102 deviation-center-line_mean 0.6498703014677251 deviation-center-line_min 0.2507886420455303 deviation-heading_max 2.7015535071532364 deviation-heading_mean 1.767360018124912 deviation-heading_median 1.8042114682290464 deviation-heading_min 1.1148917379726595 driven_any_max 1.9074185531963996 driven_any_mean 1.6034693824506157 driven_any_median 1.729847344328713 driven_any_min 0.9495787445178916 driven_lanedir_consec_max 1.8942401721383288 driven_lanedir_consec_mean 1.3411427378921807 driven_lanedir_consec_min 0.5721523483070912 driven_lanedir_max 1.8942401721383288 driven_lanedir_mean 1.3692749385248222 driven_lanedir_median 1.2295230649451847 driven_lanedir_min 0.6403366246916926 in-drivable-lane_max 4.0500000000000576 in-drivable-lane_mean 1.3700000000000152 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9495787445178916, "sim_physics": 0.017757621124713092, "survival_time": 6.849999999999984, "driven_lanedir": 0.6403366246916926, "sim_render-ego": 0.07018194929526671, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.20381861533561765, "deviation-heading": 1.8042114682290464, "set_robot_commands": 0.07962319102600543, "deviation-center-line": 0.2507886420455303, "driven_lanedir_consec": 0.5721523483070912, "sim_compute_sim_state": 0.04442989565160153, "sim_compute_performance-ego": 0.06908932219456582, "sim_compute_robot_state-ego": 0.06880444157732664}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.881548340232104, "sim_physics": 0.017004151344299317, "survival_time": 14.950000000000076, "driven_lanedir": 1.8728901188043428, "sim_render-ego": 0.07261690457661947, "in-drivable-lane": 0, "agent_compute-ego": 0.20903821388880411, "deviation-heading": 1.1148917379726595, "set_robot_commands": 0.07913135846455892, "deviation-center-line": 1.1250594969082102, "driven_lanedir_consec": 1.8728901188043428, "sim_compute_sim_state": 0.04392630577087402, "sim_compute_performance-ego": 0.07123065074284872, "sim_compute_robot_state-ego": 0.06913318157196045}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9074185531963996, "sim_physics": 0.01663631836573283, "survival_time": 14.950000000000076, "driven_lanedir": 1.8942401721383288, "sim_render-ego": 0.07030045986175537, "in-drivable-lane": 0, "agent_compute-ego": 0.20603188355763755, "deviation-heading": 1.2948614999129142, "set_robot_commands": 0.08013267040252686, "deviation-center-line": 1.0807960869350468, "driven_lanedir_consec": 1.8942401721383288, "sim_compute_sim_state": 0.0432478404045105, "sim_compute_performance-ego": 0.06962511618932088, "sim_compute_robot_state-ego": 0.06910762468973795}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.729847344328713, "sim_physics": 0.015774815877278647, "survival_time": 14.950000000000076, "driven_lanedir": 1.2295230649451847, "sim_render-ego": 0.0630138103167216, "in-drivable-lane": 4.0500000000000576, "agent_compute-ego": 0.1904921539624532, "deviation-heading": 2.7015535071532364, "set_robot_commands": 0.07813153584798177, "deviation-center-line": 0.39382901137700904, "driven_lanedir_consec": 1.2041905417314545, "sim_compute_sim_state": 0.040494059721628825, "sim_compute_performance-ego": 0.06307580471038818, "sim_compute_robot_state-ego": 0.06532618284225464}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5489539299779698, "sim_physics": 0.01638292357072992, "survival_time": 11.800000000000033, "driven_lanedir": 1.209384712044562, "sim_render-ego": 0.06560604754140821, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.19638922456967628, "deviation-heading": 1.921281877356704, "set_robot_commands": 0.0779073440422446, "deviation-center-line": 0.3988782700728286, "driven_lanedir_consec": 1.162240508479687, "sim_compute_sim_state": 0.04070238339698921, "sim_compute_performance-ego": 0.0655283836995141, "sim_compute_robot_state-ego": 0.06610485254707983}}set_robot_commands_max 0.08013267040252686 set_robot_commands_mean 0.07898521995666351 set_robot_commands_median 0.07913135846455892 set_robot_commands_min 0.0779073440422446 sim_compute_performance-ego_max 0.07123065074284872 sim_compute_performance-ego_mean 0.06770985550732753 sim_compute_performance-ego_median 0.06908932219456582 sim_compute_performance-ego_min 0.06307580471038818 sim_compute_robot_state-ego_max 0.06913318157196045 sim_compute_robot_state-ego_mean 0.0676952566456719 sim_compute_robot_state-ego_median 0.06880444157732664 sim_compute_robot_state-ego_min 0.06532618284225464 sim_compute_sim_state_max 0.04442989565160153 sim_compute_sim_state_mean 0.04256009698912082 sim_compute_sim_state_median 0.0432478404045105 sim_compute_sim_state_min 0.040494059721628825 sim_physics_max 0.017757621124713092 sim_physics_mean 0.01671116605655076 sim_physics_median 0.01663631836573283 sim_physics_min 0.015774815877278647 sim_render-ego_max 0.07261690457661947 sim_render-ego_mean 0.06834383431835427 sim_render-ego_median 0.07018194929526671 sim_render-ego_min 0.0630138103167216 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.700000000000047 survival_time_min 6.849999999999984
No reset possible 191132945Bhairav Mehta Baseline solution using reinforcement learning aido2-LF-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-24 00:07:47+00:00 2019-04-24 00:12:01+00:00 0:04:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.12304266599198188 survival_time_median 1.2500000000000004 deviation-center-line_median 0.05653489151085004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2439357280731201 agent_compute-ego_mean 0.22364152570738308 agent_compute-ego_median 0.2218333053588867 agent_compute-ego_min 0.19323069116343625 deviation-center-line_max 0.058972718554839314 deviation-center-line_mean 0.053670218810273576 deviation-center-line_min 0.03972423753952388 deviation-heading_max 0.6659641049038802 deviation-heading_mean 0.629199722036077 deviation-heading_median 0.641038660072262 deviation-heading_min 0.537091422919504 driven_any_max 0.2085690786567864 driven_any_mean 0.174047793079373 driven_any_median 0.17485748926188666 driven_any_min 0.14310523997925045 driven_lanedir_consec_max 0.16903879819220535 driven_lanedir_consec_mean 0.12227369549145424 driven_lanedir_consec_min 0.07920887281108913 driven_lanedir_max 0.16903879819220535 driven_lanedir_mean 0.12227369549145424 driven_lanedir_median 0.12304266599198188 driven_lanedir_min 0.07920887281108913 in-drivable-lane_max 0.05000000000000005 in-drivable-lane_mean 0.010000000000000007 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16520336894256074, "sim_physics": 0.01771967609723409, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11337864866627, "sim_render-ego": 0.0648649235566457, "in-drivable-lane": 0, "agent_compute-ego": 0.21887057026227316, "deviation-heading": 0.641038660072262, "set_robot_commands": 0.0787147084871928, "deviation-center-line": 0.0552933800309595, "driven_lanedir_consec": 0.11337864866627, "sim_compute_sim_state": 0.039278765519460045, "sim_compute_performance-ego": 0.06198375423749288, "sim_compute_robot_state-ego": 0.060568402210871376}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2085690786567864, "sim_physics": 0.016111488342285155, "survival_time": 1.2500000000000004, "driven_lanedir": 0.16903879819220535, "sim_render-ego": 0.06030231475830078, "in-drivable-lane": 0, "agent_compute-ego": 0.2218333053588867, "deviation-heading": 0.537091422919504, "set_robot_commands": 0.07477045059204102, "deviation-center-line": 0.058972718554839314, "driven_lanedir_consec": 0.16903879819220535, "sim_compute_sim_state": 0.03903892517089843, "sim_compute_performance-ego": 0.06302181243896485, "sim_compute_robot_state-ego": 0.06593074798583984}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14310523997925045, "sim_physics": 0.016592720280522884, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07920887281108913, "sim_render-ego": 0.06670915562173595, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.19323069116343625, "deviation-heading": 0.6363117054460274, "set_robot_commands": 0.07787170617476753, "deviation-center-line": 0.03972423753952388, "driven_lanedir_consec": 0.07920887281108913, "sim_compute_sim_state": 0.039017127907794456, "sim_compute_performance-ego": 0.0692710772804592, "sim_compute_robot_state-ego": 0.06604861176532248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17485748926188666, "sim_physics": 0.018202362060546876, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12304266599198188, "sim_render-ego": 0.0668733024597168, "in-drivable-lane": 0, "agent_compute-ego": 0.2403373336791992, "deviation-heading": 0.6655927168387111, "set_robot_commands": 0.07650693893432617, "deviation-center-line": 0.05653489151085004, "driven_lanedir_consec": 0.12304266599198188, "sim_compute_sim_state": 0.040981903076171874, "sim_compute_performance-ego": 0.06363703727722168, "sim_compute_robot_state-ego": 0.06502091407775878}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1785037885563808, "sim_physics": 0.017814998626708985, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12669949179572493, "sim_render-ego": 0.06243838310241699, "in-drivable-lane": 0, "agent_compute-ego": 0.2439357280731201, "deviation-heading": 0.6659641049038802, "set_robot_commands": 0.0838831615447998, "deviation-center-line": 0.05782586641519511, "driven_lanedir_consec": 0.12669949179572493, "sim_compute_sim_state": 0.03953632354736328, "sim_compute_performance-ego": 0.06327374458312988, "sim_compute_robot_state-ego": 0.06463454246520996}}set_robot_commands_max 0.0838831615447998 set_robot_commands_mean 0.07834939314662545 set_robot_commands_median 0.07787170617476753 set_robot_commands_min 0.07477045059204102 sim_compute_performance-ego_max 0.0692710772804592 sim_compute_performance-ego_mean 0.0642374851634537 sim_compute_performance-ego_median 0.06327374458312988 sim_compute_performance-ego_min 0.06198375423749288 sim_compute_robot_state-ego_max 0.06604861176532248 sim_compute_robot_state-ego_mean 0.06444064370100049 sim_compute_robot_state-ego_median 0.06502091407775878 sim_compute_robot_state-ego_min 0.060568402210871376 sim_compute_sim_state_max 0.040981903076171874 sim_compute_sim_state_mean 0.03957060904433762 sim_compute_sim_state_median 0.039278765519460045 sim_compute_sim_state_min 0.039017127907794456 sim_physics_max 0.018202362060546876 sim_physics_mean 0.017288249081459598 sim_physics_median 0.01771967609723409 sim_physics_min 0.016111488342285155 sim_render-ego_max 0.0668733024597168 sim_render-ego_mean 0.06423761589976325 sim_render-ego_median 0.0648649235566457 sim_render-ego_min 0.06030231475830078 simulation-passed 1 survival_time_max 1.2500000000000004 survival_time_mean 1.2200000000000002 survival_time_min 1.1500000000000004
No reset possible 191052932Bhairav Mehta Baseline solution using reinforcement learning aido2-LF-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-23 23:35:39+00:00 2019-04-23 23:36:20+00:00 0:00:41 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190962925Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LFV-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-23 22:30:27+00:00 2019-04-23 22:38:16+00:00 0:07:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0958241756425725 survival_time_median 1.2500000000000004 deviation-center-line_median 0.05301723829761258 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.5070676306883494 agent_compute-ego_mean 0.3477129000960916 agent_compute-ego_median 0.34198655128479005 agent_compute-ego_min 0.2434342114821724 deviation-center-line_max 0.06051543758688124 deviation-center-line_mean 0.04900718498681539 deviation-center-line_min 0.03449269744380228 deviation-heading_max 0.7417008753446677 deviation-heading_mean 0.6921224883467366 deviation-heading_median 0.6817565734703078 deviation-heading_min 0.6567892734025421 driven_any_max 0.17476361550858863 driven_any_mean 0.15447034672758703 driven_any_median 0.15318403249389528 driven_any_min 0.13627404918053113 driven_lanedir_consec_max 0.11355212072916963 driven_lanedir_consec_mean 0.08996611769234006 driven_lanedir_consec_min 0.057673142958070134 driven_lanedir_max 0.11355212072916963 driven_lanedir_mean 0.08996611769234006 driven_lanedir_median 0.0958241756425725 driven_lanedir_min 0.057673142958070134 in-drivable-lane_max 0.15000000000000013 in-drivable-lane_mean 0.06000000000000005 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15701352565149637, "sim_physics": 0.028747687737147015, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10046681664640866, "sim_render-ego": 0.056261042753855385, "in-drivable-lane": 0, "agent_compute-ego": 0.5070676306883494, "deviation-heading": 0.7049810360067383, "set_robot_commands": 0.07558562358220418, "deviation-center-line": 0.054763156995795224, "driven_lanedir_consec": 0.10046681664640866, "sim_compute_sim_state": 0.032964885234832764, "sim_compute_performance-ego": 0.05947799483935038, "sim_compute_robot_state-ego": 0.06058781345685323, "sim_compute_robot_state-npc0": 0.06110130747159322, "sim_compute_robot_state-npc1": 0.05644871791203817, "sim_compute_robot_state-npc2": 0.05439292391141256, "sim_compute_robot_state-npc3": 0.055474698543548584}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.13627404918053113, "sim_physics": 0.02545374870300293, "survival_time": 1.2500000000000004, "driven_lanedir": 0.057673142958070134, "sim_render-ego": 0.055186128616333006, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.34198655128479005, "deviation-heading": 0.6753846835094274, "set_robot_commands": 0.07321167945861816, "deviation-center-line": 0.03449269744380228, "driven_lanedir_consec": 0.057673142958070134, "sim_compute_sim_state": 0.03187540054321289, "sim_compute_performance-ego": 0.057889184951782226, "sim_compute_robot_state-ego": 0.060276031494140625, "sim_compute_robot_state-npc0": 0.06331174850463867, "sim_compute_robot_state-npc1": 0.060077362060546875, "sim_compute_robot_state-npc2": 0.05866701126098633, "sim_compute_robot_state-npc3": 0.05730443954467773}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17476361550858863, "sim_physics": 0.025190906524658205, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11355212072916963, "sim_render-ego": 0.057279739379882816, "in-drivable-lane": 0, "agent_compute-ego": 0.3513967514038086, "deviation-heading": 0.7417008753446677, "set_robot_commands": 0.07413528442382812, "deviation-center-line": 0.06051543758688124, "driven_lanedir_consec": 0.11355212072916963, "sim_compute_sim_state": 0.03343153953552246, "sim_compute_performance-ego": 0.06014626502990723, "sim_compute_robot_state-ego": 0.05864031791687012, "sim_compute_robot_state-npc0": 0.06451497077941895, "sim_compute_robot_state-npc1": 0.06217321395874023, "sim_compute_robot_state-npc2": 0.06317323684692383, "sim_compute_robot_state-npc3": 0.06111170768737793}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1511165108034236, "sim_physics": 0.02584114074707031, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08231433248547937, "sim_render-ego": 0.058008670806884766, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.2946793556213379, "deviation-heading": 0.6567892734025421, "set_robot_commands": 0.07396643638610839, "deviation-center-line": 0.04224739460998558, "driven_lanedir_consec": 0.08231433248547937, "sim_compute_sim_state": 0.03425820350646973, "sim_compute_performance-ego": 0.0623698616027832, "sim_compute_robot_state-ego": 0.06075121879577637, "sim_compute_robot_state-npc0": 0.06839814186096191, "sim_compute_robot_state-npc1": 0.06112166404724121, "sim_compute_robot_state-npc2": 0.06019134521484375, "sim_compute_robot_state-npc3": 0.05861034393310547}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15318403249389528, "sim_physics": 0.023175415785416313, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0958241756425725, "sim_render-ego": 0.06445492868838103, "in-drivable-lane": 0, "agent_compute-ego": 0.2434342114821724, "deviation-heading": 0.6817565734703078, "set_robot_commands": 0.07854340387427289, "deviation-center-line": 0.05301723829761258, "driven_lanedir_consec": 0.0958241756425725, "sim_compute_sim_state": 0.03276069267936375, "sim_compute_performance-ego": 0.06382393836975098, "sim_compute_robot_state-ego": 0.062254200810971466, "sim_compute_robot_state-npc0": 0.06803906482198964, "sim_compute_robot_state-npc1": 0.06507274378900943, "sim_compute_robot_state-npc2": 0.06340315030968707, "sim_compute_robot_state-npc3": 0.06297519932622495}}set_robot_commands_max 0.07854340387427289 set_robot_commands_mean 0.07508848554500634 set_robot_commands_median 0.07413528442382812 set_robot_commands_min 0.07321167945861816 sim_compute_performance-ego_max 0.06382393836975098 sim_compute_performance-ego_mean 0.060741448958714805 sim_compute_performance-ego_median 0.06014626502990723 sim_compute_performance-ego_min 0.057889184951782226 sim_compute_robot_state-ego_max 0.062254200810971466 sim_compute_robot_state-ego_mean 0.06050191649492235 sim_compute_robot_state-ego_median 0.06058781345685323 sim_compute_robot_state-ego_min 0.05864031791687012 sim_compute_robot_state-npc0_max 0.06839814186096191 sim_compute_robot_state-npc0_mean 0.06507304668772047 sim_compute_robot_state-npc0_median 0.06451497077941895 sim_compute_robot_state-npc0_min 0.06110130747159322 sim_compute_robot_state-npc1_max 0.06507274378900943 sim_compute_robot_state-npc1_mean 0.06097874035351518 sim_compute_robot_state-npc1_median 0.06112166404724121 sim_compute_robot_state-npc1_min 0.05644871791203817 sim_compute_robot_state-npc2_max 0.06340315030968707 sim_compute_robot_state-npc2_mean 0.05996553350877071 sim_compute_robot_state-npc2_median 0.06019134521484375 sim_compute_robot_state-npc2_min 0.05439292391141256 sim_compute_robot_state-npc3_max 0.06297519932622495 sim_compute_robot_state-npc3_mean 0.05909527780698694 sim_compute_robot_state-npc3_median 0.05861034393310547 sim_compute_robot_state-npc3_min 0.055474698543548584 sim_compute_sim_state_max 0.03425820350646973 sim_compute_sim_state_mean 0.03305814429988031 sim_compute_sim_state_median 0.032964885234832764 sim_compute_sim_state_min 0.03187540054321289 sim_physics_max 0.028747687737147015 sim_physics_mean 0.025681779899458957 sim_physics_median 0.02545374870300293 sim_physics_min 0.023175415785416313 sim_render-ego_max 0.06445492868838103 sim_render-ego_mean 0.05823810204906739 sim_render-ego_median 0.057279739379882816 sim_render-ego_min 0.055186128616333006 simulation-passed 1 survival_time_max 1.2500000000000004 survival_time_mean 1.2200000000000004 survival_time_min 1.1500000000000004
No reset possible 190842917Claudio Ruch Python template aido2-AMOD-service_qualitystep1-simulation aborted no idsc-rudolf-114212019-04-23 14:20:21+00:00 2019-04-23 14:20:21+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190802916Claudio Ruch Python template aido2-AMOD-efficiencystep1-simulation aborted no idsc-rudolf-114212019-04-23 14:19:40+00:00 2019-04-23 14:19:40+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190522914Claudio Ruch Python template aido2-AMOD-efficiencystep1-simulation host-error no idsc-rudolf-114212019-04-23 14:00:09+00:00 2019-04-23 14:00:09+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190492915Claudio Ruch Python template aido2-AMOD-service_qualitystep1-simulation host-error no idsc-rudolf-114212019-04-23 13:59:23+00:00 2019-04-23 13:59:23+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190392903Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-testingstep1-simulation host-error no idsc-rudolf-114212019-04-23 08:40:22+00:00 2019-04-23 09:00:51+00:00 0:20:29 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2903/step1-simulation-idsc-rudolf-11421-job19039/tmp/tmp8jt81p1b/attempts/ETHZ_autolab_technical_track-3-0.attempt3/log.gs2.cbor.tmp']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190282904Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-validationstep1-simulation host-error no idsc-rudolf-114212019-04-23 08:19:11+00:00 2019-04-23 08:39:47+00:00 0:20:36 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2904/step1-simulation-idsc-rudolf-11421-job19028/tmp/tmphp__4r8p/attempts/ETHZ_autolab_technical_track-3-0.attempt3/log.gs2.cbor.tmp']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189922891Diego Charrez Python template aido2-AMOD-efficiencystep1-simulation host-error no idsc-rudolf-114212019-04-22 17:28:25+00:00 2019-04-22 17:28:25+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189892892Diego Charrez Python template aido2-AMOD-service_qualitystep1-simulation host-error no idsc-rudolf-114212019-04-22 17:28:13+00:00 2019-04-22 17:28:13+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189802890Diego Charrez Python template aido2-AMOD-service_qualitystep1-simulation host-error no idsc-rudolf-114212019-04-22 17:26:56+00:00 2019-04-22 17:26:56+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189792889Diego Charrez Python template aido2-AMOD-efficiencystep1-simulation host-error no idsc-rudolf-114212019-04-22 17:26:38+00:00 2019-04-22 17:26:38+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189562889Diego Charrez Python template aido2-AMOD-efficiencystep1-simulation aborted no idsc-rudolf-114212019-04-22 16:49:56+00:00 2019-04-22 16:49:56+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189542890Diego Charrez Python template aido2-AMOD-service_qualitystep1-simulation aborted no idsc-rudolf-114212019-04-22 16:49:42+00:00 2019-04-22 16:49:42+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189522887Diego Charrez PredictorLast aido2-PREDstep1-simulation success no idsc-rudolf-114212019-04-22 15:33:19+00:00 2019-04-22 15:34:16+00:00 0:00:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.1063606258347482 error_L2 0.016293851180950045
No reset possible 189402884Andrea Daniele minimal_agent (Python 3) aido2-LFVI-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-21 01:53:37+00:00 2019-04-21 02:14:42+00:00 0:21:05 Waited 1200 seconds [...] Waited 1200 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189282374Liam Paull minimal_agent (Python 3) aido2-LFVI-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 15:49:21+00:00 2019-04-20 16:10:45+00:00 0:21:24 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189162373Liam Paull minimal_agent (Python 3) aido2-LFVI-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 15:26:56+00:00 2019-04-20 15:48:02+00:00 0:21:06 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189042386Andrea Censi Baseline solution using reinforcement learning aido2-LFV-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-20 15:19:27+00:00 2019-04-20 15:26:43+00:00 0:07:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.18587906056275472 survival_time_median 1.800000000000001 deviation-center-line_median 0.07931276684147284 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.24585137764612833 agent_compute-ego_mean 0.2224299273431025 agent_compute-ego_median 0.22458548016018337 agent_compute-ego_min 0.19683020179336136 deviation-center-line_max 0.08511797752229071 deviation-center-line_mean 0.07640893962580456 deviation-center-line_min 0.06493980472738148 deviation-heading_max 0.8283448050377775 deviation-heading_mean 0.7557518719508177 deviation-heading_median 0.7295679238387184 deviation-heading_min 0.6817188355159759 driven_any_max 0.2814870822095302 driven_any_mean 0.23741659329116072 driven_any_median 0.2390496367144969 driven_any_min 0.15820946490558943 driven_lanedir_consec_max 0.24201005600972536 driven_lanedir_consec_mean 0.18897279652590157 driven_lanedir_consec_min 0.09712256380094296 driven_lanedir_max 0.24201005600972536 driven_lanedir_mean 0.18897279652590157 driven_lanedir_median 0.18587906056275472 driven_lanedir_min 0.09712256380094296 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2390496367144969, "sim_physics": 0.02614780267079671, "survival_time": 1.800000000000001, "driven_lanedir": 0.18353098734226592, "sim_render-ego": 0.06012078126271566, "in-drivable-lane": 0, "agent_compute-ego": 0.212652325630188, "deviation-heading": 0.8283448050377775, "set_robot_commands": 0.07543722788492839, "deviation-center-line": 0.07314911495182, "driven_lanedir_consec": 0.18353098734226592, "sim_compute_sim_state": 0.03506262434853448, "sim_compute_performance-ego": 0.057857612768809, "sim_compute_robot_state-ego": 0.06297363175286187, "sim_compute_robot_state-npc0": 0.06744078795115153, "sim_compute_robot_state-npc1": 0.06420122252570258, "sim_compute_robot_state-npc2": 0.06041157907909817, "sim_compute_robot_state-npc3": 0.06073870923784045}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15820946490558943, "sim_physics": 0.025238831837972004, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09712256380094296, "sim_render-ego": 0.06148759524027506, "in-drivable-lane": 0, "agent_compute-ego": 0.22458548016018337, "deviation-heading": 0.8282753826656806, "set_robot_commands": 0.0769704536155418, "deviation-center-line": 0.06493980472738148, "driven_lanedir_consec": 0.09712256380094296, "sim_compute_sim_state": 0.03638922726666486, "sim_compute_performance-ego": 0.06398362583584255, "sim_compute_robot_state-ego": 0.06267412503560384, "sim_compute_robot_state-npc0": 0.07073229330557364, "sim_compute_robot_state-npc1": 0.06160476472642687, "sim_compute_robot_state-npc2": 0.06073188781738281, "sim_compute_robot_state-npc3": 0.06152805575618037}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2814870822095302, "sim_physics": 0.027025991015964083, "survival_time": 1.800000000000001, "driven_lanedir": 0.24201005600972536, "sim_render-ego": 0.06234586901134915, "in-drivable-lane": 0, "agent_compute-ego": 0.24585137764612833, "deviation-heading": 0.6817188355159759, "set_robot_commands": 0.07639312081866795, "deviation-center-line": 0.08511797752229071, "driven_lanedir_consec": 0.24201005600972536, "sim_compute_sim_state": 0.03544629282421536, "sim_compute_performance-ego": 0.06142323546939426, "sim_compute_robot_state-ego": 0.05997545189327664, "sim_compute_robot_state-npc0": 0.06690881649653117, "sim_compute_robot_state-npc1": 0.06370159652498034, "sim_compute_robot_state-npc2": 0.060846805572509766, "sim_compute_robot_state-npc3": 0.061888933181762695}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.22960529797809953, "sim_physics": 0.029007044705477627, "survival_time": 1.6500000000000008, "driven_lanedir": 0.18587906056275472, "sim_render-ego": 0.061357736587524414, "in-drivable-lane": 0, "agent_compute-ego": 0.2322302514856512, "deviation-heading": 0.7295679238387184, "set_robot_commands": 0.07555723190307617, "deviation-center-line": 0.07931276684147284, "driven_lanedir_consec": 0.18587906056275472, "sim_compute_sim_state": 0.03582825082721132, "sim_compute_performance-ego": 0.06350994110107422, "sim_compute_robot_state-ego": 0.0631065151908181, "sim_compute_robot_state-npc0": 0.06435260628208969, "sim_compute_robot_state-npc1": 0.06339268973379424, "sim_compute_robot_state-npc2": 0.06313268343607585, "sim_compute_robot_state-npc3": 0.06547877282807321}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.27873148464808745, "sim_physics": 0.02496303094399942, "survival_time": 1.850000000000001, "driven_lanedir": 0.23632131491381891, "sim_render-ego": 0.0614408609029409, "in-drivable-lane": 0, "agent_compute-ego": 0.19683020179336136, "deviation-heading": 0.7108524126959368, "set_robot_commands": 0.07572007823634792, "deviation-center-line": 0.07952503408605771, "driven_lanedir_consec": 0.23632131491381891, "sim_compute_sim_state": 0.036252498626708984, "sim_compute_performance-ego": 0.05910732295062091, "sim_compute_robot_state-ego": 0.05885132583411965, "sim_compute_robot_state-npc0": 0.06828370609798946, "sim_compute_robot_state-npc1": 0.06311398583489496, "sim_compute_robot_state-npc2": 0.062356562227816194, "sim_compute_robot_state-npc3": 0.06252714749929067}}set_robot_commands_max 0.0769704536155418 set_robot_commands_mean 0.07601562249171244 set_robot_commands_median 0.07572007823634792 set_robot_commands_min 0.07543722788492839 sim_compute_performance-ego_max 0.06398362583584255 sim_compute_performance-ego_mean 0.06117634762514819 sim_compute_performance-ego_median 0.06142323546939426 sim_compute_performance-ego_min 0.057857612768809 sim_compute_robot_state-ego_max 0.0631065151908181 sim_compute_robot_state-ego_mean 0.06151620994133602 sim_compute_robot_state-ego_median 0.06267412503560384 sim_compute_robot_state-ego_min 0.05885132583411965 sim_compute_robot_state-npc0_max 0.07073229330557364 sim_compute_robot_state-npc0_mean 0.0675436420266671 sim_compute_robot_state-npc0_median 0.06744078795115153 sim_compute_robot_state-npc0_min 0.06435260628208969 sim_compute_robot_state-npc1_max 0.06420122252570258 sim_compute_robot_state-npc1_mean 0.06320285186915979 sim_compute_robot_state-npc1_median 0.06339268973379424 sim_compute_robot_state-npc1_min 0.06160476472642687 sim_compute_robot_state-npc2_max 0.06313268343607585 sim_compute_robot_state-npc2_mean 0.061495903626576566 sim_compute_robot_state-npc2_median 0.060846805572509766 sim_compute_robot_state-npc2_min 0.06041157907909817 sim_compute_robot_state-npc3_max 0.06547877282807321 sim_compute_robot_state-npc3_mean 0.06243232370062947 sim_compute_robot_state-npc3_median 0.061888933181762695 sim_compute_robot_state-npc3_min 0.06073870923784045 sim_compute_sim_state_max 0.03638922726666486 sim_compute_sim_state_mean 0.035795778778667 sim_compute_sim_state_median 0.03582825082721132 sim_compute_sim_state_min 0.03506262434853448 sim_physics_max 0.029007044705477627 sim_physics_mean 0.026476540234841972 sim_physics_median 0.02614780267079671 sim_physics_min 0.02496303094399942 sim_render-ego_max 0.06234586901134915 sim_render-ego_mean 0.06135056860096104 sim_render-ego_median 0.0614408609029409 sim_render-ego_min 0.06012078126271566 simulation-passed 1 survival_time_max 1.850000000000001 survival_time_mean 1.6900000000000008 survival_time_min 1.3500000000000003
No reset possible 189012391Liam Paull random_agent aido2-LF-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 15:13:25+00:00 2019-04-20 15:19:10+00:00 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.13226005931695303 agent_compute-ego_mean 0.12885738903441707 agent_compute-ego_median 0.1301872518327501 agent_compute-ego_min 0.1256080168598103 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01659140946730128, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0632705013706999, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1256080168598103, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07633781433105469, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.040577339676191225, "sim_compute_performance-ego": 0.06346093483690946, "sim_compute_robot_state-ego": 0.06333040741254699}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016230648214166813, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06163873997601596, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1259610273621299, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07653168114748868, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04059666395187378, "sim_compute_performance-ego": 0.061125132170590485, "sim_compute_robot_state-ego": 0.0645593296397816}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016137764188978408, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06478508843315972, "in-drivable-lane": 0, "agent_compute-ego": 0.1301872518327501, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07841225730048286, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.039908552169799806, "sim_compute_performance-ego": 0.06844084527757432, "sim_compute_robot_state-ego": 0.06714160177442763}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01497173806031545, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05876281360785166, "in-drivable-lane": 0, "agent_compute-ego": 0.13226005931695303, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07762883603572845, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03628189365069071, "sim_compute_performance-ego": 0.06140992045402527, "sim_compute_robot_state-ego": 0.05836151043574015}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.0170788239030277, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06543647541719325, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13027058980044195, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07967691211139455, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04121423468870275, "sim_compute_performance-ego": 0.06435805909773883, "sim_compute_robot_state-ego": 0.06529163613038905}}set_robot_commands_max 0.07967691211139455 set_robot_commands_mean 0.07771750018522985 set_robot_commands_median 0.07762883603572845 set_robot_commands_min 0.07633781433105469 sim_compute_performance-ego_max 0.06844084527757432 sim_compute_performance-ego_mean 0.06375897836736769 sim_compute_performance-ego_median 0.06346093483690946 sim_compute_performance-ego_min 0.061125132170590485 sim_compute_robot_state-ego_max 0.06714160177442763 sim_compute_robot_state-ego_mean 0.06373689707857708 sim_compute_robot_state-ego_median 0.0645593296397816 sim_compute_robot_state-ego_min 0.05836151043574015 sim_compute_sim_state_max 0.04121423468870275 sim_compute_sim_state_mean 0.03971573682745165 sim_compute_sim_state_median 0.040577339676191225 sim_compute_sim_state_min 0.03628189365069071 sim_physics_max 0.0170788239030277 sim_physics_mean 0.01620207676675793 sim_physics_median 0.016230648214166813 sim_physics_min 0.01497173806031545 sim_render-ego_max 0.06543647541719325 sim_render-ego_mean 0.0627787237609841 sim_render-ego_median 0.0632705013706999 sim_render-ego_min 0.05876281360785166 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 188962402Victor Guerra Baseline solution using reinforcement learning aido2-LF-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 15:08:41+00:00 2019-04-20 15:12:52+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.08976185211999566 survival_time_median 1.2500000000000004 deviation-center-line_median 0.03888118410995975 in-drivable-lane_median 0.10000000000000007
other stats agent_compute-ego_max 0.2791706965519832 agent_compute-ego_mean 0.22106641114063752 agent_compute-ego_median 0.22033586502075195 agent_compute-ego_min 0.1785712146759033 deviation-center-line_max 0.05610235685664389 deviation-center-line_mean 0.04113253501121085 deviation-center-line_min 0.025328678690298284 deviation-heading_max 0.7178033338958204 deviation-heading_mean 0.641365362110887 deviation-heading_median 0.6253521523342918 deviation-heading_min 0.5763022701559214 driven_any_max 0.1789935277394807 driven_any_mean 0.15957642450529494 driven_any_median 0.15934787556461705 driven_any_min 0.1312850098707364 driven_lanedir_consec_max 0.12017567012075105 driven_lanedir_consec_mean 0.09070378817159466 driven_lanedir_consec_min 0.05213461138386455 driven_lanedir_max 0.12017567012075105 driven_lanedir_mean 0.09070378817159466 driven_lanedir_median 0.08976185211999566 driven_lanedir_min 0.05213461138386455 in-drivable-lane_max 0.20000000000000015 in-drivable-lane_mean 0.10000000000000007 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1312850098707364, "sim_physics": 0.016670217116673786, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05213461138386455, "sim_render-ego": 0.0613005260626475, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1959770123163859, "deviation-heading": 0.5763022701559214, "set_robot_commands": 0.07706140478452046, "deviation-center-line": 0.025328678690298284, "driven_lanedir_consec": 0.05213461138386455, "sim_compute_sim_state": 0.03947197397549947, "sim_compute_performance-ego": 0.06228650609652201, "sim_compute_robot_state-ego": 0.06232095758120219}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1758620842028389, "sim_physics": 0.014740677980276257, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10679537193758082, "sim_render-ego": 0.05938801398644081, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.2791706965519832, "deviation-heading": 0.7178033338958204, "set_robot_commands": 0.07454150456648606, "deviation-center-line": 0.05007817017752824, "driven_lanedir_consec": 0.10679537193758082, "sim_compute_sim_state": 0.03628133810483492, "sim_compute_performance-ego": 0.06061752025897686, "sim_compute_robot_state-ego": 0.061583610681387096}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1789935277394807, "sim_physics": 0.01655186653137207, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12017567012075105, "sim_render-ego": 0.057770462036132814, "in-drivable-lane": 0, "agent_compute-ego": 0.22033586502075195, "deviation-heading": 0.7018399843646629, "set_robot_commands": 0.08574421882629395, "deviation-center-line": 0.05610235685664389, "driven_lanedir_consec": 0.12017567012075105, "sim_compute_sim_state": 0.03931964874267578, "sim_compute_performance-ego": 0.06293505668640137, "sim_compute_robot_state-ego": 0.06548097610473633}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15934787556461705, "sim_physics": 0.018025588989257813, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08976185211999566, "sim_render-ego": 0.06239225387573242, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1785712146759033, "deviation-heading": 0.5855290698037388, "set_robot_commands": 0.08638611793518067, "deviation-center-line": 0.035272285221624074, "driven_lanedir_consec": 0.08976185211999566, "sim_compute_sim_state": 0.03947349548339844, "sim_compute_performance-ego": 0.06002949714660644, "sim_compute_robot_state-ego": 0.06433093070983886}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1523936251488016, "sim_physics": 0.016383032004038494, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08465143529578123, "sim_render-ego": 0.062706192334493, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.23127726713816324, "deviation-heading": 0.6253521523342918, "set_robot_commands": 0.07807813088099162, "deviation-center-line": 0.03888118410995975, "driven_lanedir_consec": 0.08465143529578123, "sim_compute_sim_state": 0.03953268130620321, "sim_compute_performance-ego": 0.06084568301836649, "sim_compute_robot_state-ego": 0.060518225034077965}}set_robot_commands_max 0.08638611793518067 set_robot_commands_mean 0.08036227539869455 set_robot_commands_median 0.07807813088099162 set_robot_commands_min 0.07454150456648606 sim_compute_performance-ego_max 0.06293505668640137 sim_compute_performance-ego_mean 0.06134285264137464 sim_compute_performance-ego_median 0.06084568301836649 sim_compute_performance-ego_min 0.06002949714660644 sim_compute_robot_state-ego_max 0.06548097610473633 sim_compute_robot_state-ego_mean 0.06284694002224847 sim_compute_robot_state-ego_median 0.06232095758120219 sim_compute_robot_state-ego_min 0.060518225034077965 sim_compute_sim_state_max 0.03953268130620321 sim_compute_sim_state_mean 0.03881582752252237 sim_compute_sim_state_median 0.03947197397549947 sim_compute_sim_state_min 0.03628133810483492 sim_physics_max 0.018025588989257813 sim_physics_mean 0.016474276524323685 sim_physics_median 0.01655186653137207 sim_physics_min 0.014740677980276257 sim_render-ego_max 0.062706192334493 sim_render-ego_mean 0.060711489659089304 sim_render-ego_median 0.0613005260626475 sim_render-ego_min 0.057770462036132814 simulation-passed 1 survival_time_max 1.3000000000000005 survival_time_mean 1.2400000000000004 survival_time_min 1.2000000000000004
No reset possible 188792410jiang peng Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 14:47:00+00:00 2019-04-20 15:07:59+00:00 0:20:59 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188742416Andrea Censi random_agent aido2-LF-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 14:40:52+00:00 2019-04-20 14:46:36+00:00 0:05:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.134404663769704 agent_compute-ego_mean 0.13081358748160063 agent_compute-ego_median 0.1291279897970312 agent_compute-ego_min 0.1284689055548774 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.017425168235346955, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.07179398806589954, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.134404663769704, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07825554991668125, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04312908424521392, "sim_compute_performance-ego": 0.06926826710970897, "sim_compute_robot_state-ego": 0.06873390359698602}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.0163768855008212, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0700003829869357, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13310318101536145, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07848878882148048, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.044163947755640205, "sim_compute_performance-ego": 0.06750541925430298, "sim_compute_robot_state-ego": 0.06654968044974587}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015683248307969834, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.07263307571411133, "in-drivable-lane": 0, "agent_compute-ego": 0.1284689055548774, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07832558419969347, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03934385511610243, "sim_compute_performance-ego": 0.06773233413696289, "sim_compute_robot_state-ego": 0.06485522588094075}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016775866349538166, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06491083403428395, "in-drivable-lane": 0, "agent_compute-ego": 0.12896319727102917, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07998191316922505, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.040770878394444786, "sim_compute_performance-ego": 0.06586120525995891, "sim_compute_robot_state-ego": 0.06564682225386302}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.016904028022990507, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06443806606180527, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1291279897970312, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07821820062749527, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04012048595091876, "sim_compute_performance-ego": 0.06412022254046272, "sim_compute_robot_state-ego": 0.06341313965180341}}set_robot_commands_max 0.07998191316922505 set_robot_commands_mean 0.0786540073469151 set_robot_commands_median 0.07832558419969347 set_robot_commands_min 0.07821820062749527 sim_compute_performance-ego_max 0.06926826710970897 sim_compute_performance-ego_mean 0.0668974896602793 sim_compute_performance-ego_median 0.06750541925430298 sim_compute_performance-ego_min 0.06412022254046272 sim_compute_robot_state-ego_max 0.06873390359698602 sim_compute_robot_state-ego_mean 0.06583975436666781 sim_compute_robot_state-ego_median 0.06564682225386302 sim_compute_robot_state-ego_min 0.06341313965180341 sim_compute_sim_state_max 0.044163947755640205 sim_compute_sim_state_mean 0.04150565029246402 sim_compute_sim_state_median 0.040770878394444786 sim_compute_sim_state_min 0.03934385511610243 sim_physics_max 0.017425168235346955 sim_physics_mean 0.016633039283333335 sim_physics_median 0.016775866349538166 sim_physics_min 0.015683248307969834 sim_render-ego_max 0.07263307571411133 sim_render-ego_mean 0.06875526937260716 sim_render-ego_median 0.0700003829869357 sim_render-ego_min 0.06443806606180527 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 188502448Nicky Eichmann Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 14:19:34+00:00 2019-04-20 14:40:36+00:00 0:21:02 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188472452Liam Paull Baseline solution using ROS aido2-LF-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 14:17:26+00:00 2019-04-20 14:19:15+00:00 0:01:49 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188442455Liam Paull challenge-aido_LF-template-ros aido2-LF-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 14:16:16+00:00 2019-04-20 14:16:54+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188412459Liam Paull challenge-aido_LF-template-ros aido2-LFV-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 14:15:18+00:00 2019-04-20 14:15:56+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188392464Liam Paull challenge-aido_LF-template-ros aido2-LFVI-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 14:14:13+00:00 2019-04-20 14:14:55+00:00 0:00:42 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188212492Liam Paull challenge-aido_LF-template-pytorch aido2-LF-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-20 14:05:47+00:00 2019-04-20 14:14:06+00:00 0:08:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.05674875043167704 survival_time_median 1.7000000000000008 deviation-center-line_median 0.026455787624629447 in-drivable-lane_median 0.6500000000000006
other stats agent_compute-ego_max 0.2754393645695278 agent_compute-ego_mean 0.2513499975953985 agent_compute-ego_median 0.25289423325482535 agent_compute-ego_min 0.21023905978483312 deviation-center-line_max 0.07099660502631157 deviation-center-line_mean 0.033967818331625516 deviation-center-line_min 0.01980513129952013 deviation-heading_max 2.5869778675133785 deviation-heading_mean 1.0005414191189614 deviation-heading_median 0.6209572822597166 deviation-heading_min 0.568663691824102 driven_any_max 0.6692195462816537 driven_any_mean 0.25124767759340527 driven_any_median 0.14424070914654386 driven_any_min 0.1413818755575762 driven_lanedir_consec_max 0.20573609944507032 driven_lanedir_consec_mean 0.08334287395198495 driven_lanedir_consec_min 0.04077496668792513 driven_lanedir_max 0.20573609944507032 driven_lanedir_mean 0.08334287395198495 driven_lanedir_median 0.05674875043167704 driven_lanedir_min 0.04077496668792513 in-drivable-lane_max 3.3499999999999925 in-drivable-lane_mean 1.189999999999999 in-drivable-lane_min 0.6000000000000005 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6692195462816537, "sim_physics": 0.01759447811318816, "survival_time": 6.949999999999983, "driven_lanedir": 0.20573609944507032, "sim_render-ego": 0.06299942517452103, "in-drivable-lane": 3.3499999999999925, "agent_compute-ego": 0.2433513857477861, "deviation-heading": 2.5869778675133785, "set_robot_commands": 0.07997862383616057, "deviation-center-line": 0.07099660502631157, "driven_lanedir_consec": 0.20573609944507032, "sim_compute_sim_state": 0.038987344975094144, "sim_compute_performance-ego": 0.06224753873811351, "sim_compute_robot_state-ego": 0.06230504392719955}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1413818755575762, "sim_physics": 0.01820173944745745, "survival_time": 1.7500000000000009, "driven_lanedir": 0.05394245520969321, "sim_render-ego": 0.06067032132829939, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.2754393645695278, "deviation-heading": 0.6540781261359405, "set_robot_commands": 0.08035968371800013, "deviation-center-line": 0.028832276348822763, "driven_lanedir_consec": 0.05394245520969321, "sim_compute_sim_state": 0.04087446757725307, "sim_compute_performance-ego": 0.06372062819344657, "sim_compute_robot_state-ego": 0.06611629894801549}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14424070914654386, "sim_physics": 0.0155945104711196, "survival_time": 1.7000000000000008, "driven_lanedir": 0.04077496668792513, "sim_render-ego": 0.05623350423925063, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.25289423325482535, "deviation-heading": 0.5720301278616686, "set_robot_commands": 0.07947536075816435, "deviation-center-line": 0.01980513129952013, "driven_lanedir_consec": 0.04077496668792513, "sim_compute_sim_state": 0.0400461238973281, "sim_compute_performance-ego": 0.05994163541232839, "sim_compute_robot_state-ego": 0.060676231103784894}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1430178820412725, "sim_physics": 0.016067827449125403, "survival_time": 1.7000000000000008, "driven_lanedir": 0.05674875043167704, "sim_render-ego": 0.06368434429168701, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.21023905978483312, "deviation-heading": 0.568663691824102, "set_robot_commands": 0.07914962488062241, "deviation-center-line": 0.023749291358843665, "driven_lanedir_consec": 0.05674875043167704, "sim_compute_sim_state": 0.040861922151902146, "sim_compute_performance-ego": 0.0661554546917186, "sim_compute_robot_state-ego": 0.06219178788802203}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15837837493998025, "sim_physics": 0.018623969134162453, "survival_time": 1.7000000000000008, "driven_lanedir": 0.05951209798555901, "sim_render-ego": 0.06611345796024098, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.27482594462002025, "deviation-heading": 0.6209572822597166, "set_robot_commands": 0.07826558281393613, "deviation-center-line": 0.026455787624629447, "driven_lanedir_consec": 0.05951209798555901, "sim_compute_sim_state": 0.040479393566355985, "sim_compute_performance-ego": 0.06446231813991771, "sim_compute_robot_state-ego": 0.06643856974209056}}set_robot_commands_max 0.08035968371800013 set_robot_commands_mean 0.07944577520137672 set_robot_commands_median 0.07947536075816435 set_robot_commands_min 0.07826558281393613 sim_compute_performance-ego_max 0.0661554546917186 sim_compute_performance-ego_mean 0.06330551503510495 sim_compute_performance-ego_median 0.06372062819344657 sim_compute_performance-ego_min 0.05994163541232839 sim_compute_robot_state-ego_max 0.06643856974209056 sim_compute_robot_state-ego_mean 0.0635455863218225 sim_compute_robot_state-ego_median 0.06230504392719955 sim_compute_robot_state-ego_min 0.060676231103784894 sim_compute_sim_state_max 0.04087446757725307 sim_compute_sim_state_mean 0.04024985043358669 sim_compute_sim_state_median 0.040479393566355985 sim_compute_sim_state_min 0.038987344975094144 sim_physics_max 0.018623969134162453 sim_physics_mean 0.017216504923010613 sim_physics_median 0.01759447811318816 sim_physics_min 0.0155945104711196 sim_render-ego_max 0.06611345796024098 sim_render-ego_mean 0.06194021059879982 sim_render-ego_median 0.06299942517452103 sim_render-ego_min 0.05623350423925063 simulation-passed 1 survival_time_max 6.949999999999983 survival_time_mean 2.7599999999999976 survival_time_min 1.7000000000000008
No reset possible 188152503Rami Al-Naim challenge-aido_LF-template-ros aido2-LF-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 14:04:44+00:00 2019-04-20 14:05:22+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188132507Rami Al-Naim challenge-aido_LF-template-ros aido2-LFVI-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 14:03:46+00:00 2019-04-20 14:04:39+00:00 0:00:53 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188062513Rami Al-Naim challenge-aido_LF-template-ros aido2-LFVI-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 14:02:47+00:00 2019-04-20 14:03:27+00:00 0:00:40 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 187762557Liam Paull challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 13:40:34+00:00 2019-04-20 14:02:33+00:00 0:21:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0 survival_time_median 14.950000000000076 deviation-center-line_median 4.685394139947218e-07 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06664247989654541 agent_compute-ego_mean 0.06463561423619588 agent_compute-ego_median 0.06402963797251383 agent_compute-ego_min 0.06329180399576823 deviation-center-line_max 4.373034425912704e-06 deviation-center-line_mean 1.170062906085128e-06 deviation-center-line_min 7.1661859209205e-08 deviation-heading_max 3.6616941510564305e-15 deviation-heading_mean 1.0060405349314265e-15 deviation-heading_median 3.4212715087255833e-16 deviation-heading_min 3.421270709830252e-16 driven_any_max 0 driven_any_mean 0 driven_any_median 0 driven_any_min 0 driven_lanedir_consec_max 0 driven_lanedir_consec_mean 0 driven_lanedir_consec_min 0 driven_lanedir_max 0 driven_lanedir_mean 0 driven_lanedir_median 0 driven_lanedir_min 0 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0, "sim_physics": 0.015965428352355957, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06379484017690022, "in-drivable-lane": 0, "agent_compute-ego": 0.06402963797251383, "deviation-heading": 3.4212715087255833e-16, "set_robot_commands": 0.07598142623901367, "deviation-center-line": 4.685394173142864e-07, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03980598449707031, "sim_compute_performance-ego": 0.064196564356486, "sim_compute_robot_state-ego": 0.063504003683726}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0, "sim_physics": 0.016067740122477213, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06561256885528564, "in-drivable-lane": 0, "agent_compute-ego": 0.0654578177134196, "deviation-heading": 3.6616941510564305e-15, "set_robot_commands": 0.0765695317586263, "deviation-center-line": 4.373034425912704e-06, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.04144604921340942, "sim_compute_performance-ego": 0.06634923537572225, "sim_compute_robot_state-ego": 0.06534116347630818}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0, "sim_physics": 0.016052146752675373, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06662447214126586, "in-drivable-lane": 0, "agent_compute-ego": 0.06664247989654541, "deviation-heading": 3.421270709830252e-16, "set_robot_commands": 0.07569859425226848, "deviation-center-line": 7.1661859209205e-08, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.04087388515472412, "sim_compute_performance-ego": 0.06673716783523559, "sim_compute_robot_state-ego": 0.06564670960108439}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0, "sim_physics": 0.01612028439839681, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06285419702529907, "in-drivable-lane": 0, "agent_compute-ego": 0.06329180399576823, "deviation-heading": 3.4212715087255833e-16, "set_robot_commands": 0.07616388082504272, "deviation-center-line": 4.685394139947218e-07, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03923948923746745, "sim_compute_performance-ego": 0.0633953579266866, "sim_compute_robot_state-ego": 0.06279026985168457}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0, "sim_physics": 0.015916104316711425, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06255359490712484, "in-drivable-lane": 0, "agent_compute-ego": 0.06375633160273234, "deviation-heading": 3.4212715087255833e-16, "set_robot_commands": 0.07461695750554402, "deviation-center-line": 4.685394139947218e-07, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03858431657155355, "sim_compute_performance-ego": 0.06167805274327596, "sim_compute_robot_state-ego": 0.06227050304412842}}set_robot_commands_max 0.0765695317586263 set_robot_commands_mean 0.07580607811609905 set_robot_commands_median 0.07598142623901367 set_robot_commands_min 0.07461695750554402 sim_compute_performance-ego_max 0.06673716783523559 sim_compute_performance-ego_mean 0.06447127564748129 sim_compute_performance-ego_median 0.064196564356486 sim_compute_performance-ego_min 0.06167805274327596 sim_compute_robot_state-ego_max 0.06564670960108439 sim_compute_robot_state-ego_mean 0.06391052993138631 sim_compute_robot_state-ego_median 0.063504003683726 sim_compute_robot_state-ego_min 0.06227050304412842 sim_compute_sim_state_max 0.04144604921340942 sim_compute_sim_state_mean 0.039989944934844965 sim_compute_sim_state_median 0.03980598449707031 sim_compute_sim_state_min 0.03858431657155355 sim_physics_max 0.01612028439839681 sim_physics_mean 0.016024340788523356 sim_physics_median 0.016052146752675373 sim_physics_min 0.015916104316711425 sim_render-ego_max 0.06662447214126586 sim_render-ego_mean 0.06428793462117513 sim_render-ego_median 0.06379484017690022 sim_render-ego_min 0.06255359490712484 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 187362601FANG MEIYI baseline-IL-logs-tensorflow aido2-LF-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-20 11:13:12+00:00 2019-04-20 11:30:51+00:00 0:17:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.338378061873262 survival_time_median 8.09999999999998 deviation-center-line_median 0.2023830697527104 in-drivable-lane_median 1.699999999999994
other stats agent_compute-ego_max 0.1609951404877651 agent_compute-ego_mean 0.1552444388250967 agent_compute-ego_median 0.15398674491066602 agent_compute-ego_min 0.14978480259577434 deviation-center-line_max 0.4581067893400542 deviation-center-line_mean 0.25973295665451407 deviation-center-line_min 0.12778620176576314 deviation-heading_max 1.220464837115952 deviation-heading_mean 1.0824151065920806 deviation-heading_median 1.0853498442089768 deviation-heading_min 0.9365006668893346 driven_any_max 3.234920446566248 driven_any_mean 2.0478383323109903 driven_any_median 1.6944900417488409 driven_any_min 1.0550177495144089 driven_lanedir_consec_max 3.223092897888648 driven_lanedir_consec_mean 1.6406046440108557 driven_lanedir_consec_min 0.7188015286550061 driven_lanedir_max 3.223092897888648 driven_lanedir_mean 1.6406046440108557 driven_lanedir_median 1.338378061873262 driven_lanedir_min 0.7188015286550061 in-drivable-lane_max 7.000000000000073 in-drivable-lane_mean 2.1300000000000123 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0550177495144089, "sim_physics": 0.01754410654051691, "survival_time": 5.849999999999987, "driven_lanedir": 0.7188015286550061, "sim_render-ego": 0.06459289942032252, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1507952559707511, "deviation-heading": 1.0853498442089768, "set_robot_commands": 0.07676690460270287, "deviation-center-line": 0.12778620176576314, "driven_lanedir_consec": 0.7188015286550061, "sim_compute_sim_state": 0.04223486704704089, "sim_compute_performance-ego": 0.06561042508508405, "sim_compute_robot_state-ego": 0.06560146299182859}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.234920446566248, "sim_physics": 0.015799462000528973, "survival_time": 14.950000000000076, "driven_lanedir": 3.223092897888648, "sim_render-ego": 0.06435269435246785, "in-drivable-lane": 0, "agent_compute-ego": 0.14978480259577434, "deviation-heading": 0.9365006668893346, "set_robot_commands": 0.07716540336608886, "deviation-center-line": 0.4581067893400542, "driven_lanedir_consec": 3.223092897888648, "sim_compute_sim_state": 0.04037518342336019, "sim_compute_performance-ego": 0.06397520303726197, "sim_compute_robot_state-ego": 0.06368247667948405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6944900417488409, "sim_physics": 0.01688788372015803, "survival_time": 7.94999999999998, "driven_lanedir": 1.624609132052001, "sim_render-ego": 0.06899321604074922, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.15398674491066602, "deviation-heading": 0.9715610524918687, "set_robot_commands": 0.07564775748822675, "deviation-center-line": 0.3309733498810805, "driven_lanedir_consec": 1.624609132052001, "sim_compute_sim_state": 0.04207553353699498, "sim_compute_performance-ego": 0.06850502026156059, "sim_compute_robot_state-ego": 0.06600739071204227}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6227337175167587, "sim_physics": 0.01726223357929075, "survival_time": 13.550000000000058, "driven_lanedir": 1.338378061873262, "sim_render-ego": 0.07368572083786405, "in-drivable-lane": 7.000000000000073, "agent_compute-ego": 0.16066025016052696, "deviation-heading": 1.220464837115952, "set_robot_commands": 0.07891757461857532, "deviation-center-line": 0.2023830697527104, "driven_lanedir_consec": 1.338378061873262, "sim_compute_sim_state": 0.044058549008246274, "sim_compute_performance-ego": 0.07315208991075355, "sim_compute_robot_state-ego": 0.07046338464941046}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6320297062086948, "sim_physics": 0.0167957897539492, "survival_time": 8.09999999999998, "driven_lanedir": 1.2981415995853605, "sim_render-ego": 0.07231884679676574, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.1609951404877651, "deviation-heading": 1.1981991322542715, "set_robot_commands": 0.07910104592641194, "deviation-center-line": 0.17941537253296214, "driven_lanedir_consec": 1.2981415995853605, "sim_compute_sim_state": 0.04440551922645098, "sim_compute_performance-ego": 0.07383000114817678, "sim_compute_robot_state-ego": 0.06809881145571485}}set_robot_commands_max 0.07910104592641194 set_robot_commands_mean 0.07751973720040115 set_robot_commands_median 0.07716540336608886 set_robot_commands_min 0.07564775748822675 sim_compute_performance-ego_max 0.07383000114817678 sim_compute_performance-ego_mean 0.0690145478885674 sim_compute_performance-ego_median 0.06850502026156059 sim_compute_performance-ego_min 0.06397520303726197 sim_compute_robot_state-ego_max 0.07046338464941046 sim_compute_robot_state-ego_mean 0.06677070529769605 sim_compute_robot_state-ego_median 0.06600739071204227 sim_compute_robot_state-ego_min 0.06368247667948405 sim_compute_sim_state_max 0.04440551922645098 sim_compute_sim_state_mean 0.04262993044841866 sim_compute_sim_state_median 0.04223486704704089 sim_compute_sim_state_min 0.04037518342336019 sim_physics_max 0.01754410654051691 sim_physics_mean 0.01685789511888877 sim_physics_median 0.01688788372015803 sim_physics_min 0.015799462000528973 sim_render-ego_max 0.07368572083786405 sim_render-ego_mean 0.06878867548963388 sim_render-ego_median 0.06899321604074922 sim_render-ego_min 0.06435269435246785 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.080000000000016 survival_time_min 5.849999999999987
No reset possible 187342605Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-20 11:07:01+00:00 2019-04-20 11:12:49+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06485612051827568 agent_compute-ego_mean 0.0628059021845976 agent_compute-ego_median 0.06304619186802914 agent_compute-ego_min 0.060370272778450175 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.016664583508561297, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.057607333834578354, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0641140588899938, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07567989535448028, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.037707930657921766, "sim_compute_performance-ego": 0.059181181395926125, "sim_compute_robot_state-ego": 0.059204052134257994}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.01595607170691857, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05789695336268498, "in-drivable-lane": 0, "agent_compute-ego": 0.06164286686823918, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07470819583305946, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.036279650834890514, "sim_compute_performance-ego": 0.06274699247800387, "sim_compute_robot_state-ego": 0.062186433718754694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01544943261653819, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.058790003999750665, "in-drivable-lane": 0, "agent_compute-ego": 0.060370272778450175, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07440131268602737, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.036769258215072306, "sim_compute_performance-ego": 0.060829355361613824, "sim_compute_robot_state-ego": 0.05945243226720932}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.019305656244466594, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.061426018620585346, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06485612051827568, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07660958269140222, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03860086661118727, "sim_compute_performance-ego": 0.060979251023177264, "sim_compute_robot_state-ego": 0.0616613901578463}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.016238425907335784, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06118773159227873, "in-drivable-lane": 0, "agent_compute-ego": 0.06304619186802914, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07271057681033485, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03857418110496119, "sim_compute_performance-ego": 0.06072420195529336, "sim_compute_robot_state-ego": 0.06216308945103696}}set_robot_commands_max 0.07660958269140222 set_robot_commands_mean 0.07482191267506084 set_robot_commands_median 0.07470819583305946 set_robot_commands_min 0.07271057681033485 sim_compute_performance-ego_max 0.06274699247800387 sim_compute_performance-ego_mean 0.060892196442802894 sim_compute_performance-ego_median 0.060829355361613824 sim_compute_performance-ego_min 0.059181181395926125 sim_compute_robot_state-ego_max 0.062186433718754694 sim_compute_robot_state-ego_mean 0.06093347954582105 sim_compute_robot_state-ego_median 0.0616613901578463 sim_compute_robot_state-ego_min 0.059204052134257994 sim_compute_sim_state_max 0.03860086661118727 sim_compute_sim_state_mean 0.03758637748480661 sim_compute_sim_state_median 0.037707930657921766 sim_compute_sim_state_min 0.036279650834890514 sim_physics_max 0.019305656244466594 sim_physics_mean 0.016722833996764087 sim_physics_median 0.016238425907335784 sim_physics_min 0.01544943261653819 sim_render-ego_max 0.061426018620585346 sim_render-ego_mean 0.05938160828197562 sim_render-ego_median 0.058790003999750665 sim_render-ego_min 0.057607333834578354 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 187222624Andrea Censi challenge-aido_LF-template-random aido2-LFVI-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 10:55:34+00:00 2019-04-20 11:06:55+00:00 0:11:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.15139574389303884 agent_compute-ego_mean 0.14378674517739448 agent_compute-ego_median 0.14304184152724894 agent_compute-ego_min 0.13968493891697303 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.029665443632337783, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.060806849646189855, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14069837615603492, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07627440255785746, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.034077773018488806, "sim_compute_performance-ego": 0.05949689471532428, "sim_compute_robot_state-ego": 0.061868236178443545, "sim_compute_robot_state-npc0": 0.07130944539630224, "sim_compute_robot_state-npc1": 0.0641302986750527, "sim_compute_robot_state-npc2": 0.06368447106982035, "sim_compute_robot_state-npc3": 0.06095111559307764}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.027357405307246188, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06130336780174106, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13968493891697303, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0769194200927136, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03452793757120768, "sim_compute_performance-ego": 0.06013297099693149, "sim_compute_robot_state-ego": 0.062490383783976235, "sim_compute_robot_state-npc0": 0.06758725409414254, "sim_compute_robot_state-npc1": 0.06222355599496879, "sim_compute_robot_state-npc2": 0.06105107419631061, "sim_compute_robot_state-npc3": 0.06299815458409927}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03200408720201062, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06647309180228941, "in-drivable-lane": 0, "agent_compute-ego": 0.15139574389303884, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07830972440781132, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03847347920940768, "sim_compute_performance-ego": 0.06448558453590639, "sim_compute_robot_state-ego": 0.06742336288575203, "sim_compute_robot_state-npc0": 0.07278853078042308, "sim_compute_robot_state-npc1": 0.06768040887771114, "sim_compute_robot_state-npc2": 0.06877450020082536, "sim_compute_robot_state-npc3": 0.0693231128877209}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.02969483365403845, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06358414507926778, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14304184152724894, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07504691215271646, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.035702598855850545, "sim_compute_performance-ego": 0.062496852367482286, "sim_compute_robot_state-ego": 0.06151913835647258, "sim_compute_robot_state-npc0": 0.06928540290670192, "sim_compute_robot_state-npc1": 0.0627718098620151, "sim_compute_robot_state-npc2": 0.06248931935492982, "sim_compute_robot_state-npc3": 0.06192644859882111}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02794025494502141, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06173570797993587, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14411282539367676, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08062182022975041, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.035062588178194486, "sim_compute_performance-ego": 0.06202520315463726, "sim_compute_robot_state-ego": 0.06391308857844426, "sim_compute_robot_state-npc0": 0.06829574474921593, "sim_compute_robot_state-npc1": 0.06419770534221943, "sim_compute_robot_state-npc2": 0.06301669891063984, "sim_compute_robot_state-npc3": 0.06208312969941359}}set_robot_commands_max 0.08062182022975041 set_robot_commands_mean 0.07743445588816986 set_robot_commands_median 0.0769194200927136 set_robot_commands_min 0.07504691215271646 sim_compute_performance-ego_max 0.06448558453590639 sim_compute_performance-ego_mean 0.06172750115405634 sim_compute_performance-ego_median 0.06202520315463726 sim_compute_performance-ego_min 0.05949689471532428 sim_compute_robot_state-ego_max 0.06742336288575203 sim_compute_robot_state-ego_mean 0.06344284195661773 sim_compute_robot_state-ego_median 0.062490383783976235 sim_compute_robot_state-ego_min 0.06151913835647258 sim_compute_robot_state-npc0_max 0.07278853078042308 sim_compute_robot_state-npc0_mean 0.06985327558535714 sim_compute_robot_state-npc0_median 0.06928540290670192 sim_compute_robot_state-npc0_min 0.06758725409414254 sim_compute_robot_state-npc1_max 0.06768040887771114 sim_compute_robot_state-npc1_mean 0.06420075575039343 sim_compute_robot_state-npc1_median 0.0641302986750527 sim_compute_robot_state-npc1_min 0.06222355599496879 sim_compute_robot_state-npc2_max 0.06877450020082536 sim_compute_robot_state-npc2_mean 0.06380321274650519 sim_compute_robot_state-npc2_median 0.06301669891063984 sim_compute_robot_state-npc2_min 0.06105107419631061 sim_compute_robot_state-npc3_max 0.0693231128877209 sim_compute_robot_state-npc3_mean 0.0634563922726265 sim_compute_robot_state-npc3_median 0.06208312969941359 sim_compute_robot_state-npc3_min 0.06095111559307764 sim_compute_sim_state_max 0.03847347920940768 sim_compute_sim_state_mean 0.035568875366629844 sim_compute_sim_state_median 0.035062588178194486 sim_compute_sim_state_min 0.034077773018488806 sim_physics_max 0.03200408720201062 sim_physics_mean 0.029332404948130893 sim_physics_median 0.029665443632337783 sim_physics_min 0.027357405307246188 sim_render-ego_max 0.06647309180228941 sim_render-ego_mean 0.0627806324618848 sim_render-ego_median 0.06173570797993587 sim_render-ego_min 0.060806849646189855 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 187202628Andrea Censi challenge-aido_LF-template-random aido2-LF-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 10:49:22+00:00 2019-04-20 10:55:04+00:00 0:05:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.14575957802106748 agent_compute-ego_mean 0.13715058582125947 agent_compute-ego_median 0.13606212536493936 agent_compute-ego_min 0.13145788149400192 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01699318975772498, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06630036965856012, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14575957802106748, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07754105441975144, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04117999436720362, "sim_compute_performance-ego": 0.06314168786102871, "sim_compute_robot_state-ego": 0.06339364681603774}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016158851710232822, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06065827066248113, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13145788149400192, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0739386731928045, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03998210213401101, "sim_compute_performance-ego": 0.06142724644054066, "sim_compute_robot_state-ego": 0.06439758430827748}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01606506241692437, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06191115379333496, "in-drivable-lane": 0, "agent_compute-ego": 0.13789084222581652, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07706717385186089, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03908143043518066, "sim_compute_performance-ego": 0.06308122211032444, "sim_compute_robot_state-ego": 0.06425428920321995}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016509989897410076, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06427513559659322, "in-drivable-lane": 0, "agent_compute-ego": 0.13606212536493936, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07575797537962596, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03889647126197815, "sim_compute_performance-ego": 0.06262387832005818, "sim_compute_robot_state-ego": 0.06318128605683644}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.017120603252859676, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.061345952398636765, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13458250200047212, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07516345907660092, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03928628739188699, "sim_compute_performance-ego": 0.06325600077124204, "sim_compute_robot_state-ego": 0.06156066936605117}}set_robot_commands_max 0.07754105441975144 set_robot_commands_mean 0.07589366718412875 set_robot_commands_median 0.07575797537962596 set_robot_commands_min 0.0739386731928045 sim_compute_performance-ego_max 0.06325600077124204 sim_compute_performance-ego_mean 0.06270600710063881 sim_compute_performance-ego_median 0.06308122211032444 sim_compute_performance-ego_min 0.06142724644054066 sim_compute_robot_state-ego_max 0.06439758430827748 sim_compute_robot_state-ego_mean 0.06335749515008456 sim_compute_robot_state-ego_median 0.06339364681603774 sim_compute_robot_state-ego_min 0.06156066936605117 sim_compute_sim_state_max 0.04117999436720362 sim_compute_sim_state_mean 0.03968525711805208 sim_compute_sim_state_median 0.03928628739188699 sim_compute_sim_state_min 0.03889647126197815 sim_physics_max 0.017120603252859676 sim_physics_mean 0.016569539407030386 sim_physics_median 0.016509989897410076 sim_physics_min 0.01606506241692437 sim_render-ego_max 0.06630036965856012 sim_render-ego_mean 0.06289817642192123 sim_render-ego_median 0.06191115379333496 sim_render-ego_min 0.06065827066248113 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 187092644Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 10:38:58+00:00 2019-04-20 10:48:38+00:00 0:09:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487132829419987 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041400208354252 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06783080101013184 agent_compute-ego_mean 0.06455225469603669 agent_compute-ego_median 0.06493042377715415 agent_compute-ego_min 0.06075348352131091 deviation-center-line_max 0.1279102488429998 deviation-center-line_mean 0.10518151035257096 deviation-center-line_min 0.06917270915638028 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550057 deviation-heading_median 0.36368201628851926 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903464 driven_any_median 0.6642785413159032 driven_any_min 0.3059207793076613 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.588039443394122 driven_lanedir_consec_min 0.28022225990343186 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.588039443394122 driven_lanedir_median 0.5487132829419987 driven_lanedir_min 0.28022225990343186 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02634800934210056, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0617821158432379, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06547628670203977, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07638238116008479, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.034460358503388196, "sim_compute_performance-ego": 0.0627168068071691, "sim_compute_robot_state-ego": 0.062257630069081374, "sim_compute_robot_state-npc0": 0.06869400129085634, "sim_compute_robot_state-npc1": 0.06450952553167576, "sim_compute_robot_state-npc2": 0.0630944938194461, "sim_compute_robot_state-npc3": 0.061704432092061855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.024858639790461615, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06302672166090745, "in-drivable-lane": 0, "agent_compute-ego": 0.06783080101013184, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.08110420520489033, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.035397043594947226, "sim_compute_performance-ego": 0.06205873305980976, "sim_compute_robot_state-ego": 0.06184227649982159, "sim_compute_robot_state-npc0": 0.0724181762108436, "sim_compute_robot_state-npc1": 0.0660022680576031, "sim_compute_robot_state-npc2": 0.06721262748424824, "sim_compute_robot_state-npc3": 0.06580745256864108}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.02904137651971046, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.0627688651389264, "in-drivable-lane": 0, "agent_compute-ego": 0.06493042377715415, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07783370829643087, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03623476941534813, "sim_compute_performance-ego": 0.06279918995309383, "sim_compute_robot_state-ego": 0.06460889349592493, "sim_compute_robot_state-npc0": 0.06768429025690606, "sim_compute_robot_state-npc1": 0.06465907299772222, "sim_compute_robot_state-npc2": 0.06398814789792324, "sim_compute_robot_state-npc3": 0.06212005209415517}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.028913081347287355, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.0650411857353462, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0637702784695468, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07470441126561427, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.036986319573370965, "sim_compute_performance-ego": 0.06420668402870933, "sim_compute_robot_state-ego": 0.06363130925775884, "sim_compute_robot_state-npc0": 0.07096401937715299, "sim_compute_robot_state-npc1": 0.06464851295555031, "sim_compute_robot_state-npc2": 0.06509233569050883, "sim_compute_robot_state-npc3": 0.06405708554026844}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.02302682399749756, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05787086486816406, "in-drivable-lane": 0, "agent_compute-ego": 0.06075348352131091, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07151001378109581, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03414731276662726, "sim_compute_performance-ego": 0.05447054536719071, "sim_compute_robot_state-ego": 0.059902297823052654, "sim_compute_robot_state-npc0": 0.06219359448081568, "sim_compute_robot_state-npc1": 0.06106849720603541, "sim_compute_robot_state-npc2": 0.06069682773790861, "sim_compute_robot_state-npc3": 0.05891949879495721}}set_robot_commands_max 0.08110420520489033 set_robot_commands_mean 0.07630694394162321 set_robot_commands_median 0.07638238116008479 set_robot_commands_min 0.07151001378109581 sim_compute_performance-ego_max 0.06420668402870933 sim_compute_performance-ego_mean 0.06125039184319454 sim_compute_performance-ego_median 0.0627168068071691 sim_compute_performance-ego_min 0.05447054536719071 sim_compute_robot_state-ego_max 0.06460889349592493 sim_compute_robot_state-ego_mean 0.06244848142912788 sim_compute_robot_state-ego_median 0.062257630069081374 sim_compute_robot_state-ego_min 0.059902297823052654 sim_compute_robot_state-npc0_max 0.0724181762108436 sim_compute_robot_state-npc0_mean 0.06839081632331492 sim_compute_robot_state-npc0_median 0.06869400129085634 sim_compute_robot_state-npc0_min 0.06219359448081568 sim_compute_robot_state-npc1_max 0.0660022680576031 sim_compute_robot_state-npc1_mean 0.06417757534971737 sim_compute_robot_state-npc1_median 0.06464851295555031 sim_compute_robot_state-npc1_min 0.06106849720603541 sim_compute_robot_state-npc2_max 0.06721262748424824 sim_compute_robot_state-npc2_mean 0.064016886526007 sim_compute_robot_state-npc2_median 0.06398814789792324 sim_compute_robot_state-npc2_min 0.06069682773790861 sim_compute_robot_state-npc3_max 0.06580745256864108 sim_compute_robot_state-npc3_mean 0.06252170421801675 sim_compute_robot_state-npc3_median 0.06212005209415517 sim_compute_robot_state-npc3_min 0.05891949879495721 sim_compute_sim_state_max 0.036986319573370965 sim_compute_sim_state_mean 0.03544516077073635 sim_compute_sim_state_median 0.035397043594947226 sim_compute_sim_state_min 0.03414731276662726 sim_physics_max 0.02904137651971046 sim_physics_mean 0.02643758619941151 sim_physics_median 0.02634800934210056 sim_physics_min 0.02302682399749756 sim_render-ego_max 0.0650411857353462 sim_render-ego_mean 0.062097950649316405 sim_render-ego_median 0.0627688651389264 sim_render-ego_min 0.05787086486816406 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 186982660Egor Zamotaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 10:17:13+00:00 2019-04-20 10:38:20+00:00 0:21:07 Waited 1201 seconds [...] Waited 1201 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186962664Rami Al-Naim Modidfied config aido2-LF-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 10:16:16+00:00 2019-04-20 10:16:55+00:00 0:00:39 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186952665Rami Al-Naim Modidfied config aido2-LF-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 10:15:20+00:00 2019-04-20 10:15:59+00:00 0:00:39 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186942668Rami Al-Naim Modidfied config aido2-LFV-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 10:14:28+00:00 2019-04-20 10:15:06+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186932669Rami Al-Naim Modidfied config aido2-LFV-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 10:13:30+00:00 2019-04-20 10:14:09+00:00 0:00:39 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186922672Rami Al-Naim Modidfied config aido2-LFVI-sim-testingstep1-simulation error no idsc-rudolf-114212019-04-20 10:12:32+00:00 2019-04-20 10:13:10+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186912673Rami Al-Naim Modidfied config aido2-LFVI-sim-validationstep1-simulation error no idsc-rudolf-114212019-04-20 10:11:38+00:00 2019-04-20 10:12:18+00:00 0:00:40 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186812691Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LF-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-20 09:55:25+00:00 2019-04-20 10:11:18+00:00 0:15:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.063459483437008 survival_time_median 14.950000000000076 deviation-center-line_median 0.5546961232718006 in-drivable-lane_median 3.0500000000000433
other stats agent_compute-ego_max 0.05768898884455363 agent_compute-ego_mean 0.05612108090549296 agent_compute-ego_median 0.05600449562072754 agent_compute-ego_min 0.05376416683197022 deviation-center-line_max 1.0057971690498306 deviation-center-line_mean 0.6106915193823553 deviation-center-line_min 0.3569483620189679 deviation-heading_max 3.5882806796434887 deviation-heading_mean 2.7241006643563055 deviation-heading_median 2.2301370186900384 deviation-heading_min 2.1344189277740853 driven_any_max 2.3555925757253044 driven_any_mean 1.898595728196133 driven_any_median 2.3447147763072675 driven_any_min 1.1261718404495134 driven_lanedir_consec_max 1.6820200455867167 driven_lanedir_consec_mean 1.1603861926523893 driven_lanedir_consec_min 0.9332503990703092 driven_lanedir_max 1.72367214694575 driven_lanedir_mean 1.2055280212482486 driven_lanedir_median 1.1173074406905732 driven_lanedir_min 0.9584177675463624 in-drivable-lane_max 8.150000000000075 in-drivable-lane_mean 3.6100000000000314 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3447147763072675, "sim_physics": 0.013433125813802084, "survival_time": 14.950000000000076, "driven_lanedir": 1.1173074406905732, "sim_render-ego": 0.04987819592158, "in-drivable-lane": 6.5000000000000355, "agent_compute-ego": 0.05600449562072754, "deviation-heading": 3.503666927781469, "set_robot_commands": 0.07060764074325561, "deviation-center-line": 0.5546961232718006, "driven_lanedir_consec": 0.9332503990703092, "sim_compute_sim_state": 0.03147685766220093, "sim_compute_performance-ego": 0.05191899061203003, "sim_compute_robot_state-ego": 0.05422620296478271}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3555490453845778, "sim_physics": 0.013401157855987549, "survival_time": 14.950000000000076, "driven_lanedir": 0.9584177675463624, "sim_render-ego": 0.050104944705963134, "in-drivable-lane": 8.150000000000075, "agent_compute-ego": 0.05768898884455363, "deviation-heading": 2.1639997678924447, "set_robot_commands": 0.06994713544845581, "deviation-center-line": 0.5248269965046815, "driven_lanedir_consec": 0.9584177675463624, "sim_compute_sim_state": 0.030966809590657552, "sim_compute_performance-ego": 0.051865456899007165, "sim_compute_robot_state-ego": 0.05282578945159912}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555925757253044, "sim_physics": 0.013836324214935304, "survival_time": 14.950000000000076, "driven_lanedir": 1.72367214694575, "sim_render-ego": 0.04904658953348796, "in-drivable-lane": 3.0500000000000433, "agent_compute-ego": 0.05376416683197022, "deviation-heading": 3.5882806796434887, "set_robot_commands": 0.06860833326975505, "deviation-center-line": 1.0057971690498306, "driven_lanedir_consec": 1.6820200455867167, "sim_compute_sim_state": 0.03041148424148559, "sim_compute_performance-ego": 0.05111051638921102, "sim_compute_robot_state-ego": 0.05285870472590128}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1261718404495134, "sim_physics": 0.014239943190796734, "survival_time": 7.299999999999982, "driven_lanedir": 1.063459483437008, "sim_render-ego": 0.05059237839424447, "in-drivable-lane": 0, "agent_compute-ego": 0.055487990379333496, "deviation-heading": 2.1344189277740853, "set_robot_commands": 0.07042423339739237, "deviation-center-line": 0.3569483620189679, "driven_lanedir_consec": 1.063459483437008, "sim_compute_sim_state": 0.03058748865780765, "sim_compute_performance-ego": 0.051074410138064866, "sim_compute_robot_state-ego": 0.05205233619637685}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.310950403114003, "sim_physics": 0.01479392220988076, "survival_time": 8.449999999999985, "driven_lanedir": 1.1647832676215495, "sim_render-ego": 0.05426444386589457, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.05765976285087992, "deviation-heading": 2.2301370186900384, "set_robot_commands": 0.07392551913063906, "deviation-center-line": 0.6111889460664963, "driven_lanedir_consec": 1.1647832676215495, "sim_compute_sim_state": 0.03334156860261274, "sim_compute_performance-ego": 0.05514679999041134, "sim_compute_robot_state-ego": 0.05632161670887964}}set_robot_commands_max 0.07392551913063906 set_robot_commands_mean 0.07070257239789958 set_robot_commands_median 0.07042423339739237 set_robot_commands_min 0.06860833326975505 sim_compute_performance-ego_max 0.05514679999041134 sim_compute_performance-ego_mean 0.05222323480574488 sim_compute_performance-ego_median 0.051865456899007165 sim_compute_performance-ego_min 0.051074410138064866 sim_compute_robot_state-ego_max 0.05632161670887964 sim_compute_robot_state-ego_mean 0.05365693000950792 sim_compute_robot_state-ego_median 0.05285870472590128 sim_compute_robot_state-ego_min 0.05205233619637685 sim_compute_sim_state_max 0.03334156860261274 sim_compute_sim_state_mean 0.031356841750952893 sim_compute_sim_state_median 0.030966809590657552 sim_compute_sim_state_min 0.03041148424148559 sim_physics_max 0.01479392220988076 sim_physics_mean 0.013940894657080488 sim_physics_median 0.013836324214935304 sim_physics_min 0.013401157855987549 sim_render-ego_max 0.05426444386589457 sim_render-ego_mean 0.05077731048423402 sim_render-ego_median 0.050104944705963134 sim_render-ego_min 0.04904658953348796 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.120000000000042 survival_time_min 7.299999999999982
No reset possible 186772711Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 09:38:01+00:00 2019-04-20 09:55:08+00:00 0:17:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7115022594494762 survival_time_median 4.94999999999999 deviation-center-line_median 0.2904671208180939 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06012824002434226 agent_compute-ego_mean 0.05812893468465576 agent_compute-ego_median 0.05740676530346072 agent_compute-ego_min 0.05693606407411637 deviation-center-line_max 1.092897696388849 deviation-center-line_mean 0.4560340522070376 deviation-center-line_min 0.06481374832327676 deviation-heading_max 2.6308437888457723 deviation-heading_mean 1.3891022347958648 deviation-heading_median 1.1596474268289618 deviation-heading_min 0.692478562447501 driven_any_max 1.7181431426801324 driven_any_mean 0.8942004042151741 driven_any_median 0.7484871461962076 driven_any_min 0.20204160518522649 driven_lanedir_consec_max 1.6839390671092695 driven_lanedir_consec_mean 0.791868749415908 driven_lanedir_consec_min 0.15650380892544025 driven_lanedir_max 1.6879262654718297 driven_lanedir_mean 0.7945847177342762 driven_lanedir_median 0.7184033573786222 driven_lanedir_min 0.15650380892544025 in-drivable-lane_max 1.500000000000021 in-drivable-lane_mean 0.30000000000000426 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.7181431426801324, "sim_physics": 0.025083468510554388, "survival_time": 11.050000000000022, "driven_lanedir": 1.6879262654718297, "sim_render-ego": 0.053340891367709475, "in-drivable-lane": 0, "agent_compute-ego": 0.05740676530346072, "deviation-heading": 1.7206345837245332, "set_robot_commands": 0.07241420724273268, "deviation-center-line": 1.092897696388849, "driven_lanedir_consec": 1.6839390671092695, "sim_compute_sim_state": 0.031300919088303236, "sim_compute_performance-ego": 0.05417314481950993, "sim_compute_robot_state-ego": 0.05632105779863591, "sim_compute_robot_state-npc0": 0.058094470209665426, "sim_compute_robot_state-npc1": 0.05597149085135481, "sim_compute_robot_state-npc2": 0.05572353337145499, "sim_compute_robot_state-npc3": 0.0554960324214055}, "udem1-1-0": {"driven_any": 0.20204160518522649, "sim_physics": 0.0248396550455401, "survival_time": 1.5500000000000007, "driven_lanedir": 0.15650380892544025, "sim_render-ego": 0.05115116796185894, "in-drivable-lane": 0, "agent_compute-ego": 0.05693606407411637, "deviation-heading": 0.692478562447501, "set_robot_commands": 0.07266006931181877, "deviation-center-line": 0.06481374832327676, "driven_lanedir_consec": 0.15650380892544025, "sim_compute_sim_state": 0.031192541122436523, "sim_compute_performance-ego": 0.05120658874511719, "sim_compute_robot_state-ego": 0.05329307433097593, "sim_compute_robot_state-npc0": 0.05405919013484832, "sim_compute_robot_state-npc1": 0.05285566083846554, "sim_compute_robot_state-npc2": 0.05429247886903824, "sim_compute_robot_state-npc3": 0.05224214830706196}, "udem1-2-0": {"driven_any": 0.7484871461962076, "sim_physics": 0.028986954929852725, "survival_time": 4.94999999999999, "driven_lanedir": 0.7184033573786222, "sim_render-ego": 0.05371881735445273, "in-drivable-lane": 0, "agent_compute-ego": 0.05725784494419291, "deviation-heading": 1.1596474268289618, "set_robot_commands": 0.07226897008491284, "deviation-center-line": 0.2904671208180939, "driven_lanedir_consec": 0.7115022594494762, "sim_compute_sim_state": 0.030523370010684236, "sim_compute_performance-ego": 0.05216883408902871, "sim_compute_robot_state-ego": 0.05417894594597094, "sim_compute_robot_state-npc0": 0.05604136351383093, "sim_compute_robot_state-npc1": 0.05342678349427502, "sim_compute_robot_state-npc2": 0.05308200614620941, "sim_compute_robot_state-npc3": 0.05383735955363572}, "udem1-3-0": {"driven_any": 0.2261462077332392, "sim_physics": 0.025711522382848403, "survival_time": 1.7000000000000008, "driven_lanedir": 0.17836372486003227, "sim_render-ego": 0.05342724042780259, "in-drivable-lane": 0, "agent_compute-ego": 0.06012824002434226, "deviation-heading": 0.741906812132556, "set_robot_commands": 0.07435119853300207, "deviation-center-line": 0.07746526153563935, "driven_lanedir_consec": 0.17836372486003227, "sim_compute_sim_state": 0.02998947395997889, "sim_compute_performance-ego": 0.05302142395692713, "sim_compute_robot_state-ego": 0.05449287330403047, "sim_compute_robot_state-npc0": 0.05848123045528636, "sim_compute_robot_state-npc1": 0.05547916889190674, "sim_compute_robot_state-npc2": 0.054264159763560575, "sim_compute_robot_state-npc3": 0.05342400775236242}, "udem1-4-0": {"driven_any": 1.5761839192810645, "sim_physics": 0.025039196014404297, "survival_time": 10.100000000000009, "driven_lanedir": 1.2317264320354564, "sim_render-ego": 0.05244646804167492, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.05891575907716657, "deviation-heading": 2.6308437888457723, "set_robot_commands": 0.0732472828119108, "deviation-center-line": 0.7545264339693296, "driven_lanedir_consec": 1.229034886735322, "sim_compute_sim_state": 0.02957264503630081, "sim_compute_performance-ego": 0.053175771590506675, "sim_compute_robot_state-ego": 0.05508141942543558, "sim_compute_robot_state-npc0": 0.05627885903462325, "sim_compute_robot_state-npc1": 0.05449107731923018, "sim_compute_robot_state-npc2": 0.05461552237520124, "sim_compute_robot_state-npc3": 0.05347899399181403}}set_robot_commands_max 0.07435119853300207 set_robot_commands_mean 0.07298834559687542 set_robot_commands_median 0.07266006931181877 set_robot_commands_min 0.07226897008491284 sim_compute_performance-ego_max 0.05417314481950993 sim_compute_performance-ego_mean 0.05274915264021792 sim_compute_performance-ego_median 0.05302142395692713 sim_compute_performance-ego_min 0.05120658874511719 sim_compute_robot_state-ego_max 0.05632105779863591 sim_compute_robot_state-ego_mean 0.05467347416100976 sim_compute_robot_state-ego_median 0.05449287330403047 sim_compute_robot_state-ego_min 0.05329307433097593 sim_compute_robot_state-npc0_max 0.05848123045528636 sim_compute_robot_state-npc0_mean 0.05659102266965086 sim_compute_robot_state-npc0_median 0.05627885903462325 sim_compute_robot_state-npc0_min 0.05405919013484832 sim_compute_robot_state-npc1_max 0.05597149085135481 sim_compute_robot_state-npc1_mean 0.05444483627904646 sim_compute_robot_state-npc1_median 0.05449107731923018 sim_compute_robot_state-npc1_min 0.05285566083846554 sim_compute_robot_state-npc2_max 0.05572353337145499 sim_compute_robot_state-npc2_mean 0.054395540105092885 sim_compute_robot_state-npc2_median 0.05429247886903824 sim_compute_robot_state-npc2_min 0.05308200614620941 sim_compute_robot_state-npc3_max 0.0554960324214055 sim_compute_robot_state-npc3_mean 0.05369570840525593 sim_compute_robot_state-npc3_median 0.05347899399181403 sim_compute_robot_state-npc3_min 0.05224214830706196 sim_compute_sim_state_max 0.031300919088303236 sim_compute_sim_state_mean 0.030515789843540746 sim_compute_sim_state_median 0.030523370010684236 sim_compute_sim_state_min 0.02957264503630081 sim_physics_max 0.028986954929852725 sim_physics_mean 0.025932159376639983 sim_physics_median 0.025083468510554388 sim_physics_min 0.0248396550455401 sim_render-ego_max 0.05371881735445273 sim_render-ego_mean 0.052816917030699725 sim_render-ego_median 0.053340891367709475 sim_render-ego_min 0.05115116796185894 simulation-passed 1 survival_time_max 11.050000000000022 survival_time_mean 5.870000000000004 survival_time_min 1.5500000000000007
No reset possible 186652725jiang peng test for ppo aido2-LF-sim-testingstep1-simulation host-error no idsc-rudolf-114212019-04-20 09:36:20+00:00 2019-04-20 09:37:36+00:00 0:01:16 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
containers = client.containers.list(filters=dict(status='running'))
File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
containers.append(self.get(r['Id']))
File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
resp = self.client.api.inspect_container(container_id)
File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
self._get(self._url("/containers/{0}/json", container)), True
File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/7b0b4e713d9bce6c432a98140622b9f323ce8f6985573e6ce4ee5fd9c178eb27/json
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 892, in write_logs
client = check_docker_environment()
File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/7b0b4e713d9bce6c432a98140622b9f323ce8f6985573e6ce4ee5fd9c178eb27/json
Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186542738Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation failed no idsc-rudolf-114212019-04-20 09:34:19+00:00 2019-04-20 09:35:59+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186512750Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation failed no idsc-rudolf-114212019-04-20 09:32:30+00:00 2019-04-20 09:34:08+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186402775Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validationstep1-simulation success no idsc-rudolf-114212019-04-20 09:13:29+00:00 2019-04-20 09:32:19+00:00 0:18:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8281217052660601 survival_time_median 8.09999999999998 deviation-center-line_median 0.7895809558318454 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.10139642442975726 agent_compute-ego_mean 0.08756163991954458 agent_compute-ego_median 0.08446505040298273 agent_compute-ego_min 0.07966655492782593 deviation-center-line_max 1.1956085856847891 deviation-center-line_mean 0.5989197521123326 deviation-center-line_min 0.08319304528184074 deviation-heading_max 1.735641402913565 deviation-heading_mean 1.0854664985811155 deviation-heading_median 1.0287937455317226 deviation-heading_min 0.6729103986607625 driven_any_max 1.8896608885697337 driven_any_mean 0.9955511491575753 driven_any_median 1.2524638129638972 driven_any_min 0.2341941059898409 driven_lanedir_consec_max 1.858975559200741 driven_lanedir_consec_mean 0.8728164455571432 driven_lanedir_consec_min 0.19959628927148376 driven_lanedir_max 1.858975559200741 driven_lanedir_mean 0.9677546478037165 driven_lanedir_median 1.2362349484256807 driven_lanedir_min 0.19959628927148376 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2524638129638972, "sim_physics": 0.02701644102732341, "survival_time": 8.09999999999998, "driven_lanedir": 1.2362349484256807, "sim_render-ego": 0.05581482251485189, "in-drivable-lane": 0, "agent_compute-ego": 0.08446505040298273, "deviation-heading": 1.0287937455317226, "set_robot_commands": 0.07443557992393587, "deviation-center-line": 0.7895809558318454, "driven_lanedir_consec": 0.8281217052660601, "sim_compute_sim_state": 0.03220623952371103, "sim_compute_performance-ego": 0.05532153594641038, "sim_compute_robot_state-ego": 0.0572275600315612, "sim_compute_robot_state-npc0": 0.06104318448054938, "sim_compute_robot_state-npc1": 0.057905369334750705, "sim_compute_robot_state-npc2": 0.057168657397046505, "sim_compute_robot_state-npc3": 0.05743423803353015}, "udem1-1-0": {"driven_any": 0.2341941059898409, "sim_physics": 0.02566026278904506, "survival_time": 1.7500000000000009, "driven_lanedir": 0.19959628927148376, "sim_render-ego": 0.05540447235107422, "in-drivable-lane": 0, "agent_compute-ego": 0.10139642442975726, "deviation-heading": 0.6729103986607625, "set_robot_commands": 0.07410234042576382, "deviation-center-line": 0.08319304528184074, "driven_lanedir_consec": 0.19959628927148376, "sim_compute_sim_state": 0.029896456854684013, "sim_compute_performance-ego": 0.05546275547572545, "sim_compute_robot_state-ego": 0.055400357927594866, "sim_compute_robot_state-npc0": 0.06079098156520298, "sim_compute_robot_state-npc1": 0.05764423779078892, "sim_compute_robot_state-npc2": 0.054651376179286414, "sim_compute_robot_state-npc3": 0.05430400030953544}, "udem1-2-0": {"driven_any": 1.335101368514538, "sim_physics": 0.02896251234897347, "survival_time": 8.599999999999987, "driven_lanedir": 1.312688125886472, "sim_render-ego": 0.051998058030771656, "in-drivable-lane": 0, "agent_compute-ego": 0.07966655492782593, "deviation-heading": 1.2758286869307396, "set_robot_commands": 0.07117216254389563, "deviation-center-line": 0.8242532847793302, "driven_lanedir_consec": 1.246110357813226, "sim_compute_sim_state": 0.030329705670822497, "sim_compute_performance-ego": 0.05279172991597375, "sim_compute_robot_state-ego": 0.05354493163352789, "sim_compute_robot_state-npc0": 0.05641023780024329, "sim_compute_robot_state-npc1": 0.054077244082162544, "sim_compute_robot_state-npc2": 0.05325714100238889, "sim_compute_robot_state-npc3": 0.05394484414610752}, "udem1-3-0": {"driven_any": 0.266335569749866, "sim_physics": 0.028336066466111403, "survival_time": 1.950000000000001, "driven_lanedir": 0.23127831623420536, "sim_render-ego": 0.052963599180563904, "in-drivable-lane": 0, "agent_compute-ego": 0.08943893970587315, "deviation-heading": 0.7141582588687876, "set_robot_commands": 0.06991274540240948, "deviation-center-line": 0.10196288898385746, "driven_lanedir_consec": 0.23127831623420536, "sim_compute_sim_state": 0.03148550253648024, "sim_compute_performance-ego": 0.05178759648249699, "sim_compute_robot_state-ego": 0.0554506411919227, "sim_compute_robot_state-npc0": 0.05724935653882149, "sim_compute_robot_state-npc1": 0.054810151075705506, "sim_compute_robot_state-npc2": 0.054730782142052285, "sim_compute_robot_state-npc3": 0.05282801848191481}, "udem1-4-0": {"driven_any": 1.8896608885697337, "sim_physics": 0.02686631333283864, "survival_time": 12.050000000000036, "driven_lanedir": 1.858975559200741, "sim_render-ego": 0.05460202941261386, "in-drivable-lane": 0, "agent_compute-ego": 0.08284123013128383, "deviation-heading": 1.735641402913565, "set_robot_commands": 0.07262437571133816, "deviation-center-line": 1.1956085856847891, "driven_lanedir_consec": 1.858975559200741, "sim_compute_sim_state": 0.030889311272079025, "sim_compute_performance-ego": 0.05491197653331203, "sim_compute_robot_state-ego": 0.05497924420843481, "sim_compute_robot_state-npc0": 0.060710119508608745, "sim_compute_robot_state-npc1": 0.05718543024973256, "sim_compute_robot_state-npc2": 0.05589407410364428, "sim_compute_robot_state-npc3": 0.05576028269850861}}set_robot_commands_max 0.07443557992393587 set_robot_commands_mean 0.0724494408014686 set_robot_commands_median 0.07262437571133816 set_robot_commands_min 0.06991274540240948 sim_compute_performance-ego_max 0.05546275547572545 sim_compute_performance-ego_mean 0.05405511887078372 sim_compute_performance-ego_median 0.05491197653331203 sim_compute_performance-ego_min 0.05178759648249699 sim_compute_robot_state-ego_max 0.0572275600315612 sim_compute_robot_state-ego_mean 0.05532054699860829 sim_compute_robot_state-ego_median 0.055400357927594866 sim_compute_robot_state-ego_min 0.05354493163352789 sim_compute_robot_state-npc0_max 0.06104318448054938 sim_compute_robot_state-npc0_mean 0.05924077597868518 sim_compute_robot_state-npc0_median 0.060710119508608745 sim_compute_robot_state-npc0_min 0.05641023780024329 sim_compute_robot_state-npc1_max 0.057905369334750705 sim_compute_robot_state-npc1_mean 0.056324486506628045 sim_compute_robot_state-npc1_median 0.05718543024973256 sim_compute_robot_state-npc1_min 0.054077244082162544 sim_compute_robot_state-npc2_max 0.057168657397046505 sim_compute_robot_state-npc2_mean 0.05514040616488367 sim_compute_robot_state-npc2_median 0.054730782142052285 sim_compute_robot_state-npc2_min 0.05325714100238889 sim_compute_robot_state-npc3_max 0.05743423803353015 sim_compute_robot_state-npc3_mean 0.054854276733919315 sim_compute_robot_state-npc3_median 0.05430400030953544 sim_compute_robot_state-npc3_min 0.05282801848191481 sim_compute_sim_state_max 0.03220623952371103 sim_compute_sim_state_mean 0.030961443171555365 sim_compute_sim_state_median 0.030889311272079025 sim_compute_sim_state_min 0.029896456854684013 sim_physics_max 0.02896251234897347 sim_physics_mean 0.0273683191928584 sim_physics_median 0.02701644102732341 sim_physics_min 0.02566026278904506 sim_render-ego_max 0.05581482251485189 sim_render-ego_mean 0.054156596297975104 sim_render-ego_median 0.05460202941261386 sim_render-ego_min 0.051998058030771656 simulation-passed 1 survival_time_max 12.050000000000036 survival_time_mean 6.49 survival_time_min 1.7500000000000009
No reset possible 186292795Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testingstep1-simulation failed no idsc-rudolf-114212019-04-20 09:11:40+00:00 2019-04-20 09:13:20+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186252800Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validationstep1-simulation failed no idsc-rudolf-114212019-04-20 09:09:38+00:00 2019-04-20 09:11:22+00:00 0:01:44 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 186092812Andrea Censi challenge-aido_LF-template-random - random_agent aido2-LFVI-sim-testingstep1-simulation success no idsc-rudolf-114212019-04-20 08:58:04+00:00 2019-04-20 09:09:25+00:00 0:11:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.15173054676429898 agent_compute-ego_mean 0.1506710642722052 agent_compute-ego_median 0.15161785166314307 agent_compute-ego_min 0.14910862937806144 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.031226597135029142, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06349259709555005, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14910862937806144, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07787350245884486, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.035542052889627126, "sim_compute_performance-ego": 0.06281139737083799, "sim_compute_robot_state-ego": 0.06339884939647857, "sim_compute_robot_state-npc0": 0.07063146243019709, "sim_compute_robot_state-npc1": 0.06598259532262409, "sim_compute_robot_state-npc2": 0.063253573008946, "sim_compute_robot_state-npc3": 0.0633232934134347}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.028668740216423485, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06601629070207185, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.15173054676429898, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0774081267562567, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.036460006938261146, "sim_compute_performance-ego": 0.06656791649612726, "sim_compute_robot_state-ego": 0.06705832948871687, "sim_compute_robot_state-npc0": 0.07158585623198864, "sim_compute_robot_state-npc1": 0.06615673326978497, "sim_compute_robot_state-npc2": 0.06522449792600145, "sim_compute_robot_state-npc3": 0.06642268685733571}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.031350881822647586, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06500362965368456, "in-drivable-lane": 0, "agent_compute-ego": 0.149202331419914, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07776426115343647, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03645002841949463, "sim_compute_performance-ego": 0.061543979952412266, "sim_compute_robot_state-ego": 0.06451492540297969, "sim_compute_robot_state-npc0": 0.07216451629515618, "sim_compute_robot_state-npc1": 0.06645745615805349, "sim_compute_robot_state-npc2": 0.063631699931237, "sim_compute_robot_state-npc3": 0.06530685194077031}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03145057343422098, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06667367448198035, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.15161785166314307, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.078204279250287, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03634081749205894, "sim_compute_performance-ego": 0.06422073029457255, "sim_compute_robot_state-ego": 0.06491909128554324, "sim_compute_robot_state-npc0": 0.07446959424526134, "sim_compute_robot_state-npc1": 0.06771300955021635, "sim_compute_robot_state-npc2": 0.0651415637198915, "sim_compute_robot_state-npc3": 0.06521631555354342}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027013077185704157, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06515183815589318, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15169596213560838, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07711929082870483, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03660277678416325, "sim_compute_performance-ego": 0.0669109454521766, "sim_compute_robot_state-ego": 0.06938902689860417, "sim_compute_robot_state-npc0": 0.0721766077555143, "sim_compute_robot_state-npc1": 0.06762047914358285, "sim_compute_robot_state-npc2": 0.06832622564755954, "sim_compute_robot_state-npc3": 0.06815527494137104}}set_robot_commands_max 0.078204279250287 set_robot_commands_mean 0.07767389208950598 set_robot_commands_median 0.07776426115343647 set_robot_commands_min 0.07711929082870483 sim_compute_performance-ego_max 0.0669109454521766 sim_compute_performance-ego_mean 0.06441099391322533 sim_compute_performance-ego_median 0.06422073029457255 sim_compute_performance-ego_min 0.061543979952412266 sim_compute_robot_state-ego_max 0.06938902689860417 sim_compute_robot_state-ego_mean 0.0658560444944645 sim_compute_robot_state-ego_median 0.06491909128554324 sim_compute_robot_state-ego_min 0.06339884939647857 sim_compute_robot_state-npc0_max 0.07446959424526134 sim_compute_robot_state-npc0_mean 0.07220560739162352 sim_compute_robot_state-npc0_median 0.07216451629515618 sim_compute_robot_state-npc0_min 0.07063146243019709 sim_compute_robot_state-npc1_max 0.06771300955021635 sim_compute_robot_state-npc1_mean 0.06678605468885235 sim_compute_robot_state-npc1_median 0.06645745615805349 sim_compute_robot_state-npc1_min 0.06598259532262409 sim_compute_robot_state-npc2_max 0.06832622564755954 sim_compute_robot_state-npc2_mean 0.0651155120467271 sim_compute_robot_state-npc2_median 0.0651415637198915 sim_compute_robot_state-npc2_min 0.063253573008946 sim_compute_robot_state-npc3_max 0.06815527494137104 sim_compute_robot_state-npc3_mean 0.06568488454129104 sim_compute_robot_state-npc3_median 0.06530685194077031 sim_compute_robot_state-npc3_min 0.0633232934134347 sim_compute_sim_state_max 0.03660277678416325 sim_compute_sim_state_mean 0.03627913650472102 sim_compute_sim_state_median 0.03645002841949463 sim_compute_sim_state_min 0.035542052889627126 sim_physics_max 0.03145057343422098 sim_physics_mean 0.029941973958805067 sim_physics_median 0.031226597135029142 sim_physics_min 0.027013077185704157 sim_render-ego_max 0.06667367448198035 sim_render-ego_mean 0.06526760601783599 sim_render-ego_median 0.06515183815589318 sim_render-ego_min 0.06349259709555005 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible
Andrea Censi 🇨🇭
