Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 196972994Manfred Diaz challenge-aido_LF-template-tensorflow aido2-LF-sim-testingstep1-simulation error no ip-172-31-25-98-97662019-04-24 20:18:23+00:00 2019-04-24 20:20:35+00:00 0:02:12 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 196752365Andrea Censi random_agent aido2-LFV-sim-validationstep1-simulation success no ip-172-31-25-98-97662019-04-24 16:38:12+00:00 2019-04-24 16:45:07+00:00 0:06:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.1409030556678772 agent_compute-ego_mean 0.12095669109439976 agent_compute-ego_median 0.11208895024131328 agent_compute-ego_min 0.10911055405934653 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.036587386761071546, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06091867302948574, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13098486414495503, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09533127748741294, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.0383466549639432, "sim_compute_performance-ego": 0.06300761114876226, "sim_compute_robot_state-ego": 0.06941843932529665, "sim_compute_robot_state-npc0": 0.06485728497775096, "sim_compute_robot_state-npc1": 0.06508576645041411, "sim_compute_robot_state-npc2": 0.06807365507449743, "sim_compute_robot_state-npc3": 0.06808778025069327}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.043324979868802155, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0644307244907726, "in-drivable-lane": 0, "agent_compute-ego": 0.1409030556678772, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.10722288218411533, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.040053974498401985, "sim_compute_performance-ego": 0.07077932899648492, "sim_compute_robot_state-ego": 0.07240422747351906, "sim_compute_robot_state-npc0": 0.07711786031723022, "sim_compute_robot_state-npc1": 0.08169967477971857, "sim_compute_robot_state-npc2": 0.07837368141521107, "sim_compute_robot_state-npc3": 0.0719988237727772}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03248378965589735, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.050854126612345375, "in-drivable-lane": 0, "agent_compute-ego": 0.11169603135850696, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07691026793585884, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.033091566297743055, "sim_compute_performance-ego": 0.054736026128133136, "sim_compute_robot_state-ego": 0.05756594340006511, "sim_compute_robot_state-npc0": 0.058348623911539714, "sim_compute_robot_state-npc1": 0.05914052857293023, "sim_compute_robot_state-npc2": 0.05973139868842231, "sim_compute_robot_state-npc3": 0.059478203455607094}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.030793105562527973, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.04694048563639323, "in-drivable-lane": 0, "agent_compute-ego": 0.10911055405934653, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07204784452915192, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03111124038696289, "sim_compute_performance-ego": 0.051723877588907875, "sim_compute_robot_state-ego": 0.05252909163633982, "sim_compute_robot_state-npc0": 0.054670910040537514, "sim_compute_robot_state-npc1": 0.053004552920659385, "sim_compute_robot_state-npc2": 0.05394059419631958, "sim_compute_robot_state-npc3": 0.05325572192668915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.029553721932803884, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.049562254372765034, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11208895024131328, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07478147745132446, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.030251531039967257, "sim_compute_performance-ego": 0.05384627861135146, "sim_compute_robot_state-ego": 0.05489490663304048, "sim_compute_robot_state-npc0": 0.05445975065231323, "sim_compute_robot_state-npc1": 0.05437176017200246, "sim_compute_robot_state-npc2": 0.052956616177278405, "sim_compute_robot_state-npc3": 0.05390495412489947}}set_robot_commands_max 0.10722288218411533 set_robot_commands_mean 0.0852587499175727 set_robot_commands_median 0.07691026793585884 set_robot_commands_min 0.07204784452915192 sim_compute_performance-ego_max 0.07077932899648492 sim_compute_performance-ego_mean 0.058818624494727925 sim_compute_performance-ego_median 0.054736026128133136 sim_compute_performance-ego_min 0.051723877588907875 sim_compute_robot_state-ego_max 0.07240422747351906 sim_compute_robot_state-ego_mean 0.06136252169365223 sim_compute_robot_state-ego_median 0.05756594340006511 sim_compute_robot_state-ego_min 0.05252909163633982 sim_compute_robot_state-npc0_max 0.07711786031723022 sim_compute_robot_state-npc0_mean 0.061890885979874334 sim_compute_robot_state-npc0_median 0.058348623911539714 sim_compute_robot_state-npc0_min 0.05445975065231323 sim_compute_robot_state-npc1_max 0.08169967477971857 sim_compute_robot_state-npc1_mean 0.06266045657914496 sim_compute_robot_state-npc1_median 0.05914052857293023 sim_compute_robot_state-npc1_min 0.053004552920659385 sim_compute_robot_state-npc2_max 0.07837368141521107 sim_compute_robot_state-npc2_mean 0.06261518911034576 sim_compute_robot_state-npc2_median 0.05973139868842231 sim_compute_robot_state-npc2_min 0.052956616177278405 sim_compute_robot_state-npc3_max 0.0719988237727772 sim_compute_robot_state-npc3_mean 0.06134509670613324 sim_compute_robot_state-npc3_median 0.059478203455607094 sim_compute_robot_state-npc3_min 0.05325572192668915 sim_compute_sim_state_max 0.040053974498401985 sim_compute_sim_state_mean 0.03457099343740368 sim_compute_sim_state_median 0.033091566297743055 sim_compute_sim_state_min 0.030251531039967257 sim_physics_max 0.043324979868802155 sim_physics_mean 0.03454859675622059 sim_physics_median 0.03248378965589735 sim_physics_min 0.029553721932803884 sim_render-ego_max 0.0644307244907726 sim_render-ego_mean 0.05454125282835239 sim_render-ego_median 0.050854126612345375 sim_render-ego_min 0.04694048563639323 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 196322410jiang peng Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation success no ip-172-31-25-98-97662019-04-24 16:03:18+00:00 2019-04-24 16:37:57+00:00 0:34:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.361452200425545 survival_time_median 14.950000000000076 deviation-center-line_median 1.011969887428033 in-drivable-lane_median 4.050000000000022
other stats agent_compute-ego_max 0.18969799677530924 agent_compute-ego_mean 0.17478085136413574 agent_compute-ego_median 0.17232945680618286 agent_compute-ego_min 0.1657857592900594 deviation-center-line_max 1.0119698874280334 deviation-center-line_mean 1.0119697532537184 deviation-center-line_min 1.0119693200897375 deviation-heading_max 6.81542792438532 deviation-heading_mean 6.81542792438532 deviation-heading_median 6.815427924385319 deviation-heading_min 6.815427924385319 driven_any_max 4.3908241527849325 driven_any_mean 4.390824152784925 driven_any_median 4.390824152784922 driven_any_min 4.390824152784921 driven_lanedir_consec_max -1.3614496374256428 driven_lanedir_consec_mean -1.3614540243276398 driven_lanedir_consec_min -1.3614583993086016 driven_lanedir_max -2.3158123434400073 driven_lanedir_mean -2.3158154428816067 driven_lanedir_median -2.315814608416598 driven_lanedir_min -2.3158179462767055 in-drivable-lane_max 4.050000000000022 in-drivable-lane_mean 4.050000000000022 in-drivable-lane_min 4.050000000000022 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.03919199784596761, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.06361299117406209, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.17547608852386476, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.10135854641596476, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.040284857749938965, "sim_compute_performance-ego": 0.07208918412526448, "sim_compute_robot_state-ego": 0.07401538213094075, "sim_compute_robot_state-npc0": 0.07185281435648601, "sim_compute_robot_state-npc1": 0.0710350743929545, "sim_compute_robot_state-npc2": 0.07112523158391316, "sim_compute_robot_state-npc3": 0.07088948647181192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.3908241527849325, "sim_physics": 0.037111202081044514, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158177078581264, "sim_render-ego": 0.06354399045308431, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.17061495542526245, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.098595445950826, "deviation-center-line": 1.0119697838947552, "driven_lanedir_consec": -1.3614576840528645, "sim_compute_sim_state": 0.03952281475067139, "sim_compute_performance-ego": 0.06886969327926636, "sim_compute_robot_state-ego": 0.07294840256373088, "sim_compute_robot_state-npc0": 0.07076127529144287, "sim_compute_robot_state-npc1": 0.07038481156031291, "sim_compute_robot_state-npc2": 0.07221241156260172, "sim_compute_robot_state-npc3": 0.07101951201756795}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784922, "sim_physics": 0.038045649528503415, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.0635878856976827, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.17232945680618286, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.09757927974065143, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.040360044638315835, "sim_compute_performance-ego": 0.06882397333780925, "sim_compute_robot_state-ego": 0.07387878179550171, "sim_compute_robot_state-npc0": 0.06916936079661051, "sim_compute_robot_state-npc1": 0.07004000027974447, "sim_compute_robot_state-npc2": 0.07051036278406779, "sim_compute_robot_state-npc3": 0.07116803407669067}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.03803332805633545, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.06178672631581624, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1657857592900594, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.09421712875366212, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03793735027313232, "sim_compute_performance-ego": 0.0674890907605489, "sim_compute_robot_state-ego": 0.0703265905380249, "sim_compute_robot_state-npc0": 0.06872533241907755, "sim_compute_robot_state-npc1": 0.06811847845713298, "sim_compute_robot_state-npc2": 0.0668119740486145, "sim_compute_robot_state-npc3": 0.06785612026850382}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784921, "sim_physics": 0.04259278853734334, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158123434400073, "sim_render-ego": 0.06830968459447224, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.18969799677530924, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.10648305972417196, "deviation-center-line": 1.0119693200897375, "driven_lanedir_consec": -1.3614496374256428, "sim_compute_sim_state": 0.04252401351928711, "sim_compute_performance-ego": 0.0748237919807434, "sim_compute_robot_state-ego": 0.08170776923497518, "sim_compute_robot_state-npc0": 0.0769030491511027, "sim_compute_robot_state-npc1": 0.07700449387232462, "sim_compute_robot_state-npc2": 0.07642977714538574, "sim_compute_robot_state-npc3": 0.07633352994918824}}set_robot_commands_max 0.10648305972417196 set_robot_commands_mean 0.09964669211705524 set_robot_commands_median 0.098595445950826 set_robot_commands_min 0.09421712875366212 sim_compute_performance-ego_max 0.0748237919807434 sim_compute_performance-ego_mean 0.07041914669672648 sim_compute_performance-ego_median 0.06886969327926636 sim_compute_performance-ego_min 0.0674890907605489 sim_compute_robot_state-ego_max 0.08170776923497518 sim_compute_robot_state-ego_mean 0.07457538525263468 sim_compute_robot_state-ego_median 0.07387878179550171 sim_compute_robot_state-ego_min 0.0703265905380249 sim_compute_robot_state-npc0_max 0.0769030491511027 sim_compute_robot_state-npc0_mean 0.07148236640294392 sim_compute_robot_state-npc0_median 0.07076127529144287 sim_compute_robot_state-npc0_min 0.06872533241907755 sim_compute_robot_state-npc1_max 0.07700449387232462 sim_compute_robot_state-npc1_mean 0.07131657171249389 sim_compute_robot_state-npc1_median 0.07038481156031291 sim_compute_robot_state-npc1_min 0.06811847845713298 sim_compute_robot_state-npc2_max 0.07642977714538574 sim_compute_robot_state-npc2_mean 0.07141795142491658 sim_compute_robot_state-npc2_median 0.07112523158391316 sim_compute_robot_state-npc2_min 0.0668119740486145 sim_compute_robot_state-npc3_max 0.07633352994918824 sim_compute_robot_state-npc3_mean 0.07145333655675253 sim_compute_robot_state-npc3_median 0.07101951201756795 sim_compute_robot_state-npc3_min 0.06785612026850382 sim_compute_sim_state_max 0.04252401351928711 sim_compute_sim_state_mean 0.04012581618626913 sim_compute_sim_state_median 0.040284857749938965 sim_compute_sim_state_min 0.03793735027313232 sim_physics_max 0.04259278853734334 sim_physics_mean 0.03899499320983887 sim_physics_median 0.038045649528503415 sim_physics_min 0.037111202081044514 sim_render-ego_max 0.06830968459447224 sim_render-ego_mean 0.06416825564702351 sim_render-ego_median 0.0635878856976827 sim_render-ego_min 0.06178672631581624 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 196232449Nicky Eichmann Baseline solution using reinforcement learning aido2-LFV-sim-validationstep1-simulation error no ip-172-31-25-98-97662019-04-24 16:00:24+00:00 2019-04-24 16:02:02+00:00 0:01:38 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 88, in main
sim_ci.write_topic_and_expect_zero('seed', config.seed)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
wait_for_data(f, timeout, waiting_for)
File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 88, in main
> sim_ci.write_topic_and_expect_zero('seed', config.seed)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
> wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
> File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
> wait_for_data(f, timeout, waiting_for)
> File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
> raise TimeoutError(msg)
> TimeoutError: Timeout after 30.0 s.
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 195932448Nicky Eichmann Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-25-98-97662019-04-24 15:51:20+00:00 2019-04-24 16:00:06+00:00 0:08:46 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19593-500738', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19593-500738', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19593-500738', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 195752491Liam Paull challenge-aido_LF-template-pytorch aido2-LF-sim-testingstep1-simulation success no ip-172-31-25-98-97662019-04-24 15:46:40+00:00 2019-04-24 15:50:51+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.05895029027380527 survival_time_median 1.4500000000000006 deviation-center-line_median 0.020601093965642855 in-drivable-lane_median 0.5000000000000003
other stats agent_compute-ego_max 0.23452198094335097 agent_compute-ego_mean 0.1418656263022587 agent_compute-ego_median 0.13196847356598954 agent_compute-ego_min 0.10176491737365724 deviation-center-line_max 0.034706324904630374 deviation-center-line_mean 0.02340965278447534 deviation-center-line_min 0.020051862299800258 deviation-heading_max 0.6403207127056927 deviation-heading_mean 0.5341603961625121 deviation-heading_median 0.5306664431620078 deviation-heading_min 0.4609641897417714 driven_any_max 0.1606315010517443 driven_any_mean 0.15114996536270786 driven_any_median 0.1480055153591565 driven_any_min 0.14213049955231352 driven_lanedir_consec_max 0.06994967612986436 driven_lanedir_consec_mean 0.05801104661078353 driven_lanedir_consec_min 0.04768234282134509 driven_lanedir_max 0.06994967612986436 driven_lanedir_mean 0.05801104661078353 driven_lanedir_median 0.05895029027380527 driven_lanedir_min 0.04768234282134509 in-drivable-lane_max 0.5500000000000004 in-drivable-lane_mean 0.4600000000000003 in-drivable-lane_min 0.20000000000000015 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1480055153591565, "sim_physics": 0.015197094281514483, "survival_time": 1.5000000000000009, "driven_lanedir": 0.051128531815617606, "sim_render-ego": 0.037347086270650226, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.10435824394226074, "deviation-heading": 0.5306664431620078, "set_robot_commands": 0.05682387351989746, "deviation-center-line": 0.021152030998879613, "driven_lanedir_consec": 0.051128531815617606, "sim_compute_sim_state": 0.023893507321675615, "sim_compute_performance-ego": 0.041578054428100586, "sim_compute_robot_state-ego": 0.04250649611155192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16044158226804228, "sim_physics": 0.01380455493927002, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06994967612986436, "sim_render-ego": 0.048220380147298174, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.10176491737365724, "deviation-heading": 0.4609641897417714, "set_robot_commands": 0.05836061636606852, "deviation-center-line": 0.020601093965642855, "driven_lanedir_consec": 0.06994967612986436, "sim_compute_sim_state": 0.02459425926208496, "sim_compute_performance-ego": 0.04026868343353272, "sim_compute_robot_state-ego": 0.042571306228637695}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1606315010517443, "sim_physics": 0.02733272519604913, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05895029027380527, "sim_render-ego": 0.075020222828306, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.23452198094335097, "deviation-heading": 0.4961985252091066, "set_robot_commands": 0.11808529393426304, "deviation-center-line": 0.020051862299800258, "driven_lanedir_consec": 0.05895029027380527, "sim_compute_sim_state": 0.04583852044467268, "sim_compute_performance-ego": 0.07873667519668053, "sim_compute_robot_state-ego": 0.10030921574296622}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14454072858228267, "sim_physics": 0.02005254811254041, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04768234282134509, "sim_render-ego": 0.05081625642447636, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.13196847356598954, "deviation-heading": 0.5426521099939822, "set_robot_commands": 0.07739132026146198, "deviation-center-line": 0.020536951753423575, "driven_lanedir_consec": 0.04768234282134509, "sim_compute_sim_state": 0.032706211353170464, "sim_compute_performance-ego": 0.059147185292737235, "sim_compute_robot_state-ego": 0.057419883793797984}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14213049955231352, "sim_physics": 0.019074678421020508, "survival_time": 1.2500000000000004, "driven_lanedir": 0.062344392013285344, "sim_render-ego": 0.05142197608947754, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.13671451568603515, "deviation-heading": 0.6403207127056927, "set_robot_commands": 0.08013559341430664, "deviation-center-line": 0.034706324904630374, "driven_lanedir_consec": 0.062344392013285344, "sim_compute_sim_state": 0.034866838455200194, "sim_compute_performance-ego": 0.05719061851501465, "sim_compute_robot_state-ego": 0.06014389038085938}}set_robot_commands_max 0.11808529393426304 set_robot_commands_mean 0.07815933949919954 set_robot_commands_median 0.07739132026146198 set_robot_commands_min 0.05682387351989746 sim_compute_performance-ego_max 0.07873667519668053 sim_compute_performance-ego_mean 0.05538424337321314 sim_compute_performance-ego_median 0.05719061851501465 sim_compute_performance-ego_min 0.04026868343353272 sim_compute_robot_state-ego_max 0.10030921574296622 sim_compute_robot_state-ego_mean 0.06059015845156264 sim_compute_robot_state-ego_median 0.057419883793797984 sim_compute_robot_state-ego_min 0.04250649611155192 sim_compute_sim_state_max 0.04583852044467268 sim_compute_sim_state_mean 0.03237986736736079 sim_compute_sim_state_median 0.032706211353170464 sim_compute_sim_state_min 0.023893507321675615 sim_physics_max 0.02733272519604913 sim_physics_mean 0.01909232019007891 sim_physics_median 0.019074678421020508 sim_physics_min 0.01380455493927002 sim_render-ego_max 0.075020222828306 sim_render-ego_mean 0.05256518435204166 sim_render-ego_median 0.05081625642447636 sim_render-ego_min 0.037347086270650226 simulation-passed 1 survival_time_max 1.5000000000000009 survival_time_mean 1.4300000000000004 survival_time_min 1.2500000000000004
No reset possible 195502511Rami Al-Naim challenge-aido_LF-template-ros aido2-LFV-sim-validationstep1-simulation error no ip-172-31-25-98-97662019-04-24 15:44:33+00:00 2019-04-24 15:46:33+00:00 0:02:00 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 195352536Liam Paull baseline-IL-sim-tensorflow aido2-LFVI-sim-testingstep1-simulation error no ip-172-31-25-98-97662019-04-24 15:41:56+00:00 2019-04-24 15:44:03+00:00 0:02:07 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 195152568Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-25-98-97662019-04-24 15:32:09+00:00 2019-04-24 15:41:42+00:00 0:09:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.07729857404467086 agent_compute-ego_mean 0.07426190486375875 agent_compute-ego_median 0.07412717216893246 agent_compute-ego_min 0.0707253468664069 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.04917717732881245, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06366045098555716, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07412717216893246, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.09975555319535104, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03959183943899054, "sim_compute_performance-ego": 0.06748937556618138, "sim_compute_robot_state-ego": 0.07268669479771664, "sim_compute_robot_state-npc0": 0.06827718082227205, "sim_compute_robot_state-npc1": 0.06853457752027009, "sim_compute_robot_state-npc2": 0.06903363278037623, "sim_compute_robot_state-npc3": 0.06829299926757812}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.039775572325053965, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.061905547192222195, "in-drivable-lane": 0, "agent_compute-ego": 0.0707253468664069, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.09272323156657972, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03711968346645957, "sim_compute_performance-ego": 0.06634467526486046, "sim_compute_robot_state-ego": 0.06715232447574013, "sim_compute_robot_state-npc0": 0.06638863212183903, "sim_compute_robot_state-npc1": 0.06563802769309596, "sim_compute_robot_state-npc2": 0.06512582302093506, "sim_compute_robot_state-npc3": 0.06494518957639996}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.04721413514552973, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06769508581895095, "in-drivable-lane": 0, "agent_compute-ego": 0.07552725840837528, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.11404700768299592, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.04177234111688076, "sim_compute_performance-ego": 0.0719603208395151, "sim_compute_robot_state-ego": 0.07584741176703037, "sim_compute_robot_state-npc0": 0.07924053607842861, "sim_compute_robot_state-npc1": 0.07388449937869342, "sim_compute_robot_state-npc2": 0.07184582490187424, "sim_compute_robot_state-npc3": 0.07411742210388184}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.0511929216519208, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06526069238152303, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07729857404467086, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.10201411851694886, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.040524976354249766, "sim_compute_performance-ego": 0.07306313514709473, "sim_compute_robot_state-ego": 0.07552542484981913, "sim_compute_robot_state-npc0": 0.07076494458695533, "sim_compute_robot_state-npc1": 0.07225343207238426, "sim_compute_robot_state-npc2": 0.0729092409912969, "sim_compute_robot_state-npc3": 0.07303435030117841}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.04249448126012629, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06441041014411232, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07363117283040826, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.09659490260210904, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03796265883879228, "sim_compute_performance-ego": 0.07203080437400124, "sim_compute_robot_state-ego": 0.0752030231735923, "sim_compute_robot_state-npc0": 0.06933545524423773, "sim_compute_robot_state-npc1": 0.07035981525074352, "sim_compute_robot_state-npc2": 0.06814648888327858, "sim_compute_robot_state-npc3": 0.07094364816492255}}set_robot_commands_max 0.11404700768299592 set_robot_commands_mean 0.10102696271279692 set_robot_commands_median 0.09975555319535104 set_robot_commands_min 0.09272323156657972 sim_compute_performance-ego_max 0.07306313514709473 sim_compute_performance-ego_mean 0.07017766223833058 sim_compute_performance-ego_median 0.0719603208395151 sim_compute_performance-ego_min 0.06634467526486046 sim_compute_robot_state-ego_max 0.07584741176703037 sim_compute_robot_state-ego_mean 0.0732829758127797 sim_compute_robot_state-ego_median 0.0752030231735923 sim_compute_robot_state-ego_min 0.06715232447574013 sim_compute_robot_state-npc0_max 0.07924053607842861 sim_compute_robot_state-npc0_mean 0.07080134977074655 sim_compute_robot_state-npc0_median 0.06933545524423773 sim_compute_robot_state-npc0_min 0.06638863212183903 sim_compute_robot_state-npc1_max 0.07388449937869342 sim_compute_robot_state-npc1_mean 0.07013407038303746 sim_compute_robot_state-npc1_median 0.07035981525074352 sim_compute_robot_state-npc1_min 0.06563802769309596 sim_compute_robot_state-npc2_max 0.0729092409912969 sim_compute_robot_state-npc2_mean 0.0694122021155522 sim_compute_robot_state-npc2_median 0.06903363278037623 sim_compute_robot_state-npc2_min 0.06512582302093506 sim_compute_robot_state-npc3_max 0.07411742210388184 sim_compute_robot_state-npc3_mean 0.07026672188279218 sim_compute_robot_state-npc3_median 0.07094364816492255 sim_compute_robot_state-npc3_min 0.06494518957639996 sim_compute_sim_state_max 0.04177234111688076 sim_compute_sim_state_mean 0.03939429984307459 sim_compute_sim_state_median 0.03959183943899054 sim_compute_sim_state_min 0.03711968346645957 sim_physics_max 0.0511929216519208 sim_physics_mean 0.04597085754228865 sim_physics_median 0.04721413514552973 sim_physics_min 0.039775572325053965 sim_render-ego_max 0.06769508581895095 sim_render-ego_mean 0.06458643730447314 sim_render-ego_median 0.06441041014411232 sim_render-ego_min 0.061905547192222195 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 195102577Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testingstep1-simulation error no ip-172-31-25-98-97662019-04-24 15:29:01+00:00 2019-04-24 15:31:53+00:00 0:02:52 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 194812613Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-validationstep1-simulation success no ip-172-31-25-98-97662019-04-24 15:17:45+00:00 2019-04-24 15:28:27+00:00 0:10:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.08739827181163587 agent_compute-ego_mean 0.0783464648586287 agent_compute-ego_median 0.07997076887833444 agent_compute-ego_min 0.06197542493993586 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.05590358031423468, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06996171348973325, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07997076887833444, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.11246258083142732, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.04304658990157278, "sim_compute_performance-ego": 0.07658842488339072, "sim_compute_robot_state-ego": 0.082120933030781, "sim_compute_robot_state-npc0": 0.07608855147110788, "sim_compute_robot_state-npc1": 0.07659537415755423, "sim_compute_robot_state-npc2": 0.0769548491427773, "sim_compute_robot_state-npc3": 0.07711199459276702}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.04834546540912829, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.07032534950657894, "in-drivable-lane": 0, "agent_compute-ego": 0.08739827181163587, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.12306527087562964, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.04385089246850265, "sim_compute_performance-ego": 0.07882304568039744, "sim_compute_robot_state-ego": 0.08472785824223568, "sim_compute_robot_state-npc0": 0.07900354109312359, "sim_compute_robot_state-npc1": 0.07968565037376002, "sim_compute_robot_state-npc2": 0.07929639439833791, "sim_compute_robot_state-npc3": 0.07922318734620747}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.05230521544432029, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06930993764828412, "in-drivable-lane": 0, "agent_compute-ego": 0.08311635408646022, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.11498312461070526, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.04467376684531187, "sim_compute_performance-ego": 0.07919626969557542, "sim_compute_robot_state-ego": 0.08549718979077461, "sim_compute_robot_state-npc0": 0.07729787092942458, "sim_compute_robot_state-npc1": 0.07844213950328338, "sim_compute_robot_state-npc2": 0.07947343435042943, "sim_compute_robot_state-npc3": 0.08011852166591546}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.05586226221541283, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.065488660839242, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07927150457677706, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.1103050171489447, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.04161599320425114, "sim_compute_performance-ego": 0.07532005578699247, "sim_compute_robot_state-ego": 0.07809600359956984, "sim_compute_robot_state-npc0": 0.07289515750508913, "sim_compute_robot_state-npc1": 0.07591671003422266, "sim_compute_robot_state-npc2": 0.07335935847859987, "sim_compute_robot_state-npc3": 0.07380813612064845}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.03508163582194935, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.05156802047382702, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06197542493993586, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.08371130986647173, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03396694226698442, "sim_compute_performance-ego": 0.057448186657645485, "sim_compute_robot_state-ego": 0.05957750298760154, "sim_compute_robot_state-npc0": 0.05966351249001243, "sim_compute_robot_state-npc1": 0.05873827500776811, "sim_compute_robot_state-npc2": 0.05669647455215454, "sim_compute_robot_state-npc3": 0.0575039115819064}}set_robot_commands_max 0.12306527087562964 set_robot_commands_mean 0.10890546066663571 set_robot_commands_median 0.11246258083142732 set_robot_commands_min 0.08371130986647173 sim_compute_performance-ego_max 0.07919626969557542 sim_compute_performance-ego_mean 0.07347519654080031 sim_compute_performance-ego_median 0.07658842488339072 sim_compute_performance-ego_min 0.057448186657645485 sim_compute_robot_state-ego_max 0.08549718979077461 sim_compute_robot_state-ego_mean 0.07800389753019252 sim_compute_robot_state-ego_median 0.082120933030781 sim_compute_robot_state-ego_min 0.05957750298760154 sim_compute_robot_state-npc0_max 0.07900354109312359 sim_compute_robot_state-npc0_mean 0.07298972669775153 sim_compute_robot_state-npc0_median 0.07608855147110788 sim_compute_robot_state-npc0_min 0.05966351249001243 sim_compute_robot_state-npc1_max 0.07968565037376002 sim_compute_robot_state-npc1_mean 0.07387562981531769 sim_compute_robot_state-npc1_median 0.07659537415755423 sim_compute_robot_state-npc1_min 0.05873827500776811 sim_compute_robot_state-npc2_max 0.07947343435042943 sim_compute_robot_state-npc2_mean 0.07315610218445981 sim_compute_robot_state-npc2_median 0.0769548491427773 sim_compute_robot_state-npc2_min 0.05669647455215454 sim_compute_robot_state-npc3_max 0.08011852166591546 sim_compute_robot_state-npc3_mean 0.07355315026148897 sim_compute_robot_state-npc3_median 0.07711199459276702 sim_compute_robot_state-npc3_min 0.0575039115819064 sim_compute_sim_state_max 0.04467376684531187 sim_compute_sim_state_mean 0.04143083693732456 sim_compute_sim_state_median 0.04304658990157278 sim_compute_sim_state_min 0.03396694226698442 sim_physics_max 0.05590358031423468 sim_physics_mean 0.04949963184100909 sim_physics_median 0.05230521544432029 sim_physics_min 0.03508163582194935 sim_render-ego_max 0.07032534950657894 sim_render-ego_mean 0.06533073639153306 sim_render-ego_median 0.06930993764828412 sim_render-ego_min 0.05156802047382702 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 194642648Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-25-98-97662019-04-24 15:07:23+00:00 2019-04-24 15:17:32+00:00 0:10:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.08865457926041041 agent_compute-ego_mean 0.08047501110203703 agent_compute-ego_median 0.07881473487531634 agent_compute-ego_min 0.07760230519554832 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.05413547817029451, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06812186241149902, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07806433125546104, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.10786329319602564, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.042042280498303865, "sim_compute_performance-ego": 0.07550760570325349, "sim_compute_robot_state-ego": 0.08383698212473016, "sim_compute_robot_state-npc0": 0.07433977378042121, "sim_compute_robot_state-npc1": 0.07517319478486714, "sim_compute_robot_state-npc2": 0.07309670197336297, "sim_compute_robot_state-npc3": 0.07284759722257915}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.04845129816155685, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.07105031766389545, "in-drivable-lane": 0, "agent_compute-ego": 0.07923910492344906, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.10604000718970048, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.04556509695555035, "sim_compute_performance-ego": 0.07601054091202586, "sim_compute_robot_state-ego": 0.08136915533166182, "sim_compute_robot_state-npc0": 0.07618296146392822, "sim_compute_robot_state-npc1": 0.07415150968652022, "sim_compute_robot_state-npc2": 0.08255105896999962, "sim_compute_robot_state-npc3": 0.07782828180413497}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.05457919683211889, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.07137331595787635, "in-drivable-lane": 0, "agent_compute-ego": 0.08865457926041041, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.11683795390984952, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.04407699291522686, "sim_compute_performance-ego": 0.07606764328785431, "sim_compute_robot_state-ego": 0.0865173645508595, "sim_compute_robot_state-npc0": 0.07930094767839481, "sim_compute_robot_state-npc1": 0.07733928851592235, "sim_compute_robot_state-npc2": 0.07752545063312237, "sim_compute_robot_state-npc3": 0.07693642836350661}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.05811344401937135, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.07022360680808484, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07881473487531634, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.1102085785127022, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.04336320514410314, "sim_compute_performance-ego": 0.07545469176601356, "sim_compute_robot_state-ego": 0.08127201778787962, "sim_compute_robot_state-npc0": 0.07890685175506162, "sim_compute_robot_state-npc1": 0.0758405907053343, "sim_compute_robot_state-npc2": 0.07596793644864794, "sim_compute_robot_state-npc3": 0.07767117862970056}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.04547034610401501, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.07085069743069736, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07760230519554832, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.10901543227109042, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.041723852807825264, "sim_compute_performance-ego": 0.07531218095259233, "sim_compute_robot_state-ego": 0.07801913131367076, "sim_compute_robot_state-npc0": 0.07427186315709894, "sim_compute_robot_state-npc1": 0.07293325120752508, "sim_compute_robot_state-npc2": 0.07396021214398471, "sim_compute_robot_state-npc3": 0.07448949055238203}}set_robot_commands_max 0.11683795390984952 set_robot_commands_mean 0.10999305301587366 set_robot_commands_median 0.10901543227109042 set_robot_commands_min 0.10604000718970048 sim_compute_performance-ego_max 0.07606764328785431 sim_compute_performance-ego_mean 0.07567053252434791 sim_compute_performance-ego_median 0.07550760570325349 sim_compute_performance-ego_min 0.07531218095259233 sim_compute_robot_state-ego_max 0.0865173645508595 sim_compute_robot_state-ego_mean 0.08220293022176037 sim_compute_robot_state-ego_median 0.08136915533166182 sim_compute_robot_state-ego_min 0.07801913131367076 sim_compute_robot_state-npc0_max 0.07930094767839481 sim_compute_robot_state-npc0_mean 0.07660047956698096 sim_compute_robot_state-npc0_median 0.07618296146392822 sim_compute_robot_state-npc0_min 0.07427186315709894 sim_compute_robot_state-npc1_max 0.07733928851592235 sim_compute_robot_state-npc1_mean 0.07508756698003381 sim_compute_robot_state-npc1_median 0.07517319478486714 sim_compute_robot_state-npc1_min 0.07293325120752508 sim_compute_robot_state-npc2_max 0.08255105896999962 sim_compute_robot_state-npc2_mean 0.07662027203382353 sim_compute_robot_state-npc2_median 0.07596793644864794 sim_compute_robot_state-npc2_min 0.07309670197336297 sim_compute_robot_state-npc3_max 0.07782828180413497 sim_compute_robot_state-npc3_mean 0.07595459531446067 sim_compute_robot_state-npc3_median 0.07693642836350661 sim_compute_robot_state-npc3_min 0.07284759722257915 sim_compute_sim_state_max 0.04556509695555035 sim_compute_sim_state_mean 0.043354285664201894 sim_compute_sim_state_median 0.04336320514410314 sim_compute_sim_state_min 0.041723852807825264 sim_physics_max 0.05811344401937135 sim_physics_mean 0.05214995265747132 sim_physics_median 0.05413547817029451 sim_physics_min 0.04547034610401501 sim_render-ego_max 0.07137331595787635 sim_render-ego_mean 0.07032396005441062 sim_render-ego_median 0.07085069743069736 sim_render-ego_min 0.06812186241149902 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 194592629Andrea Censi challenge-aido_LF-template-random aido2-LF-sim-validationstep1-simulation success no ip-172-31-25-98-97662019-04-24 15:00:54+00:00 2019-04-24 15:06:55+00:00 0:06:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.17549185482960827 agent_compute-ego_mean 0.15907758826019985 agent_compute-ego_median 0.15733437736829123 agent_compute-ego_min 0.14931920983574606 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.027205048866991727, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06896447685529601, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.17549185482960827, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.1091919170235688, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.041632485839555845, "sim_compute_performance-ego": 0.0792027734360605, "sim_compute_robot_state-ego": 0.08175776139745172}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.024624418128620495, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06277105483141812, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14931920983574606, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.09359339692375876, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03736454790288752, "sim_compute_performance-ego": 0.06932405991987749, "sim_compute_robot_state-ego": 0.06773873350837013}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.02538847923278809, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06614717377556695, "in-drivable-lane": 0, "agent_compute-ego": 0.16279873847961426, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.10762732293870714, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.0419528325398763, "sim_compute_performance-ego": 0.07104236814710829, "sim_compute_robot_state-ego": 0.07394896613226996}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.024173518021901447, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0645831177632014, "in-drivable-lane": 0, "agent_compute-ego": 0.15733437736829123, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0956450750430425, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.039790054162343345, "sim_compute_performance-ego": 0.07143790026505788, "sim_compute_robot_state-ego": 0.07363780836264293}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.027503209955552044, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06186335227068733, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.15044376078773947, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09662165010676664, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03872716777464923, "sim_compute_performance-ego": 0.06812307413886576, "sim_compute_robot_state-ego": 0.07033052514581119}}set_robot_commands_max 0.1091919170235688 set_robot_commands_mean 0.10053587240716876 set_robot_commands_median 0.09662165010676664 set_robot_commands_min 0.09359339692375876 sim_compute_performance-ego_max 0.0792027734360605 sim_compute_performance-ego_mean 0.07182603518139398 sim_compute_performance-ego_median 0.07104236814710829 sim_compute_performance-ego_min 0.06812307413886576 sim_compute_robot_state-ego_max 0.08175776139745172 sim_compute_robot_state-ego_mean 0.07348275890930919 sim_compute_robot_state-ego_median 0.07363780836264293 sim_compute_robot_state-ego_min 0.06773873350837013 sim_compute_sim_state_max 0.0419528325398763 sim_compute_sim_state_mean 0.03989341764386245 sim_compute_sim_state_median 0.039790054162343345 sim_compute_sim_state_min 0.03736454790288752 sim_physics_max 0.027503209955552044 sim_physics_mean 0.02577893484117076 sim_physics_median 0.02538847923278809 sim_physics_min 0.024173518021901447 sim_render-ego_max 0.06896447685529601 sim_render-ego_mean 0.06486583509923396 sim_render-ego_median 0.0645831177632014 sim_render-ego_min 0.06186335227068733 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 194262677Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LF-sim-validationstep1-simulation host-error no ip-172-31-25-98-97662019-04-24 14:48:13+00:00 2019-04-24 15:00:04+00:00 0:11:51 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19426-66439', 'ps', '-q', 'solution']' returned non-zero exit status 255.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19426-66439', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19426-66439', 'ps', '-q', 'solution']' returned non-zero exit status 255.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 193982660Egor Zamotaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-25-98-97662019-04-24 14:27:05+00:00 2019-04-24 14:47:16+00:00 0:20:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4725546764682309 survival_time_median 3.7499999999999942 deviation-center-line_median 0.2318475612666791 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.10391579656039968 agent_compute-ego_mean 0.0963609252290394 agent_compute-ego_median 0.0987846117753249 agent_compute-ego_min 0.0806053075413246 deviation-center-line_max 1.0810907593495376 deviation-center-line_mean 0.4723397308374004 deviation-center-line_min 0.07880716082236432 deviation-heading_max 4.3762036819363646 deviation-heading_mean 1.5941829982958822 deviation-heading_median 0.9480091782017134 deviation-heading_min 0.6720250628814004 driven_any_max 2.3556198723889996 driven_any_mean 0.9536600317617372 driven_any_median 0.5556374863277342 driven_any_min 0.2261520078050874 driven_lanedir_consec_max 2.203105646153547 driven_lanedir_consec_mean 0.8875371946314997 driven_lanedir_consec_min 0.18959772566764288 driven_lanedir_max 2.2037304124001436 driven_lanedir_mean 0.8883371626291409 driven_lanedir_median 0.4725546764682309 driven_lanedir_min 0.18959772566764288 in-drivable-lane_max 0.29999999999999893 in-drivable-lane_mean 0.05999999999999979 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.3645636959163912, "sim_physics": 0.0458581609241033, "survival_time": 8.84999999999999, "driven_lanedir": 1.3416299311104327, "sim_render-ego": 0.06538671288786635, "in-drivable-lane": 0, "agent_compute-ego": 0.0806053075413246, "deviation-heading": 1.2927454719507216, "set_robot_commands": 0.1044663749845688, "deviation-center-line": 0.8680557774979514, "driven_lanedir_consec": 1.338254857368823, "sim_compute_sim_state": 0.04170473147246797, "sim_compute_performance-ego": 0.07113651232530842, "sim_compute_robot_state-ego": 0.07499172862640209, "sim_compute_robot_state-npc0": 0.0730405419559802, "sim_compute_robot_state-npc1": 0.07350393877191058, "sim_compute_robot_state-npc2": 0.07266052429285427, "sim_compute_robot_state-npc3": 0.07161663750470695}, "udem1-1-0": {"driven_any": 0.2261520078050874, "sim_physics": 0.05708312287050135, "survival_time": 1.7000000000000008, "driven_lanedir": 0.18959772566764288, "sim_render-ego": 0.07523544395671171, "in-drivable-lane": 0, "agent_compute-ego": 0.10391579656039968, "deviation-heading": 0.6720250628814004, "set_robot_commands": 0.1421800921945011, "deviation-center-line": 0.07880716082236432, "driven_lanedir_consec": 0.18959772566764288, "sim_compute_sim_state": 0.04586338295656092, "sim_compute_performance-ego": 0.08526535595164579, "sim_compute_robot_state-ego": 0.09252321018892176, "sim_compute_robot_state-npc0": 0.08887917153975543, "sim_compute_robot_state-npc1": 0.09447398606468647, "sim_compute_robot_state-npc2": 0.08443939685821533, "sim_compute_robot_state-npc3": 0.0866841989405015}, "udem1-2-0": {"driven_any": 0.5556374863277342, "sim_physics": 0.06882602691650391, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4725546764682309, "sim_render-ego": 0.07980796178181966, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1021869150797526, "deviation-heading": 0.9480091782017134, "set_robot_commands": 0.13589739481608074, "deviation-center-line": 0.2318475612666791, "driven_lanedir_consec": 0.4725546764682309, "sim_compute_sim_state": 0.05039762179056803, "sim_compute_performance-ego": 0.08845828056335449, "sim_compute_robot_state-ego": 0.09868295669555664, "sim_compute_robot_state-npc0": 0.08967665672302245, "sim_compute_robot_state-npc1": 0.09011315981547038, "sim_compute_robot_state-npc2": 0.08828666687011719, "sim_compute_robot_state-npc3": 0.08945293744405111}, "udem1-3-0": {"driven_any": 0.2663270963704733, "sim_physics": 0.059503671450492665, "survival_time": 1.950000000000001, "driven_lanedir": 0.23417306749925437, "sim_render-ego": 0.07378301253685585, "in-drivable-lane": 0, "agent_compute-ego": 0.0987846117753249, "deviation-heading": 0.6819315965092105, "set_robot_commands": 0.12689574559529623, "deviation-center-line": 0.10189739525046956, "driven_lanedir_consec": 0.23417306749925437, "sim_compute_sim_state": 0.04457957316667606, "sim_compute_performance-ego": 0.08140832949907352, "sim_compute_robot_state-ego": 0.09436261959564991, "sim_compute_robot_state-npc0": 0.07968818224393405, "sim_compute_robot_state-npc1": 0.08143465946882199, "sim_compute_robot_state-npc2": 0.07988281127734062, "sim_compute_robot_state-npc3": 0.07965391721480931}, "udem1-4-0": {"driven_any": 2.3556198723889996, "sim_physics": 0.05291146993637085, "survival_time": 14.950000000000076, "driven_lanedir": 2.2037304124001436, "sim_render-ego": 0.0723766533533732, "in-drivable-lane": 0, "agent_compute-ego": 0.0963119951883952, "deviation-heading": 4.3762036819363646, "set_robot_commands": 0.12490700483322144, "deviation-center-line": 1.0810907593495376, "driven_lanedir_consec": 2.203105646153547, "sim_compute_sim_state": 0.04529801050821941, "sim_compute_performance-ego": 0.08164201180140178, "sim_compute_robot_state-ego": 0.09272791862487792, "sim_compute_robot_state-npc0": 0.08221226056416829, "sim_compute_robot_state-npc1": 0.08195485909779866, "sim_compute_robot_state-npc2": 0.08234562714894612, "sim_compute_robot_state-npc3": 0.08261575222015381}}set_robot_commands_max 0.1421800921945011 set_robot_commands_mean 0.12686932248473365 set_robot_commands_median 0.12689574559529623 set_robot_commands_min 0.1044663749845688 sim_compute_performance-ego_max 0.08845828056335449 sim_compute_performance-ego_mean 0.0815820980281568 sim_compute_performance-ego_median 0.08164201180140178 sim_compute_performance-ego_min 0.07113651232530842 sim_compute_robot_state-ego_max 0.09868295669555664 sim_compute_robot_state-ego_mean 0.09065768674628168 sim_compute_robot_state-ego_median 0.09272791862487792 sim_compute_robot_state-ego_min 0.07499172862640209 sim_compute_robot_state-npc0_max 0.08967665672302245 sim_compute_robot_state-npc0_mean 0.08269936260537208 sim_compute_robot_state-npc0_median 0.08221226056416829 sim_compute_robot_state-npc0_min 0.0730405419559802 sim_compute_robot_state-npc1_max 0.09447398606468647 sim_compute_robot_state-npc1_mean 0.08429612064373762 sim_compute_robot_state-npc1_median 0.08195485909779866 sim_compute_robot_state-npc1_min 0.07350393877191058 sim_compute_robot_state-npc2_max 0.08828666687011719 sim_compute_robot_state-npc2_mean 0.0815230052894947 sim_compute_robot_state-npc2_median 0.08234562714894612 sim_compute_robot_state-npc2_min 0.07266052429285427 sim_compute_robot_state-npc3_max 0.08945293744405111 sim_compute_robot_state-npc3_mean 0.08200468866484453 sim_compute_robot_state-npc3_median 0.08261575222015381 sim_compute_robot_state-npc3_min 0.07161663750470695 sim_compute_sim_state_max 0.05039762179056803 sim_compute_sim_state_mean 0.045568663978898485 sim_compute_sim_state_median 0.04529801050821941 sim_compute_sim_state_min 0.04170473147246797 sim_physics_max 0.06882602691650391 sim_physics_mean 0.05683649041959442 sim_physics_median 0.05708312287050135 sim_physics_min 0.0458581609241033 sim_render-ego_max 0.07980796178181966 sim_render-ego_mean 0.07331795690332535 sim_render-ego_median 0.07378301253685585 sim_render-ego_min 0.06538671288786635 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 6.240000000000013 survival_time_min 1.7000000000000008
No reset possible 193902738Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation failed no ip-172-31-25-98-97662019-04-24 14:24:56+00:00 2019-04-24 14:26:39+00:00 0:01:43 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 193792754Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testingstep1-simulation success no ip-172-31-25-98-97662019-04-24 14:18:21+00:00 2019-04-24 14:24:34+00:00 0:06:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07811612617678759 agent_compute-ego_mean 0.0735141667783503 agent_compute-ego_median 0.07236929943687037 agent_compute-ego_min 0.07118299374213585 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02959110678696051, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06744834853381645, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07811612617678759, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.10970960303050716, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.04396051604573319, "sim_compute_performance-ego": 0.07587325282213164, "sim_compute_robot_state-ego": 0.08297889407088117}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.027009184543903057, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.0680459921176617, "in-drivable-lane": 0, "agent_compute-ego": 0.07118299374213585, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.10006325978499192, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.04053636697622446, "sim_compute_performance-ego": 0.07940799456376296, "sim_compute_robot_state-ego": 0.07742487467252292}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.026594791006534654, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.064093660801015, "in-drivable-lane": 0, "agent_compute-ego": 0.07410841292523324, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.1011459675241024, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03918312458281822, "sim_compute_performance-ego": 0.07092004633964376, "sim_compute_robot_state-ego": 0.07270486304100524}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02857652077308068, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06157516123174311, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07179400161072448, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.1032046459533356, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03892195355761182, "sim_compute_performance-ego": 0.06951672690255302, "sim_compute_robot_state-ego": 0.07297404519804232}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.02579892309088456, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06669288559963829, "in-drivable-lane": 0, "agent_compute-ego": 0.07236929943687037, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10180762567018208, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04356142094260768, "sim_compute_performance-ego": 0.07317653455232319, "sim_compute_robot_state-ego": 0.07646439577403821}}set_robot_commands_max 0.10970960303050716 set_robot_commands_mean 0.10318622039262382 set_robot_commands_median 0.10180762567018208 set_robot_commands_min 0.10006325978499192 sim_compute_performance-ego_max 0.07940799456376296 sim_compute_performance-ego_mean 0.07377891103608292 sim_compute_performance-ego_median 0.07317653455232319 sim_compute_performance-ego_min 0.06951672690255302 sim_compute_robot_state-ego_max 0.08297889407088117 sim_compute_robot_state-ego_mean 0.07650941455129796 sim_compute_robot_state-ego_median 0.07646439577403821 sim_compute_robot_state-ego_min 0.07270486304100524 sim_compute_sim_state_max 0.04396051604573319 sim_compute_sim_state_mean 0.04123267642099908 sim_compute_sim_state_median 0.04053636697622446 sim_compute_sim_state_min 0.03892195355761182 sim_physics_max 0.02959110678696051 sim_physics_mean 0.02751410524027269 sim_physics_median 0.027009184543903057 sim_physics_min 0.02579892309088456 sim_render-ego_max 0.0680459921176617 sim_render-ego_mean 0.0655712096567749 sim_render-ego_median 0.06669288559963829 sim_render-ego_min 0.06157516123174311 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 193372877Andrea Daniele minimal_agent (Python 3) aido2-LF-sim-validationstep1-simulation success no ip-172-31-25-98-97662019-04-24 14:00:31+00:00 2019-04-24 14:17:40+00:00 0:17:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.225306900765771 survival_time_median 10.750000000000018 deviation-center-line_median 0.40864173779456053 in-drivable-lane_median 1.7000000000000242
other stats agent_compute-ego_max 0.17701114346628233 agent_compute-ego_mean 0.1694091479008581 agent_compute-ego_median 0.1681576888926708 agent_compute-ego_min 0.16559230729385657 deviation-center-line_max 0.6491801892887803 deviation-center-line_mean 0.3683230725655418 deviation-center-line_min 0.1475671628461062 deviation-heading_max 2.2060076411946548 deviation-heading_mean 1.4163758252990906 deviation-heading_median 1.5250264276913703 deviation-heading_min 0.6970592634293067 driven_any_max 1.6057043265958648 driven_any_mean 1.3484469345214642 driven_any_median 1.5756972277649912 driven_any_min 0.9900494571900692 driven_lanedir_consec_max 1.4904214722299334 driven_lanedir_consec_mean 1.0721437270256324 driven_lanedir_consec_min 0.6474115509746436 driven_lanedir_max 1.4904214722299334 driven_lanedir_mean 1.0721437270256324 driven_lanedir_median 1.225306900765771 driven_lanedir_min 0.6474115509746436 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.4300000000000082 in-drivable-lane_min 0.25000000000000355 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.027928249441462456, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.06793134161036649, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1658873592349265, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.1066791891194076, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.04238300529315317, "sim_compute_performance-ego": 0.07549230657893119, "sim_compute_robot_state-ego": 0.0786497764450183}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.028716451060162844, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.06914159503296344, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1681576888926708, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.1084471375402743, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.04220486731424819, "sim_compute_performance-ego": 0.07547727466499718, "sim_compute_robot_state-ego": 0.07970091722307414}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.02656456066353973, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.07167545669281963, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.17701114346628233, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.1112160394009988, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.04469971485736659, "sim_compute_performance-ego": 0.07716353377953773, "sim_compute_robot_state-ego": 0.08252526826388099}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.028605046383170196, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.06954955943795138, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.17039724061655442, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.10910725704459256, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.04352357553881269, "sim_compute_performance-ego": 0.07668112377787745, "sim_compute_robot_state-ego": 0.0823222792425821}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.02694090759312665, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.06879916235252663, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.16559230729385657, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.10527479317453171, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.042127125793033175, "sim_compute_performance-ego": 0.0777311932157587, "sim_compute_robot_state-ego": 0.07916913209138093}}set_robot_commands_max 0.1112160394009988 set_robot_commands_mean 0.108144883255961 set_robot_commands_median 0.1084471375402743 set_robot_commands_min 0.10527479317453171 sim_compute_performance-ego_max 0.0777311932157587 sim_compute_performance-ego_mean 0.07650908640342045 sim_compute_performance-ego_median 0.07668112377787745 sim_compute_performance-ego_min 0.07547727466499718 sim_compute_robot_state-ego_max 0.08252526826388099 sim_compute_robot_state-ego_mean 0.0804734746531873 sim_compute_robot_state-ego_median 0.07970091722307414 sim_compute_robot_state-ego_min 0.0786497764450183 sim_compute_sim_state_max 0.04469971485736659 sim_compute_sim_state_mean 0.04298765775932276 sim_compute_sim_state_median 0.04238300529315317 sim_compute_sim_state_min 0.042127125793033175 sim_physics_max 0.028716451060162844 sim_physics_mean 0.02775104302829238 sim_physics_median 0.027928249441462456 sim_physics_min 0.02656456066353973 sim_render-ego_max 0.07167545669281963 sim_render-ego_mean 0.06941942302532553 sim_render-ego_median 0.06914159503296344 sim_render-ego_min 0.06793134161036649 simulation-passed 1 survival_time_max 11.150000000000023 survival_time_mean 9.300000000000004 survival_time_min 6.849999999999984
No reset possible 193272822Liam Paull challenge-aido_LF-template-random aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-25-98-97662019-04-24 13:59:32+00:00 2019-04-24 14:00:06+00:00 0:00:34 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19327-677077', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19327-677077', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19327-677077', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 192632960Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-testingstep1-simulation success no ip-172-31-25-98-97662019-04-24 13:28:58+00:00 2019-04-24 13:59:04+00:00 0:30:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.198568460305644 survival_time_median 13.900000000000064 deviation-center-line_median 0.40907345914236193 in-drivable-lane_median 1.5999999999999943
other stats agent_compute-ego_max 0.25060458624490217 agent_compute-ego_mean 0.2316701908745215 agent_compute-ego_median 0.23176441947333248 agent_compute-ego_min 0.21878976265589395 deviation-center-line_max 0.6981423816640132 deviation-center-line_mean 0.4138108564930269 deviation-center-line_min 0.19240467183487808 deviation-heading_max 3.3769423039868363 deviation-heading_mean 1.9971507997863711 deviation-heading_median 1.783222412948547 deviation-heading_min 0.43942050209339634 driven_any_max 2.035349111062978 driven_any_mean 1.6113955424425723 driven_any_median 1.7175036974473494 driven_any_min 0.9618167910189216 driven_lanedir_consec_max 2.033569962783974 driven_lanedir_consec_mean 1.2364084515410922 driven_lanedir_consec_min 0.5693555103083439 driven_lanedir_max 2.033569962783974 driven_lanedir_mean 1.262511573244263 driven_lanedir_median 1.2421451784362478 driven_lanedir_min 0.5852717655650199 in-drivable-lane_max 2.550000000000036 in-drivable-lane_mean 1.600000000000017 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9618167910189216, "sim_physics": 0.043233529159000944, "survival_time": 6.999999999999983, "driven_lanedir": 0.5852717655650199, "sim_render-ego": 0.0634430238178798, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.22063251733779907, "deviation-heading": 1.5147216691032022, "set_robot_commands": 0.0990833248410906, "deviation-center-line": 0.19240467183487808, "driven_lanedir_consec": 0.5693555103083439, "sim_compute_sim_state": 0.04385699374335153, "sim_compute_performance-ego": 0.06914277928216117, "sim_compute_robot_state-ego": 0.07459257330213274, "sim_compute_robot_state-npc0": 0.07052807978221348, "sim_compute_robot_state-npc1": 0.07193953820637294, "sim_compute_robot_state-npc2": 0.07272362879344395, "sim_compute_robot_state-npc3": 0.07138747487749372}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.035349111062978, "sim_physics": 0.0389311679204305, "survival_time": 14.950000000000076, "driven_lanedir": 2.033569962783974, "sim_render-ego": 0.06197837829589844, "in-drivable-lane": 0, "agent_compute-ego": 0.21878976265589395, "deviation-heading": 0.43942050209339634, "set_robot_commands": 0.09897416432698568, "deviation-center-line": 0.6981423816640132, "driven_lanedir_consec": 2.033569962783974, "sim_compute_sim_state": 0.0406792688369751, "sim_compute_performance-ego": 0.06966837088267008, "sim_compute_robot_state-ego": 0.07315710067749023, "sim_compute_robot_state-npc0": 0.07063327630360922, "sim_compute_robot_state-npc1": 0.06943098942438762, "sim_compute_robot_state-npc2": 0.06889492988586426, "sim_compute_robot_state-npc3": 0.06873526175816853}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7528319531040215, "sim_physics": 0.03927704756208461, "survival_time": 13.900000000000064, "driven_lanedir": 1.2421451784362478, "sim_render-ego": 0.06456967738034913, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.23176441947333248, "deviation-heading": 2.8714471107998745, "set_robot_commands": 0.10217330095579298, "deviation-center-line": 0.40907345914236193, "driven_lanedir_consec": 1.2060153821900863, "sim_compute_sim_state": 0.042202489839183344, "sim_compute_performance-ego": 0.07210496861300023, "sim_compute_robot_state-ego": 0.07605845036266519, "sim_compute_robot_state-npc0": 0.07283806028983576, "sim_compute_robot_state-npc1": 0.07272598640524226, "sim_compute_robot_state-npc2": 0.07611724798627895, "sim_compute_robot_state-npc3": 0.07203681263134634}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.589476159579593, "sim_physics": 0.040733904033512264, "survival_time": 11.55000000000003, "driven_lanedir": 1.201587308849993, "sim_render-ego": 0.06451903896414356, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.23655966866067993, "deviation-heading": 1.783222412948547, "set_robot_commands": 0.10380816872501786, "deviation-center-line": 0.3384512153390148, "driven_lanedir_consec": 1.1745329421174129, "sim_compute_sim_state": 0.040677124287658954, "sim_compute_performance-ego": 0.07137918369078533, "sim_compute_robot_state-ego": 0.07687481347616616, "sim_compute_robot_state-npc0": 0.07157148840107443, "sim_compute_robot_state-npc1": 0.0721712215638264, "sim_compute_robot_state-npc2": 0.07172846174859382, "sim_compute_robot_state-npc3": 0.07354271566713011}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7175036974473494, "sim_physics": 0.04120174166995011, "survival_time": 14.050000000000065, "driven_lanedir": 1.2499836505860822, "sim_render-ego": 0.06706731769113779, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.25060458624490217, "deviation-heading": 3.3769423039868363, "set_robot_commands": 0.10700911389551128, "deviation-center-line": 0.43098255448486605, "driven_lanedir_consec": 1.198568460305644, "sim_compute_sim_state": 0.04167284235835499, "sim_compute_performance-ego": 0.07412679679028929, "sim_compute_robot_state-ego": 0.07905761881655221, "sim_compute_robot_state-npc0": 0.0755943988990105, "sim_compute_robot_state-npc1": 0.07569602630316574, "sim_compute_robot_state-npc2": 0.07542542715513834, "sim_compute_robot_state-npc3": 0.07537708418225054}}set_robot_commands_max 0.10700911389551128 set_robot_commands_mean 0.1022096145488797 set_robot_commands_median 0.10217330095579298 set_robot_commands_min 0.09897416432698568 sim_compute_performance-ego_max 0.07412679679028929 sim_compute_performance-ego_mean 0.07128441985178122 sim_compute_performance-ego_median 0.07137918369078533 sim_compute_performance-ego_min 0.06914277928216117 sim_compute_robot_state-ego_max 0.07905761881655221 sim_compute_robot_state-ego_mean 0.0759481113270013 sim_compute_robot_state-ego_median 0.07605845036266519 sim_compute_robot_state-ego_min 0.07315710067749023 sim_compute_robot_state-npc0_max 0.0755943988990105 sim_compute_robot_state-npc0_mean 0.07223306073514867 sim_compute_robot_state-npc0_median 0.07157148840107443 sim_compute_robot_state-npc0_min 0.07052807978221348 sim_compute_robot_state-npc1_max 0.07569602630316574 sim_compute_robot_state-npc1_mean 0.07239275238059899 sim_compute_robot_state-npc1_median 0.0721712215638264 sim_compute_robot_state-npc1_min 0.06943098942438762 sim_compute_robot_state-npc2_max 0.07611724798627895 sim_compute_robot_state-npc2_mean 0.07297793911386387 sim_compute_robot_state-npc2_median 0.07272362879344395 sim_compute_robot_state-npc2_min 0.06889492988586426 sim_compute_robot_state-npc3_max 0.07537708418225054 sim_compute_robot_state-npc3_mean 0.07221586982327785 sim_compute_robot_state-npc3_median 0.07203681263134634 sim_compute_robot_state-npc3_min 0.06873526175816853 sim_compute_sim_state_max 0.04385699374335153 sim_compute_sim_state_mean 0.04181774381310478 sim_compute_sim_state_median 0.04167284235835499 sim_compute_sim_state_min 0.040677124287658954 sim_physics_max 0.043233529159000944 sim_physics_mean 0.040675478068995685 sim_physics_median 0.040733904033512264 sim_physics_min 0.0389311679204305 sim_render-ego_max 0.06706731769113779 sim_render-ego_mean 0.06431548722988174 sim_render-ego_median 0.06451903896414356 sim_render-ego_min 0.06197837829589844 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.290000000000044 survival_time_min 6.999999999999983
No reset possible
Manfred Diaz
Andrea Censi 🇨ðŸ‡
jiang peng
Nicky Eichmann
Liam Paull 🇨🇦
Rami Al-Naim 🇷🇺
Alexander Karavaev
Konstantin Chaika
Egor Zamotaev
Bhairav Mehta
Andrea Daniele 🇮🇹
Julian Zilly