Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 19152
2300
Andrea Censi 🇨🇭Python template aido2-AMOD-service_quality
step2-scoring success yes idsc-rudolf-9560
2019-04-24 09:10:37+00:00 2019-04-24 09:10:56+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.754042946526994
other stats efficiency -64.0305317861065 fleet_size -1000000000
No reset possible 19145
2300
Andrea Censi 🇨🇭Python template aido2-AMOD-service_quality
step1-simulation success yes idsc-rudolf-9560
2019-04-24 09:06:55+00:00 2019-04-24 09:10:18+00:00 0:03:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19118
2961
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-9560
2019-04-24 05:40:55+00:00 2019-04-24 06:02:15+00:00 0:21:20 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19116
2953
Bhairav Mehta Baseline solution using reinforcement learning aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-9560
2019-04-24 00:07:49+00:00 2019-04-24 00:15:05+00:00 0:07:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07091088688141989 survival_time_median 1.6000000000000008 deviation-center-line_median 0.04246300250295304 in-drivable-lane_median 0.5000000000000004
other stats agent_compute-ego_max 0.2579405754804611 agent_compute-ego_mean 0.2133246343326168 agent_compute-ego_median 0.2034933987785788 agent_compute-ego_min 0.19487913165773663 deviation-center-line_max 0.045456903080898 deviation-center-line_mean 0.0389239937943314 deviation-center-line_min 0.025872964535231698 deviation-heading_max 0.7807873705161368 deviation-heading_mean 0.7255365667992566 deviation-heading_median 0.7430474472660081 deviation-heading_min 0.6233433972699136 driven_any_max 0.18014278328049962 driven_any_mean 0.15928533802065087 driven_any_median 0.16274017393720963 driven_any_min 0.13684221131338936 driven_lanedir_consec_max 0.08655675364174176 driven_lanedir_consec_mean 0.06991173327637604 driven_lanedir_consec_min 0.05504410747792443 driven_lanedir_max 0.08655675364174176 driven_lanedir_mean 0.06991173327637604 driven_lanedir_median 0.07091088688141989 driven_lanedir_min 0.05504410747792443 in-drivable-lane_max 0.5000000000000004 in-drivable-lane_mean 0.37000000000000033 in-drivable-lane_min 0.15000000000000013 per-episodes details {"udem1-0-0": {"driven_any": 0.16274017393720963, "sim_physics": 0.02904096245765686, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05504410747792443, "sim_render-ego": 0.061547622084617615, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2579405754804611, "deviation-heading": 0.6233433972699136, "set_robot_commands": 0.07875682413578033, "deviation-center-line": 0.025872964535231698, "driven_lanedir_consec": 0.05504410747792443, "sim_compute_sim_state": 0.03543737530708313, "sim_compute_performance-ego": 0.06299611926078796, "sim_compute_robot_state-ego": 0.06494870781898499, "sim_compute_robot_state-npc0": 0.06798671931028366, "sim_compute_robot_state-npc1": 0.062150247395038605, "sim_compute_robot_state-npc2": 0.0644928365945816, "sim_compute_robot_state-npc3": 0.062031470239162445}, "udem1-1-0": {"driven_any": 0.18014278328049962, "sim_physics": 0.030026025242275663, "survival_time": 1.800000000000001, "driven_lanedir": 0.08655675364174176, "sim_render-ego": 0.06837745507558186, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2120231588681539, "deviation-heading": 0.7430474472660081, "set_robot_commands": 0.0811455249786377, "deviation-center-line": 0.04246300250295304, "driven_lanedir_consec": 0.08655675364174176, "sim_compute_sim_state": 0.035464968946244985, "sim_compute_performance-ego": 0.06644046306610107, "sim_compute_robot_state-ego": 0.06421591175927056, "sim_compute_robot_state-npc0": 0.06967057122124566, "sim_compute_robot_state-npc1": 0.06484229034847683, "sim_compute_robot_state-npc2": 0.06533877054850261, "sim_compute_robot_state-npc3": 0.06330524550543891}, "udem1-2-0": {"driven_any": 0.13684221131338936, "sim_physics": 0.03094461134501866, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06156084273478957, "sim_render-ego": 0.06839399678366524, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.19487913165773663, "deviation-heading": 0.7807873705161368, "set_robot_commands": 0.0804266163281032, "deviation-center-line": 0.04314689230184291, "driven_lanedir_consec": 0.06156084273478957, "sim_compute_sim_state": 0.036161414214542935, "sim_compute_performance-ego": 0.06784322432109288, "sim_compute_robot_state-ego": 0.06291465248380389, "sim_compute_robot_state-npc0": 0.07068834134510585, "sim_compute_robot_state-npc1": 0.06306967564991542, "sim_compute_robot_state-npc2": 0.061986991337367466, "sim_compute_robot_state-npc3": 0.06232788733073643}, "udem1-3-0": {"driven_any": 0.1515844345680399, "sim_physics": 0.031406315167744954, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07548607564600451, "sim_render-ego": 0.06781995296478271, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.19828690687815348, "deviation-heading": 0.7736276142889771, "set_robot_commands": 0.07887507279713948, "deviation-center-line": 0.045456903080898, "driven_lanedir_consec": 0.07548607564600451, "sim_compute_sim_state": 0.036392529805501304, "sim_compute_performance-ego": 0.06488362153371176, "sim_compute_robot_state-ego": 0.06600981553395589, "sim_compute_robot_state-npc0": 0.07352470556894938, "sim_compute_robot_state-npc1": 0.06949685414632162, "sim_compute_robot_state-npc2": 0.06737685203552246, "sim_compute_robot_state-npc3": 0.06783738136291503}, "udem1-4-0": {"driven_any": 0.16511708700411593, "sim_physics": 0.029892654979930204, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07091088688141989, "sim_render-ego": 0.06614139500786276, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2034933987785788, "deviation-heading": 0.7068770046552477, "set_robot_commands": 0.08351841393639059, "deviation-center-line": 0.037680206550731385, "driven_lanedir_consec": 0.07091088688141989, "sim_compute_sim_state": 0.03623269586002126, "sim_compute_performance-ego": 0.0652620932635139, "sim_compute_robot_state-ego": 0.06642056212705724, "sim_compute_robot_state-npc0": 0.07249156166525449, "sim_compute_robot_state-npc1": 0.06532777056974523, "sim_compute_robot_state-npc2": 0.06315771271200742, "sim_compute_robot_state-npc3": 0.06436858457677505}}set_robot_commands_max 0.08351841393639059 set_robot_commands_mean 0.08054449043521025 set_robot_commands_median 0.0804266163281032 set_robot_commands_min 0.07875682413578033 sim_compute_performance-ego_max 0.06784322432109288 sim_compute_performance-ego_mean 0.06548510428904152 sim_compute_performance-ego_median 0.0652620932635139 sim_compute_performance-ego_min 0.06299611926078796 sim_compute_robot_state-ego_max 0.06642056212705724 sim_compute_robot_state-ego_mean 0.06490192994461452 sim_compute_robot_state-ego_median 0.06494870781898499 sim_compute_robot_state-ego_min 0.06291465248380389 sim_compute_robot_state-npc0_max 0.07352470556894938 sim_compute_robot_state-npc0_mean 0.0708723798221678 sim_compute_robot_state-npc0_median 0.07068834134510585 sim_compute_robot_state-npc0_min 0.06798671931028366 sim_compute_robot_state-npc1_max 0.06949685414632162 sim_compute_robot_state-npc1_mean 0.06497736762189954 sim_compute_robot_state-npc1_median 0.06484229034847683 sim_compute_robot_state-npc1_min 0.062150247395038605 sim_compute_robot_state-npc2_max 0.06737685203552246 sim_compute_robot_state-npc2_mean 0.06447063264559631 sim_compute_robot_state-npc2_median 0.0644928365945816 sim_compute_robot_state-npc2_min 0.061986991337367466 sim_compute_robot_state-npc3_max 0.06783738136291503 sim_compute_robot_state-npc3_mean 0.06397411380300558 sim_compute_robot_state-npc3_median 0.06330524550543891 sim_compute_robot_state-npc3_min 0.062031470239162445 sim_compute_sim_state_max 0.036392529805501304 sim_compute_sim_state_mean 0.035937796826678726 sim_compute_sim_state_median 0.036161414214542935 sim_compute_sim_state_min 0.03543737530708313 sim_physics_max 0.031406315167744954 sim_physics_mean 0.030262113838525267 sim_physics_median 0.030026025242275663 sim_physics_min 0.02904096245765686 sim_render-ego_max 0.06839399678366524 sim_render-ego_mean 0.06645608438330204 sim_render-ego_median 0.06781995296478271 sim_render-ego_min 0.061547622084617615 simulation-passed 1 survival_time_max 1.800000000000001 survival_time_mean 1.6000000000000008 survival_time_min 1.4000000000000006
No reset possible 19100
2928
Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-23 22:30:39+00:00 2019-04-23 22:38:48+00:00 0:08:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.14012603313990724 survival_time_median 1.3000000000000005 deviation-center-line_median 0.05901274376135567 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.40788776533944265 agent_compute-ego_mean 0.33476597719486617 agent_compute-ego_median 0.3408019175896278 agent_compute-ego_min 0.2745673656463623 deviation-center-line_max 0.07434475248362699 deviation-center-line_mean 0.06201598225778786 deviation-center-line_min 0.05461460644938909 deviation-heading_max 0.6377796155010951 deviation-heading_mean 0.6154194085069695 deviation-heading_median 0.6190157965000459 deviation-heading_min 0.5674665480797144 driven_any_max 0.2796817885960001 driven_any_mean 0.20593806949763796 driven_any_median 0.1871045668127292 driven_any_min 0.17578018806740175 driven_lanedir_consec_max 0.23903091529425913 driven_lanedir_consec_mean 0.16036595005642157 driven_lanedir_consec_min 0.1279389730175884 driven_lanedir_max 0.23903091529425913 driven_lanedir_mean 0.16036595005642157 driven_lanedir_median 0.14012603313990724 driven_lanedir_min 0.1279389730175884 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.2059048053357713, "sim_physics": 0.031181837831224715, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16286248277670645, "sim_render-ego": 0.05852032559258597, "in-drivable-lane": 0, "agent_compute-ego": 0.40788776533944265, "deviation-heading": 0.6346092584853296, "set_robot_commands": 0.07690385409763881, "deviation-center-line": 0.06601172089939268, "driven_lanedir_consec": 0.16286248277670645, "sim_compute_sim_state": 0.03514761584145682, "sim_compute_performance-ego": 0.0623563357761928, "sim_compute_robot_state-ego": 0.0639021737234933, "sim_compute_robot_state-npc0": 0.06595374856676374, "sim_compute_robot_state-npc1": 0.06268812928880964, "sim_compute_robot_state-npc2": 0.06058218649455479, "sim_compute_robot_state-npc3": 0.06117244277681623}, "udem1-1-0": {"driven_any": 0.2796817885960001, "sim_physics": 0.03246504260647681, "survival_time": 1.5500000000000007, "driven_lanedir": 0.23903091529425913, "sim_render-ego": 0.06040010144633631, "in-drivable-lane": 0, "agent_compute-ego": 0.3627976832851287, "deviation-heading": 0.5674665480797144, "set_robot_commands": 0.07400949539676789, "deviation-center-line": 0.07434475248362699, "driven_lanedir_consec": 0.23903091529425913, "sim_compute_sim_state": 0.03461214803880261, "sim_compute_performance-ego": 0.06014895439147949, "sim_compute_robot_state-ego": 0.06273445006339781, "sim_compute_robot_state-npc0": 0.06440121127713111, "sim_compute_robot_state-npc1": 0.060471234783049554, "sim_compute_robot_state-npc2": 0.05954065630512853, "sim_compute_robot_state-npc3": 0.05880754993807885}, "udem1-2-0": {"driven_any": 0.1871045668127292, "sim_physics": 0.033487870143010065, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14012603313990724, "sim_render-ego": 0.0637430319419274, "in-drivable-lane": 0, "agent_compute-ego": 0.3408019175896278, "deviation-heading": 0.6182258239686623, "set_robot_commands": 0.07684743404388428, "deviation-center-line": 0.05901274376135567, "driven_lanedir_consec": 0.14012603313990724, "sim_compute_sim_state": 0.03321899817540096, "sim_compute_performance-ego": 0.06036737331977257, "sim_compute_robot_state-ego": 0.0614479321699876, "sim_compute_robot_state-npc0": 0.06562955562884991, "sim_compute_robot_state-npc1": 0.06337139239678016, "sim_compute_robot_state-npc2": 0.05981185803046593, "sim_compute_robot_state-npc3": 0.06107833752265343}, "udem1-3-0": {"driven_any": 0.18121899867628752, "sim_physics": 0.034824600586524375, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1318713460536467, "sim_render-ego": 0.061914874957158014, "in-drivable-lane": 0, "agent_compute-ego": 0.2745673656463623, "deviation-heading": 0.6377796155010951, "set_robot_commands": 0.07638521377856915, "deviation-center-line": 0.05461460644938909, "driven_lanedir_consec": 0.1318713460536467, "sim_compute_sim_state": 0.036618489485520586, "sim_compute_performance-ego": 0.06064668985513541, "sim_compute_robot_state-ego": 0.06405409482809213, "sim_compute_robot_state-npc0": 0.06459342516385592, "sim_compute_robot_state-npc1": 0.06436325036562406, "sim_compute_robot_state-npc2": 0.0631101131439209, "sim_compute_robot_state-npc3": 0.06552574267754188}, "udem1-4-0": {"driven_any": 0.17578018806740175, "sim_physics": 0.028391132354736327, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1279389730175884, "sim_render-ego": 0.05883027076721192, "in-drivable-lane": 0, "agent_compute-ego": 0.2877751541137695, "deviation-heading": 0.6190157965000459, "set_robot_commands": 0.07870048522949219, "deviation-center-line": 0.056096087695174865, "driven_lanedir_consec": 0.1279389730175884, "sim_compute_sim_state": 0.03718918800354004, "sim_compute_performance-ego": 0.06277231216430663, "sim_compute_robot_state-ego": 0.06137678146362305, "sim_compute_robot_state-npc0": 0.0681296443939209, "sim_compute_robot_state-npc1": 0.0647162914276123, "sim_compute_robot_state-npc2": 0.06087549209594727, "sim_compute_robot_state-npc3": 0.062456703186035155}}set_robot_commands_max 0.07870048522949219 set_robot_commands_mean 0.07656929650927047 set_robot_commands_median 0.07684743404388428 set_robot_commands_min 0.07400949539676789 sim_compute_performance-ego_max 0.06277231216430663 sim_compute_performance-ego_mean 0.061258333101377384 sim_compute_performance-ego_median 0.06064668985513541 sim_compute_performance-ego_min 0.06014895439147949 sim_compute_robot_state-ego_max 0.06405409482809213 sim_compute_robot_state-ego_mean 0.06270308644971878 sim_compute_robot_state-ego_median 0.06273445006339781 sim_compute_robot_state-ego_min 0.06137678146362305 sim_compute_robot_state-npc0_max 0.0681296443939209 sim_compute_robot_state-npc0_mean 0.06574151700610431 sim_compute_robot_state-npc0_median 0.06562955562884991 sim_compute_robot_state-npc0_min 0.06440121127713111 sim_compute_robot_state-npc1_max 0.0647162914276123 sim_compute_robot_state-npc1_mean 0.06312205965237515 sim_compute_robot_state-npc1_median 0.06337139239678016 sim_compute_robot_state-npc1_min 0.060471234783049554 sim_compute_robot_state-npc2_max 0.0631101131439209 sim_compute_robot_state-npc2_mean 0.06078406121400348 sim_compute_robot_state-npc2_median 0.06058218649455479 sim_compute_robot_state-npc2_min 0.05954065630512853 sim_compute_robot_state-npc3_max 0.06552574267754188 sim_compute_robot_state-npc3_mean 0.06180815522022511 sim_compute_robot_state-npc3_median 0.06117244277681623 sim_compute_robot_state-npc3_min 0.05880754993807885 sim_compute_sim_state_max 0.03718918800354004 sim_compute_sim_state_mean 0.0353572879089442 sim_compute_sim_state_median 0.03514761584145682 sim_compute_sim_state_min 0.03321899817540096 sim_physics_max 0.034824600586524375 sim_physics_mean 0.032070096704394466 sim_physics_median 0.03246504260647681 sim_physics_min 0.028391132354736327 sim_render-ego_max 0.0637430319419274 sim_render-ego_mean 0.060681720941043925 sim_render-ego_median 0.06040010144633631 sim_render-ego_min 0.05852032559258597 simulation-passed 1 survival_time_max 1.5500000000000007 survival_time_mean 1.3600000000000003 survival_time_min 1.2500000000000004
No reset possible 19090
2916
Claudio Ruch Python template aido2-AMOD-efficiency
step1-simulation aborted no idsc-rudolf-9560
2019-04-23 14:21:17+00:00 2019-04-23 14:21:17+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19088
2917
Claudio Ruch Python template aido2-AMOD-service_quality
step1-simulation aborted no idsc-rudolf-9560
2019-04-23 14:20:57+00:00 2019-04-23 14:20:58+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19064
2914
Claudio Ruch Python template aido2-AMOD-efficiency
step1-simulation host-error no idsc-rudolf-9560
2019-04-23 14:01:54+00:00 2019-04-23 14:01:54+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19063
2915
Claudio Ruch Python template aido2-AMOD-service_quality
step1-simulation host-error no idsc-rudolf-9560
2019-04-23 14:01:40+00:00 2019-04-23 14:01:40+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19041
2907
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-9560
2019-04-23 08:45:55+00:00 2019-04-23 09:07:01+00:00 0:21:06 Waited 1200 seconds [...] Waited 1200 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19031
2903
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-9560
2019-04-23 08:19:13+00:00 2019-04-23 08:40:24+00:00 0:21:11 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19009
2891
Diego Charrez 🇵🇪Python template aido2-AMOD-efficiency
step1-simulation host-error no idsc-rudolf-9560
2019-04-22 17:29:38+00:00 2019-04-22 17:29:38+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19005
2892
Diego Charrez 🇵🇪Python template aido2-AMOD-service_quality
step1-simulation host-error no idsc-rudolf-9560
2019-04-22 17:29:19+00:00 2019-04-22 17:29:19+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18983
2890
Diego Charrez 🇵🇪Python template aido2-AMOD-service_quality
step1-simulation host-error no idsc-rudolf-9560
2019-04-22 17:27:33+00:00 2019-04-22 17:27:33+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18982
2889
Diego Charrez 🇵🇪Python template aido2-AMOD-efficiency
step1-simulation host-error no idsc-rudolf-9560
2019-04-22 17:27:20+00:00 2019-04-22 17:27:20+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18977
2889
Diego Charrez 🇵🇪Python template aido2-AMOD-efficiency
step1-simulation aborted no idsc-rudolf-9560
2019-04-22 17:08:53+00:00 2019-04-22 17:08:56+00:00 0:00:03 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18976
2889
Diego Charrez 🇵🇪Python template aido2-AMOD-efficiency
step1-simulation aborted no idsc-rudolf-9560
2019-04-22 17:06:02+00:00 2019-04-22 17:06:29+00:00 0:00:27 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18972
2889
Diego Charrez 🇵🇪Python template aido2-AMOD-efficiency
step1-simulation aborted no idsc-rudolf-9560
2019-04-22 16:59:07+00:00 2019-04-22 17:01:42+00:00 0:02:35 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18969
2890
Diego Charrez 🇵🇪Python template aido2-AMOD-service_quality
step1-simulation aborted no idsc-rudolf-9560
2019-04-22 16:56:55+00:00 2019-04-22 16:56:55+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18933
2877
Andrea Daniele 🇮🇹minimal_agent (Python 3) aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-9560
2019-04-21 01:53:06+00:00 2019-04-21 02:08:18+00:00 0:15:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.225306900765771 survival_time_median 10.750000000000018 deviation-center-line_median 0.40864173779456053 in-drivable-lane_median 1.7000000000000242
other stats agent_compute-ego_max 0.1553019771661459 agent_compute-ego_mean 0.1522871327134929 agent_compute-ego_median 0.15303011162336483 agent_compute-ego_min 0.1487415576422656 deviation-center-line_max 0.6491801892887803 deviation-center-line_mean 0.3683230725655418 deviation-center-line_min 0.1475671628461062 deviation-heading_max 2.2060076411946548 deviation-heading_mean 1.4163758252990906 deviation-heading_median 1.5250264276913703 deviation-heading_min 0.6970592634293067 driven_any_max 1.6057043265958648 driven_any_mean 1.3484469345214642 driven_any_median 1.5756972277649912 driven_any_min 0.9900494571900692 driven_lanedir_consec_max 1.4904214722299334 driven_lanedir_consec_mean 1.0721437270256324 driven_lanedir_consec_min 0.6474115509746436 driven_lanedir_max 1.4904214722299334 driven_lanedir_mean 1.0721437270256324 driven_lanedir_median 1.225306900765771 driven_lanedir_min 0.6474115509746436 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.4300000000000082 in-drivable-lane_min 0.25000000000000355 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.016956157821545498, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.06850323231100179, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15118990527640144, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07797704497687251, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.04369469169232485, "sim_compute_performance-ego": 0.06827188224243604, "sim_compute_robot_state-ego": 0.06697689886573407}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.017733264143449546, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.07056141247714523, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15317211185928678, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07753892710609157, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.045230931609216395, "sim_compute_performance-ego": 0.06963044535504641, "sim_compute_robot_state-ego": 0.06926959796543539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.017274058987741512, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.07073965628585473, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.1553019771661459, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.0773118707631201, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.04413172375460911, "sim_compute_performance-ego": 0.06847063842910288, "sim_compute_robot_state-ego": 0.06801971726353392}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.01704337430554767, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.06926361793695494, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.15303011162336483, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.07893157005310059, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.04480573853781057, "sim_compute_performance-ego": 0.06811237335205078, "sim_compute_robot_state-ego": 0.06881538657254951}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.01714963052007887, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.06752782618557965, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.1487415576422656, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.07686309461240415, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.043922222322887845, "sim_compute_performance-ego": 0.06724305064589889, "sim_compute_robot_state-ego": 0.0688973312024717}}set_robot_commands_max 0.07893157005310059 set_robot_commands_mean 0.07772450150231777 set_robot_commands_median 0.07753892710609157 set_robot_commands_min 0.07686309461240415 sim_compute_performance-ego_max 0.06963044535504641 sim_compute_performance-ego_mean 0.06834567800490701 sim_compute_performance-ego_median 0.06827188224243604 sim_compute_performance-ego_min 0.06724305064589889 sim_compute_robot_state-ego_max 0.06926959796543539 sim_compute_robot_state-ego_mean 0.06839578637394492 sim_compute_robot_state-ego_median 0.06881538657254951 sim_compute_robot_state-ego_min 0.06697689886573407 sim_compute_sim_state_max 0.045230931609216395 sim_compute_sim_state_mean 0.04435706158336975 sim_compute_sim_state_median 0.04413172375460911 sim_compute_sim_state_min 0.04369469169232485 sim_physics_max 0.017733264143449546 sim_physics_mean 0.017231297155672617 sim_physics_median 0.01714963052007887 sim_physics_min 0.016956157821545498 sim_render-ego_max 0.07073965628585473 sim_render-ego_mean 0.06931914903930728 sim_render-ego_median 0.06926361793695494 sim_render-ego_min 0.06752782618557965 simulation-passed 1 survival_time_max 11.150000000000023 survival_time_mean 9.300000000000004 survival_time_min 6.849999999999984
No reset possible 18930
2871
Peter Almasi 🇭🇺Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-9560
2019-04-20 17:15:06+00:00 2019-04-20 17:21:44+00:00 0:06:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7818595530775636 survival_time_median 2.3999999999999995 deviation-center-line_median 0.05477019665148306 in-drivable-lane_median 0.6999999999999991
other stats agent_compute-ego_max 0.1835041168408516 agent_compute-ego_mean 0.1776204226967709 agent_compute-ego_median 0.1796757393195981 agent_compute-ego_min 0.17165122353113615 deviation-center-line_max 0.18216209978951656 deviation-center-line_mean 0.10011615593181442 deviation-center-line_min 0.03755859071755083 deviation-heading_max 1.436729282105208 deviation-heading_mean 0.5980113330451529 deviation-heading_median 0.5234815026970941 deviation-heading_min 0.1839215741515293 driven_any_max 2.4295522418543007 driven_any_mean 1.413325455749734 driven_any_median 1.137655986662778 driven_any_min 0.8584365506054418 driven_lanedir_consec_max 1.5058707151667556 driven_lanedir_consec_mean 0.9397893721182252 driven_lanedir_consec_min 0.37727616016542065 driven_lanedir_max 1.7174987384633815 driven_lanedir_mean 0.9884061899166752 driven_lanedir_median 0.7818595530775636 driven_lanedir_min 0.37727616016542065 in-drivable-lane_max 1.0499999999999965 in-drivable-lane_mean 0.679999999999999 in-drivable-lane_min 0.2499999999999991 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.137655986662778, "sim_physics": 0.016470864415168762, "survival_time": 2.3999999999999995, "driven_lanedir": 0.6899675327353663, "sim_render-ego": 0.064009095231692, "in-drivable-lane": 0.6999999999999991, "agent_compute-ego": 0.18042359252770743, "deviation-heading": 0.5234815026970941, "set_robot_commands": 0.0753908356030782, "deviation-center-line": 0.04855382277826571, "driven_lanedir_consec": 0.6585114670397423, "sim_compute_sim_state": 0.04270936052004496, "sim_compute_performance-ego": 0.06425277392069499, "sim_compute_robot_state-ego": 0.06530348459879558}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0245341668356458, "sim_physics": 0.016336242357889812, "survival_time": 2.1000000000000005, "driven_lanedir": 0.7818595530775636, "sim_render-ego": 0.06448884237380255, "in-drivable-lane": 0.44999999999999973, "agent_compute-ego": 0.17284744126456125, "deviation-heading": 0.1839215741515293, "set_robot_commands": 0.07891757147652763, "deviation-center-line": 0.03755859071755083, "driven_lanedir_consec": 0.7818595530775636, "sim_compute_sim_state": 0.04335409686678931, "sim_compute_performance-ego": 0.06472064767565046, "sim_compute_robot_state-ego": 0.06639347757611956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.616448332790504, "sim_physics": 0.018168441584852875, "survival_time": 3.049999999999997, "driven_lanedir": 1.3754289651416445, "sim_render-ego": 0.06531209632998607, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.1796757393195981, "deviation-heading": 0.6320132901052304, "set_robot_commands": 0.08031917400047427, "deviation-center-line": 0.17753606972225594, "driven_lanedir_consec": 1.3754289651416445, "sim_compute_sim_state": 0.04487337440740867, "sim_compute_performance-ego": 0.06769394483722624, "sim_compute_robot_state-ego": 0.06823433422651447}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4295522418543007, "sim_physics": 0.017785166318599995, "survival_time": 5.1999999999999895, "driven_lanedir": 1.7174987384633815, "sim_render-ego": 0.0637474128833184, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17165122353113615, "deviation-heading": 1.436729282105208, "set_robot_commands": 0.07725564333108756, "deviation-center-line": 0.18216209978951656, "driven_lanedir_consec": 1.5058707151667556, "sim_compute_sim_state": 0.04402235379585853, "sim_compute_performance-ego": 0.0640224562241481, "sim_compute_robot_state-ego": 0.06611225238213173}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8584365506054418, "sim_physics": 0.016926031846266527, "survival_time": 1.950000000000001, "driven_lanedir": 0.37727616016542065, "sim_render-ego": 0.06512330739926069, "in-drivable-lane": 0.9500000000000008, "agent_compute-ego": 0.1835041168408516, "deviation-heading": 0.21391101616670205, "set_robot_commands": 0.08513269057640663, "deviation-center-line": 0.05477019665148306, "driven_lanedir_consec": 0.37727616016542065, "sim_compute_sim_state": 0.045707445878248945, "sim_compute_performance-ego": 0.06671172533279811, "sim_compute_robot_state-ego": 0.06851421258388421}}set_robot_commands_max 0.08513269057640663 set_robot_commands_mean 0.07940318299751485 set_robot_commands_median 0.07891757147652763 set_robot_commands_min 0.0753908356030782 sim_compute_performance-ego_max 0.06769394483722624 sim_compute_performance-ego_mean 0.06548030959810358 sim_compute_performance-ego_median 0.06472064767565046 sim_compute_performance-ego_min 0.0640224562241481 sim_compute_robot_state-ego_max 0.06851421258388421 sim_compute_robot_state-ego_mean 0.0669115522734891 sim_compute_robot_state-ego_median 0.06639347757611956 sim_compute_robot_state-ego_min 0.06530348459879558 sim_compute_sim_state_max 0.045707445878248945 sim_compute_sim_state_mean 0.04413332629367008 sim_compute_sim_state_median 0.04402235379585853 sim_compute_sim_state_min 0.04270936052004496 sim_physics_max 0.018168441584852875 sim_physics_mean 0.017137349304555592 sim_physics_median 0.016926031846266527 sim_physics_min 0.016336242357889812 sim_render-ego_max 0.06531209632998607 sim_render-ego_mean 0.06453615084361194 sim_render-ego_median 0.06448884237380255 sim_render-ego_min 0.0637474128833184 simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 2.9399999999999973 survival_time_min 1.950000000000001
No reset possible 18927
2362
Andrea Censi 🇨🇭random_agent aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 15:47:31+00:00 2019-04-20 15:53:19+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.14006199205622957 agent_compute-ego_mean 0.13542655626338732 agent_compute-ego_median 0.1353160752190484 agent_compute-ego_min 0.13177581103342884 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01714697423970924, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0672340932882057, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13177581103342884, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07782833531217755, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.041972128850109175, "sim_compute_performance-ego": 0.06585045580594044, "sim_compute_robot_state-ego": 0.06467843505571473}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01681418852372603, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06899551911787553, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1346296342936429, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07780558954585683, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.041655930605801667, "sim_compute_performance-ego": 0.06792104786092584, "sim_compute_robot_state-ego": 0.0660496245731007}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016089434093899197, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0682701375749376, "in-drivable-lane": 0, "agent_compute-ego": 0.1353160752190484, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07742909855312771, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04190480444166395, "sim_compute_performance-ego": 0.06693691147698297, "sim_compute_robot_state-ego": 0.06527104377746581}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016620213786760967, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.07083448270956676, "in-drivable-lane": 0, "agent_compute-ego": 0.13534926871458688, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07721162339051564, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04268089930216471, "sim_compute_performance-ego": 0.07002131640911102, "sim_compute_robot_state-ego": 0.0660781313975652}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01731406941133387, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07121878161149867, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14006199205622957, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07982104315477259, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04173452012679156, "sim_compute_performance-ego": 0.0682839365566478, "sim_compute_robot_state-ego": 0.06474509309319888}}set_robot_commands_max 0.07982104315477259 set_robot_commands_mean 0.07801913799129005 set_robot_commands_median 0.07780558954585683 set_robot_commands_min 0.07721162339051564 sim_compute_performance-ego_max 0.07002131640911102 sim_compute_performance-ego_mean 0.06780273362192162 sim_compute_performance-ego_median 0.06792104786092584 sim_compute_performance-ego_min 0.06585045580594044 sim_compute_robot_state-ego_max 0.0660781313975652 sim_compute_robot_state-ego_mean 0.06536446557940906 sim_compute_robot_state-ego_median 0.06527104377746581 sim_compute_robot_state-ego_min 0.06467843505571473 sim_compute_sim_state_max 0.04268089930216471 sim_compute_sim_state_mean 0.041989656665306206 sim_compute_sim_state_median 0.04190480444166395 sim_compute_sim_state_min 0.041655930605801667 sim_physics_max 0.01731406941133387 sim_physics_mean 0.016796976011085863 sim_physics_median 0.01681418852372603 sim_physics_min 0.016089434093899197 sim_render-ego_max 0.07121878161149867 sim_render-ego_mean 0.06931060286041686 sim_render-ego_median 0.06899551911787553 sim_render-ego_min 0.0672340932882057 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18914
2413
jiang peng Baseline solution using reinforcement learning aido2-LFVI-sim-validation
step1-simulation error no idsc-rudolf-9560
2019-04-20 15:26:23+00:00 2019-04-20 15:47:24+00:00 0:21:01 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18907
2384
Andrea Censi 🇨🇭Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-9560
2019-04-20 15:21:34+00:00 2019-04-20 15:26:15+00:00 0:04:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.09168411810457444 survival_time_median 1.4000000000000006 deviation-center-line_median 0.03738462622611095 in-drivable-lane_median 0.2500000000000002
other stats agent_compute-ego_max 0.2618074246815273 agent_compute-ego_mean 0.23965671825809637 agent_compute-ego_median 0.22907150643212457 agent_compute-ego_min 0.2245689971106393 deviation-center-line_max 0.04543008975077391 deviation-center-line_mean 0.03683944555026227 deviation-center-line_min 0.0257094706357947 deviation-heading_max 0.6842052506949267 deviation-heading_mean 0.6448628777701277 deviation-heading_median 0.6406996668380651 deviation-heading_min 0.6137629919574086 driven_any_max 0.208993278749454 driven_any_mean 0.16892466870312145 driven_any_median 0.16210268435820271 driven_any_min 0.14946320112132128 driven_lanedir_consec_max 0.11287440353545895 driven_lanedir_consec_mean 0.08678324154576308 driven_lanedir_consec_min 0.04966684745878158 driven_lanedir_max 0.11287440353545895 driven_lanedir_mean 0.08678324154576308 driven_lanedir_median 0.09168411810457444 driven_lanedir_min 0.04966684745878158 in-drivable-lane_max 0.4500000000000004 in-drivable-lane_mean 0.29000000000000026 in-drivable-lane_min 0.15000000000000013 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16210268435820271, "sim_physics": 0.017290805067334856, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09168411810457444, "sim_render-ego": 0.06107690504619053, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.2618074246815273, "deviation-heading": 0.6276650742372778, "set_robot_commands": 0.07684681245258876, "deviation-center-line": 0.03589796187071441, "driven_lanedir_consec": 0.09168411810457444, "sim_compute_sim_state": 0.040510518210274835, "sim_compute_performance-ego": 0.06327951805932182, "sim_compute_robot_state-ego": 0.06334137916564941}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14946320112132128, "sim_physics": 0.015819509824117024, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04966684745878158, "sim_render-ego": 0.06079301834106445, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.22870473861694335, "deviation-heading": 0.6137629919574086, "set_robot_commands": 0.08008301258087158, "deviation-center-line": 0.0257094706357947, "driven_lanedir_consec": 0.04966684745878158, "sim_compute_sim_state": 0.036480498313903806, "sim_compute_performance-ego": 0.060522905985514325, "sim_compute_robot_state-ego": 0.05921659469604492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15679024614579956, "sim_physics": 0.015977433749607632, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08129691342031897, "sim_render-ego": 0.05663019418716431, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.2245689971106393, "deviation-heading": 0.6406996668380651, "set_robot_commands": 0.07622144903455462, "deviation-center-line": 0.03738462622611095, "driven_lanedir_consec": 0.08129691342031897, "sim_compute_sim_state": 0.03723009995051792, "sim_compute_performance-ego": 0.059169811861855645, "sim_compute_robot_state-ego": 0.058279948575156074}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.208993278749454, "sim_physics": 0.015404883553000057, "survival_time": 1.7000000000000008, "driven_lanedir": 0.11287440353545895, "sim_render-ego": 0.059829782037174, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.25413092444924745, "deviation-heading": 0.6842052506949267, "set_robot_commands": 0.07447428563061882, "deviation-center-line": 0.04543008975077391, "driven_lanedir_consec": 0.11287440353545895, "sim_compute_sim_state": 0.037393289453843064, "sim_compute_performance-ego": 0.0597079641678754, "sim_compute_robot_state-ego": 0.06173517423517564}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1672739331408297, "sim_physics": 0.016069786889212474, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09839392520968147, "sim_render-ego": 0.06096327304840088, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.22907150643212457, "deviation-heading": 0.6579814051229604, "set_robot_commands": 0.08315916572298322, "deviation-center-line": 0.0397750792679174, "driven_lanedir_consec": 0.09839392520968147, "sim_compute_sim_state": 0.03885937588555472, "sim_compute_performance-ego": 0.06160180057798113, "sim_compute_robot_state-ego": 0.05986851453781128}}set_robot_commands_max 0.08315916572298322 set_robot_commands_mean 0.07815694508432339 set_robot_commands_median 0.07684681245258876 set_robot_commands_min 0.07447428563061882 sim_compute_performance-ego_max 0.06327951805932182 sim_compute_performance-ego_mean 0.06085640013050967 sim_compute_performance-ego_median 0.060522905985514325 sim_compute_performance-ego_min 0.059169811861855645 sim_compute_robot_state-ego_max 0.06334137916564941 sim_compute_robot_state-ego_mean 0.06048832224196747 sim_compute_robot_state-ego_median 0.05986851453781128 sim_compute_robot_state-ego_min 0.058279948575156074 sim_compute_sim_state_max 0.040510518210274835 sim_compute_sim_state_mean 0.03809475636281887 sim_compute_sim_state_median 0.037393289453843064 sim_compute_sim_state_min 0.036480498313903806 sim_physics_max 0.017290805067334856 sim_physics_mean 0.016112483816654408 sim_physics_median 0.015977433749607632 sim_physics_min 0.015404883553000057 sim_render-ego_max 0.06107690504619053 sim_render-ego_mean 0.059858634531998835 sim_render-ego_median 0.06079301834106445 sim_render-ego_min 0.05663019418716431 simulation-passed 1 survival_time_max 1.7000000000000008 survival_time_mean 1.4800000000000006 survival_time_min 1.4000000000000006
No reset possible 18899
2395
Liam Paull 🇨🇦random_agent aido2-LFV-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 15:11:45+00:00 2019-04-20 15:21:17+00:00 0:09:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.13430878851148817 agent_compute-ego_mean 0.12959764445755123 agent_compute-ego_median 0.13147126544605603 agent_compute-ego_min 0.12523723098466982 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.024960355938605544, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06457016153155633, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12523723098466982, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07912447317591254, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03656102126499392, "sim_compute_performance-ego": 0.062358856201171875, "sim_compute_robot_state-ego": 0.06244058878916615, "sim_compute_robot_state-npc0": 0.07142569433968023, "sim_compute_robot_state-npc1": 0.06678067963078337, "sim_compute_robot_state-npc2": 0.0659020037021277, "sim_compute_robot_state-npc3": 0.06485999305293245}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.02810780026695945, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0642886378548362, "in-drivable-lane": 0, "agent_compute-ego": 0.13147126544605603, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07980390028520064, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03521115129644221, "sim_compute_performance-ego": 0.06637482751499522, "sim_compute_robot_state-ego": 0.06383631446144798, "sim_compute_robot_state-npc0": 0.07111905921589244, "sim_compute_robot_state-npc1": 0.06630967963825572, "sim_compute_robot_state-npc2": 0.06480656970630992, "sim_compute_robot_state-npc3": 0.06382526592774825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02807234658135308, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06572010252210829, "in-drivable-lane": 0, "agent_compute-ego": 0.13430878851148817, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08026097085740831, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03750994470384386, "sim_compute_performance-ego": 0.0645588927798801, "sim_compute_robot_state-ego": 0.06484191152784559, "sim_compute_robot_state-npc0": 0.07288278473748101, "sim_compute_robot_state-npc1": 0.06667973730299208, "sim_compute_robot_state-npc2": 0.06544089847140842, "sim_compute_robot_state-npc3": 0.06573102209303114}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.028977001706759136, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0647961397965749, "in-drivable-lane": 0, "agent_compute-ego": 0.12526561816533408, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07926993072032928, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03757149477799734, "sim_compute_performance-ego": 0.0674847960472107, "sim_compute_robot_state-ego": 0.06647037466367085, "sim_compute_robot_state-npc0": 0.07152558366457622, "sim_compute_robot_state-npc1": 0.06688213845094045, "sim_compute_robot_state-npc2": 0.06384679178396861, "sim_compute_robot_state-npc3": 0.06632199883460999}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.026631846147425035, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06909712272531846, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13170531918020809, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07765864975312177, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03617634142146391, "sim_compute_performance-ego": 0.06622515706455007, "sim_compute_robot_state-ego": 0.06496456791372861, "sim_compute_robot_state-npc0": 0.07266260946498197, "sim_compute_robot_state-npc1": 0.06667928485309377, "sim_compute_robot_state-npc2": 0.06639156622045181, "sim_compute_robot_state-npc3": 0.06670290932935827}}set_robot_commands_max 0.08026097085740831 set_robot_commands_mean 0.0792235849583945 set_robot_commands_median 0.07926993072032928 set_robot_commands_min 0.07765864975312177 sim_compute_performance-ego_max 0.0674847960472107 sim_compute_performance-ego_mean 0.06540050592156159 sim_compute_performance-ego_median 0.06622515706455007 sim_compute_performance-ego_min 0.062358856201171875 sim_compute_robot_state-ego_max 0.06647037466367085 sim_compute_robot_state-ego_mean 0.06451075147117183 sim_compute_robot_state-ego_median 0.06484191152784559 sim_compute_robot_state-ego_min 0.06244058878916615 sim_compute_robot_state-npc0_max 0.07288278473748101 sim_compute_robot_state-npc0_mean 0.07192314628452237 sim_compute_robot_state-npc0_median 0.07152558366457622 sim_compute_robot_state-npc0_min 0.07111905921589244 sim_compute_robot_state-npc1_max 0.06688213845094045 sim_compute_robot_state-npc1_mean 0.06666630397521307 sim_compute_robot_state-npc1_median 0.06667973730299208 sim_compute_robot_state-npc1_min 0.06630967963825572 sim_compute_robot_state-npc2_max 0.06639156622045181 sim_compute_robot_state-npc2_mean 0.0652775659768533 sim_compute_robot_state-npc2_median 0.06544089847140842 sim_compute_robot_state-npc2_min 0.06384679178396861 sim_compute_robot_state-npc3_max 0.06670290932935827 sim_compute_robot_state-npc3_mean 0.06548823784753602 sim_compute_robot_state-npc3_median 0.06573102209303114 sim_compute_robot_state-npc3_min 0.06382526592774825 sim_compute_sim_state_max 0.03757149477799734 sim_compute_sim_state_mean 0.036605990692948245 sim_compute_sim_state_median 0.03656102126499392 sim_compute_sim_state_min 0.03521115129644221 sim_physics_max 0.028977001706759136 sim_physics_mean 0.02734987012822045 sim_physics_median 0.02807234658135308 sim_physics_min 0.024960355938605544 sim_render-ego_max 0.06909712272531846 sim_render-ego_mean 0.06569443288607883 sim_render-ego_median 0.0647961397965749 sim_render-ego_min 0.0642886378548362 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18881
2408
jiang peng Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-9560
2019-04-20 14:50:07+00:00 2019-04-20 15:11:20+00:00 0:21:13 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18867
2420
Andrea Censi 🇨🇭random_agent aido2-LFV-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 14:40:15+00:00 2019-04-20 14:49:28+00:00 0:09:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.13184779385725656 agent_compute-ego_mean 0.1295863025085393 agent_compute-ego_median 0.12922024726867676 agent_compute-ego_min 0.12704808976915147 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025935074068465323, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0656555508667568, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12890754105909816, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07395164921598614, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03764159274551104, "sim_compute_performance-ego": 0.06387801440256946, "sim_compute_robot_state-ego": 0.061790502296303805, "sim_compute_robot_state-npc0": 0.07013612423302992, "sim_compute_robot_state-npc1": 0.06587448210086462, "sim_compute_robot_state-npc2": 0.06623512394023391, "sim_compute_robot_state-npc3": 0.06655908530613161}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.027893223545768044, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06255456534298984, "in-drivable-lane": 0, "agent_compute-ego": 0.12922024726867676, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08085924928838556, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03427381948991255, "sim_compute_performance-ego": 0.06337959658015858, "sim_compute_robot_state-ego": 0.06015851822766391, "sim_compute_robot_state-npc0": 0.06945013458078558, "sim_compute_robot_state-npc1": 0.06470473246140913, "sim_compute_robot_state-npc2": 0.06300111792304298, "sim_compute_robot_state-npc3": 0.06473049792376431}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02517496214972602, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06166612307230632, "in-drivable-lane": 0, "agent_compute-ego": 0.12704808976915147, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07503305011325412, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03370631006028917, "sim_compute_performance-ego": 0.059746408462524415, "sim_compute_robot_state-ego": 0.05867693689134386, "sim_compute_robot_state-npc0": 0.06708441310458713, "sim_compute_robot_state-npc1": 0.05993762016296387, "sim_compute_robot_state-npc2": 0.05955550405714247, "sim_compute_robot_state-npc3": 0.06000061564975315}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.027841617663701378, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06270660956700642, "in-drivable-lane": 0, "agent_compute-ego": 0.13184779385725656, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07721113165219624, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.0363818754752477, "sim_compute_performance-ego": 0.06453285117944081, "sim_compute_robot_state-ego": 0.06242880721886953, "sim_compute_robot_state-npc0": 0.07085236410299937, "sim_compute_robot_state-npc1": 0.06866460541884105, "sim_compute_robot_state-npc2": 0.06266037126382192, "sim_compute_robot_state-npc3": 0.06429083148638408}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02723953653784359, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06440036437090706, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13090784058851354, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07838651011971866, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03769037653418148, "sim_compute_performance-ego": 0.06114883633220897, "sim_compute_robot_state-ego": 0.059744982158436495, "sim_compute_robot_state-npc0": 0.07113056673723109, "sim_compute_robot_state-npc1": 0.06677743266610538, "sim_compute_robot_state-npc2": 0.06536927994559794, "sim_compute_robot_state-npc3": 0.06584140132455264}}set_robot_commands_max 0.08085924928838556 set_robot_commands_mean 0.07708831807790814 set_robot_commands_median 0.07721113165219624 set_robot_commands_min 0.07395164921598614 sim_compute_performance-ego_max 0.06453285117944081 sim_compute_performance-ego_mean 0.06253714139138045 sim_compute_performance-ego_median 0.06337959658015858 sim_compute_performance-ego_min 0.059746408462524415 sim_compute_robot_state-ego_max 0.06242880721886953 sim_compute_robot_state-ego_mean 0.060559949358523525 sim_compute_robot_state-ego_median 0.06015851822766391 sim_compute_robot_state-ego_min 0.05867693689134386 sim_compute_robot_state-npc0_max 0.07113056673723109 sim_compute_robot_state-npc0_mean 0.06973072055172662 sim_compute_robot_state-npc0_median 0.07013612423302992 sim_compute_robot_state-npc0_min 0.06708441310458713 sim_compute_robot_state-npc1_max 0.06866460541884105 sim_compute_robot_state-npc1_mean 0.06519177456203681 sim_compute_robot_state-npc1_median 0.06587448210086462 sim_compute_robot_state-npc1_min 0.05993762016296387 sim_compute_robot_state-npc2_max 0.06623512394023391 sim_compute_robot_state-npc2_mean 0.06336427942596784 sim_compute_robot_state-npc2_median 0.06300111792304298 sim_compute_robot_state-npc2_min 0.05955550405714247 sim_compute_robot_state-npc3_max 0.06655908530613161 sim_compute_robot_state-npc3_mean 0.06428448633811715 sim_compute_robot_state-npc3_median 0.06473049792376431 sim_compute_robot_state-npc3_min 0.06000061564975315 sim_compute_sim_state_max 0.03769037653418148 sim_compute_sim_state_mean 0.03593879486102839 sim_compute_sim_state_median 0.0363818754752477 sim_compute_sim_state_min 0.03370631006028917 sim_physics_max 0.027893223545768044 sim_physics_mean 0.02681688279310087 sim_physics_median 0.02723953653784359 sim_physics_min 0.02517496214972602 sim_render-ego_max 0.0656555508667568 sim_render-ego_mean 0.06339664264399329 sim_render-ego_median 0.06270660956700642 sim_render-ego_min 0.06166612307230632 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18860
2439
Jacopo Tani random_agent aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 14:34:21+00:00 2019-04-20 14:40:09+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.1477189752790663 agent_compute-ego_mean 0.1414069285968193 agent_compute-ego_median 0.1422685764052651 agent_compute-ego_min 0.13542036712169647 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01615164414891657, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.058773985448873266, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13834510659271815, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07633437750474462, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03480195999145508, "sim_compute_performance-ego": 0.059396995688384434, "sim_compute_robot_state-ego": 0.06233715111354612}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016406682404604824, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.061376869678497314, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1422685764052651, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07733388922431252, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03898599472912875, "sim_compute_performance-ego": 0.06283779035915028, "sim_compute_robot_state-ego": 0.06297606229782104}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016646697786119248, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06185140079922146, "in-drivable-lane": 0, "agent_compute-ego": 0.1477189752790663, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08192501597934299, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04092974132961697, "sim_compute_performance-ego": 0.06450129614935982, "sim_compute_robot_state-ego": 0.06474089622497559}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015330066283543903, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.056953608989715576, "in-drivable-lane": 0, "agent_compute-ego": 0.13542036712169647, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0745796263217926, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.037009100119272866, "sim_compute_performance-ego": 0.06342651446660359, "sim_compute_robot_state-ego": 0.061145653327306114}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.017333896721110624, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06269154829137466, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1432816175853505, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08003934691934024, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.037977260701796585, "sim_compute_performance-ego": 0.06250086952658261, "sim_compute_robot_state-ego": 0.06307263584697947}}set_robot_commands_max 0.08192501597934299 set_robot_commands_mean 0.07804245118990659 set_robot_commands_median 0.07733388922431252 set_robot_commands_min 0.0745796263217926 sim_compute_performance-ego_max 0.06450129614935982 sim_compute_performance-ego_mean 0.06253269323801615 sim_compute_performance-ego_median 0.06283779035915028 sim_compute_performance-ego_min 0.059396995688384434 sim_compute_robot_state-ego_max 0.06474089622497559 sim_compute_robot_state-ego_mean 0.06285447976212567 sim_compute_robot_state-ego_median 0.06297606229782104 sim_compute_robot_state-ego_min 0.061145653327306114 sim_compute_sim_state_max 0.04092974132961697 sim_compute_sim_state_mean 0.03794081137425405 sim_compute_sim_state_median 0.037977260701796585 sim_compute_sim_state_min 0.03480195999145508 sim_physics_max 0.017333896721110624 sim_physics_mean 0.016373797468859037 sim_physics_median 0.016406682404604824 sim_physics_min 0.015330066283543903 sim_render-ego_max 0.06269154829137466 sim_render-ego_mean 0.06032948264153646 sim_render-ego_median 0.061376869678497314 sim_render-ego_min 0.056953608989715576 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18855
2443
Jacopo Tani random_agent aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 14:22:10+00:00 2019-04-20 14:33:58+00:00 0:11:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.1489038582771055 agent_compute-ego_mean 0.14487740152312775 agent_compute-ego_median 0.1450577086590706 agent_compute-ego_min 0.13920152888578527 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.032953954878307525, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06511223126971533, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14625017983572824, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08114270179990739, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.0346370538075765, "sim_compute_performance-ego": 0.0647773023635622, "sim_compute_robot_state-ego": 0.06389324248783172, "sim_compute_robot_state-npc0": 0.07462559427533831, "sim_compute_robot_state-npc1": 0.06657564072381883, "sim_compute_robot_state-npc2": 0.06547195192367311, "sim_compute_robot_state-npc3": 0.06499860400245303}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03145463326398064, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06255251286076564, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13920152888578527, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08132564320283778, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03876484141630285, "sim_compute_performance-ego": 0.061894888971366135, "sim_compute_robot_state-ego": 0.06551865502899769, "sim_compute_robot_state-npc0": 0.07028649835025563, "sim_compute_robot_state-npc1": 0.06293754951626647, "sim_compute_robot_state-npc2": 0.0658273883894378, "sim_compute_robot_state-npc3": 0.06386436668096804}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03277116437112131, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06451187979790472, "in-drivable-lane": 0, "agent_compute-ego": 0.1489038582771055, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07858372888257427, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.037082306800350066, "sim_compute_performance-ego": 0.0626540107111777, "sim_compute_robot_state-ego": 0.06615976748927947, "sim_compute_robot_state-npc0": 0.07097456532139931, "sim_compute_robot_state-npc1": 0.06612048995110296, "sim_compute_robot_state-npc2": 0.06462519784127513, "sim_compute_robot_state-npc3": 0.0637176998199955}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.031129824354293498, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06507757876781707, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1450577086590706, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07885824365818754, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03520633819255423, "sim_compute_performance-ego": 0.06400692209284356, "sim_compute_robot_state-ego": 0.06217335893752727, "sim_compute_robot_state-npc0": 0.07074271110778159, "sim_compute_robot_state-npc1": 0.06521030689807648, "sim_compute_robot_state-npc2": 0.06385260439933614, "sim_compute_robot_state-npc3": 0.06391100173300886}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.029595512610215407, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.060408326295705944, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14497373195794913, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08016567046825702, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03697017522958609, "sim_compute_performance-ego": 0.06287254278476422, "sim_compute_robot_state-ego": 0.06248000951913687, "sim_compute_robot_state-npc0": 0.07053176714823796, "sim_compute_robot_state-npc1": 0.06429906991811898, "sim_compute_robot_state-npc2": 0.06286816413585956, "sim_compute_robot_state-npc3": 0.06363992049143864}}set_robot_commands_max 0.08132564320283778 set_robot_commands_mean 0.08001519760235279 set_robot_commands_median 0.08016567046825702 set_robot_commands_min 0.07858372888257427 sim_compute_performance-ego_max 0.0647773023635622 sim_compute_performance-ego_mean 0.06324113338474277 sim_compute_performance-ego_median 0.06287254278476422 sim_compute_performance-ego_min 0.061894888971366135 sim_compute_robot_state-ego_max 0.06615976748927947 sim_compute_robot_state-ego_mean 0.06404500669255461 sim_compute_robot_state-ego_median 0.06389324248783172 sim_compute_robot_state-ego_min 0.06217335893752727 sim_compute_robot_state-npc0_max 0.07462559427533831 sim_compute_robot_state-npc0_mean 0.07143222724060257 sim_compute_robot_state-npc0_median 0.07074271110778159 sim_compute_robot_state-npc0_min 0.07028649835025563 sim_compute_robot_state-npc1_max 0.06657564072381883 sim_compute_robot_state-npc1_mean 0.06502861140147675 sim_compute_robot_state-npc1_median 0.06521030689807648 sim_compute_robot_state-npc1_min 0.06293754951626647 sim_compute_robot_state-npc2_max 0.0658273883894378 sim_compute_robot_state-npc2_mean 0.06452906133791635 sim_compute_robot_state-npc2_median 0.06462519784127513 sim_compute_robot_state-npc2_min 0.06286816413585956 sim_compute_robot_state-npc3_max 0.06499860400245303 sim_compute_robot_state-npc3_mean 0.06402631854557281 sim_compute_robot_state-npc3_median 0.06386436668096804 sim_compute_robot_state-npc3_min 0.06363992049143864 sim_compute_sim_state_max 0.03876484141630285 sim_compute_sim_state_mean 0.03653214308927395 sim_compute_sim_state_median 0.03697017522958609 sim_compute_sim_state_min 0.0346370538075765 sim_physics_max 0.032953954878307525 sim_physics_mean 0.03158101789558368 sim_physics_median 0.03145463326398064 sim_physics_min 0.029595512610215407 sim_render-ego_max 0.06511223126971533 sim_render-ego_mean 0.06353250579838174 sim_render-ego_median 0.06451187979790472 sim_render-ego_min 0.060408326295705944 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18854
2870
Jieming Ji 🇨🇭PredictorLast aido2-PRED
step1-simulation success no idsc-rudolf-9560
2019-04-20 14:21:04+00:00 2019-04-20 14:21:56+00:00 0:00:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.12164876936953704 error_L2 0.022846773723256546
No reset possible 18832
2475
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 14:09:23+00:00 2019-04-20 14:20:57+00:00 0:11:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.14989055839239382 agent_compute-ego_mean 0.14662550110549075 agent_compute-ego_median 0.1464844510910359 agent_compute-ego_min 0.1421569585800171 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03385351953052339, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06477576967269655, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14529277029491605, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07841517054845416, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03578928160288977, "sim_compute_performance-ego": 0.06493617239452544, "sim_compute_robot_state-ego": 0.0649049963269915, "sim_compute_robot_state-npc0": 0.07041251848614405, "sim_compute_robot_state-npc1": 0.06359342923240056, "sim_compute_robot_state-npc2": 0.06511240913754418, "sim_compute_robot_state-npc3": 0.06481907102796766}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.0306551783692603, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.07003104452993356, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.14989055839239382, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0787816047668457, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03930169460820217, "sim_compute_performance-ego": 0.06710269871880026, "sim_compute_robot_state-ego": 0.06619507191227932, "sim_compute_robot_state-npc0": 0.07092373978857901, "sim_compute_robot_state-npc1": 0.06497837047950894, "sim_compute_robot_state-npc2": 0.06542472745857987, "sim_compute_robot_state-npc3": 0.0646982333239387}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03210203109248992, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.0671311616897583, "in-drivable-lane": 0, "agent_compute-ego": 0.14930276716909102, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07945863662227508, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.036330922957389586, "sim_compute_performance-ego": 0.06379543965862643, "sim_compute_robot_state-ego": 0.06690226831743794, "sim_compute_robot_state-npc0": 0.07259240842634632, "sim_compute_robot_state-npc1": 0.06648009438668528, "sim_compute_robot_state-npc2": 0.06615486837202503, "sim_compute_robot_state-npc3": 0.06638853011592742}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0322667918306716, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06366338121130112, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1464844510910359, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07618858205511216, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03519853125227258, "sim_compute_performance-ego": 0.06328164770248089, "sim_compute_robot_state-ego": 0.06398504592002706, "sim_compute_robot_state-npc0": 0.07167275154844244, "sim_compute_robot_state-npc1": 0.06695339020262374, "sim_compute_robot_state-npc2": 0.06793799552511662, "sim_compute_robot_state-npc3": 0.06533007418855707}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027638728802020732, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05908803297923161, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1421569585800171, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08114955975459172, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.035278691695286676, "sim_compute_performance-ego": 0.06255892606881949, "sim_compute_robot_state-ego": 0.06150081065984873, "sim_compute_robot_state-npc0": 0.06572932921923123, "sim_compute_robot_state-npc1": 0.06297138562569252, "sim_compute_robot_state-npc2": 0.06259472095049344, "sim_compute_robot_state-npc3": 0.06113507197453426}}set_robot_commands_max 0.08114955975459172 set_robot_commands_mean 0.07879871074945576 set_robot_commands_median 0.0787816047668457 set_robot_commands_min 0.07618858205511216 sim_compute_performance-ego_max 0.06710269871880026 sim_compute_performance-ego_mean 0.0643349769086505 sim_compute_performance-ego_median 0.06379543965862643 sim_compute_performance-ego_min 0.06255892606881949 sim_compute_robot_state-ego_max 0.06690226831743794 sim_compute_robot_state-ego_mean 0.06469763862731691 sim_compute_robot_state-ego_median 0.0649049963269915 sim_compute_robot_state-ego_min 0.06150081065984873 sim_compute_robot_state-npc0_max 0.07259240842634632 sim_compute_robot_state-npc0_mean 0.07026614949374861 sim_compute_robot_state-npc0_median 0.07092373978857901 sim_compute_robot_state-npc0_min 0.06572932921923123 sim_compute_robot_state-npc1_max 0.06695339020262374 sim_compute_robot_state-npc1_mean 0.06499533398538222 sim_compute_robot_state-npc1_median 0.06497837047950894 sim_compute_robot_state-npc1_min 0.06297138562569252 sim_compute_robot_state-npc2_max 0.06793799552511662 sim_compute_robot_state-npc2_mean 0.06544494428875183 sim_compute_robot_state-npc2_median 0.06542472745857987 sim_compute_robot_state-npc2_min 0.06259472095049344 sim_compute_robot_state-npc3_max 0.06638853011592742 sim_compute_robot_state-npc3_mean 0.06447419612618502 sim_compute_robot_state-npc3_median 0.06481907102796766 sim_compute_robot_state-npc3_min 0.06113507197453426 sim_compute_sim_state_max 0.03930169460820217 sim_compute_sim_state_mean 0.03637982442320816 sim_compute_sim_state_median 0.03578928160288977 sim_compute_sim_state_min 0.03519853125227258 sim_physics_max 0.03385351953052339 sim_physics_mean 0.031303249924993184 sim_physics_median 0.03210203109248992 sim_physics_min 0.027638728802020732 sim_render-ego_max 0.07003104452993356 sim_render-ego_mean 0.06493787801658422 sim_render-ego_median 0.06477576967269655 sim_render-ego_min 0.05908803297923161 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18828
2484
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-9560
2019-04-20 14:08:00+00:00 2019-04-20 14:08:43+00:00 0:00:43 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18801
2543
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 14:01:26+00:00 2019-04-20 14:07:27+00:00 0:06:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.15923770035014434 agent_compute-ego_mean 0.14224011733309597 agent_compute-ego_median 0.14225865999857584 agent_compute-ego_min 0.1302955448627472 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01524405209523327, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05882408933819465, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14237359334837715, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07653590868104179, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03661096770808382, "sim_compute_performance-ego": 0.06235483007610969, "sim_compute_robot_state-ego": 0.0625408595463015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.015658140182495117, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05910911885174838, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13703508810563522, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07155447114597667, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.037184715270996094, "sim_compute_performance-ego": 0.05943116816607388, "sim_compute_robot_state-ego": 0.06317095864902843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015737417009141712, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0610980298784044, "in-drivable-lane": 0, "agent_compute-ego": 0.14225865999857584, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07718082533942329, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.041053862041897246, "sim_compute_performance-ego": 0.06242553393046061, "sim_compute_robot_state-ego": 0.0644660578833686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015757376948992412, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05934771398703257, "in-drivable-lane": 0, "agent_compute-ego": 0.1302955448627472, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07311089336872101, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03787030279636383, "sim_compute_performance-ego": 0.06018282473087311, "sim_compute_robot_state-ego": 0.0621131956577301}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01915827218224021, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06941197549595553, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.15923770035014434, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08188288352068733, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04509990355547737, "sim_compute_performance-ego": 0.0713669833014993, "sim_compute_robot_state-ego": 0.07191039534176097}}set_robot_commands_max 0.08188288352068733 set_robot_commands_mean 0.07605299641117001 set_robot_commands_median 0.07653590868104179 set_robot_commands_min 0.07155447114597667 sim_compute_performance-ego_max 0.0713669833014993 sim_compute_performance-ego_mean 0.06315226804100332 sim_compute_performance-ego_median 0.06235483007610969 sim_compute_performance-ego_min 0.05943116816607388 sim_compute_robot_state-ego_max 0.07191039534176097 sim_compute_robot_state-ego_mean 0.06484029341563792 sim_compute_robot_state-ego_median 0.06317095864902843 sim_compute_robot_state-ego_min 0.0621131956577301 sim_compute_sim_state_max 0.04509990355547737 sim_compute_sim_state_mean 0.03956395027456368 sim_compute_sim_state_median 0.03787030279636383 sim_compute_sim_state_min 0.03661096770808382 sim_physics_max 0.01915827218224021 sim_physics_mean 0.016311051683620542 sim_physics_median 0.015737417009141712 sim_physics_min 0.01524405209523327 sim_render-ego_max 0.06941197549595553 sim_render-ego_mean 0.06155818551026711 sim_render-ego_median 0.05934771398703257 sim_render-ego_min 0.05882408933819465 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18793
2537
Liam Paull 🇨🇦baseline-IL-sim-tensorflow aido2-LFVI-sim-validation
step1-simulation error no idsc-rudolf-9560
2019-04-20 13:58:38+00:00 2019-04-20 14:01:01+00:00 0:02:23 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18783
2544
Liam Paull 🇨🇦challenge-aido_LF-template-ros aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 13:52:24+00:00 2019-04-20 13:58:23+00:00 0:05:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06645475901090182 agent_compute-ego_mean 0.06494207800549531 agent_compute-ego_median 0.06617624508707147 agent_compute-ego_min 0.06244826607587861 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017945403006018663, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.062390469923252014, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06244826607587861, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07451305156800805, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.0404645059166885, "sim_compute_performance-ego": 0.06351428787882735, "sim_compute_robot_state-ego": 0.06412388638752263}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.016752041303194486, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.0609810444024893, "in-drivable-lane": 0, "agent_compute-ego": 0.06645475901090182, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.0768433534182035, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.040868557416475736, "sim_compute_performance-ego": 0.06183913120856652, "sim_compute_robot_state-ego": 0.06539658399728629}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.015706605099617167, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06335212321991616, "in-drivable-lane": 0, "agent_compute-ego": 0.06333911165278008, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07444318304670618, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.039118076892609294, "sim_compute_performance-ego": 0.06399755782269417, "sim_compute_robot_state-ego": 0.06494699133203384}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02042681568271511, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06828946857661991, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06629200820084456, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0753350284073379, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04118544714791434, "sim_compute_performance-ego": 0.0666883437188117, "sim_compute_robot_state-ego": 0.06633695927295057}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.015891269633644504, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06906625471617046, "in-drivable-lane": 0, "agent_compute-ego": 0.06617624508707147, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07450513463271291, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04092399697554739, "sim_compute_performance-ego": 0.06410559227592066, "sim_compute_robot_state-ego": 0.06435396169361315}}set_robot_commands_max 0.0768433534182035 set_robot_commands_mean 0.0751279502145937 set_robot_commands_median 0.07451305156800805 set_robot_commands_min 0.07444318304670618 sim_compute_performance-ego_max 0.0666883437188117 sim_compute_performance-ego_mean 0.06402898258096408 sim_compute_performance-ego_median 0.06399755782269417 sim_compute_performance-ego_min 0.06183913120856652 sim_compute_robot_state-ego_max 0.06633695927295057 sim_compute_robot_state-ego_mean 0.0650316765366813 sim_compute_robot_state-ego_median 0.06494699133203384 sim_compute_robot_state-ego_min 0.06412388638752263 sim_compute_sim_state_max 0.04118544714791434 sim_compute_sim_state_mean 0.04051211686984705 sim_compute_sim_state_median 0.040868557416475736 sim_compute_sim_state_min 0.039118076892609294 sim_physics_max 0.02042681568271511 sim_physics_mean 0.01734442694503799 sim_physics_median 0.016752041303194486 sim_physics_min 0.015706605099617167 sim_render-ego_max 0.06906625471617046 sim_render-ego_mean 0.06481587216768955 sim_render-ego_median 0.06335212321991616 sim_render-ego_min 0.0609810444024893 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18775
2568
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 13:40:32+00:00 2019-04-20 13:52:13+00:00 0:11:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.06808629035949706 agent_compute-ego_mean 0.06521023194403013 agent_compute-ego_median 0.06424808166396449 agent_compute-ego_min 0.062240660190582275 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.029908049734015212, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06183208666349712, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06808629035949706, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07818648940638492, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03497128988567152, "sim_compute_performance-ego": 0.06297629506964432, "sim_compute_robot_state-ego": 0.06196737038461785, "sim_compute_robot_state-npc0": 0.06948522266588714, "sim_compute_robot_state-npc1": 0.06296151813707854, "sim_compute_robot_state-npc2": 0.06237695091649106, "sim_compute_robot_state-npc3": 0.06336809459485505}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.027011105888768247, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.0577542781829834, "in-drivable-lane": 0, "agent_compute-ego": 0.06402517619885896, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07360477823960154, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03648939258173892, "sim_compute_performance-ego": 0.06175168564445094, "sim_compute_robot_state-ego": 0.06338679790496826, "sim_compute_robot_state-npc0": 0.06694941771657843, "sim_compute_robot_state-npc1": 0.06483575544859234, "sim_compute_robot_state-npc2": 0.06397429265474018, "sim_compute_robot_state-npc3": 0.06112549179478696}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.02959873126103328, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06453397335150303, "in-drivable-lane": 0, "agent_compute-ego": 0.06745095130724785, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07720526059468587, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.035938538037813626, "sim_compute_performance-ego": 0.062137689345922224, "sim_compute_robot_state-ego": 0.06280376972296299, "sim_compute_robot_state-npc0": 0.07086397440005572, "sim_compute_robot_state-npc1": 0.06693713481609638, "sim_compute_robot_state-npc2": 0.06474206997798039, "sim_compute_robot_state-npc3": 0.0644695330888797}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.030934330443261375, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.062357462627786985, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06424808166396449, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07529757728039378, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.035855397372178625, "sim_compute_performance-ego": 0.06021285392868687, "sim_compute_robot_state-ego": 0.06021162153969349, "sim_compute_robot_state-npc0": 0.06710186138958998, "sim_compute_robot_state-npc1": 0.06209653196200519, "sim_compute_robot_state-npc2": 0.06316591988147145, "sim_compute_robot_state-npc3": 0.061808109283447266}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02727939323945479, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06039654666727239, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.062240660190582275, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07708645950664174, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03441278500990434, "sim_compute_performance-ego": 0.06123727018182928, "sim_compute_robot_state-ego": 0.0642878684130582, "sim_compute_robot_state-npc0": 0.06490807099775835, "sim_compute_robot_state-npc1": 0.06461964412169023, "sim_compute_robot_state-npc2": 0.0657851750200445, "sim_compute_robot_state-npc3": 0.062322388995777474}}set_robot_commands_max 0.07818648940638492 set_robot_commands_mean 0.07627611300554157 set_robot_commands_median 0.07708645950664174 set_robot_commands_min 0.07360477823960154 sim_compute_performance-ego_max 0.06297629506964432 sim_compute_performance-ego_mean 0.06166315883410672 sim_compute_performance-ego_median 0.06175168564445094 sim_compute_performance-ego_min 0.06021285392868687 sim_compute_robot_state-ego_max 0.0642878684130582 sim_compute_robot_state-ego_mean 0.06253148559306015 sim_compute_robot_state-ego_median 0.06280376972296299 sim_compute_robot_state-ego_min 0.06021162153969349 sim_compute_robot_state-npc0_max 0.07086397440005572 sim_compute_robot_state-npc0_mean 0.06786170943397393 sim_compute_robot_state-npc0_median 0.06710186138958998 sim_compute_robot_state-npc0_min 0.06490807099775835 sim_compute_robot_state-npc1_max 0.06693713481609638 sim_compute_robot_state-npc1_mean 0.06429011689709255 sim_compute_robot_state-npc1_median 0.06461964412169023 sim_compute_robot_state-npc1_min 0.06209653196200519 sim_compute_robot_state-npc2_max 0.0657851750200445 sim_compute_robot_state-npc2_mean 0.06400888169014551 sim_compute_robot_state-npc2_median 0.06397429265474018 sim_compute_robot_state-npc2_min 0.06237695091649106 sim_compute_robot_state-npc3_max 0.0644695330888797 sim_compute_robot_state-npc3_mean 0.0626187235515493 sim_compute_robot_state-npc3_median 0.062322388995777474 sim_compute_robot_state-npc3_min 0.06112549179478696 sim_compute_sim_state_max 0.03648939258173892 sim_compute_sim_state_mean 0.035533480577461404 sim_compute_sim_state_median 0.035855397372178625 sim_compute_sim_state_min 0.03441278500990434 sim_physics_max 0.030934330443261375 sim_physics_mean 0.028946322113306576 sim_physics_median 0.02959873126103328 sim_physics_min 0.027011105888768247 sim_render-ego_max 0.06453397335150303 sim_render-ego_mean 0.061374869498608584 sim_render-ego_median 0.06183208666349712 sim_render-ego_min 0.0577542781829834 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 18733
2608
Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 11:06:42+00:00 2019-04-20 11:16:22+00:00 0:09:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487132829419987 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041400208354252 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06813844214094446 agent_compute-ego_mean 0.06447828654096821 agent_compute-ego_median 0.0653760891694289 agent_compute-ego_min 0.060724841920953045 deviation-center-line_max 0.1279102488429998 deviation-center-line_mean 0.10518151035257096 deviation-center-line_min 0.06917270915638028 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550057 deviation-heading_median 0.36368201628851926 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903464 driven_any_median 0.6642785413159032 driven_any_min 0.3059207793076613 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.588039443394122 driven_lanedir_consec_min 0.28022225990343186 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.588039443394122 driven_lanedir_median 0.5487132829419987 driven_lanedir_min 0.28022225990343186 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.026857393543894697, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05966724709766667, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06232792284430527, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07421867149632151, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.035190742190291245, "sim_compute_performance-ego": 0.05972480192417052, "sim_compute_robot_state-ego": 0.060681037786530286, "sim_compute_robot_state-npc0": 0.06509426163464058, "sim_compute_robot_state-npc1": 0.06297479897010617, "sim_compute_robot_state-npc2": 0.061800889852570325, "sim_compute_robot_state-npc3": 0.06257650328845513}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.027337138469402607, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06028297314277062, "in-drivable-lane": 0, "agent_compute-ego": 0.0653760891694289, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.08170537765209492, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03595147683070256, "sim_compute_performance-ego": 0.06335935225853553, "sim_compute_robot_state-ego": 0.06656529353215145, "sim_compute_robot_state-npc0": 0.06565402104304387, "sim_compute_robot_state-npc1": 0.06431999573340783, "sim_compute_robot_state-npc2": 0.06778130164513221, "sim_compute_robot_state-npc3": 0.06538131603827843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.027785463536039313, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.06510314535587391, "in-drivable-lane": 0, "agent_compute-ego": 0.06813844214094446, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0763478583477913, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03615979438132428, "sim_compute_performance-ego": 0.06053062195473529, "sim_compute_robot_state-ego": 0.06258310155665621, "sim_compute_robot_state-npc0": 0.06676671352792293, "sim_compute_robot_state-npc1": 0.06324518487808552, "sim_compute_robot_state-npc2": 0.06336219767306714, "sim_compute_robot_state-npc3": 0.06248612606779058}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.027974076323456817, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06085811866508736, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06582413662920941, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0766589824969952, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03541866763607486, "sim_compute_performance-ego": 0.06266486513745653, "sim_compute_robot_state-ego": 0.06250166107010055, "sim_compute_robot_state-npc0": 0.06830944595756111, "sim_compute_robot_state-npc1": 0.06443308735941793, "sim_compute_robot_state-npc2": 0.06593194636669787, "sim_compute_robot_state-npc3": 0.06185392757038494}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.023309651174043353, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05806553363800049, "in-drivable-lane": 0, "agent_compute-ego": 0.060724841920953045, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07362149263683118, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03477972432186729, "sim_compute_performance-ego": 0.0585966988613731, "sim_compute_robot_state-ego": 0.06202900409698486, "sim_compute_robot_state-npc0": 0.06443839951565392, "sim_compute_robot_state-npc1": 0.06092865216104608, "sim_compute_robot_state-npc2": 0.06154500183306242, "sim_compute_robot_state-npc3": 0.06081042164250424}}set_robot_commands_max 0.08170537765209492 set_robot_commands_mean 0.07651047652600682 set_robot_commands_median 0.0763478583477913 set_robot_commands_min 0.07362149263683118 sim_compute_performance-ego_max 0.06335935225853553 sim_compute_performance-ego_mean 0.06097526802725419 sim_compute_performance-ego_median 0.06053062195473529 sim_compute_performance-ego_min 0.0585966988613731 sim_compute_robot_state-ego_max 0.06656529353215145 sim_compute_robot_state-ego_mean 0.06287201960848468 sim_compute_robot_state-ego_median 0.06250166107010055 sim_compute_robot_state-ego_min 0.060681037786530286 sim_compute_robot_state-npc0_max 0.06830944595756111 sim_compute_robot_state-npc0_mean 0.06605256833576448 sim_compute_robot_state-npc0_median 0.06565402104304387 sim_compute_robot_state-npc0_min 0.06443839951565392 sim_compute_robot_state-npc1_max 0.06443308735941793 sim_compute_robot_state-npc1_mean 0.06318034382041271 sim_compute_robot_state-npc1_median 0.06324518487808552 sim_compute_robot_state-npc1_min 0.06092865216104608 sim_compute_robot_state-npc2_max 0.06778130164513221 sim_compute_robot_state-npc2_mean 0.06408426747410599 sim_compute_robot_state-npc2_median 0.06336219767306714 sim_compute_robot_state-npc2_min 0.06154500183306242 sim_compute_robot_state-npc3_max 0.06538131603827843 sim_compute_robot_state-npc3_mean 0.06262165892148266 sim_compute_robot_state-npc3_median 0.06248612606779058 sim_compute_robot_state-npc3_min 0.06081042164250424 sim_compute_sim_state_max 0.03615979438132428 sim_compute_sim_state_mean 0.03550008107205204 sim_compute_sim_state_median 0.03541866763607486 sim_compute_sim_state_min 0.03477972432186729 sim_physics_max 0.027974076323456817 sim_physics_mean 0.02665274460936736 sim_physics_median 0.027337138469402607 sim_physics_min 0.023309651174043353 sim_render-ego_max 0.06510314535587391 sim_render-ego_mean 0.0607954035798798 sim_render-ego_median 0.06028297314277062 sim_render-ego_min 0.05806553363800049 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18725
2620
Andrea Censi 🇨🇭challenge-aido_LF-template-random aido2-LFV-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 10:57:25+00:00 2019-04-20 11:06:36+00:00 0:09:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.14945689307318794 agent_compute-ego_mean 0.14327110336603183 agent_compute-ego_median 0.14567875862121582 agent_compute-ego_min 0.13095587141373577 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02409694329747614, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.061432240144261775, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14567875862121582, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07796069361128898, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.035351519314747934, "sim_compute_performance-ego": 0.06383342113134996, "sim_compute_robot_state-ego": 0.06146662640121748, "sim_compute_robot_state-npc0": 0.06900559281403164, "sim_compute_robot_state-npc1": 0.06509660774806761, "sim_compute_robot_state-npc2": 0.062974547440151, "sim_compute_robot_state-npc3": 0.06359934356977355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.02607095241546631, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06549310142343695, "in-drivable-lane": 0, "agent_compute-ego": 0.14382121779701926, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07726398381319913, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03406537120992487, "sim_compute_performance-ego": 0.06418849121440541, "sim_compute_robot_state-ego": 0.06141759590669112, "sim_compute_robot_state-npc0": 0.07204648581418124, "sim_compute_robot_state-npc1": 0.06841016899455678, "sim_compute_robot_state-npc2": 0.06375624374909834, "sim_compute_robot_state-npc3": 0.06237370317632502}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02747408019171821, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06825590663486057, "in-drivable-lane": 0, "agent_compute-ego": 0.14945689307318794, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07684207492404514, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03861549695332845, "sim_compute_performance-ego": 0.06726317935519749, "sim_compute_robot_state-ego": 0.06717090606689453, "sim_compute_robot_state-npc0": 0.07448142369588216, "sim_compute_robot_state-npc1": 0.07083477444118924, "sim_compute_robot_state-npc2": 0.06913813485039605, "sim_compute_robot_state-npc3": 0.06731991767883301}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.026688093940416973, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.061696295936902366, "in-drivable-lane": 0, "agent_compute-ego": 0.14644277592500052, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07477375864982605, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03686430553595225, "sim_compute_performance-ego": 0.05921914676825205, "sim_compute_robot_state-ego": 0.06077504654725393, "sim_compute_robot_state-npc0": 0.07018640140692393, "sim_compute_robot_state-npc1": 0.06572442253430684, "sim_compute_robot_state-npc2": 0.06305172542730968, "sim_compute_robot_state-npc3": 0.06464353700478871}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.022908862899331486, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05493676311829511, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13095587141373577, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07267528772354126, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.031198189539067885, "sim_compute_performance-ego": 0.05487971446093391, "sim_compute_robot_state-ego": 0.05497001549776863, "sim_compute_robot_state-npc0": 0.06210052967071533, "sim_compute_robot_state-npc1": 0.058190380825715905, "sim_compute_robot_state-npc2": 0.05661507564432481, "sim_compute_robot_state-npc3": 0.05622144306407256}}set_robot_commands_max 0.07796069361128898 set_robot_commands_mean 0.07590315974438011 set_robot_commands_median 0.07684207492404514 set_robot_commands_min 0.07267528772354126 sim_compute_performance-ego_max 0.06726317935519749 sim_compute_performance-ego_mean 0.061876790586027776 sim_compute_performance-ego_median 0.06383342113134996 sim_compute_performance-ego_min 0.05487971446093391 sim_compute_robot_state-ego_max 0.06717090606689453 sim_compute_robot_state-ego_mean 0.06116003808396514 sim_compute_robot_state-ego_median 0.06141759590669112 sim_compute_robot_state-ego_min 0.05497001549776863 sim_compute_robot_state-npc0_max 0.07448142369588216 sim_compute_robot_state-npc0_mean 0.06956408668034687 sim_compute_robot_state-npc0_median 0.07018640140692393 sim_compute_robot_state-npc0_min 0.06210052967071533 sim_compute_robot_state-npc1_max 0.07083477444118924 sim_compute_robot_state-npc1_mean 0.06565127090876728 sim_compute_robot_state-npc1_median 0.06572442253430684 sim_compute_robot_state-npc1_min 0.058190380825715905 sim_compute_robot_state-npc2_max 0.06913813485039605 sim_compute_robot_state-npc2_mean 0.06310714542225598 sim_compute_robot_state-npc2_median 0.06305172542730968 sim_compute_robot_state-npc2_min 0.05661507564432481 sim_compute_robot_state-npc3_max 0.06731991767883301 sim_compute_robot_state-npc3_mean 0.06283158889875858 sim_compute_robot_state-npc3_median 0.06359934356977355 sim_compute_robot_state-npc3_min 0.05622144306407256 sim_compute_sim_state_max 0.03861549695332845 sim_compute_sim_state_mean 0.03521897651060428 sim_compute_sim_state_median 0.035351519314747934 sim_compute_sim_state_min 0.031198189539067885 sim_physics_max 0.02747408019171821 sim_physics_mean 0.025447786548881825 sim_physics_median 0.02607095241546631 sim_physics_min 0.022908862899331486 sim_render-ego_max 0.06825590663486057 sim_render-ego_mean 0.062362861451551344 sim_render-ego_median 0.061696295936902366 sim_render-ego_min 0.05493676311829511 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18715
2636
Andrea Censi 🇨🇭challenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 10:45:44+00:00 2019-04-20 10:57:01+00:00 0:11:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.13579045557508282 agent_compute-ego_mean 0.13476392274003002 agent_compute-ego_median 0.13421933881698117 agent_compute-ego_min 0.13396534465608145 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02819173676627023, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.056166035788399835, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13396534465608145, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07515877012222533, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.0315234623258076, "sim_compute_performance-ego": 0.05505102399795774, "sim_compute_robot_state-ego": 0.05822285773262145, "sim_compute_robot_state-npc0": 0.062905576494005, "sim_compute_robot_state-npc1": 0.05776728902544294, "sim_compute_robot_state-npc2": 0.05808120303683811, "sim_compute_robot_state-npc3": 0.0582325988345676}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.027356914445465685, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06231226640589097, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13579045557508282, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07497844509049958, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03329094250996908, "sim_compute_performance-ego": 0.06103777417949602, "sim_compute_robot_state-ego": 0.06225436809016209, "sim_compute_robot_state-npc0": 0.06889870120029823, "sim_compute_robot_state-npc1": 0.06264826363208247, "sim_compute_robot_state-npc2": 0.060337005877027325, "sim_compute_robot_state-npc3": 0.06109236268436208}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.02861104472990959, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05905063306131671, "in-drivable-lane": 0, "agent_compute-ego": 0.13421933881698117, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07781016057537447, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03283260714623236, "sim_compute_performance-ego": 0.05972817251759191, "sim_compute_robot_state-ego": 0.05849372186968403, "sim_compute_robot_state-npc0": 0.06514381208727436, "sim_compute_robot_state-npc1": 0.061406504723333546, "sim_compute_robot_state-npc2": 0.06098027767673615, "sim_compute_robot_state-npc3": 0.05871926584551411}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.02865324375477243, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05932986482660821, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13568706461723817, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07444498640425662, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.032368160308675564, "sim_compute_performance-ego": 0.05956572928327195, "sim_compute_robot_state-ego": 0.05900548113153336, "sim_compute_robot_state-npc0": 0.0641907681810095, "sim_compute_robot_state-npc1": 0.061285706276589254, "sim_compute_robot_state-npc2": 0.058927358464991794, "sim_compute_robot_state-npc3": 0.05927261900394521}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027343378617213324, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05863735767511221, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13415741003476656, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.076900275853964, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03380237634365375, "sim_compute_performance-ego": 0.061488247834719144, "sim_compute_robot_state-ego": 0.06322365540724534, "sim_compute_robot_state-npc0": 0.06837271727048434, "sim_compute_robot_state-npc1": 0.06232975079463078, "sim_compute_robot_state-npc2": 0.06209258849804218, "sim_compute_robot_state-npc3": 0.06186998348969679}}set_robot_commands_max 0.07781016057537447 set_robot_commands_mean 0.075858527609264 set_robot_commands_median 0.07515877012222533 set_robot_commands_min 0.07444498640425662 sim_compute_performance-ego_max 0.061488247834719144 sim_compute_performance-ego_mean 0.05937418956260735 sim_compute_performance-ego_median 0.05972817251759191 sim_compute_performance-ego_min 0.05505102399795774 sim_compute_robot_state-ego_max 0.06322365540724534 sim_compute_robot_state-ego_mean 0.06024001684624926 sim_compute_robot_state-ego_median 0.05900548113153336 sim_compute_robot_state-ego_min 0.05822285773262145 sim_compute_robot_state-npc0_max 0.06889870120029823 sim_compute_robot_state-npc0_mean 0.06590231504661428 sim_compute_robot_state-npc0_median 0.06514381208727436 sim_compute_robot_state-npc0_min 0.062905576494005 sim_compute_robot_state-npc1_max 0.06264826363208247 sim_compute_robot_state-npc1_mean 0.06108750289041579 sim_compute_robot_state-npc1_median 0.061406504723333546 sim_compute_robot_state-npc1_min 0.05776728902544294 sim_compute_robot_state-npc2_max 0.06209258849804218 sim_compute_robot_state-npc2_mean 0.06008368671072711 sim_compute_robot_state-npc2_median 0.060337005877027325 sim_compute_robot_state-npc2_min 0.05808120303683811 sim_compute_robot_state-npc3_max 0.06186998348969679 sim_compute_robot_state-npc3_mean 0.059837365971617165 sim_compute_robot_state-npc3_median 0.05927261900394521 sim_compute_robot_state-npc3_min 0.0582325988345676 sim_compute_sim_state_max 0.03380237634365375 sim_compute_sim_state_mean 0.032763509726867666 sim_compute_sim_state_median 0.03283260714623236 sim_compute_sim_state_min 0.0315234623258076 sim_physics_max 0.02865324375477243 sim_physics_mean 0.028031263662726253 sim_physics_median 0.02819173676627023 sim_physics_min 0.027343378617213324 sim_render-ego_max 0.06231226640589097 sim_render-ego_mean 0.05909923155146559 sim_render-ego_median 0.05905063306131671 sim_render-ego_min 0.056166035788399835 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18710
2641
Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-9560
2019-04-20 10:39:52+00:00 2019-04-20 10:45:30+00:00 0:05:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06643049009553678 agent_compute-ego_mean 0.06341180145834482 agent_compute-ego_median 0.06351688567628251 agent_compute-ego_min 0.059132869427020736 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017355796767444146, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05835513661547405, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06335078216180569, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07894538670051389, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.039125840838362534, "sim_compute_performance-ego": 0.05948587452493063, "sim_compute_robot_state-ego": 0.06112836919179777}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.016177562566903923, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05592181132389949, "in-drivable-lane": 0, "agent_compute-ego": 0.059132869427020736, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07212692040663499, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03890386911538931, "sim_compute_performance-ego": 0.05892688494462233, "sim_compute_robot_state-ego": 0.06019750008216271}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.015909879765612013, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06083034961781603, "in-drivable-lane": 0, "agent_compute-ego": 0.06351688567628251, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07303985129011438, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03841393551927932, "sim_compute_performance-ego": 0.062073443798308675, "sim_compute_robot_state-ego": 0.060201726061232544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.01711604097387293, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06018330500676082, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06643049009553678, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07670727404919299, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03722984974200909, "sim_compute_performance-ego": 0.06133712517036186, "sim_compute_robot_state-ego": 0.06196947150178008}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.01636354546797903, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06028575646249872, "in-drivable-lane": 0, "agent_compute-ego": 0.06462797993107845, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07554334715793007, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03994427856646086, "sim_compute_performance-ego": 0.0620201449645193, "sim_compute_robot_state-ego": 0.06367180849376478}}set_robot_commands_max 0.07894538670051389 set_robot_commands_mean 0.07527255592087725 set_robot_commands_median 0.07554334715793007 set_robot_commands_min 0.07212692040663499 sim_compute_performance-ego_max 0.062073443798308675 sim_compute_performance-ego_mean 0.06076869468054855 sim_compute_performance-ego_median 0.06133712517036186 sim_compute_performance-ego_min 0.05892688494462233 sim_compute_robot_state-ego_max 0.06367180849376478 sim_compute_robot_state-ego_mean 0.061433775066147576 sim_compute_robot_state-ego_median 0.06112836919179777 sim_compute_robot_state-ego_min 0.06019750008216271 sim_compute_sim_state_max 0.03994427856646086 sim_compute_sim_state_mean 0.038723554756300224 sim_compute_sim_state_median 0.03890386911538931 sim_compute_sim_state_min 0.03722984974200909 sim_physics_max 0.017355796767444146 sim_physics_mean 0.01658456510836241 sim_physics_median 0.01636354546797903 sim_physics_min 0.015909879765612013 sim_render-ego_max 0.06083034961781603 sim_render-ego_mean 0.059115271805289825 sim_render-ego_median 0.06018330500676082 sim_render-ego_min 0.05592181132389949 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18701
2680
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation success no idsc-rudolf-9560
2019-04-20 10:21:09+00:00 2019-04-20 10:39:12+00:00 0:18:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0494101139404726 survival_time_median 6.999999999999983 deviation-center-line_median 0.4114452923747232 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.058055541094611675 agent_compute-ego_mean 0.056533243481632814 agent_compute-ego_median 0.056312439289498833 agent_compute-ego_min 0.05561222859791347 deviation-center-line_max 0.6224996164639154 deviation-center-line_mean 0.420658543577316 deviation-center-line_min 0.18669002326807368 deviation-heading_max 2.7051896780359175 deviation-heading_mean 1.82092421288296 deviation-heading_median 2.1176976665979463 deviation-heading_min 0.6240920157870962 driven_any_max 1.3270581137113913 driven_any_mean 0.984184420377592 driven_any_median 1.0779845464860416 driven_any_min 0.4886497723225228 driven_lanedir_consec_max 1.2414388188003094 driven_lanedir_consec_mean 0.8399082041571099 driven_lanedir_consec_min 0.24101563879124388 driven_lanedir_max 1.2414388188003094 driven_lanedir_mean 0.8798729125236007 driven_lanedir_median 1.0494101139404726 driven_lanedir_min 0.44083918062369776 in-drivable-lane_max 0.4999999999999995 in-drivable-lane_mean 0.15000000000000063 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4886497723225228, "sim_physics": 0.025568471235387465, "survival_time": 3.399999999999996, "driven_lanedir": 0.4738535967511015, "sim_render-ego": 0.05256384611129761, "in-drivable-lane": 0, "agent_compute-ego": 0.058055541094611675, "deviation-heading": 0.6240920157870962, "set_robot_commands": 0.0721786898725173, "deviation-center-line": 0.18669002326807368, "driven_lanedir_consec": 0.4738535967511015, "sim_compute_sim_state": 0.031239902271943933, "sim_compute_performance-ego": 0.0544653710197, "sim_compute_robot_state-ego": 0.05606660772772396, "sim_compute_robot_state-npc0": 0.05844837076523725, "sim_compute_robot_state-npc1": 0.05609311075771556, "sim_compute_robot_state-npc2": 0.054628144292270434, "sim_compute_robot_state-npc3": 0.05491023905137006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7082069604129195, "sim_physics": 0.024996356761201897, "survival_time": 4.699999999999991, "driven_lanedir": 0.44083918062369776, "sim_render-ego": 0.053299622332796136, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.056312439289498833, "deviation-heading": 2.7051896780359175, "set_robot_commands": 0.07100561324586259, "deviation-center-line": 0.41024624739519655, "driven_lanedir_consec": 0.24101563879124388, "sim_compute_sim_state": 0.03115388941257558, "sim_compute_performance-ego": 0.05435696814922576, "sim_compute_robot_state-ego": 0.055436890176002014, "sim_compute_robot_state-npc0": 0.05690842486442404, "sim_compute_robot_state-npc1": 0.05505929855590171, "sim_compute_robot_state-npc2": 0.05453406242614097, "sim_compute_robot_state-npc3": 0.05487891714623634}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0779845464860416, "sim_physics": 0.02310058048793248, "survival_time": 6.999999999999983, "driven_lanedir": 1.0494101139404726, "sim_render-ego": 0.05109184639794486, "in-drivable-lane": 0, "agent_compute-ego": 0.05561222859791347, "deviation-heading": 1.3240471487517858, "set_robot_commands": 0.07017819370542254, "deviation-center-line": 0.6224996164639154, "driven_lanedir_consec": 1.0494101139404726, "sim_compute_sim_state": 0.03092080695288522, "sim_compute_performance-ego": 0.05252840689250401, "sim_compute_robot_state-ego": 0.05464540209089007, "sim_compute_robot_state-npc0": 0.05518579993929182, "sim_compute_robot_state-npc1": 0.05383493900299072, "sim_compute_robot_state-npc2": 0.05294177872794015, "sim_compute_robot_state-npc3": 0.053218431132180354}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3190227089550843, "sim_physics": 0.02350615894093233, "survival_time": 8.499999999999986, "driven_lanedir": 1.193822852502422, "sim_render-ego": 0.05136822532205021, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.055868214719435746, "deviation-heading": 2.1176976665979463, "set_robot_commands": 0.07247818217558019, "deviation-center-line": 0.47241153838467104, "driven_lanedir_consec": 1.193822852502422, "sim_compute_sim_state": 0.030094431428348316, "sim_compute_performance-ego": 0.05325909081627341, "sim_compute_robot_state-ego": 0.0546905798070571, "sim_compute_robot_state-npc0": 0.05562842873965992, "sim_compute_robot_state-npc1": 0.054597208079169776, "sim_compute_robot_state-npc2": 0.05449595170862535, "sim_compute_robot_state-npc3": 0.053436749121722055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3270581137113913, "sim_physics": 0.022095883798878096, "survival_time": 8.549999999999986, "driven_lanedir": 1.2414388188003094, "sim_render-ego": 0.05293096854672794, "in-drivable-lane": 0, "agent_compute-ego": 0.056817793706704305, "deviation-heading": 2.3335945552420543, "set_robot_commands": 0.07224065936796846, "deviation-center-line": 0.4114452923747232, "driven_lanedir_consec": 1.2414388188003094, "sim_compute_sim_state": 0.030615014639514233, "sim_compute_performance-ego": 0.0539181065141109, "sim_compute_robot_state-ego": 0.054751242810522606, "sim_compute_robot_state-npc0": 0.05813365651850115, "sim_compute_robot_state-npc1": 0.05505394099051492, "sim_compute_robot_state-npc2": 0.05499884259631062, "sim_compute_robot_state-npc3": 0.05403708714490745}}set_robot_commands_max 0.07247818217558019 set_robot_commands_mean 0.07161626767347021 set_robot_commands_median 0.0721786898725173 set_robot_commands_min 0.07017819370542254 sim_compute_performance-ego_max 0.0544653710197 sim_compute_performance-ego_mean 0.053705588678362816 sim_compute_performance-ego_median 0.0539181065141109 sim_compute_performance-ego_min 0.05252840689250401 sim_compute_robot_state-ego_max 0.05606660772772396 sim_compute_robot_state-ego_mean 0.05511814452243915 sim_compute_robot_state-ego_median 0.054751242810522606 sim_compute_robot_state-ego_min 0.05464540209089007 sim_compute_robot_state-npc0_max 0.05844837076523725 sim_compute_robot_state-npc0_mean 0.05686093616542283 sim_compute_robot_state-npc0_median 0.05690842486442404 sim_compute_robot_state-npc0_min 0.05518579993929182 sim_compute_robot_state-npc1_max 0.05609311075771556 sim_compute_robot_state-npc1_mean 0.05492769947725854 sim_compute_robot_state-npc1_median 0.05505394099051492 sim_compute_robot_state-npc1_min 0.05383493900299072 sim_compute_robot_state-npc2_max 0.05499884259631062 sim_compute_robot_state-npc2_mean 0.054319755950257495 sim_compute_robot_state-npc2_median 0.05453406242614097 sim_compute_robot_state-npc2_min 0.05294177872794015 sim_compute_robot_state-npc3_max 0.05491023905137006 sim_compute_robot_state-npc3_mean 0.05409628471928325 sim_compute_robot_state-npc3_median 0.05403708714490745 sim_compute_robot_state-npc3_min 0.053218431132180354 sim_compute_sim_state_max 0.031239902271943933 sim_compute_sim_state_mean 0.030804808941053457 sim_compute_sim_state_median 0.03092080695288522 sim_compute_sim_state_min 0.030094431428348316 sim_physics_max 0.025568471235387465 sim_physics_mean 0.023853490244866455 sim_physics_median 0.02350615894093233 sim_physics_min 0.022095883798878096 sim_render-ego_max 0.053299622332796136 sim_render-ego_mean 0.05225090174216336 sim_render-ego_median 0.05256384611129761 sim_render-ego_min 0.05109184639794486 simulation-passed 1 survival_time_max 8.549999999999986 survival_time_mean 6.429999999999988 survival_time_min 3.399999999999996
No reset possible 18684
2681
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-9560
2019-04-20 09:59:25+00:00 2019-04-20 10:20:35+00:00 0:21:10 Waited 1201 seconds [...] Waited 1201 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18674
2707
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-9560
2019-04-20 09:38:01+00:00 2019-04-20 09:59:12+00:00 0:21:11 Waited 1201 seconds [...] Waited 1201 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18668
2715
jiang peng test for ppo aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-9560
2019-04-20 09:36:45+00:00 2019-04-20 09:37:31+00:00 0:00:46 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18660
2735
Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validation
step1-simulation failed no idsc-rudolf-9560
2019-04-20 09:34:55+00:00 2019-04-20 09:36:39+00:00 0:01:44 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18638
2771
Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-9560
2019-04-20 09:13:29+00:00 2019-04-20 09:34:41+00:00 0:21:12 Waited 1201 seconds [...] Waited 1201 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18630
2796
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation failed no idsc-rudolf-9560
2019-04-20 09:11:40+00:00 2019-04-20 09:13:18+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18624
2805
Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agent aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-9560
2019-04-20 09:05:20+00:00 2019-04-20 09:11:02+00:00 0:05:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.14711361581628973 agent_compute-ego_mean 0.1418899499268463 agent_compute-ego_median 0.1421171873807907 agent_compute-ego_min 0.13792327245076497 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.0160117599199403, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05780366231810371, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13993256047086897, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07396613876774626, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.0393999567571676, "sim_compute_performance-ego": 0.057604825721596774, "sim_compute_robot_state-ego": 0.06039941535805756}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016332534226504238, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05791804465380582, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14711361581628973, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07723181356083263, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.036203454841266976, "sim_compute_performance-ego": 0.05991086092862216, "sim_compute_robot_state-ego": 0.060851248827847565}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015873389773898655, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05820664829678006, "in-drivable-lane": 0, "agent_compute-ego": 0.13792327245076497, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.0769890202416314, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.038576825459798174, "sim_compute_performance-ego": 0.05943384170532227, "sim_compute_robot_state-ego": 0.062493186526828344}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015710721413294475, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06076530118783315, "in-drivable-lane": 0, "agent_compute-ego": 0.1421171873807907, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07699679334958394, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03892690440018972, "sim_compute_performance-ego": 0.06239058574040731, "sim_compute_robot_state-ego": 0.06371283531188965}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01751635004492367, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06541435157551485, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14236311351551728, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07830983400344849, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04158027382457957, "sim_compute_performance-ego": 0.06405102505403407, "sim_compute_robot_state-ego": 0.06680783103494083}}set_robot_commands_max 0.07830983400344849 set_robot_commands_mean 0.07669871998464854 set_robot_commands_median 0.07699679334958394 set_robot_commands_min 0.07396613876774626 sim_compute_performance-ego_max 0.06405102505403407 sim_compute_performance-ego_mean 0.06067822782999653 sim_compute_performance-ego_median 0.05991086092862216 sim_compute_performance-ego_min 0.057604825721596774 sim_compute_robot_state-ego_max 0.06680783103494083 sim_compute_robot_state-ego_mean 0.06285290341191278 sim_compute_robot_state-ego_median 0.062493186526828344 sim_compute_robot_state-ego_min 0.06039941535805756 sim_compute_sim_state_max 0.04158027382457957 sim_compute_sim_state_mean 0.03893748305660041 sim_compute_sim_state_median 0.03892690440018972 sim_compute_sim_state_min 0.036203454841266976 sim_physics_max 0.01751635004492367 sim_physics_mean 0.016288951075712266 sim_physics_median 0.0160117599199403 sim_physics_min 0.015710721413294475 sim_render-ego_max 0.06541435157551485 sim_render-ego_mean 0.06002160160640753 sim_render-ego_median 0.05820664829678006 sim_render-ego_min 0.05780366231810371 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible