22972step1-simulation success yes 2019-05-17 04:25:39+00:00 2019-05-17 04:56:40+00:00 0:31:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6537162971975778 survival_time_median 2.5999999999999988 deviation-center-line_median 0.14884708769804722 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.16722194506571844 agent_compute-ego_mean 0.156397677146723 agent_compute-ego_median 0.15397003330761874 agent_compute-ego_min 0.14718160846016623 deviation-center-line_max 0.5141120095458062 deviation-center-line_mean 0.1769000227005324 deviation-center-line_min 0.06216029860587694 deviation-heading_max 1.9929437250081896 deviation-heading_mean 0.692977823395608 deviation-heading_median 0.4928440244444201 deviation-heading_min 0.24234723632033853 driven_any_max 3.5343244022418343 driven_any_mean 1.3470385992234175 driven_any_median 1.001633421251194 driven_any_min 0.3412551960104244 driven_lanedir_consec_max 2.494308053441959 driven_lanedir_consec_mean 0.881391085527715 driven_lanedir_consec_min 0.3199180625488627 driven_lanedir_max 2.494308053441959 driven_lanedir_mean 0.8962528018383226 driven_lanedir_median 0.7206363324756615 driven_lanedir_min 0.3199180625488627 in-drivable-lane_max 3.549999999999991 in-drivable-lane_mean 0.839999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1842850944663905, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06257108797000933, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15397003330761874, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09476546396183062, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.035986658893054045, "sim_compute_performance-ego": 0.06804596623287926, "sim_compute_robot_state-ego": 0.07399900351898579, "sim_compute_robot_state-npc0": 0.06907651997819732, "sim_compute_robot_state-npc1": 0.07032777991475939, "sim_compute_robot_state-npc2": 0.06592767449873912, "sim_compute_robot_state-npc3": 0.06460548050795929}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2283307569367545, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06655513388769967, "in-drivable-lane": 0, "agent_compute-ego": 0.1666585717882429, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10015562602451868, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04201396022524152, "sim_compute_performance-ego": 0.0713720406804766, "sim_compute_robot_state-ego": 0.0824567334992545, "sim_compute_robot_state-npc0": 0.07094841344015938, "sim_compute_robot_state-npc1": 0.0742525543485369, "sim_compute_robot_state-npc2": 0.07209922586168561, "sim_compute_robot_state-npc3": 0.07609885931015015}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.19834946891636523, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0695742472861577, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16305812122752367, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10040039692110228, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04040974320717229, "sim_compute_performance-ego": 0.07102754046616044, "sim_compute_robot_state-ego": 0.07676100267947299, "sim_compute_robot_state-npc0": 0.0719196009404451, "sim_compute_robot_state-npc1": 0.07141532944244089, "sim_compute_robot_state-npc2": 0.0726843296902851, "sim_compute_robot_state-npc3": 0.07345060468877404}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1931402335564295, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05889975527922312, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15390782058238983, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0977311929066976, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.038101136684417725, "sim_compute_performance-ego": 0.06988384823004405, "sim_compute_robot_state-ego": 0.07611844937006633, "sim_compute_robot_state-npc0": 0.06970613201459248, "sim_compute_robot_state-npc1": 0.07253833611806233, "sim_compute_robot_state-npc2": 0.06788947681585948, "sim_compute_robot_state-npc3": 0.06834089756011963}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1980260894412086, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06301837875729516, "in-drivable-lane": 0, "agent_compute-ego": 0.15897234280904135, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.095352570215861, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03782377924237933, "sim_compute_performance-ego": 0.07013080233619326, "sim_compute_robot_state-ego": 0.07363406817118327, "sim_compute_robot_state-npc0": 0.06980569022042411, "sim_compute_robot_state-npc1": 0.07261940411158971, "sim_compute_robot_state-npc2": 0.07008000782557897, "sim_compute_robot_state-npc3": 0.06836785588945661}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.203996215751785, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06271861127750603, "in-drivable-lane": 2, "agent_compute-ego": 0.15800981892797047, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09801517989107236, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04001798030145154, "sim_compute_performance-ego": 0.07133056303698146, "sim_compute_robot_state-ego": 0.07863844511751643, "sim_compute_robot_state-npc0": 0.06905841827392578, "sim_compute_robot_state-npc1": 0.07078269712939234, "sim_compute_robot_state-npc2": 0.07079041646626182, "sim_compute_robot_state-npc3": 0.07250153804253676}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2051212070057693, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.061628804623501975, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14925430816354104, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09431846396436969, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.0382951278130985, "sim_compute_performance-ego": 0.06620945976775827, "sim_compute_robot_state-ego": 0.07352233395993131, "sim_compute_robot_state-npc0": 0.07672594125988413, "sim_compute_robot_state-npc1": 0.06772145021308973, "sim_compute_robot_state-npc2": 0.07151989797944004, "sim_compute_robot_state-npc3": 0.0694707620491102}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20525562286376953, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06102067947387695, "in-drivable-lane": 0, "agent_compute-ego": 0.151539306640625, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09516477108001709, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03948815822601318, "sim_compute_performance-ego": 0.06630090236663819, "sim_compute_robot_state-ego": 0.07105167388916016, "sim_compute_robot_state-npc0": 0.06939900398254395, "sim_compute_robot_state-npc1": 0.06909412860870362, "sim_compute_robot_state-npc2": 0.06847365379333496, "sim_compute_robot_state-npc3": 0.06674327850341796}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.23332378038993248, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06745843703930195, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16722194506571844, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10699975490570068, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04192429322462816, "sim_compute_performance-ego": 0.07541423119031467, "sim_compute_robot_state-ego": 0.08770690514491154, "sim_compute_robot_state-npc0": 0.07367177192981426, "sim_compute_robot_state-npc1": 0.07333363478000347, "sim_compute_robot_state-npc2": 0.07281445539914645, "sim_compute_robot_state-npc3": 0.07466728870685284}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2414106955895057, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06662397201244648, "in-drivable-lane": 0, "agent_compute-ego": 0.16252249020796555, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09817108741173378, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.040324706297654375, "sim_compute_performance-ego": 0.07334412978245662, "sim_compute_robot_state-ego": 0.07767229813795823, "sim_compute_robot_state-npc0": 0.07155010333428016, "sim_compute_robot_state-npc1": 0.07578729666196383, "sim_compute_robot_state-npc2": 0.07444368875943698, "sim_compute_robot_state-npc3": 0.07069266759432279}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2006264708258889, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06342648376118053, "in-drivable-lane": 0, "agent_compute-ego": 0.14718160846016623, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10354530811309814, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.0380151705308394, "sim_compute_performance-ego": 0.07033882357857445, "sim_compute_robot_state-ego": 0.07408400015397505, "sim_compute_robot_state-npc0": 0.06580479578538374, "sim_compute_robot_state-npc1": 0.07109386270696466, "sim_compute_robot_state-npc2": 0.07200832800431685, "sim_compute_robot_state-npc3": 0.06819708780808882}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.17453941822052002, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06271063327789307, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1537902069091797, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09294427871704102, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.037311339378356935, "sim_compute_performance-ego": 0.06797646045684815, "sim_compute_robot_state-ego": 0.07400153636932373, "sim_compute_robot_state-npc0": 0.06761928081512451, "sim_compute_robot_state-npc1": 0.06517164707183838, "sim_compute_robot_state-npc2": 0.06578044414520264, "sim_compute_robot_state-npc3": 0.06474825859069824}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.20067748363981855, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.061021272172319126, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1514436716729022, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09447940613361117, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03998952977200772, "sim_compute_performance-ego": 0.06893517869584104, "sim_compute_robot_state-ego": 0.0750314453814892, "sim_compute_robot_state-npc0": 0.06744057320533915, "sim_compute_robot_state-npc1": 0.06684420971160239, "sim_compute_robot_state-npc2": 0.07023898337749725, "sim_compute_robot_state-npc3": 0.06872883502473222}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.2069228887557983, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06417755438731267, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1573143463868361, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0968733659157386, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04015142642534696, "sim_compute_performance-ego": 0.07060102774546696, "sim_compute_robot_state-ego": 0.0784544302867009, "sim_compute_robot_state-npc0": 0.07124351996641892, "sim_compute_robot_state-npc1": 0.07042103547316331, "sim_compute_robot_state-npc2": 0.06921963508312519, "sim_compute_robot_state-npc3": 0.07040005463820237}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1793178263164702, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.061737046922956194, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1511205650511242, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.0928757349650065, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03913474082946777, "sim_compute_performance-ego": 0.06761943499247233, "sim_compute_robot_state-ego": 0.07170276187715076, "sim_compute_robot_state-npc0": 0.06691044171651205, "sim_compute_robot_state-npc1": 0.06895176115490141, "sim_compute_robot_state-npc2": 0.06869666235787528, "sim_compute_robot_state-npc3": 0.06877732503981818}}set_robot_commands_max 0.10699975490570068 set_robot_commands_mean 0.09745284007515992 set_robot_commands_median 0.0968733659157386 set_robot_commands_min 0.0928757349650065 sim_compute_performance-ego_max 0.07541423119031467 sim_compute_performance-ego_mean 0.06990202730394038 sim_compute_performance-ego_median 0.07013080233619326 sim_compute_performance-ego_min 0.06620945976775827 sim_compute_robot_state-ego_max 0.08770690514491154 sim_compute_robot_state-ego_mean 0.07632233917047201 sim_compute_robot_state-ego_median 0.0750314453814892 sim_compute_robot_state-ego_min 0.07105167388916016 sim_compute_robot_state-npc0_max 0.07672594125988413 sim_compute_robot_state-npc0_mean 0.07005868045753633 sim_compute_robot_state-npc0_median 0.06970613201459248 sim_compute_robot_state-npc0_min 0.06580479578538374 sim_compute_robot_state-npc1_max 0.07578729666196383 sim_compute_robot_state-npc1_mean 0.07069034182980082 sim_compute_robot_state-npc1_median 0.07078269712939234 sim_compute_robot_state-npc1_min 0.06517164707183838 sim_compute_robot_state-npc2_max 0.07444368875943698 sim_compute_robot_state-npc2_mean 0.0701777920038524 sim_compute_robot_state-npc2_median 0.07023898337749725 sim_compute_robot_state-npc2_min 0.06578044414520264 sim_compute_robot_state-npc3_max 0.07609885931015015 sim_compute_robot_state-npc3_mean 0.06971938626361601 sim_compute_robot_state-npc3_median 0.06877732503981818 sim_compute_robot_state-npc3_min 0.06460548050795929 sim_compute_sim_state_max 0.04201396022524152 sim_compute_sim_state_mean 0.039265850070075305 sim_compute_sim_state_median 0.03948815822601318 sim_compute_sim_state_min 0.035986658893054045 sim_physics_max 0.2414106955895057 sim_physics_mean 0.2035548835117605 sim_physics_median 0.20067748363981855 sim_physics_min 0.17453941822052002 sim_render-ego_max 0.0695742472861577 sim_render-ego_mean 0.063542806541912 sim_render-ego_median 0.06271861127750603 sim_render-ego_min 0.05889975527922312 simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 3.3333333333333286 survival_time_min 1.0500000000000005
No reset possible 19596step1-simulation host-error no 2019-04-24 15:52:50+00:00 2019-04-24 16:00:04+00:00 0:07:14 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19596-828770', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19596-828770', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19596-828770', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18495step1-simulation host-error no 2019-04-19 14:58:56+00:00 2019-04-19 15:00:04+00:00 0:01:08 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18495-755906', 'ps', '-q', 'solution']' returned non-zero exit status 255.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18495-755906', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job18495-755906', 'ps', '-q', 'solution']' returned non-zero exit status 255.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 
Jacopo Tani