22823step1-simulation success yes 2019-05-17 02:12:35+00:00 2019-05-17 03:16:02+00:00 1:03:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8496886510423824 survival_time_median 10.600000000000016 deviation-center-line_median 0.7158391049958931 in-drivable-lane_median 0.7999999999999987
other stats agent_compute-ego_max 0.056368228865832815 agent_compute-ego_mean 0.05455365446959823 agent_compute-ego_median 0.05448263996052293 agent_compute-ego_min 0.05229093607734232 deviation-center-line_max 1.2979980976987588 deviation-center-line_mean 0.6983233784460772 deviation-center-line_min 0.30468510751400724 deviation-heading_max 8.511192605044654 deviation-heading_mean 4.370071273419499 deviation-heading_median 4.514475795851272 deviation-heading_min 0.4260191365252912 driven_any_max 2.348886797212572 driven_any_mean 1.701077214002253 driven_any_median 1.6496999176814275 driven_any_min 0.4606529631847675 driven_lanedir_consec_max 1.3806316055778978 driven_lanedir_consec_mean 0.886010385027158 driven_lanedir_consec_min 0.4550856483940704 driven_lanedir_max 2.0009739262735553 driven_lanedir_mean 1.1650263436861747 driven_lanedir_median 1.2896951741179432 driven_lanedir_min 0.4550856483940704 in-drivable-lane_max 4.600000000000022 in-drivable-lane_mean 1.803333333333338 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5044532055763151, "sim_physics": 0.08478265514179152, "survival_time": 9.800000000000004, "driven_lanedir": 1.3806316055778978, "sim_render-ego": 0.05520607379018044, "in-drivable-lane": 0, "agent_compute-ego": 0.055832749726820965, "deviation-heading": 3.30171790485117, "set_robot_commands": 0.05290765665015395, "deviation-center-line": 0.7158391049958931, "driven_lanedir_consec": 1.3806316055778978, "sim_compute_sim_state": 0.032968311893696686, "sim_compute_performance-ego": 0.05772821757258201, "sim_compute_robot_state-ego": 0.05659823636619412, "sim_compute_robot_state-npc0": 0.06379725008594747, "sim_compute_robot_state-npc1": 0.058122824649421534, "sim_compute_robot_state-npc2": 0.05801866857372984, "sim_compute_robot_state-npc3": 0.05705096405379626}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348886797212572, "sim_physics": 0.08644755204518637, "survival_time": 14.950000000000076, "driven_lanedir": 2.0009739262735553, "sim_render-ego": 0.05412648359934489, "in-drivable-lane": 0.4500000000000019, "agent_compute-ego": 0.05551364183425903, "deviation-heading": 5.754054389129794, "set_robot_commands": 0.05328003168106079, "deviation-center-line": 0.9000062292556569, "driven_lanedir_consec": 1.0163373711839352, "sim_compute_sim_state": 0.03302592833836873, "sim_compute_performance-ego": 0.05756763458251953, "sim_compute_robot_state-ego": 0.05536910931269328, "sim_compute_robot_state-npc0": 0.06333560228347779, "sim_compute_robot_state-npc1": 0.05796541293462117, "sim_compute_robot_state-npc2": 0.05725080569585164, "sim_compute_robot_state-npc3": 0.05649318297704061}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.175713732041361, "sim_physics": 0.08763416452345506, "survival_time": 7.649999999999981, "driven_lanedir": 0.6664550377983005, "sim_render-ego": 0.05393125652487761, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.05445582414764205, "deviation-heading": 1.9447590702186288, "set_robot_commands": 0.05329710050346025, "deviation-center-line": 0.5328625638576998, "driven_lanedir_consec": 0.5000377451909839, "sim_compute_sim_state": 0.03252043287738476, "sim_compute_performance-ego": 0.05659331527410769, "sim_compute_robot_state-ego": 0.05640819960949467, "sim_compute_robot_state-npc0": 0.0644797047758414, "sim_compute_robot_state-npc1": 0.058914424547182966, "sim_compute_robot_state-npc2": 0.056933142780478486, "sim_compute_robot_state-npc3": 0.05835630535300261}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348574733712377, "sim_physics": 0.08638741572697957, "survival_time": 14.950000000000076, "driven_lanedir": 1.2541342325042495, "sim_render-ego": 0.05392916917800903, "in-drivable-lane": 4.600000000000022, "agent_compute-ego": 0.05488274653752645, "deviation-heading": 5.797748768980967, "set_robot_commands": 0.052807218233744305, "deviation-center-line": 0.9331920296812152, "driven_lanedir_consec": 0.8265154392513199, "sim_compute_sim_state": 0.03238076368967692, "sim_compute_performance-ego": 0.056861967245737714, "sim_compute_robot_state-ego": 0.055463936328887936, "sim_compute_robot_state-npc0": 0.06326525847117107, "sim_compute_robot_state-npc1": 0.05714671770731608, "sim_compute_robot_state-npc2": 0.05632357517878214, "sim_compute_robot_state-npc3": 0.05647479216257731}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.629419215864214, "sim_physics": 0.08210430145263672, "survival_time": 4.249999999999993, "driven_lanedir": 0.6214683483511103, "sim_render-ego": 0.05132751184351304, "in-drivable-lane": 0, "agent_compute-ego": 0.05229093607734232, "deviation-heading": 0.668735228803154, "set_robot_commands": 0.05106563007130342, "deviation-center-line": 0.3510106905724936, "driven_lanedir_consec": 0.6214683483511103, "sim_compute_sim_state": 0.03108338468215045, "sim_compute_performance-ego": 0.05416064823375029, "sim_compute_robot_state-ego": 0.05304024359759162, "sim_compute_robot_state-npc0": 0.06062632168040556, "sim_compute_robot_state-npc1": 0.05532763705534093, "sim_compute_robot_state-npc2": 0.05492656932157629, "sim_compute_robot_state-npc3": 0.05553211604847628}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3484884215227972, "sim_physics": 0.08784311294555663, "survival_time": 14.950000000000076, "driven_lanedir": 1.451719704834156, "sim_render-ego": 0.05347213506698609, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.05489833434422811, "deviation-heading": 8.511192605044654, "set_robot_commands": 0.05315951903661092, "deviation-center-line": 1.2979980976987588, "driven_lanedir_consec": 0.7066290778097644, "sim_compute_sim_state": 0.032529513835906985, "sim_compute_performance-ego": 0.05847697973251343, "sim_compute_robot_state-ego": 0.055955464839935305, "sim_compute_robot_state-npc0": 0.06213561455408732, "sim_compute_robot_state-npc1": 0.05706678469975789, "sim_compute_robot_state-npc2": 0.05595875342686971, "sim_compute_robot_state-npc3": 0.055884512265523274}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7016624465005665, "sim_physics": 0.08310376329624906, "survival_time": 4.699999999999991, "driven_lanedir": 0.5668501167164193, "sim_render-ego": 0.05248590225869037, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.05596178643246914, "deviation-heading": 1.7666488715165596, "set_robot_commands": 0.051710027329465176, "deviation-center-line": 0.30468510751400724, "driven_lanedir_consec": 0.5668501167164193, "sim_compute_sim_state": 0.03259990316756228, "sim_compute_performance-ego": 0.0549703430622182, "sim_compute_robot_state-ego": 0.053206433641149645, "sim_compute_robot_state-npc0": 0.0628569557311687, "sim_compute_robot_state-npc1": 0.05735576913711873, "sim_compute_robot_state-npc2": 0.05717165926669506, "sim_compute_robot_state-npc3": 0.05628368448703847}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.6496999176814275, "sim_physics": 0.0879854807313883, "survival_time": 10.600000000000016, "driven_lanedir": 1.2896951741179432, "sim_render-ego": 0.05392417705283975, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.05448263996052293, "deviation-heading": 4.514475795851272, "set_robot_commands": 0.05310906554168125, "deviation-center-line": 0.634809953512164, "driven_lanedir_consec": 0.8496886510423824, "sim_compute_sim_state": 0.032308207367951015, "sim_compute_performance-ego": 0.05711744528896403, "sim_compute_robot_state-ego": 0.0559237835542211, "sim_compute_robot_state-npc0": 0.061866255301349565, "sim_compute_robot_state-npc1": 0.05767039532931346, "sim_compute_robot_state-npc2": 0.056199726068748616, "sim_compute_robot_state-npc3": 0.056024002579023256}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3486337678292295, "sim_physics": 0.08335928678512573, "survival_time": 14.950000000000076, "driven_lanedir": 1.216398313323213, "sim_render-ego": 0.05418534994125366, "in-drivable-lane": 4.2500000000000195, "agent_compute-ego": 0.05366854906082153, "deviation-heading": 6.893990733123386, "set_robot_commands": 0.05323248545328776, "deviation-center-line": 0.9040208880468492, "driven_lanedir_consec": 0.8569745794369827, "sim_compute_sim_state": 0.03265163342158, "sim_compute_performance-ego": 0.057521350383758545, "sim_compute_robot_state-ego": 0.056050275961558024, "sim_compute_robot_state-npc0": 0.06419832070668538, "sim_compute_robot_state-npc1": 0.058259072303771975, "sim_compute_robot_state-npc2": 0.05727806091308594, "sim_compute_robot_state-npc3": 0.05668689092000326}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.348644888723356, "sim_physics": 0.08699962933858235, "survival_time": 14.950000000000076, "driven_lanedir": 1.420172457585963, "sim_render-ego": 0.05318460782368978, "in-drivable-lane": 3.250000000000014, "agent_compute-ego": 0.05373634497324626, "deviation-heading": 6.701226236543467, "set_robot_commands": 0.0526122784614563, "deviation-center-line": 0.7938090036117907, "driven_lanedir_consec": 1.1897540831340183, "sim_compute_sim_state": 0.03216533581415812, "sim_compute_performance-ego": 0.057215526898701984, "sim_compute_robot_state-ego": 0.05488691012064616, "sim_compute_robot_state-npc0": 0.06201965490976969, "sim_compute_robot_state-npc1": 0.05831339120864868, "sim_compute_robot_state-npc2": 0.056407856146494545, "sim_compute_robot_state-npc3": 0.0558686892191569}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.59354014226088, "sim_physics": 0.08551994881978849, "survival_time": 10.25000000000001, "driven_lanedir": 1.33759762416311, "sim_render-ego": 0.05365192483111126, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.056368228865832815, "deviation-heading": 3.915760181405531, "set_robot_commands": 0.05182978467243474, "deviation-center-line": 0.6459585448559878, "driven_lanedir_consec": 1.33759762416311, "sim_compute_sim_state": 0.032712952683611615, "sim_compute_performance-ego": 0.05680170059204102, "sim_compute_robot_state-ego": 0.05492049193963772, "sim_compute_robot_state-npc0": 0.06274983126942704, "sim_compute_robot_state-npc1": 0.05769940818228373, "sim_compute_robot_state-npc2": 0.05709412970194003, "sim_compute_robot_state-npc3": 0.05694245245398544}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4606529631847675, "sim_physics": 0.08313903585076332, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4550856483940704, "sim_render-ego": 0.05252743139863014, "in-drivable-lane": 0, "agent_compute-ego": 0.05251151695847511, "deviation-heading": 0.4260191365252912, "set_robot_commands": 0.05224892124533653, "deviation-center-line": 0.3511693152642639, "driven_lanedir_consec": 0.4550856483940704, "sim_compute_sim_state": 0.03158457204699516, "sim_compute_performance-ego": 0.055606305599212646, "sim_compute_robot_state-ego": 0.05492980405688286, "sim_compute_robot_state-npc0": 0.061839036643505096, "sim_compute_robot_state-npc1": 0.05559906363487244, "sim_compute_robot_state-npc2": 0.05531591549515724, "sim_compute_robot_state-npc3": 0.05462169647216797}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.13986439853255, "sim_physics": 0.08551966489016355, "survival_time": 13.65000000000006, "driven_lanedir": 1.6756817589221231, "sim_render-ego": 0.05372158249655923, "in-drivable-lane": 0.7999999999999987, "agent_compute-ego": 0.05426192370963184, "deviation-heading": 5.931800005905381, "set_robot_commands": 0.052340219309041786, "deviation-center-line": 0.8430118243498965, "driven_lanedir_consec": 1.1412741958515231, "sim_compute_sim_state": 0.03293369541238079, "sim_compute_performance-ego": 0.0570635131863884, "sim_compute_robot_state-ego": 0.05513743865184295, "sim_compute_robot_state-npc0": 0.06327438965821877, "sim_compute_robot_state-npc1": 0.05802547364007859, "sim_compute_robot_state-npc2": 0.05689828911107102, "sim_compute_robot_state-npc3": 0.05640208153497605}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5692525032150957, "sim_physics": 0.0879959493580431, "survival_time": 10.100000000000009, "driven_lanedir": 0.6818992797102941, "sim_render-ego": 0.05326805374409893, "in-drivable-lane": 4.300000000000009, "agent_compute-ego": 0.05544153180452856, "deviation-heading": 3.0488209370415595, "set_robot_commands": 0.05340906062928757, "deviation-center-line": 0.40798582809083306, "driven_lanedir_consec": 0.6818992797102941, "sim_compute_sim_state": 0.03254434613898249, "sim_compute_performance-ego": 0.056432727539893424, "sim_compute_robot_state-ego": 0.054198785583571635, "sim_compute_robot_state-npc0": 0.06282716930502712, "sim_compute_robot_state-npc1": 0.05750816293282083, "sim_compute_robot_state-npc2": 0.05626734294513665, "sim_compute_robot_state-npc3": 0.05659843199323899}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3486710761762835, "sim_physics": 0.08758112986882528, "survival_time": 14.950000000000076, "driven_lanedir": 1.4566319270202164, "sim_render-ego": 0.05393584171930949, "in-drivable-lane": 3.250000000000009, "agent_compute-ego": 0.05399806261062622, "deviation-heading": 6.374119236351655, "set_robot_commands": 0.052275270620981855, "deviation-center-line": 0.858491495383649, "driven_lanedir_consec": 1.1594120095935598, "sim_compute_sim_state": 0.03297834873199463, "sim_compute_performance-ego": 0.05829410870869955, "sim_compute_robot_state-ego": 0.05601789077123006, "sim_compute_robot_state-npc0": 0.06391544500986734, "sim_compute_robot_state-npc1": 0.05810862382253011, "sim_compute_robot_state-npc2": 0.05718373298645019, "sim_compute_robot_state-npc3": 0.05702620267868042}}set_robot_commands_max 0.05340906062928757 set_robot_commands_mean 0.05261895129595376 set_robot_commands_median 0.052807218233744305 set_robot_commands_min 0.05106563007130342 sim_compute_performance-ego_max 0.05847697973251343 sim_compute_performance-ego_mean 0.05682745226007256 sim_compute_performance-ego_median 0.0570635131863884 sim_compute_performance-ego_min 0.05416064823375029 sim_compute_robot_state-ego_max 0.05659823636619412 sim_compute_robot_state-ego_mean 0.05520713362236915 sim_compute_robot_state-ego_median 0.05536910931269328 sim_compute_robot_state-ego_min 0.05304024359759162 sim_compute_robot_state-npc0_max 0.0644797047758414 sim_compute_robot_state-npc0_mean 0.06287912069239662 sim_compute_robot_state-npc0_median 0.0628569557311687 sim_compute_robot_state-npc0_min 0.06062632168040556 sim_compute_robot_state-npc1_max 0.058914424547182966 sim_compute_robot_state-npc1_mean 0.05753887745233859 sim_compute_robot_state-npc1_median 0.05769940818228373 sim_compute_robot_state-npc1_min 0.05532763705534093 sim_compute_robot_state-npc2_max 0.05801866857372984 sim_compute_robot_state-npc2_mean 0.05661521517413783 sim_compute_robot_state-npc2_median 0.05689828911107102 sim_compute_robot_state-npc2_min 0.05492656932157629 sim_compute_robot_state-npc3_max 0.05835630535300261 sim_compute_robot_state-npc3_mean 0.05641640034657914 sim_compute_robot_state-npc3_median 0.05647479216257731 sim_compute_robot_state-npc3_min 0.05462169647216797 sim_compute_sim_state_max 0.03302592833836873 sim_compute_sim_state_mean 0.03246582200682671 sim_compute_sim_state_median 0.03254434613898249 sim_compute_sim_state_min 0.03108338468215045 sim_physics_max 0.0879959493580431 sim_physics_mean 0.08576020605163567 sim_physics_median 0.08638741572697957 sim_physics_min 0.08210430145263672 sim_render-ego_max 0.05520607379018044 sim_render-ego_mean 0.053525166751272925 sim_render-ego_median 0.05372158249655923 sim_render-ego_min 0.05132751184351304 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.9266666666667 survival_time_min 3.1999999999999966
No reset possible 20423step1-simulation host-error no 2019-04-25 12:59:02+00:00 2019-04-25 13:00:07+00:00 0:01:05 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20423-308355', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20423-308355', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job20423-308355', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20378step1-simulation host-error no 2019-04-25 11:57:17+00:00 2019-04-25 12:00:08+00:00 0:02:51 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20378-398762', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20378-398762', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job20378-398762', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 
Konstantin Chaika