Evaluator 758

Baseline-IL-logs-tensorflow

step1-simulation

timeout

2019-04-24 13:01:07+00:00

2019-04-24 14:07:07+00:00

1:06:00

I can see how the jo [...]

I can see how the job 19217 is timeout because passed 3960 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19212

2960

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-24 12:39:14+00:00

2019-04-24 13:00:06+00:00

0:20:52

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19212-341305', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19212-341305', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19212-341305', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19206

2876

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-24 12:24:03+00:00

2019-04-24 12:37:39+00:00

0:13:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.225306900765771
survival_time_median	10.750000000000018
deviation-center-line_median	0.40864173779456053
in-drivable-lane_median	1.7000000000000242

other stats

agent_compute-ego_max	0.16592133474006926
agent_compute-ego_mean	0.1470446351787966
agent_compute-ego_median	0.15519603057827117
agent_compute-ego_min	0.11874779617344892
deviation-center-line_max	0.6491801892887803
deviation-center-line_mean	0.3683230725655418
deviation-center-line_min	0.1475671628461062
deviation-heading_max	2.2060076411946548
deviation-heading_mean	1.4163758252990906
deviation-heading_median	1.5250264276913703
deviation-heading_min	0.6970592634293067
driven_any_max	1.6057043265958648
driven_any_mean	1.3484469345214642
driven_any_median	1.5756972277649912
driven_any_min	0.9900494571900692
driven_lanedir_consec_max	1.4904214722299334
driven_lanedir_consec_mean	1.0721437270256324
driven_lanedir_consec_min	0.6474115509746436
driven_lanedir_max	1.4904214722299334
driven_lanedir_mean	1.0721437270256324
driven_lanedir_median	1.225306900765771
driven_lanedir_min	0.6474115509746436
in-drivable-lane_max	2.0499999999999927
in-drivable-lane_mean	1.4300000000000082
in-drivable-lane_min	0.25000000000000355
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.026983727654107184, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.06612682685577612, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.16592133474006926, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.10751755117512436, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.04263129337228459, "sim_compute_performance-ego": 0.0773885370158463, "sim_compute_robot_state-ego": 0.08063509309892174}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.02708565753741856, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.06578534362960035, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15967150152164655, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.10026298648249496, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.04044133729308191, "sim_compute_performance-ego": 0.0714397064960786, "sim_compute_robot_state-ego": 0.0729738378176724}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.02516557069102745, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.06338951085180446, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.15519603057827117, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.09911197504120556, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.03954737924139596, "sim_compute_performance-ego": 0.06842639093441813, "sim_compute_robot_state-ego": 0.07328529956629458}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.021583412968835165, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.0534469393796699, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.1356865128805471, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.08321098837741586, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.03474506444709245, "sim_compute_performance-ego": 0.05867697693580805, "sim_compute_robot_state-ego": 0.062024448084276776}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.018315398030810885, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.048279932251682985, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.11874779617344892, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.0727708946775507, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.030363351106643677, "sim_compute_performance-ego": 0.051843612282364455, "sim_compute_robot_state-ego": 0.05399167096173322}}
set_robot_commands_max	0.10751755117512436
set_robot_commands_mean	0.09257487915075828
set_robot_commands_median	0.09911197504120556
set_robot_commands_min	0.0727708946775507
sim_compute_performance-ego_max	0.0773885370158463
sim_compute_performance-ego_mean	0.0655550447329031
sim_compute_performance-ego_median	0.06842639093441813
sim_compute_performance-ego_min	0.051843612282364455
sim_compute_robot_state-ego_max	0.08063509309892174
sim_compute_robot_state-ego_mean	0.06858206990577974
sim_compute_robot_state-ego_median	0.0729738378176724
sim_compute_robot_state-ego_min	0.05399167096173322
sim_compute_sim_state_max	0.04263129337228459
sim_compute_sim_state_mean	0.03754568509209971
sim_compute_sim_state_median	0.03954737924139596
sim_compute_sim_state_min	0.030363351106643677
sim_physics_max	0.02708565753741856
sim_physics_mean	0.023826753376439847
sim_physics_median	0.02516557069102745
sim_physics_min	0.018315398030810885
sim_render-ego_max	0.06612682685577612
sim_render-ego_mean	0.059405710593706765
sim_render-ego_median	0.06338951085180446
sim_render-ego_min	0.048279932251682985
simulation-passed	1
survival_time_max	11.150000000000023
survival_time_mean	9.300000000000004
survival_time_min	6.849999999999984

No reset possible

19201

2920

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-24 12:14:58+00:00

2019-04-24 12:21:46+00:00

0:06:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.04894519907501538
survival_time_median	1.5000000000000009
deviation-center-line_median	0.019568709664935343
in-drivable-lane_median	0.6000000000000004

other stats

agent_compute-ego_max	0.2097447149215206
agent_compute-ego_mean	0.18829212225294664
agent_compute-ego_median	0.18342870555511892
agent_compute-ego_min	0.1723336515755489
deviation-center-line_max	0.055845663420438216
deviation-center-line_mean	0.02667294937405369
deviation-center-line_min	0.015106299229305708
deviation-heading_max	1.374091164975141
deviation-heading_mean	0.709419027844078
deviation-heading_median	0.5790946242870849
deviation-heading_min	0.5027835669755683
driven_any_max	0.3697402739410986
driven_any_mean	0.1883765059814193
driven_any_median	0.14732012163077698
driven_any_min	0.1351741044581308
driven_lanedir_consec_max	0.10962975196309888
driven_lanedir_consec_mean	0.05603572009757731
driven_lanedir_consec_min	0.03394951570536042
driven_lanedir_max	0.10962975196309888
driven_lanedir_mean	0.05603572009757731
driven_lanedir_median	0.04894519907501538
driven_lanedir_min	0.03394951570536042
in-drivable-lane_max	1.6499999999999988
in-drivable-lane_mean	0.7600000000000001
in-drivable-lane_min	0.4500000000000004
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1488499841092094, "sim_physics": 0.034392372254402406, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04894519907501538, "sim_render-ego": 0.07637553061208417, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.2097447149215206, "deviation-heading": 0.5027835669755683, "set_robot_commands": 0.14600810697001795, "deviation-center-line": 0.01777426099077491, "driven_lanedir_consec": 0.04894519907501538, "sim_compute_sim_state": 0.04707174147329023, "sim_compute_performance-ego": 0.08162842258330315, "sim_compute_robot_state-ego": 0.10432704033390168}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14732012163077698, "sim_physics": 0.02419180705629546, "survival_time": 1.4500000000000006, "driven_lanedir": 0.052510078244582425, "sim_render-ego": 0.06251803759870858, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1723336515755489, "deviation-heading": 0.5852683358837822, "set_robot_commands": 0.10119563135607489, "deviation-center-line": 0.025069813564814292, "driven_lanedir_consec": 0.052510078244582425, "sim_compute_sim_state": 0.03790623566199993, "sim_compute_performance-ego": 0.06604019526777596, "sim_compute_robot_state-ego": 0.06883663144604914}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14079804576788066, "sim_physics": 0.0266555013327763, "survival_time": 1.4500000000000006, "driven_lanedir": 0.03514405549982946, "sim_render-ego": 0.06430119481580011, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.1775062084197998, "deviation-heading": 0.5790946242870849, "set_robot_commands": 0.10293786279086407, "deviation-center-line": 0.019568709664935343, "driven_lanedir_consec": 0.03514405549982946, "sim_compute_sim_state": 0.04250561779943006, "sim_compute_performance-ego": 0.07154022414108803, "sim_compute_robot_state-ego": 0.07455087530201879}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1351741044581308, "sim_physics": 0.02938395341237386, "survival_time": 1.5000000000000009, "driven_lanedir": 0.03394951570536042, "sim_render-ego": 0.06782314777374268, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.19844733079274496, "deviation-heading": 0.5058574470988132, "set_robot_commands": 0.1149623155593872, "deviation-center-line": 0.015106299229305708, "driven_lanedir_consec": 0.03394951570536042, "sim_compute_sim_state": 0.041716599464416505, "sim_compute_performance-ego": 0.07264207204182943, "sim_compute_robot_state-ego": 0.0830795923868815}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3697402739410986, "sim_physics": 0.02906933549332292, "survival_time": 3.649999999999995, "driven_lanedir": 0.10962975196309888, "sim_render-ego": 0.06400034199022267, "in-drivable-lane": 1.6499999999999988, "agent_compute-ego": 0.18342870555511892, "deviation-heading": 1.374091164975141, "set_robot_commands": 0.10223155805509385, "deviation-center-line": 0.055845663420438216, "driven_lanedir_consec": 0.10962975196309888, "sim_compute_sim_state": 0.04048989570304139, "sim_compute_performance-ego": 0.07387621435400558, "sim_compute_robot_state-ego": 0.074985680514819}}
set_robot_commands_max	0.14600810697001795
set_robot_commands_mean	0.1134670949462876
set_robot_commands_median	0.10293786279086407
set_robot_commands_min	0.10119563135607489
sim_compute_performance-ego_max	0.08162842258330315
sim_compute_performance-ego_mean	0.07314542567760043
sim_compute_performance-ego_median	0.07264207204182943
sim_compute_performance-ego_min	0.06604019526777596
sim_compute_robot_state-ego_max	0.10432704033390168
sim_compute_robot_state-ego_mean	0.08115596399673403
sim_compute_robot_state-ego_median	0.074985680514819
sim_compute_robot_state-ego_min	0.06883663144604914
sim_compute_sim_state_max	0.04707174147329023
sim_compute_sim_state_mean	0.04193801802043562
sim_compute_sim_state_median	0.041716599464416505
sim_compute_sim_state_min	0.03790623566199993
sim_physics_max	0.034392372254402406
sim_physics_mean	0.02873859390983419
sim_physics_median	0.02906933549332292
sim_physics_min	0.02419180705629546
sim_render-ego_max	0.07637553061208417
sim_render-ego_mean	0.06700365055811164
sim_render-ego_median	0.06430119481580011
sim_render-ego_min	0.06251803759870858
simulation-passed	1
survival_time_max	3.649999999999995
survival_time_mean	1.9199999999999997
survival_time_min	1.4500000000000006

No reset possible

19196

2814

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

error

2019-04-24 12:12:15+00:00

2019-04-24 12:14:34+00:00

0:02:19

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19188

2866

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 12:06:32+00:00

2019-04-24 12:11:48+00:00

0:05:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19183

2876

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

error

2019-04-24 12:01:54+00:00

2019-04-24 12:05:53+00:00

0:03:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19175

2956

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-24 11:57:39+00:00

2019-04-24 12:01:46+00:00

0:04:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19175-532822', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19175-532822', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19175-532822', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19171

2967

Andrea Censi 🇨🇭

Python template

step2-scoring

success

yes

2019-04-24 09:26:48+00:00

2019-04-24 09:26:55+00:00

0:00:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-33.47501268485958

other stats

efficiency	-67.21537073943841
fleet_size	-1000000000

No reset possible

19165

2967

Andrea Censi 🇨🇭

Python template

step1-simulation

success

yes

2019-04-24 09:22:40+00:00

2019-04-24 09:26:14+00:00

0:03:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19158

2917

Python template

step1-simulation

success

yes

2019-04-24 09:16:36+00:00

2019-04-24 09:19:50+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19154

2296

Andrea Censi 🇨🇭

Java template

aido2-AMOD-fleet_size

step1-simulation

error

yes

2019-04-24 09:11:18+00:00

2019-04-24 09:11:39+00:00

0:00:21

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19153

2299

Andrea Censi 🇨🇭

Python template

aido2-AMOD-fleet_size

step2-scoring

success

yes

2019-04-24 09:10:57+00:00

2019-04-24 09:11:05+00:00

0:00:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

fleet_size

-1000000000

other stats

efficiency	-63.224244841298024
service_quality	-32.50706121032528

No reset possible

19146

2299

Andrea Censi 🇨🇭

Python template

aido2-AMOD-fleet_size

step1-simulation

success

yes

2019-04-24 09:07:08+00:00

2019-04-24 09:10:37+00:00

0:03:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19143

2312

Andrea Censi 🇨🇭

Python template

step2-scoring

success

yes

2019-04-24 09:06:38+00:00

2019-04-24 09:06:51+00:00

0:00:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.878462503618636

other stats

efficiency	-64.33441001447456
fleet_size	-1000000000

No reset possible

19137

2312

Andrea Censi 🇨🇭

Python template

step1-simulation

success

yes

2019-04-24 09:01:50+00:00

2019-04-24 09:06:00+00:00

0:04:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19133

2307

Andrea Censi 🇨🇭

Java template

step1-simulation

error

yes

2019-04-24 08:57:17+00:00

2019-04-24 08:58:47+00:00

0:01:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19129

2956

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-24 06:04:12+00:00

2019-04-24 06:24:57+00:00

0:20:45

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19119

2965

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-24 05:41:00+00:00

2019-04-24 06:00:05+00:00

0:19:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19119-17084', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19119-17084', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19119-17084', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19098

2920

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-23 22:30:36+00:00

2019-04-23 22:43:14+00:00

0:12:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.05503948988718976
survival_time_median	1.6000000000000008
deviation-center-line_median	0.021368899876973043
in-drivable-lane_median	0.5500000000000005

other stats

agent_compute-ego_max	0.1917596709343695
agent_compute-ego_mean	0.15928218862137605
agent_compute-ego_median	0.16851790994405746
agent_compute-ego_min	0.12410421082467744
deviation-center-line_max	0.20863991482808647
deviation-center-line_mean	0.059107745225934705
deviation-center-line_min	0.01945596556210035
deviation-heading_max	5.7899782927144114
deviation-heading_mean	1.592094662713092
deviation-heading_median	0.540782371852935
deviation-heading_min	0.518155317786575
driven_any_max	1.5835035156517476
driven_any_mean	0.4377825315095598
driven_any_median	0.1506666047350336
driven_any_min	0.1472720943615614
driven_lanedir_consec_max	0.4193396915979617
driven_lanedir_consec_mean	0.1273973689150028
driven_lanedir_consec_min	0.050272905623975905
driven_lanedir_max	0.4193396915979617
driven_lanedir_mean	0.1273973689150028
driven_lanedir_median	0.05503948988718976
driven_lanedir_min	0.050272905623975905
in-drivable-lane_max	7.550000000000047
in-drivable-lane_mean	1.97000000000001
in-drivable-lane_min	0.5500000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1493863665850726, "sim_physics": 0.027909286560550813, "survival_time": 1.5500000000000007, "driven_lanedir": 0.050272905623975905, "sim_render-ego": 0.07325280097223097, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1917596709343695, "deviation-heading": 0.540782371852935, "set_robot_commands": 0.1033792341909101, "deviation-center-line": 0.01945596556210035, "driven_lanedir_consec": 0.050272905623975905, "sim_compute_sim_state": 0.043977714353992094, "sim_compute_performance-ego": 0.07278475453776698, "sim_compute_robot_state-ego": 0.07938658806585497}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5835035156517476, "sim_physics": 0.025386330286661783, "survival_time": 14.950000000000076, "driven_lanedir": 0.4193396915979617, "sim_render-ego": 0.06846429189046224, "in-drivable-lane": 7.550000000000047, "agent_compute-ego": 0.18136383374532064, "deviation-heading": 5.7899782927144114, "set_robot_commands": 0.10111372868220012, "deviation-center-line": 0.20863991482808647, "driven_lanedir_consec": 0.4193396915979617, "sim_compute_sim_state": 0.041828173796335855, "sim_compute_performance-ego": 0.07317468086878459, "sim_compute_robot_state-ego": 0.07694819688796997}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15808407621438372, "sim_physics": 0.020208515226840973, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05928198364078874, "sim_render-ego": 0.06346787512302399, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16851790994405746, "deviation-heading": 0.5838767817604948, "set_robot_commands": 0.09719919413328172, "deviation-center-line": 0.026455877334933688, "driven_lanedir_consec": 0.05928198364078874, "sim_compute_sim_state": 0.03883811831474304, "sim_compute_performance-ego": 0.06517990678548813, "sim_compute_robot_state-ego": 0.06814649701118469}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1506666047350336, "sim_physics": 0.017051761800592594, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05305277382509787, "sim_render-ego": 0.04797156651814779, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.12410421082467744, "deviation-heading": 0.518155317786575, "set_robot_commands": 0.06790939244357022, "deviation-center-line": 0.019618068527579996, "driven_lanedir_consec": 0.05305277382509787, "sim_compute_sim_state": 0.026946125608502017, "sim_compute_performance-ego": 0.047468409393772934, "sim_compute_robot_state-ego": 0.048518029126254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1472720943615614, "sim_physics": 0.01795112702154344, "survival_time": 1.5500000000000007, "driven_lanedir": 0.05503948988718976, "sim_render-ego": 0.050712677740281625, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.13066531765845515, "deviation-heading": 0.5276805494510427, "set_robot_commands": 0.0725464436315721, "deviation-center-line": 0.021368899876973043, "driven_lanedir_consec": 0.05503948988718976, "sim_compute_sim_state": 0.028516354099396735, "sim_compute_performance-ego": 0.05063129240466702, "sim_compute_robot_state-ego": 0.05261184323218561}}
set_robot_commands_max	0.1033792341909101
set_robot_commands_mean	0.08842959861630685
set_robot_commands_median	0.09719919413328172
set_robot_commands_min	0.06790939244357022
sim_compute_performance-ego_max	0.07317468086878459
sim_compute_performance-ego_mean	0.06184780879809593
sim_compute_performance-ego_median	0.06517990678548813
sim_compute_performance-ego_min	0.047468409393772934
sim_compute_robot_state-ego_max	0.07938658806585497
sim_compute_robot_state-ego_mean	0.06512223086468985
sim_compute_robot_state-ego_median	0.06814649701118469
sim_compute_robot_state-ego_min	0.048518029126254
sim_compute_sim_state_max	0.043977714353992094
sim_compute_sim_state_mean	0.03602129723459395
sim_compute_sim_state_median	0.03883811831474304
sim_compute_sim_state_min	0.026946125608502017
sim_physics_max	0.027909286560550813
sim_physics_mean	0.02170140417923792
sim_physics_median	0.020208515226840973
sim_physics_min	0.017051761800592594
sim_render-ego_max	0.07325280097223097
sim_render-ego_mean	0.06077384244882933
sim_render-ego_median	0.06346787512302399
sim_render-ego_min	0.04797156651814779
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.260000000000017
survival_time_min	1.5500000000000007

No reset possible

19074

2916

Python template

step1-simulation

aborted

2019-04-23 14:18:43+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19071

2917

Python template

step1-simulation

aborted

2019-04-23 14:18:08+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19059

2914

Python template

step1-simulation

host-error

2019-04-23 14:01:04+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19055

2915

Python template

step1-simulation

host-error

2019-04-23 14:00:27+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19044

2910

FANG MEIYI 🇸🇬

test

step1-simulation

success

2019-04-23 09:23:21+00:00

2019-04-23 09:42:38+00:00

0:19:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.8193400092698555
survival_time_median	14.950000000000076
deviation-center-line_median	0.48663705267581314
in-drivable-lane_median	2.049999999999998

other stats

agent_compute-ego_max	0.09546529054641724
agent_compute-ego_mean	0.09440577840805052
agent_compute-ego_median	0.09422386884689332
agent_compute-ego_min	0.09377121925354004
deviation-center-line_max	0.5865137278344811
deviation-center-line_mean	0.4407779549689742
deviation-center-line_min	0.22117707660560113
deviation-heading_max	2.6663684618290264
deviation-heading_mean	1.8855362711406651
deviation-heading_median	2.280212867788918
deviation-heading_min	0.7406800962199922
driven_any_max	3.608474259102237
driven_any_mean	3.438111703960274
driven_any_median	3.3951943683440025
driven_any_min	3.3009537394164084
driven_lanedir_consec_max	3.600349563872293
driven_lanedir_consec_mean	2.982744562321706
driven_lanedir_consec_min	2.5951467077067782
driven_lanedir_max	3.600349563872293
driven_lanedir_mean	2.982744562321706
driven_lanedir_median	2.8193400092698555
driven_lanedir_min	2.5951467077067782
in-drivable-lane_max	2.6999999999999904
in-drivable-lane_mean	1.7100000000000015
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.3009537394164084, "sim_physics": 0.014278619289398194, "survival_time": 14.950000000000076, "driven_lanedir": 2.5951467077067782, "sim_render-ego": 0.04013775904973348, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.09546529054641724, "deviation-heading": 2.6663684618290264, "set_robot_commands": 0.058231108983357746, "deviation-center-line": 0.5865137278344811, "driven_lanedir_consec": 2.5951467077067782, "sim_compute_sim_state": 0.02408519585927327, "sim_compute_performance-ego": 0.04046559651692709, "sim_compute_robot_state-ego": 0.04178404092788696}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.608474259102237, "sim_physics": 0.014100237687428793, "survival_time": 14.950000000000076, "driven_lanedir": 3.600349563872293, "sim_render-ego": 0.03987396001815796, "in-drivable-lane": 0, "agent_compute-ego": 0.09422386884689332, "deviation-heading": 0.7406800962199922, "set_robot_commands": 0.058220455646514895, "deviation-center-line": 0.22117707660560113, "driven_lanedir_consec": 3.600349563872293, "sim_compute_sim_state": 0.024166877269744872, "sim_compute_performance-ego": 0.041380321979522704, "sim_compute_robot_state-ego": 0.04194207588831584}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.5164352853287837, "sim_physics": 0.014644663333892822, "survival_time": 14.950000000000076, "driven_lanedir": 3.1133464434004106, "sim_render-ego": 0.03971490621566773, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.09477132717768352, "deviation-heading": 1.345793545487199, "set_robot_commands": 0.0571711532274882, "deviation-center-line": 0.3517845008327363, "driven_lanedir_consec": 3.1133464434004106, "sim_compute_sim_state": 0.02408954620361328, "sim_compute_performance-ego": 0.04006438732147217, "sim_compute_robot_state-ego": 0.041565108299255374}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.3695008676099416, "sim_physics": 0.014217669169108074, "survival_time": 14.950000000000076, "driven_lanedir": 2.8193400092698555, "sim_render-ego": 0.03897465149561564, "in-drivable-lane": 2.049999999999998, "agent_compute-ego": 0.0937971862157186, "deviation-heading": 2.394626384378191, "set_robot_commands": 0.05814625422159831, "deviation-center-line": 0.5577774168962394, "driven_lanedir_consec": 2.8193400092698555, "sim_compute_sim_state": 0.02381066878636678, "sim_compute_performance-ego": 0.03992063124974569, "sim_compute_robot_state-ego": 0.04133602062861125}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3951943683440025, "sim_physics": 0.013755029042561848, "survival_time": 14.950000000000076, "driven_lanedir": 2.785540087359194, "sim_render-ego": 0.03908318916956584, "in-drivable-lane": 2.299999999999999, "agent_compute-ego": 0.09377121925354004, "deviation-heading": 2.280212867788918, "set_robot_commands": 0.060993390878041585, "deviation-center-line": 0.48663705267581314, "driven_lanedir_consec": 2.785540087359194, "sim_compute_sim_state": 0.02393679141998291, "sim_compute_performance-ego": 0.040183515548706056, "sim_compute_robot_state-ego": 0.04201471885045369}}
set_robot_commands_max	0.060993390878041585
set_robot_commands_mean	0.05855247259140014
set_robot_commands_median	0.058220455646514895
set_robot_commands_min	0.0571711532274882
sim_compute_performance-ego_max	0.041380321979522704
sim_compute_performance-ego_mean	0.04040289052327474
sim_compute_performance-ego_median	0.040183515548706056
sim_compute_performance-ego_min	0.03992063124974569
sim_compute_robot_state-ego_max	0.04201471885045369
sim_compute_robot_state-ego_mean	0.04172839291890462
sim_compute_robot_state-ego_median	0.04178404092788696
sim_compute_robot_state-ego_min	0.04133602062861125
sim_compute_sim_state_max	0.024166877269744872
sim_compute_sim_state_mean	0.024017815907796225
sim_compute_sim_state_median	0.02408519585927327
sim_compute_sim_state_min	0.02381066878636678
sim_physics_max	0.014644663333892822
sim_physics_mean	0.014199243704477943
sim_physics_median	0.014217669169108074
sim_physics_min	0.013755029042561848
sim_render-ego_max	0.04013775904973348
sim_render-ego_mean	0.03955689318974813
sim_render-ego_median	0.03971490621566773
sim_render-ego_min	0.03897465149561564
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

19036

2908

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-23 08:19:56+00:00

2019-04-23 08:41:53+00:00

0:21:57

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19004

2891

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:29:18+00:00

2019-04-22 17:29:19+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18994

2892

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:28:29+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18985

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:27:48+00:00

2019-04-22 17:27:49+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18984

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:27:34+00:00

2019-04-22 17:27:35+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18965

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

2019-04-22 16:53:43+00:00

2019-04-22 16:53:44+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18964

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

2019-04-22 16:53:05+00:00

2019-04-22 16:53:06+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18951

2887

Diego Charrez 🇵🇪

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-22 15:29:27+00:00

2019-04-22 15:32:40+00:00

0:03:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10522496582380972
error_L2	0.018111485398148615

No reset possible

18943

2880

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

error

2019-04-21 02:00:34+00:00

2019-04-21 02:21:32+00:00

0:20:58

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18936

2881

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-21 01:53:22+00:00

2019-04-21 02:00:05+00:00

0:06:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18936-436643', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18936-436643', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18936-436643', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18924

2366

Andrea Censi 🇨🇭

random_agent

step1-simulation

host-error

2019-04-20 15:45:00+00:00

2019-04-20 16:00:04+00:00

0:15:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18924-808550', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18924-808550', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18924-808550', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18910

2379

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

error

2019-04-20 15:23:45+00:00

2019-04-20 15:44:39+00:00

0:20:54

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18902

2391

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-20 15:14:37+00:00

2019-04-20 15:23:31+00:00

0:08:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.15333844283047846
agent_compute-ego_mean	0.14384285479128822
agent_compute-ego_median	0.14304714732699925
agent_compute-ego_min	0.13442683219909668
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025132647100484597, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06874364277101913, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13442683219909668, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0973340835211412, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.037629190480934, "sim_compute_performance-ego": 0.07204171396651358, "sim_compute_robot_state-ego": 0.07077520298507978}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.02402825247157704, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06455571543086659, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13747149164026434, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0952471603046764, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03784231706099077, "sim_compute_performance-ego": 0.07031086358157071, "sim_compute_robot_state-ego": 0.07113799181851474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.0257973935869005, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.07047122319539388, "in-drivable-lane": 0, "agent_compute-ego": 0.14304714732699925, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.10136095152960883, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.040460862053765194, "sim_compute_performance-ego": 0.07530066702100965, "sim_compute_robot_state-ego": 0.07426282034979927}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02851329743862152, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.07261541485786438, "in-drivable-lane": 0, "agent_compute-ego": 0.15093035995960236, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.1097986747821172, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.043391287326812744, "sim_compute_performance-ego": 0.077512522538503, "sim_compute_robot_state-ego": 0.08191719651222229}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02880274898865644, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07061425377340878, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.15333844283047846, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.11205858693403356, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.042708288220798266, "sim_compute_performance-ego": 0.07513618469238281, "sim_compute_robot_state-ego": 0.0836683757164899}}
set_robot_commands_max	0.11205858693403356
set_robot_commands_mean	0.10315989141431545
set_robot_commands_median	0.10136095152960883
set_robot_commands_min	0.0952471603046764
sim_compute_performance-ego_max	0.077512522538503
sim_compute_performance-ego_mean	0.07406039035999595
sim_compute_performance-ego_median	0.07513618469238281
sim_compute_performance-ego_min	0.07031086358157071
sim_compute_robot_state-ego_max	0.0836683757164899
sim_compute_robot_state-ego_mean	0.0763523174764212
sim_compute_robot_state-ego_median	0.07426282034979927
sim_compute_robot_state-ego_min	0.07077520298507978
sim_compute_sim_state_max	0.043391287326812744
sim_compute_sim_state_mean	0.04040638902866019
sim_compute_sim_state_median	0.040460862053765194
sim_compute_sim_state_min	0.037629190480934
sim_physics_max	0.02880274898865644
sim_physics_mean	0.026454867917248017
sim_physics_median	0.0257973935869005
sim_physics_min	0.02402825247157704
sim_render-ego_max	0.07261541485786438
sim_render-ego_mean	0.06940005000571056
sim_render-ego_median	0.07047122319539388
sim_render-ego_min	0.06455571543086659
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18888

2405

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-20 15:01:29+00:00

2019-04-20 15:11:17+00:00

0:09:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08595126138431786
survival_time_median	1.4000000000000006
deviation-center-line_median	0.042884252215555335
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.23131324563707625
agent_compute-ego_mean	0.20078275037246224
agent_compute-ego_median	0.20319111116470828
agent_compute-ego_min	0.17519317354474748
deviation-center-line_max	0.04553681666531298
deviation-center-line_mean	0.04069147044823436
deviation-center-line_min	0.03579213847843083
deviation-heading_max	0.7234005444131596
deviation-heading_mean	0.66913162515038
deviation-heading_median	0.6726444447237778
deviation-heading_min	0.6184508726618281
driven_any_max	0.18057832557590056
driven_any_mean	0.1609948371734126
driven_any_median	0.15884819503890493
driven_any_min	0.1488537843738686
driven_lanedir_consec_max	0.09166495439949474
driven_lanedir_consec_mean	0.080998721777361
driven_lanedir_consec_min	0.061881391449168266
driven_lanedir_max	0.09166495439949474
driven_lanedir_mean	0.080998721777361
driven_lanedir_median	0.08595126138431786
driven_lanedir_min	0.061881391449168266
in-drivable-lane_max	0.4500000000000004
in-drivable-lane_mean	0.29000000000000026
in-drivable-lane_min	0.15000000000000013
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15441004213921228, "sim_physics": 0.042737122504941875, "survival_time": 1.5500000000000007, "driven_lanedir": 0.061881391449168266, "sim_render-ego": 0.06637969324665685, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.20319111116470828, "deviation-heading": 0.6533627898204206, "set_robot_commands": 0.10309602368262506, "deviation-center-line": 0.03579213847843083, "driven_lanedir_consec": 0.061881391449168266, "sim_compute_sim_state": 0.03982107100948211, "sim_compute_performance-ego": 0.07611695412666566, "sim_compute_robot_state-ego": 0.08339441976239605, "sim_compute_robot_state-npc0": 0.0702232007057436, "sim_compute_robot_state-npc1": 0.07334068513685657, "sim_compute_robot_state-npc2": 0.06773137277172457, "sim_compute_robot_state-npc3": 0.07150094739852413}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16228383873917648, "sim_physics": 0.03789648839405605, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09166495439949474, "sim_render-ego": 0.07044152702604022, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17519317354474748, "deviation-heading": 0.6726444447237778, "set_robot_commands": 0.09283851725714548, "deviation-center-line": 0.04553681666531298, "driven_lanedir_consec": 0.09166495439949474, "sim_compute_sim_state": 0.038733950683048794, "sim_compute_performance-ego": 0.07084046942847115, "sim_compute_robot_state-ego": 0.07657359327588763, "sim_compute_robot_state-npc0": 0.07267207758767265, "sim_compute_robot_state-npc1": 0.07347667217254639, "sim_compute_robot_state-npc2": 0.07134033952440534, "sim_compute_robot_state-npc3": 0.06883679968970162}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18057832557590056, "sim_physics": 0.04597964882850647, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08595126138431786, "sim_render-ego": 0.0717901960015297, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.21680358797311783, "deviation-heading": 0.6184508726618281, "set_robot_commands": 0.11307478696107864, "deviation-center-line": 0.036104656353096246, "driven_lanedir_consec": 0.08595126138431786, "sim_compute_sim_state": 0.04432643949985504, "sim_compute_performance-ego": 0.07570398598909378, "sim_compute_robot_state-ego": 0.08786001056432724, "sim_compute_robot_state-npc0": 0.07530899345874786, "sim_compute_robot_state-npc1": 0.07414795458316803, "sim_compute_robot_state-npc2": 0.07312138378620148, "sim_compute_robot_state-npc3": 0.07389350235462189}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15884819503890493, "sim_physics": 0.046666315623692105, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08842834763541596, "sim_render-ego": 0.07076143366949898, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.23131324563707625, "deviation-heading": 0.677799474132714, "set_robot_commands": 0.11058000155857632, "deviation-center-line": 0.04313948852877644, "driven_lanedir_consec": 0.08842834763541596, "sim_compute_sim_state": 0.043103507586887906, "sim_compute_performance-ego": 0.07340445688792638, "sim_compute_robot_state-ego": 0.0824136734008789, "sim_compute_robot_state-npc0": 0.0769133312361581, "sim_compute_robot_state-npc1": 0.07720364843096052, "sim_compute_robot_state-npc2": 0.07731146471840995, "sim_compute_robot_state-npc3": 0.0771152036530631}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1488537843738686, "sim_physics": 0.038907395468817815, "survival_time": 1.3500000000000003, "driven_lanedir": 0.0770676540184082, "sim_render-ego": 0.07072880533006456, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17741263354266132, "deviation-heading": 0.7234005444131596, "set_robot_commands": 0.12057057133427372, "deviation-center-line": 0.042884252215555335, "driven_lanedir_consec": 0.0770676540184082, "sim_compute_sim_state": 0.04206922319200304, "sim_compute_performance-ego": 0.07260228086400915, "sim_compute_robot_state-ego": 0.07902927751894351, "sim_compute_robot_state-npc0": 0.07855750896312573, "sim_compute_robot_state-npc1": 0.07212883454781992, "sim_compute_robot_state-npc2": 0.07486322191026476, "sim_compute_robot_state-npc3": 0.07586989579377351}}
set_robot_commands_max	0.12057057133427372
set_robot_commands_mean	0.10803198015873984
set_robot_commands_median	0.11058000155857632
set_robot_commands_min	0.09283851725714548
sim_compute_performance-ego_max	0.07611695412666566
sim_compute_performance-ego_mean	0.07373362945923322
sim_compute_performance-ego_median	0.07340445688792638
sim_compute_performance-ego_min	0.07084046942847115
sim_compute_robot_state-ego_max	0.08786001056432724
sim_compute_robot_state-ego_mean	0.08185419490448667
sim_compute_robot_state-ego_median	0.0824136734008789
sim_compute_robot_state-ego_min	0.07657359327588763
sim_compute_robot_state-npc0_max	0.07855750896312573
sim_compute_robot_state-npc0_mean	0.07473502239028959
sim_compute_robot_state-npc0_median	0.07530899345874786
sim_compute_robot_state-npc0_min	0.0702232007057436
sim_compute_robot_state-npc1_max	0.07720364843096052
sim_compute_robot_state-npc1_mean	0.07405955897427029
sim_compute_robot_state-npc1_median	0.07347667217254639
sim_compute_robot_state-npc1_min	0.07212883454781992
sim_compute_robot_state-npc2_max	0.07731146471840995
sim_compute_robot_state-npc2_mean	0.07287355654220122
sim_compute_robot_state-npc2_median	0.07312138378620148
sim_compute_robot_state-npc2_min	0.06773137277172457
sim_compute_robot_state-npc3_max	0.0771152036530631
sim_compute_robot_state-npc3_mean	0.07344326977793685
sim_compute_robot_state-npc3_median	0.07389350235462189
sim_compute_robot_state-npc3_min	0.06883679968970162
sim_compute_sim_state_max	0.04432643949985504
sim_compute_sim_state_mean	0.041610838394255376
sim_compute_sim_state_median	0.04206922319200304
sim_compute_sim_state_min	0.038733950683048794
sim_physics_max	0.046666315623692105
sim_physics_mean	0.04243739416400286
sim_physics_median	0.042737122504941875
sim_physics_min	0.03789648839405605
sim_render-ego_max	0.0717901960015297
sim_render-ego_mean	0.07002033105475806
sim_render-ego_median	0.07072880533006456
sim_render-ego_min	0.06637969324665685
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.4600000000000004
survival_time_min	1.3500000000000003

No reset possible

18885

2409

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-20 14:54:50+00:00

2019-04-20 15:00:04+00:00

0:05:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18885-469330', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18885-469330', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18885-469330', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18872

2417

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-20 14:40:19+00:00

2019-04-20 14:46:57+00:00

0:06:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.10661969465367936
agent_compute-ego_mean	0.0984826215698208
agent_compute-ego_median	0.09994447773153133
agent_compute-ego_min	0.08559565246105194
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.017477957707531046, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0494289128285534, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.09899775487072064, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.06725154732758144, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.030742078457238534, "sim_compute_performance-ego": 0.05153427034054162, "sim_compute_robot_state-ego": 0.05294372450630619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.017818212509155273, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.04987491260875355, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.09994447773153133, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07103879343379628, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.030450858853080055, "sim_compute_performance-ego": 0.050279871983961624, "sim_compute_robot_state-ego": 0.0522913932800293}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.018808105256822374, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.04889242384168837, "in-drivable-lane": 0, "agent_compute-ego": 0.10125552813212076, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07329201698303223, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.030870432323879662, "sim_compute_performance-ego": 0.054189607832166885, "sim_compute_robot_state-ego": 0.05374817848205567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.014989654223124186, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.041318719585736595, "in-drivable-lane": 0, "agent_compute-ego": 0.08559565246105194, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.05858900646368662, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.025640174746513367, "sim_compute_performance-ego": 0.042055606842041016, "sim_compute_robot_state-ego": 0.04249880711237589}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.019024186274584604, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05103454870336196, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.10661969465367936, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.0709417181856492, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.031420697184169996, "sim_compute_performance-ego": 0.05240492259754854, "sim_compute_robot_state-ego": 0.052918595426222854}}
set_robot_commands_max	0.07329201698303223
set_robot_commands_mean	0.06822261647874915
set_robot_commands_median	0.0709417181856492
set_robot_commands_min	0.05858900646368662
sim_compute_performance-ego_max	0.054189607832166885
sim_compute_performance-ego_mean	0.050092855919251944
sim_compute_performance-ego_median	0.05153427034054162
sim_compute_performance-ego_min	0.042055606842041016
sim_compute_robot_state-ego_max	0.05374817848205567
sim_compute_robot_state-ego_mean	0.05088013976139798
sim_compute_robot_state-ego_median	0.052918595426222854
sim_compute_robot_state-ego_min	0.04249880711237589
sim_compute_sim_state_max	0.031420697184169996
sim_compute_sim_state_mean	0.029824848312976326
sim_compute_sim_state_median	0.030742078457238534
sim_compute_sim_state_min	0.025640174746513367
sim_physics_max	0.019024186274584604
sim_physics_mean	0.017623623194243498
sim_physics_median	0.017818212509155273
sim_physics_min	0.014989654223124186
sim_render-ego_max	0.05103454870336196
sim_render-ego_mean	0.04810990351361878
sim_render-ego_median	0.0494289128285534
sim_render-ego_min	0.041318719585736595
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18865

2433

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-20 14:39:25+00:00

2019-04-20 14:40:00+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18848

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-20 14:17:45+00:00

2019-04-20 14:39:18+00:00

0:21:33

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18824

2500

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-20 14:05:48+00:00

2019-04-20 14:16:40+00:00

0:10:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.05522893076307578
survival_time_median	1.6000000000000008
deviation-center-line_median	0.024870752063703767
in-drivable-lane_median	0.5500000000000005

other stats

agent_compute-ego_max	0.21053941547870636
agent_compute-ego_mean	0.1581518861555284
agent_compute-ego_median	0.15770244598388672
agent_compute-ego_min	0.12673716391286544
deviation-center-line_max	0.03320965981486065
deviation-center-line_mean	0.026221284491714465
deviation-center-line_min	0.021983274358116586
deviation-heading_max	0.6325534322289739
deviation-heading_mean	0.594898127193156
deviation-heading_median	0.594331577434672
deviation-heading_min	0.556530181612281
driven_any_max	0.15829499710780812
driven_any_mean	0.1529038495370036
driven_any_median	0.15279881124159397
driven_any_min	0.14709359280609902
driven_lanedir_consec_max	0.06470955154570013
driven_lanedir_consec_mean	0.05585206853033671
driven_lanedir_consec_min	0.04833626621221088
driven_lanedir_max	0.06470955154570013
driven_lanedir_mean	0.05585206853033671
driven_lanedir_median	0.05522893076307578
driven_lanedir_min	0.04833626621221088
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.5400000000000006
in-drivable-lane_min	0.4500000000000004
per-episodes	details {"udem1-0-0": {"driven_any": 0.15829499710780812, "sim_physics": 0.031107018070836222, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06470955154570013, "sim_render-ego": 0.04839560293382214, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.12673716391286544, "deviation-heading": 0.6325534322289739, "set_robot_commands": 0.07541135049635364, "deviation-center-line": 0.03320965981486065, "driven_lanedir_consec": 0.06470955154570013, "sim_compute_sim_state": 0.02814945866984706, "sim_compute_performance-ego": 0.05165434652759183, "sim_compute_robot_state-ego": 0.051624982587752805, "sim_compute_robot_state-npc0": 0.05225341550765499, "sim_compute_robot_state-npc1": 0.04976412557786511, "sim_compute_robot_state-npc2": 0.04986344614336567, "sim_compute_robot_state-npc3": 0.05227724967464324}, "udem1-1-0": {"driven_any": 0.15279881124159397, "sim_physics": 0.03868146985769272, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04833626621221088, "sim_render-ego": 0.060696303844451904, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15770244598388672, "deviation-heading": 0.6036059290961817, "set_robot_commands": 0.0862753763794899, "deviation-center-line": 0.023327956984272744, "driven_lanedir_consec": 0.04833626621221088, "sim_compute_sim_state": 0.03516973555088043, "sim_compute_performance-ego": 0.05925559997558594, "sim_compute_robot_state-ego": 0.06233369559049606, "sim_compute_robot_state-npc0": 0.06079275906085968, "sim_compute_robot_state-npc1": 0.061551615595817566, "sim_compute_robot_state-npc2": 0.06188137084245682, "sim_compute_robot_state-npc3": 0.0630798414349556}, "udem1-2-0": {"driven_any": 0.1551397682825564, "sim_physics": 0.04520290344953537, "survival_time": 1.6000000000000008, "driven_lanedir": 0.059902823377287806, "sim_render-ego": 0.0649920105934143, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16345392912626266, "deviation-heading": 0.594331577434672, "set_robot_commands": 0.09883960336446762, "deviation-center-line": 0.027714779237618573, "driven_lanedir_consec": 0.059902823377287806, "sim_compute_sim_state": 0.03865066170692444, "sim_compute_performance-ego": 0.06975752115249634, "sim_compute_robot_state-ego": 0.07199480384588242, "sim_compute_robot_state-npc0": 0.06652695685625076, "sim_compute_robot_state-npc1": 0.06773203611373901, "sim_compute_robot_state-npc2": 0.06998089700937271, "sim_compute_robot_state-npc3": 0.06593754887580872}, "udem1-3-0": {"driven_any": 0.14709359280609902, "sim_physics": 0.051480866968631744, "survival_time": 1.6000000000000008, "driven_lanedir": 0.051082770753408946, "sim_render-ego": 0.07243122905492783, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.21053941547870636, "deviation-heading": 0.556530181612281, "set_robot_commands": 0.10452436655759811, "deviation-center-line": 0.021983274358116586, "driven_lanedir_consec": 0.051082770753408946, "sim_compute_sim_state": 0.04210576415061951, "sim_compute_performance-ego": 0.07441052794456482, "sim_compute_robot_state-ego": 0.08527860790491104, "sim_compute_robot_state-npc0": 0.07344241440296173, "sim_compute_robot_state-npc1": 0.07236956059932709, "sim_compute_robot_state-npc2": 0.07337149977684021, "sim_compute_robot_state-npc3": 0.07375017553567886}, "udem1-4-0": {"driven_any": 0.15119207824696043, "sim_physics": 0.029859907925128937, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05522893076307578, "sim_render-ego": 0.04667576402425766, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.13232647627592087, "deviation-heading": 0.5874695155936719, "set_robot_commands": 0.07195660471916199, "deviation-center-line": 0.024870752063703767, "driven_lanedir_consec": 0.05522893076307578, "sim_compute_sim_state": 0.028874248266220093, "sim_compute_performance-ego": 0.05189508944749832, "sim_compute_robot_state-ego": 0.052466168999671936, "sim_compute_robot_state-npc0": 0.05169883370399475, "sim_compute_robot_state-npc1": 0.05323383957147598, "sim_compute_robot_state-npc2": 0.04972172528505325, "sim_compute_robot_state-npc3": 0.05181736499071121}}
set_robot_commands_max	0.10452436655759811
set_robot_commands_mean	0.08740146030341425
set_robot_commands_median	0.0862753763794899
set_robot_commands_min	0.07195660471916199
sim_compute_performance-ego_max	0.07441052794456482
sim_compute_performance-ego_mean	0.061394617009547445
sim_compute_performance-ego_median	0.05925559997558594
sim_compute_performance-ego_min	0.05165434652759183
sim_compute_robot_state-ego_max	0.08527860790491104
sim_compute_robot_state-ego_mean	0.06473965178574285
sim_compute_robot_state-ego_median	0.06233369559049606
sim_compute_robot_state-ego_min	0.051624982587752805
sim_compute_robot_state-npc0_max	0.07344241440296173
sim_compute_robot_state-npc0_mean	0.06094287590634438
sim_compute_robot_state-npc0_median	0.06079275906085968
sim_compute_robot_state-npc0_min	0.05169883370399475
sim_compute_robot_state-npc1_max	0.07236956059932709
sim_compute_robot_state-npc1_mean	0.06093023549164496
sim_compute_robot_state-npc1_median	0.061551615595817566
sim_compute_robot_state-npc1_min	0.04976412557786511
sim_compute_robot_state-npc2_max	0.07337149977684021
sim_compute_robot_state-npc2_mean	0.06096378781141774
sim_compute_robot_state-npc2_median	0.06188137084245682
sim_compute_robot_state-npc2_min	0.04972172528505325
sim_compute_robot_state-npc3_max	0.07375017553567886
sim_compute_robot_state-npc3_mean	0.061372436102359526
sim_compute_robot_state-npc3_median	0.0630798414349556
sim_compute_robot_state-npc3_min	0.05181736499071121
sim_compute_sim_state_max	0.04210576415061951
sim_compute_sim_state_mean	0.03458997366889831
sim_compute_sim_state_median	0.03516973555088043
sim_compute_sim_state_min	0.02814945866984706
sim_physics_max	0.051480866968631744
sim_physics_mean	0.039266433254365
sim_physics_median	0.03868146985769272
sim_physics_min	0.029859907925128937
sim_render-ego_max	0.07243122905492783
sim_render-ego_mean	0.058638182090174774
sim_render-ego_median	0.060696303844451904
sim_render-ego_min	0.04667576402425766
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.5900000000000003
survival_time_min	1.5500000000000007

No reset possible

18808

2517

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 14:02:50+00:00

2019-04-20 14:05:04+00:00

0:02:14

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18798

2529

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-20 14:01:21+00:00

2019-04-20 14:02:33+00:00

0:01:12

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18794

2536

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

host-error

2019-04-20 13:59:40+00:00

2019-04-20 14:01:14+00:00

0:01:34

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18794-234820', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18794-234820', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18794-234820', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18781

2555

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-20 13:46:41+00:00

2019-04-20 13:59:08+00:00

0:12:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.08195078372955322
agent_compute-ego_mean	0.06541022103282024
agent_compute-ego_median	0.05981075931602801
agent_compute-ego_min	0.057944518641421666
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03727003900628341, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.052401404631765264, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.057944518641421666, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07515514775326378, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03060689474406995, "sim_compute_performance-ego": 0.055656852220234115, "sim_compute_robot_state-ego": 0.057524864297164115, "sim_compute_robot_state-npc0": 0.05472707246479235, "sim_compute_robot_state-npc1": 0.05279691344813297, "sim_compute_robot_state-npc2": 0.056223377428556744, "sim_compute_robot_state-npc3": 0.0539096054277922}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.04130192179428904, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.05961259415275172, "in-drivable-lane": 0, "agent_compute-ego": 0.06850151639235647, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.08703711158350895, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.035123436074507866, "sim_compute_performance-ego": 0.06952494696566933, "sim_compute_robot_state-ego": 0.06396742243515818, "sim_compute_robot_state-npc0": 0.06459080545525801, "sim_compute_robot_state-npc1": 0.06175750180294639, "sim_compute_robot_state-npc2": 0.060782401185286675, "sim_compute_robot_state-npc3": 0.06200518106159411}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.03473797822609926, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.05238451713170761, "in-drivable-lane": 0, "agent_compute-ego": 0.05884352708474184, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07193715144426395, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03028760200891739, "sim_compute_performance-ego": 0.05220299500685472, "sim_compute_robot_state-ego": 0.0545352483407045, "sim_compute_robot_state-npc0": 0.055474391350379355, "sim_compute_robot_state-npc1": 0.05425101060133714, "sim_compute_robot_state-npc2": 0.05250407487918169, "sim_compute_robot_state-npc3": 0.05572746350215031}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.040666872346904914, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.0544023077252885, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05981075931602801, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.08094434670999016, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.0319569748891911, "sim_compute_performance-ego": 0.05694588137344575, "sim_compute_robot_state-ego": 0.05900426313910686, "sim_compute_robot_state-npc0": 0.057779735242816765, "sim_compute_robot_state-npc1": 0.056710760358353735, "sim_compute_robot_state-npc2": 0.05630135536193848, "sim_compute_robot_state-npc3": 0.05622228770188882}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.04678035324270075, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.07828516851771962, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08195078372955322, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.112865074114366, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.04055860367688266, "sim_compute_performance-ego": 0.08663531325080177, "sim_compute_robot_state-ego": 0.07949271527203647, "sim_compute_robot_state-npc0": 0.07509546388279308, "sim_compute_robot_state-npc1": 0.07384708794680508, "sim_compute_robot_state-npc2": 0.07058425924994728, "sim_compute_robot_state-npc3": 0.07666637680747292}}
set_robot_commands_max	0.112865074114366
set_robot_commands_mean	0.08558776632107858
set_robot_commands_median	0.08094434670999016
set_robot_commands_min	0.07193715144426395
sim_compute_performance-ego_max	0.08663531325080177
sim_compute_performance-ego_mean	0.06419319776340113
sim_compute_performance-ego_median	0.05694588137344575
sim_compute_performance-ego_min	0.05220299500685472
sim_compute_robot_state-ego_max	0.07949271527203647
sim_compute_robot_state-ego_mean	0.06290490269683402
sim_compute_robot_state-ego_median	0.05900426313910686
sim_compute_robot_state-ego_min	0.0545352483407045
sim_compute_robot_state-npc0_max	0.07509546388279308
sim_compute_robot_state-npc0_mean	0.06153349367920791
sim_compute_robot_state-npc0_median	0.057779735242816765
sim_compute_robot_state-npc0_min	0.05472707246479235
sim_compute_robot_state-npc1_max	0.07384708794680508
sim_compute_robot_state-npc1_mean	0.05987265483151507
sim_compute_robot_state-npc1_median	0.056710760358353735
sim_compute_robot_state-npc1_min	0.05279691344813297
sim_compute_robot_state-npc2_max	0.07058425924994728
sim_compute_robot_state-npc2_mean	0.05927909362098217
sim_compute_robot_state-npc2_median	0.05630135536193848
sim_compute_robot_state-npc2_min	0.05250407487918169
sim_compute_robot_state-npc3_max	0.07666637680747292
sim_compute_robot_state-npc3_mean	0.06090618290017966
sim_compute_robot_state-npc3_median	0.05622228770188882
sim_compute_robot_state-npc3_min	0.0539096054277922
sim_compute_sim_state_max	0.04055860367688266
sim_compute_sim_state_mean	0.03370670227871379
sim_compute_sim_state_median	0.0319569748891911
sim_compute_sim_state_min	0.03028760200891739
sim_physics_max	0.04678035324270075
sim_physics_mean	0.04015143292325547
sim_physics_median	0.040666872346904914
sim_physics_min	0.03473797822609926
sim_render-ego_max	0.07828516851771962
sim_render-ego_mean	0.05941719843184654
sim_render-ego_median	0.0544023077252885
sim_render-ego_min	0.05238451713170761
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18771

2565

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-20 13:31:15+00:00

2019-04-20 13:45:32+00:00

0:14:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487132829419987
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041400208354252
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07416002043000944
agent_compute-ego_mean	0.06682266594229386
agent_compute-ego_median	0.07262681170207698
agent_compute-ego_min	0.04987932168520414
deviation-center-line_max	0.1279102488429998
deviation-center-line_mean	0.10518151035257096
deviation-center-line_min	0.06917270915638028
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550057
deviation-heading_median	0.36368201628851926
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903464
driven_any_median	0.6642785413159032
driven_any_min	0.3059207793076613
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.588039443394122
driven_lanedir_consec_min	0.28022225990343186
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.588039443394122
driven_lanedir_median	0.5487132829419987
driven_lanedir_min	0.28022225990343186
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.04280808204557837, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06798995704185672, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07262681170207698, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.10098554739137976, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.039434935988449465, "sim_compute_performance-ego": 0.07253074645996094, "sim_compute_robot_state-ego": 0.07819804040397085, "sim_compute_robot_state-npc0": 0.07222411981443079, "sim_compute_robot_state-npc1": 0.0746050346188429, "sim_compute_robot_state-npc2": 0.07093041117598371, "sim_compute_robot_state-npc3": 0.06941146966887683}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.027000124637897197, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.04654403833242563, "in-drivable-lane": 0, "agent_compute-ego": 0.04987932168520414, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.06724868370936467, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.028014678221482497, "sim_compute_performance-ego": 0.04780264084155743, "sim_compute_robot_state-ego": 0.047286712206327, "sim_compute_robot_state-npc0": 0.051155319580665, "sim_compute_robot_state-npc1": 0.04892913194803091, "sim_compute_robot_state-npc2": 0.04803261390099159, "sim_compute_robot_state-npc3": 0.046887452785785384}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.0352787159858866, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.05846970132056703, "in-drivable-lane": 0, "agent_compute-ego": 0.06385249279915019, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0878902851267064, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.034424259307536675, "sim_compute_performance-ego": 0.05962368275256867, "sim_compute_robot_state-ego": 0.06530575549348872, "sim_compute_robot_state-npc0": 0.06237302435205338, "sim_compute_robot_state-npc1": 0.06224306593550012, "sim_compute_robot_state-npc2": 0.06187097569729419, "sim_compute_robot_state-npc3": 0.06234928902159346}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.04664142577202766, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06824671305142917, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07416002043000944, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.10477502791436163, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04088983430967226, "sim_compute_performance-ego": 0.06874290403428969, "sim_compute_robot_state-ego": 0.07824029765286289, "sim_compute_robot_state-npc0": 0.07291045031704746, "sim_compute_robot_state-npc1": 0.07247291030464592, "sim_compute_robot_state-npc2": 0.0725090110694969, "sim_compute_robot_state-npc3": 0.07199647924402258}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.03853122811568411, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.07289138593171772, "in-drivable-lane": 0, "agent_compute-ego": 0.07359468309502852, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10208788043574284, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.04310749706469084, "sim_compute_performance-ego": 0.07461380958557129, "sim_compute_robot_state-ego": 0.08104788002214934, "sim_compute_robot_state-npc0": 0.07177244362078215, "sim_compute_robot_state-npc1": 0.07580226973483437, "sim_compute_robot_state-npc2": 0.07319057615179765, "sim_compute_robot_state-npc3": 0.07831344479008724}}
set_robot_commands_max	0.10477502791436163
set_robot_commands_mean	0.09259748491551106
set_robot_commands_median	0.10098554739137976
set_robot_commands_min	0.06724868370936467
sim_compute_performance-ego_max	0.07461380958557129
sim_compute_performance-ego_mean	0.0646627567347896
sim_compute_performance-ego_median	0.06874290403428969
sim_compute_performance-ego_min	0.04780264084155743
sim_compute_robot_state-ego_max	0.08104788002214934
sim_compute_robot_state-ego_mean	0.07001573715575976
sim_compute_robot_state-ego_median	0.07819804040397085
sim_compute_robot_state-ego_min	0.047286712206327
sim_compute_robot_state-npc0_max	0.07291045031704746
sim_compute_robot_state-npc0_mean	0.06608707153699575
sim_compute_robot_state-npc0_median	0.07177244362078215
sim_compute_robot_state-npc0_min	0.051155319580665
sim_compute_robot_state-npc1_max	0.07580226973483437
sim_compute_robot_state-npc1_mean	0.06681048250837085
sim_compute_robot_state-npc1_median	0.07247291030464592
sim_compute_robot_state-npc1_min	0.04892913194803091
sim_compute_robot_state-npc2_max	0.07319057615179765
sim_compute_robot_state-npc2_mean	0.0653067175991128
sim_compute_robot_state-npc2_median	0.07093041117598371
sim_compute_robot_state-npc2_min	0.04803261390099159
sim_compute_robot_state-npc3_max	0.07831344479008724
sim_compute_robot_state-npc3_mean	0.0657916271020731
sim_compute_robot_state-npc3_median	0.06941146966887683
sim_compute_robot_state-npc3_min	0.046887452785785384
sim_compute_sim_state_max	0.04310749706469084
sim_compute_sim_state_mean	0.037174240978366344
sim_compute_sim_state_median	0.039434935988449465
sim_compute_sim_state_min	0.028014678221482497
sim_physics_max	0.04664142577202766
sim_physics_mean	0.03805191531141479
sim_physics_median	0.03853122811568411
sim_physics_min	0.027000124637897197
sim_render-ego_max	0.07289138593171772
sim_render-ego_mean	0.06282835913559925
sim_render-ego_median	0.06798995704185672
sim_render-ego_min	0.04654403833242563
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18768

2570

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 13:10:06+00:00

2019-04-20 13:31:00+00:00

0:20:54

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18765

2561

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-20 13:00:31+00:00

2019-04-20 13:09:53+00:00

0:09:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07661748559851396
agent_compute-ego_mean	0.07232472578035258
agent_compute-ego_median	0.07420257683638688
agent_compute-ego_min	0.06598604486343708
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02683411865699582, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06536260756050669, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0698886877152978, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.09890347864569687, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03854239277723359, "sim_compute_performance-ego": 0.0695238346006812, "sim_compute_robot_state-ego": 0.07365802730002054}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.026236341549799994, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.0671480527290931, "in-drivable-lane": 0, "agent_compute-ego": 0.07492883388812725, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.11004815651820256, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.042136164811941296, "sim_compute_performance-ego": 0.07190767618326041, "sim_compute_robot_state-ego": 0.07748106809762809}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.02329384012425199, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06199998043953104, "in-drivable-lane": 0, "agent_compute-ego": 0.06598604486343708, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0942694532110336, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03680453909204361, "sim_compute_performance-ego": 0.06477537560970226, "sim_compute_robot_state-ego": 0.06872647366625198}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.03010495416410677, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06617312378935762, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07420257683638688, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.1075446238884559, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04115174628876068, "sim_compute_performance-ego": 0.07195227224748213, "sim_compute_robot_state-ego": 0.07671830156347254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.026769405917117472, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.0709841063148097, "in-drivable-lane": 0, "agent_compute-ego": 0.07661748559851396, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10809657448216488, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04258550468244051, "sim_compute_performance-ego": 0.07540651999021832, "sim_compute_robot_state-ego": 0.08160248555635151}}
set_robot_commands_max	0.11004815651820256
set_robot_commands_mean	0.10377245734911077
set_robot_commands_median	0.1075446238884559
set_robot_commands_min	0.0942694532110336
sim_compute_performance-ego_max	0.07540651999021832
sim_compute_performance-ego_mean	0.07071313572626886
sim_compute_performance-ego_median	0.07190767618326041
sim_compute_performance-ego_min	0.06477537560970226
sim_compute_robot_state-ego_max	0.08160248555635151
sim_compute_robot_state-ego_mean	0.07563727123674494
sim_compute_robot_state-ego_median	0.07671830156347254
sim_compute_robot_state-ego_min	0.06872647366625198
sim_compute_sim_state_max	0.04258550468244051
sim_compute_sim_state_mean	0.04024406953048394
sim_compute_sim_state_median	0.04115174628876068
sim_compute_sim_state_min	0.03680453909204361
sim_physics_max	0.03010495416410677
sim_physics_mean	0.026647732082454405
sim_physics_median	0.026769405917117472
sim_physics_min	0.02329384012425199
sim_render-ego_max	0.0709841063148097
sim_render-ego_mean	0.06633357416665964
sim_render-ego_median	0.06617312378935762
sim_render-ego_min	0.06199998043953104
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18753

2591

baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-20 12:42:00+00:00

2019-04-20 13:00:05+00:00

0:18:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18753-177369', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18753-177369', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18753-177369', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18750

2594

baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-20 12:18:34+00:00

2019-04-20 12:39:29+00:00

0:20:55

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18749

2587

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-20 12:00:25+00:00

2019-04-20 12:18:07+00:00

0:17:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2694985329322238
survival_time_median	5.4999999999999885
deviation-center-line_median	0.3016008771279541
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.2747693451968106
agent_compute-ego_mean	0.24994183687597887
agent_compute-ego_median	0.24593267696244375
agent_compute-ego_min	0.23627687625165256
deviation-center-line_max	0.32778074505147636
deviation-center-line_mean	0.30105249676591855
deviation-center-line_min	0.2778364748655631
deviation-heading_max	2.308177555111929
deviation-heading_mean	2.0707516804634905
deviation-heading_median	2.0576302306273826
deviation-heading_min	1.8868722883468705
driven_any_max	0.34017669745215806
driven_any_mean	0.3045641286511246
driven_any_median	0.30636820719949065
driven_any_min	0.26686448366819226
driven_lanedir_consec_max	0.3027975815729169
driven_lanedir_consec_mean	0.2678296353315087
driven_lanedir_consec_min	0.22973693809692583
driven_lanedir_max	0.3027975815729169
driven_lanedir_mean	0.2678296353315087
driven_lanedir_median	0.2694985329322238
driven_lanedir_min	0.22973693809692583
in-drivable-lane_max	0.09999999999999964
in-drivable-lane_mean	0.039999999999999855
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.26686448366819226, "sim_physics": 0.030508488978979724, "survival_time": 5.299999999999989, "driven_lanedir": 0.22973693809692583, "sim_render-ego": 0.06978186121526754, "in-drivable-lane": 0, "agent_compute-ego": 0.23627687625165256, "deviation-heading": 2.308177555111929, "set_robot_commands": 0.10219870873217313, "deviation-center-line": 0.30298284676081594, "driven_lanedir_consec": 0.22973693809692583, "sim_compute_sim_state": 0.04297923366978483, "sim_compute_performance-ego": 0.07211645819106192, "sim_compute_robot_state-ego": 0.0767653393295576}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.30653975265164446, "sim_physics": 0.027271266417069867, "survival_time": 5.4999999999999885, "driven_lanedir": 0.2694985329322238, "sim_render-ego": 0.06870100931687788, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2747693451968106, "deviation-heading": 1.9953481545168463, "set_robot_commands": 0.10661221200769598, "deviation-center-line": 0.2950615400237834, "driven_lanedir_consec": 0.2694985329322238, "sim_compute_sim_state": 0.04105335148898038, "sim_compute_performance-ego": 0.07282357866113837, "sim_compute_robot_state-ego": 0.07954114133661444}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30636820719949065, "sim_physics": 0.02768687667133652, "survival_time": 5.349999999999989, "driven_lanedir": 0.26980013881452924, "sim_render-ego": 0.06911140958839487, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.23989065339632124, "deviation-heading": 1.8868722883468705, "set_robot_commands": 0.10295726205701028, "deviation-center-line": 0.2778364748655631, "driven_lanedir_consec": 0.26980013881452924, "sim_compute_sim_state": 0.042756149701983014, "sim_compute_performance-ego": 0.07312144965768974, "sim_compute_robot_state-ego": 0.07588678208467002}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.34017669745215806, "sim_physics": 0.028146128500661543, "survival_time": 6.199999999999986, "driven_lanedir": 0.3027975815729169, "sim_render-ego": 0.07152459313792567, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.2528396325726663, "deviation-heading": 2.0576302306273826, "set_robot_commands": 0.1029780795497279, "deviation-center-line": 0.32778074505147636, "driven_lanedir_consec": 0.3027975815729169, "sim_compute_sim_state": 0.04119017816358997, "sim_compute_performance-ego": 0.07313037110913184, "sim_compute_robot_state-ego": 0.07851227637260191}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.30287150228413773, "sim_physics": 0.02674615596021925, "survival_time": 5.599999999999988, "driven_lanedir": 0.26731498524094777, "sim_render-ego": 0.06768444180488586, "in-drivable-lane": 0, "agent_compute-ego": 0.24593267696244375, "deviation-heading": 2.1057301737144254, "set_robot_commands": 0.10244072335106988, "deviation-center-line": 0.3016008771279541, "driven_lanedir_consec": 0.26731498524094777, "sim_compute_sim_state": 0.04107630252838135, "sim_compute_performance-ego": 0.07095373528344291, "sim_compute_robot_state-ego": 0.0748654476233891}}
set_robot_commands_max	0.10661221200769598
set_robot_commands_mean	0.10343739713953544
set_robot_commands_median	0.10295726205701028
set_robot_commands_min	0.10219870873217313
sim_compute_performance-ego_max	0.07313037110913184
sim_compute_performance-ego_mean	0.07242911858049296
sim_compute_performance-ego_median	0.07282357866113837
sim_compute_performance-ego_min	0.07095373528344291
sim_compute_robot_state-ego_max	0.07954114133661444
sim_compute_robot_state-ego_mean	0.07711419734936661
sim_compute_robot_state-ego_median	0.0767653393295576
sim_compute_robot_state-ego_min	0.0748654476233891
sim_compute_sim_state_max	0.04297923366978483
sim_compute_sim_state_mean	0.04181104311054391
sim_compute_sim_state_median	0.04119017816358997
sim_compute_sim_state_min	0.04105335148898038
sim_physics_max	0.030508488978979724
sim_physics_mean	0.02807178330565338
sim_physics_median	0.02768687667133652
sim_physics_min	0.02674615596021925
sim_render-ego_max	0.07152459313792567
sim_render-ego_mean	0.06936066301267037
sim_render-ego_median	0.06911140958839487
sim_render-ego_min	0.06768444180488586
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	5.589999999999987
survival_time_min	5.299999999999989

No reset possible

18743

2595

baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-20 11:43:30+00:00

2019-04-20 12:00:07+00:00

0:16:37

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18743-621867', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18743-621867', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18743-621867', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18739

2599

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-20 11:22:58+00:00

2019-04-20 11:30:21+00:00

0:07:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.12449213649463976
survival_time_median	1.4000000000000006
deviation-center-line_median	0.0622197571145304
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.28142879803975424
agent_compute-ego_mean	0.2100353861903431
agent_compute-ego_median	0.2255097053669117
agent_compute-ego_min	0.1366434097290039
deviation-center-line_max	0.07288220570573611
deviation-center-line_mean	0.06265938953634649
deviation-center-line_min	0.05678718825933824
deviation-heading_max	0.7627513659532845
deviation-heading_mean	0.7349432442025738
deviation-heading_median	0.7257543889140243
deviation-heading_min	0.7118511780359554
driven_any_max	0.21786129825343917
driven_any_mean	0.19225713437341815
driven_any_median	0.18500486248702405
driven_any_min	0.1721133920518218
driven_lanedir_consec_max	0.1693161242757104
driven_lanedir_consec_mean	0.13668021039952968
driven_lanedir_consec_min	0.1174685437764884
driven_lanedir_max	0.1693161242757104
driven_lanedir_mean	0.13668021039952968
driven_lanedir_median	0.12449213649463976
driven_lanedir_min	0.1174685437764884
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.010000000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1721133920518218, "sim_physics": 0.026989927998295537, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1174685437764884, "sim_render-ego": 0.07559371877599645, "in-drivable-lane": 0, "agent_compute-ego": 0.2255097053669117, "deviation-heading": 0.7627513659532845, "set_robot_commands": 0.1100756150704843, "deviation-center-line": 0.0622197571145304, "driven_lanedir_consec": 0.1174685437764884, "sim_compute_sim_state": 0.04226575074372469, "sim_compute_performance-ego": 0.08264871879860207, "sim_compute_robot_state-ego": 0.08808368223684805}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18500486248702405, "sim_physics": 0.01915174060397678, "survival_time": 1.3500000000000003, "driven_lanedir": 0.12449213649463976, "sim_render-ego": 0.05289906925625271, "in-drivable-lane": 0, "agent_compute-ego": 0.1366434097290039, "deviation-heading": 0.7216413517950598, "set_robot_commands": 0.07824602833500614, "deviation-center-line": 0.058098508926495714, "driven_lanedir_consec": 0.12449213649463976, "sim_compute_sim_state": 0.03187872745372631, "sim_compute_performance-ego": 0.0532274776034885, "sim_compute_robot_state-ego": 0.05871519335994014}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2060775398246626, "sim_physics": 0.03119515550547633, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1541967524950549, "sim_render-ego": 0.0859630847799367, "in-drivable-lane": 0, "agent_compute-ego": 0.2544550731264312, "deviation-heading": 0.7118511780359554, "set_robot_commands": 0.13886609570733432, "deviation-center-line": 0.06330928767563201, "driven_lanedir_consec": 0.1541967524950549, "sim_compute_sim_state": 0.052977265982792295, "sim_compute_performance-ego": 0.08673471417920343, "sim_compute_robot_state-ego": 0.09657945304081358}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18022857925014324, "sim_physics": 0.021508991718292236, "survival_time": 1.4000000000000006, "driven_lanedir": 0.11792749495575494, "sim_render-ego": 0.0581550087247576, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15213994468961442, "deviation-heading": 0.7527179363145449, "set_robot_commands": 0.07824772596359253, "deviation-center-line": 0.05678718825933824, "driven_lanedir_consec": 0.11792749495575494, "sim_compute_sim_state": 0.03323142869131906, "sim_compute_performance-ego": 0.05937654631478446, "sim_compute_robot_state-ego": 0.06076440640858242}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21786129825343917, "sim_physics": 0.035473752021789554, "survival_time": 1.5000000000000009, "driven_lanedir": 0.1693161242757104, "sim_render-ego": 0.0820302406946818, "in-drivable-lane": 0, "agent_compute-ego": 0.28142879803975424, "deviation-heading": 0.7257543889140243, "set_robot_commands": 0.13407366275787352, "deviation-center-line": 0.07288220570573611, "driven_lanedir_consec": 0.1693161242757104, "sim_compute_sim_state": 0.04878517786661784, "sim_compute_performance-ego": 0.09426221052805582, "sim_compute_robot_state-ego": 0.10051735242207845}}
set_robot_commands_max	0.13886609570733432
set_robot_commands_mean	0.10790182556685816
set_robot_commands_median	0.1100756150704843
set_robot_commands_min	0.07824602833500614
sim_compute_performance-ego_max	0.09426221052805582
sim_compute_performance-ego_mean	0.07524993348482686
sim_compute_performance-ego_median	0.08264871879860207
sim_compute_performance-ego_min	0.0532274776034885
sim_compute_robot_state-ego_max	0.10051735242207845
sim_compute_robot_state-ego_mean	0.08093201749365253
sim_compute_robot_state-ego_median	0.08808368223684805
sim_compute_robot_state-ego_min	0.05871519335994014
sim_compute_sim_state_max	0.052977265982792295
sim_compute_sim_state_mean	0.04182767014763604
sim_compute_sim_state_median	0.04226575074372469
sim_compute_sim_state_min	0.03187872745372631
sim_physics_max	0.035473752021789554
sim_physics_mean	0.02686391356956609
sim_physics_median	0.026989927998295537
sim_physics_min	0.01915174060397678
sim_render-ego_max	0.0859630847799367
sim_render-ego_mean	0.07092822444632504
sim_render-ego_median	0.07559371877599645
sim_render-ego_min	0.05289906925625271
simulation-passed	1
survival_time_max	1.5000000000000009
survival_time_mean	1.4100000000000006
survival_time_min	1.3500000000000003

No reset possible

18737

2600

Liam Paull 🇨🇦

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-20 11:19:26+00:00

2019-04-20 11:22:25+00:00

0:02:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18727

2637

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-20 11:00:28+00:00

2019-04-20 11:16:45+00:00

0:16:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.18006906201762538
agent_compute-ego_mean	0.15311644910336733
agent_compute-ego_median	0.15189232724778196
agent_compute-ego_min	0.1297581914871458
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.04087638098096091, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.054272208895002096, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1297581914871458, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08197558493841262, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03403423324463859, "sim_compute_performance-ego": 0.056848094576881045, "sim_compute_robot_state-ego": 0.059302848482888845, "sim_compute_robot_state-npc0": 0.05805601014031304, "sim_compute_robot_state-npc1": 0.058460738923814565, "sim_compute_robot_state-npc2": 0.058062572327871174, "sim_compute_robot_state-npc3": 0.0586423154861208}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.0345767853306789, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0577235689350203, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13249928811017206, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08272380454867494, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03505864330366546, "sim_compute_performance-ego": 0.05755001423405666, "sim_compute_robot_state-ego": 0.06382464427574008, "sim_compute_robot_state-npc0": 0.06071947135177313, "sim_compute_robot_state-npc1": 0.059005433437871, "sim_compute_robot_state-npc2": 0.059557596842447914, "sim_compute_robot_state-npc3": 0.06039859734329523}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.05564863835611651, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.07478627466386364, "in-drivable-lane": 0, "agent_compute-ego": 0.18006906201762538, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.114427593446547, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.04444220758253528, "sim_compute_performance-ego": 0.07886941586771319, "sim_compute_robot_state-ego": 0.08551369559380316, "sim_compute_robot_state-npc0": 0.07806322651524697, "sim_compute_robot_state-npc1": 0.07813894748687744, "sim_compute_robot_state-npc2": 0.07762329809127315, "sim_compute_robot_state-npc3": 0.07946028632502403}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04665624588093859, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06397853760009116, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.15189232724778196, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.09599885281096114, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.036764773916690904, "sim_compute_performance-ego": 0.06576886075608274, "sim_compute_robot_state-ego": 0.06976398001325891, "sim_compute_robot_state-npc0": 0.06785603787036652, "sim_compute_robot_state-npc1": 0.06621804389547795, "sim_compute_robot_state-npc2": 0.06640222732056962, "sim_compute_robot_state-npc3": 0.06674335611627456}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.05012261409025926, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.07423880925545326, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.17136337665411142, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.10840009267513569, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.04378758485500629, "sim_compute_performance-ego": 0.07844855235173152, "sim_compute_robot_state-ego": 0.08172533145317665, "sim_compute_robot_state-npc0": 0.07638820318075326, "sim_compute_robot_state-npc1": 0.07697962339107807, "sim_compute_robot_state-npc2": 0.07646280985612136, "sim_compute_robot_state-npc3": 0.07843945118097159}}
set_robot_commands_max	0.114427593446547
set_robot_commands_mean	0.09670518568394627
set_robot_commands_median	0.09599885281096114
set_robot_commands_min	0.08197558493841262
sim_compute_performance-ego_max	0.07886941586771319
sim_compute_performance-ego_mean	0.06749698755729303
sim_compute_performance-ego_median	0.06576886075608274
sim_compute_performance-ego_min	0.056848094576881045
sim_compute_robot_state-ego_max	0.08551369559380316
sim_compute_robot_state-ego_mean	0.07202609996377354
sim_compute_robot_state-ego_median	0.06976398001325891
sim_compute_robot_state-ego_min	0.059302848482888845
sim_compute_robot_state-npc0_max	0.07806322651524697
sim_compute_robot_state-npc0_mean	0.06821658981169058
sim_compute_robot_state-npc0_median	0.06785603787036652
sim_compute_robot_state-npc0_min	0.05805601014031304
sim_compute_robot_state-npc1_max	0.07813894748687744
sim_compute_robot_state-npc1_mean	0.06776055742702379
sim_compute_robot_state-npc1_median	0.06621804389547795
sim_compute_robot_state-npc1_min	0.058460738923814565
sim_compute_robot_state-npc2_max	0.07762329809127315
sim_compute_robot_state-npc2_mean	0.06762170088765665
sim_compute_robot_state-npc2_median	0.06640222732056962
sim_compute_robot_state-npc2_min	0.058062572327871174
sim_compute_robot_state-npc3_max	0.07946028632502403
sim_compute_robot_state-npc3_mean	0.06873680129033724
sim_compute_robot_state-npc3_median	0.06674335611627456
sim_compute_robot_state-npc3_min	0.0586423154861208
sim_compute_sim_state_max	0.04444220758253528
sim_compute_sim_state_mean	0.038817488580507306
sim_compute_sim_state_median	0.036764773916690904
sim_compute_sim_state_min	0.03403423324463859
sim_physics_max	0.05564863835611651
sim_physics_mean	0.04557613292779083
sim_physics_median	0.04665624588093859
sim_physics_min	0.0345767853306789
sim_render-ego_max	0.07478627466386364
sim_render-ego_mean	0.06499987986988609
sim_render-ego_median	0.06397853760009116
sim_render-ego_min	0.054272208895002096
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

18719

2685

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 10:49:14+00:00

2019-04-20 11:00:08+00:00

0:10:54

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18719-74263', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18719-74263', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18719-74263', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18704

2653

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 10:21:40+00:00

2019-04-20 10:42:50+00:00

0:21:10

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18688

2676

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 10:00:20+00:00

2019-04-20 10:21:19+00:00

0:20:59

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18679

2695

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 09:40:39+00:00

2019-04-20 10:00:04+00:00

0:19:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18679-316730', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18679-316730', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18679-316730', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18678

2725

jiang peng

test for ppo

step1-simulation

error

2019-04-20 09:38:22+00:00

2019-04-20 09:39:30+00:00

0:01:08

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18666

2727

jiang peng

test for ppo

step1-simulation

error

2019-04-20 09:36:21+00:00

2019-04-20 09:37:57+00:00

0:01:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18657

2743

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-20 09:34:24+00:00

2019-04-20 09:36:02+00:00

0:01:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18649

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-20 09:30:46+00:00

2019-04-20 09:32:37+00:00

0:01:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18641

2763

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-20 09:13:42+00:00

2019-04-20 09:30:03+00:00

0:16:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.08223743187753778
agent_compute-ego_mean	0.0772806186901013
agent_compute-ego_median	0.08067043261094527
agent_compute-ego_min	0.07109091909308182
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.0465058025560881, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06515109664515445, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07109091909308182, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.09945721375314812, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03930276067633378, "sim_compute_performance-ego": 0.06641099578455875, "sim_compute_robot_state-ego": 0.07103342006081029, "sim_compute_robot_state-npc0": 0.06854510558278937, "sim_compute_robot_state-npc1": 0.06976523901286878, "sim_compute_robot_state-npc2": 0.06966799936796489, "sim_compute_robot_state-npc3": 0.07120254165247868}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.046570313604254475, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.07186713971589741, "in-drivable-lane": 0, "agent_compute-ego": 0.08223743187753778, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.11817051862415516, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.04205554410030967, "sim_compute_performance-ego": 0.07558084789075349, "sim_compute_robot_state-ego": 0.07942660231339305, "sim_compute_robot_state-npc0": 0.07524949625918739, "sim_compute_robot_state-npc1": 0.07533261650486996, "sim_compute_robot_state-npc2": 0.07758301182797081, "sim_compute_robot_state-npc3": 0.0766947959598742}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.04544355319096492, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06825879292610364, "in-drivable-lane": 0, "agent_compute-ego": 0.07170202181889461, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.0975962785574106, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.04010773316407815, "sim_compute_performance-ego": 0.07471969188787998, "sim_compute_robot_state-ego": 0.0727094259017553, "sim_compute_robot_state-npc0": 0.07119373786143768, "sim_compute_robot_state-npc1": 0.07004118577027932, "sim_compute_robot_state-npc2": 0.07079650194216998, "sim_compute_robot_state-npc3": 0.07003178963294396}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.059146259872006696, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.07217348461419763, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0807022880500471, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.11083103233659772, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.04417953021089795, "sim_compute_performance-ego": 0.07691435075142014, "sim_compute_robot_state-ego": 0.08444299160594672, "sim_compute_robot_state-npc0": 0.07731544803565657, "sim_compute_robot_state-npc1": 0.07608701813388878, "sim_compute_robot_state-npc2": 0.0778846841462901, "sim_compute_robot_state-npc3": 0.07780341027488172}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.044772733341563835, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.07101572101766412, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08067043261094527, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.10820992968299172, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.04262786561792547, "sim_compute_performance-ego": 0.07213061506097967, "sim_compute_robot_state-ego": 0.08053559064865112, "sim_compute_robot_state-npc0": 0.07481213049455122, "sim_compute_robot_state-npc1": 0.07521667263724587, "sim_compute_robot_state-npc2": 0.07477908784692938, "sim_compute_robot_state-npc3": 0.07626863501288673}}
set_robot_commands_max	0.11817051862415516
set_robot_commands_mean	0.10685299459086066
set_robot_commands_median	0.10820992968299172
set_robot_commands_min	0.0975962785574106
sim_compute_performance-ego_max	0.07691435075142014
sim_compute_performance-ego_mean	0.07315130027511842
sim_compute_performance-ego_median	0.07471969188787998
sim_compute_performance-ego_min	0.06641099578455875
sim_compute_robot_state-ego_max	0.08444299160594672
sim_compute_robot_state-ego_mean	0.07762960610611129
sim_compute_robot_state-ego_median	0.07942660231339305
sim_compute_robot_state-ego_min	0.07103342006081029
sim_compute_robot_state-npc0_max	0.07731544803565657
sim_compute_robot_state-npc0_mean	0.07342318364672444
sim_compute_robot_state-npc0_median	0.07481213049455122
sim_compute_robot_state-npc0_min	0.06854510558278937
sim_compute_robot_state-npc1_max	0.07608701813388878
sim_compute_robot_state-npc1_mean	0.07328854641183054
sim_compute_robot_state-npc1_median	0.07521667263724587
sim_compute_robot_state-npc1_min	0.06976523901286878
sim_compute_robot_state-npc2_max	0.0778846841462901
sim_compute_robot_state-npc2_mean	0.07414225702626503
sim_compute_robot_state-npc2_median	0.07477908784692938
sim_compute_robot_state-npc2_min	0.06966799936796489
sim_compute_robot_state-npc3_max	0.07780341027488172
sim_compute_robot_state-npc3_mean	0.07440023450661307
sim_compute_robot_state-npc3_median	0.07626863501288673
sim_compute_robot_state-npc3_min	0.07003178963294396
sim_compute_sim_state_max	0.04417953021089795
sim_compute_sim_state_mean	0.04165468675390901
sim_compute_sim_state_median	0.04205554410030967
sim_compute_sim_state_min	0.03930276067633378
sim_physics_max	0.059146259872006696
sim_physics_mean	0.048487732512975605
sim_physics_median	0.0465058025560881
sim_physics_min	0.044772733341563835
sim_render-ego_max	0.07217348461419763
sim_render-ego_mean	0.06969324698380346
sim_render-ego_median	0.07101572101766412
sim_render-ego_min	0.06515109664515445
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18635

2782

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-20 09:12:55+00:00

2019-04-20 09:13:22+00:00

0:00:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18632

2787

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-20 09:12:04+00:00

2019-04-20 09:12:35+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18620

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-20 09:00:29+00:00

2019-04-20 09:11:30+00:00

0:11:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.158879550298055
agent_compute-ego_mean	0.13598567435121425
agent_compute-ego_median	0.13813996811707815
agent_compute-ego_min	0.1169580852284151
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02903072789030255, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04935598373413086, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12276892392140516, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08166797206086933, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03088550297719128, "sim_compute_performance-ego": 0.05164063201760346, "sim_compute_robot_state-ego": 0.05758993580656232, "sim_compute_robot_state-npc0": 0.05581540881462817, "sim_compute_robot_state-npc1": 0.05585486933870135, "sim_compute_robot_state-npc2": 0.05610851071915537, "sim_compute_robot_state-npc3": 0.05630976748916338}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03789371793920344, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06029287793419578, "in-drivable-lane": 0, "agent_compute-ego": 0.1431818441911177, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08638598160310225, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03652980652722446, "sim_compute_performance-ego": 0.06195851889523593, "sim_compute_robot_state-ego": 0.06481605226343329, "sim_compute_robot_state-npc0": 0.0597030141136863, "sim_compute_robot_state-npc1": 0.06493354385549371, "sim_compute_robot_state-npc2": 0.06518537889827382, "sim_compute_robot_state-npc3": 0.06168855320323597}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.037550232145521376, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06591651174757215, "in-drivable-lane": 0, "agent_compute-ego": 0.158879550298055, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09564813507927789, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.04128896395365397, "sim_compute_performance-ego": 0.06822680897182888, "sim_compute_robot_state-ego": 0.07376745541890463, "sim_compute_robot_state-npc0": 0.07164583206176758, "sim_compute_robot_state-npc1": 0.07059308687845865, "sim_compute_robot_state-npc2": 0.06921091079711914, "sim_compute_robot_state-npc3": 0.06956827375623915}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03578871488571167, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.056918238600095115, "in-drivable-lane": 0, "agent_compute-ego": 0.13813996811707815, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08977632721265157, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.034231290221214294, "sim_compute_performance-ego": 0.058914706110954285, "sim_compute_robot_state-ego": 0.06095783909161886, "sim_compute_robot_state-npc0": 0.06247601409753164, "sim_compute_robot_state-npc1": 0.06126175324122111, "sim_compute_robot_state-npc2": 0.05926413834095001, "sim_compute_robot_state-npc3": 0.06164472301801046}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.027289706117966595, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.04800893278682933, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1169580852284151, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07203110526589786, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.027856893399182486, "sim_compute_performance-ego": 0.05278748975080602, "sim_compute_robot_state-ego": 0.05031465432223152, "sim_compute_robot_state-npc0": 0.04900796273175408, "sim_compute_robot_state-npc1": 0.04965937488219317, "sim_compute_robot_state-npc2": 0.05126433863359339, "sim_compute_robot_state-npc3": 0.049558748217190016}}
set_robot_commands_max	0.09564813507927789
set_robot_commands_mean	0.08510190424435977
set_robot_commands_median	0.08638598160310225
set_robot_commands_min	0.07203110526589786
sim_compute_performance-ego_max	0.06822680897182888
sim_compute_performance-ego_mean	0.05870563114928571
sim_compute_performance-ego_median	0.058914706110954285
sim_compute_performance-ego_min	0.05164063201760346
sim_compute_robot_state-ego_max	0.07376745541890463
sim_compute_robot_state-ego_mean	0.06148918738055013
sim_compute_robot_state-ego_median	0.06095783909161886
sim_compute_robot_state-ego_min	0.05031465432223152
sim_compute_robot_state-npc0_max	0.07164583206176758
sim_compute_robot_state-npc0_mean	0.059729646363873554
sim_compute_robot_state-npc0_median	0.0597030141136863
sim_compute_robot_state-npc0_min	0.04900796273175408
sim_compute_robot_state-npc1_max	0.07059308687845865
sim_compute_robot_state-npc1_mean	0.0604605256392136
sim_compute_robot_state-npc1_median	0.06126175324122111
sim_compute_robot_state-npc1_min	0.04965937488219317
sim_compute_robot_state-npc2_max	0.06921091079711914
sim_compute_robot_state-npc2_mean	0.06020665547781834
sim_compute_robot_state-npc2_median	0.05926413834095001
sim_compute_robot_state-npc2_min	0.05126433863359339
sim_compute_robot_state-npc3_max	0.06956827375623915
sim_compute_robot_state-npc3_mean	0.05975401313676779
sim_compute_robot_state-npc3_median	0.06164472301801046
sim_compute_robot_state-npc3_min	0.049558748217190016
sim_compute_sim_state_max	0.04128896395365397
sim_compute_sim_state_mean	0.0341584914156933
sim_compute_sim_state_median	0.034231290221214294
sim_compute_sim_state_min	0.027856893399182486
sim_physics_max	0.03789371793920344
sim_physics_mean	0.033510619795741124
sim_physics_median	0.03578871488571167
sim_physics_min	0.027289706117966595
sim_render-ego_max	0.06591651174757215
sim_render-ego_mean	0.056098508960564654
sim_render-ego_median	0.056918238600095115
sim_render-ego_min	0.04800893278682933
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18615

2826

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-20 08:58:25+00:00

2019-04-20 09:00:06+00:00

0:01:41

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18615-918310', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18615-918310', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18615-918310', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18610

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error