Evaluator 753

Baseline-IL-logs-tensorflow

step1-simulation

timeout

2019-04-24 13:00:57+00:00

2019-04-24 14:06:07+00:00

1:05:10

I can see how the jo [...]

I can see how the job 19215 is timeout because passed 3910 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19211

2964

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-24 12:37:22+00:00

2019-04-24 13:00:05+00:00

0:22:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19211-430248', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19211-430248', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19211-430248', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19199

2956

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 12:14:33+00:00

2019-04-24 12:34:32+00:00

0:19:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1970696583711948
survival_time_median	13.500000000000057
deviation-center-line_median	0.40144147170472666
in-drivable-lane_median	1.3500000000000192

other stats

agent_compute-ego_max	0.2327623694031327
agent_compute-ego_mean	0.19348941267274591
agent_compute-ego_median	0.18406125942866008
agent_compute-ego_min	0.15255581332791235
deviation-center-line_max	1.122413760700928
deviation-center-line_mean	0.634953505436981
deviation-center-line_min	0.20423933765322444
deviation-heading_max	2.6766585856208636
deviation-heading_mean	1.836495865415818
deviation-heading_median	2.001248801443645
deviation-heading_min	1.1005168018130589
driven_any_max	1.9321774569101475
driven_any_mean	1.647939568319608
driven_any_median	1.6839938468537576
driven_any_min	1.1455980212253798
driven_lanedir_consec_max	1.919954474581851
driven_lanedir_consec_mean	1.3581961926585016
driven_lanedir_consec_min	0.6227950388270624
driven_lanedir_max	1.919954474581851
driven_lanedir_mean	1.3853465611168612
driven_lanedir_median	1.2361372288465504
driven_lanedir_min	0.6598990084294942
in-drivable-lane_max	2.6500000000000377
in-drivable-lane_mean	1.19000000000001
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1455980212253798, "sim_physics": 0.017039934281379947, "survival_time": 7.7499999999999805, "driven_lanedir": 0.6598990084294942, "sim_render-ego": 0.04386452090355658, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.15255581332791235, "deviation-heading": 2.1647968926941816, "set_robot_commands": 0.0677858752589072, "deviation-center-line": 0.20423933765322444, "driven_lanedir_consec": 0.6227950388270624, "sim_compute_sim_state": 0.0291510981898154, "sim_compute_performance-ego": 0.04825261485192084, "sim_compute_robot_state-ego": 0.05071688775093325}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8858358080481, "sim_physics": 0.025403625170389812, "survival_time": 14.950000000000076, "driven_lanedir": 1.8771866778711424, "sim_render-ego": 0.06422940174738566, "in-drivable-lane": 0, "agent_compute-ego": 0.22365612347920735, "deviation-heading": 1.1005168018130589, "set_robot_commands": 0.10257797638575236, "deviation-center-line": 1.122413760700928, "driven_lanedir_consec": 1.8771866778711424, "sim_compute_sim_state": 0.04065370718638102, "sim_compute_performance-ego": 0.07172665357589722, "sim_compute_robot_state-ego": 0.07407614231109619}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9321774569101475, "sim_physics": 0.02085086027781169, "survival_time": 14.950000000000076, "driven_lanedir": 1.919954474581851, "sim_render-ego": 0.053957071304321286, "in-drivable-lane": 0, "agent_compute-ego": 0.18406125942866008, "deviation-heading": 1.239258245507342, "set_robot_commands": 0.08265148719151814, "deviation-center-line": 1.0952775357957156, "driven_lanedir_consec": 1.919954474581851, "sim_compute_sim_state": 0.03357967376708984, "sim_compute_performance-ego": 0.05845958709716797, "sim_compute_robot_state-ego": 0.06003369172414144}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6839938468537576, "sim_physics": 0.02570206500865795, "survival_time": 13.500000000000057, "driven_lanedir": 1.2361372288465504, "sim_render-ego": 0.06472184481444182, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.2327623694031327, "deviation-heading": 2.6766585856208636, "set_robot_commands": 0.10441151283405443, "deviation-center-line": 0.40144147170472666, "driven_lanedir_consec": 1.1970696583711948, "sim_compute_sim_state": 0.040784185904043695, "sim_compute_performance-ego": 0.07190408883271394, "sim_compute_robot_state-ego": 0.07712752907364456}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.592092708560655, "sim_physics": 0.018859484855164872, "survival_time": 11.750000000000032, "driven_lanedir": 1.2335554158552675, "sim_render-ego": 0.049942553297002264, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.17441149772481715, "deviation-heading": 2.001248801443645, "set_robot_commands": 0.07822339788396308, "deviation-center-line": 0.35139542133031093, "driven_lanedir_consec": 1.1739751136412568, "sim_compute_sim_state": 0.0316925566247169, "sim_compute_performance-ego": 0.05665088105708995, "sim_compute_robot_state-ego": 0.05711283379412712}}
set_robot_commands_max	0.10441151283405443
set_robot_commands_mean	0.08713004991083904
set_robot_commands_median	0.08265148719151814
set_robot_commands_min	0.0677858752589072
sim_compute_performance-ego_max	0.07190408883271394
sim_compute_performance-ego_mean	0.06139876508295798
sim_compute_performance-ego_median	0.05845958709716797
sim_compute_performance-ego_min	0.04825261485192084
sim_compute_robot_state-ego_max	0.07712752907364456
sim_compute_robot_state-ego_mean	0.06381341693078851
sim_compute_robot_state-ego_median	0.06003369172414144
sim_compute_robot_state-ego_min	0.05071688775093325
sim_compute_sim_state_max	0.040784185904043695
sim_compute_sim_state_mean	0.03517224433440937
sim_compute_sim_state_median	0.03357967376708984
sim_compute_sim_state_min	0.0291510981898154
sim_physics_max	0.02570206500865795
sim_physics_mean	0.021571193918680853
sim_physics_median	0.02085086027781169
sim_physics_min	0.017039934281379947
sim_render-ego_max	0.06472184481444182
sim_render-ego_mean	0.05534307841334152
sim_render-ego_median	0.053957071304321286
sim_render-ego_min	0.04386452090355658
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.580000000000044
survival_time_min	7.7499999999999805

No reset possible

19193

2818

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

error

2019-04-24 12:11:17+00:00

2019-04-24 12:14:02+00:00

0:02:45

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19187

2956

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-24 12:06:19+00:00

2019-04-24 12:10:37+00:00

0:04:18

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19178

2516

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-24 11:58:23+00:00

2019-04-24 12:02:42+00:00

0:04:19

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19178-702199', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19178-702199', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19178-702199', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19139

2961

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-24 09:02:31+00:00

2019-04-24 09:25:42+00:00

0:23:11

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19134

2310

Andrea Censi 🇨🇭

Python template

step1-simulation

host-error

yes

2019-04-24 08:57:17+00:00

2019-04-24 09:01:48+00:00

0:04:31

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19134-847350', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19134-847350', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19134-847350', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19127

2961

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-24 06:00:43+00:00

2019-04-24 06:21:28+00:00

0:20:45

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19124

2957

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-24 05:41:29+00:00

2019-04-24 06:00:06+00:00

0:18:37

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19124-352242', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19124-352242', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19124-352242', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19107

2937

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-23 23:35:41+00:00

2019-04-23 23:37:32+00:00

0:01:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19104

2921

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-23 23:00:19+00:00

2019-04-23 23:11:10+00:00

0:10:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1357801998353101
survival_time_median	4.449999999999992
deviation-center-line_median	0.05815481250886279
in-drivable-lane_median	1.9999999999999971

other stats

agent_compute-ego_max	0.10563203947884696
agent_compute-ego_mean	0.10261705450886643
agent_compute-ego_median	0.10219046774874913
agent_compute-ego_min	0.09990618569510323
deviation-center-line_max	0.43379721840092383
deviation-center-line_mean	0.15073050645065322
deviation-center-line_min	0.022424737224502445
deviation-heading_max	5.726585942672637
deviation-heading_mean	2.8825104544331888
deviation-heading_median	1.7065959883516244
deviation-heading_min	0.6396423210979028
driven_any_max	1.2002685912675657
driven_any_mean	0.581486213561173
driven_any_median	0.4028491889883631
driven_any_min	0.12872126138025303
driven_lanedir_consec_max	0.3669537212540881
driven_lanedir_consec_mean	0.1789494390434518
driven_lanedir_consec_min	0.037668153167188745
driven_lanedir_max	0.3669537212540881
driven_lanedir_mean	0.1789494390434518
driven_lanedir_median	0.1357801998353101
driven_lanedir_min	0.037668153167188745
in-drivable-lane_max	7.600000000000045
in-drivable-lane_mean	3.670000000000017
in-drivable-lane_min	0.6000000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.12872126138025303, "sim_physics": 0.014093215124947683, "survival_time": 1.7500000000000009, "driven_lanedir": 0.037668153167188745, "sim_render-ego": 0.04113616943359375, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.10563203947884696, "deviation-heading": 0.6457842132332183, "set_robot_commands": 0.05888615335736956, "deviation-center-line": 0.022424737224502445, "driven_lanedir_consec": 0.037668153167188745, "sim_compute_sim_state": 0.025133814130510603, "sim_compute_performance-ego": 0.04150634493146624, "sim_compute_robot_state-ego": 0.04292419297354562}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.156982779432106, "sim_physics": 0.012643439429146903, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07565138257358017, "sim_render-ego": 0.03914703641619001, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09990618569510323, "deviation-heading": 0.6396423210979028, "set_robot_commands": 0.056469263349260605, "deviation-center-line": 0.03355814723744762, "driven_lanedir_consec": 0.07565138257358017, "sim_compute_sim_state": 0.02441713469369071, "sim_compute_performance-ego": 0.04241517611912319, "sim_compute_robot_state-ego": 0.0428363459450858}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2002685912675657, "sim_physics": 0.013873140017191568, "survival_time": 14.950000000000076, "driven_lanedir": 0.3669537212540881, "sim_render-ego": 0.039408931732177736, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.1016509739557902, "deviation-heading": 5.693943806810562, "set_robot_commands": 0.05751800775527954, "deviation-center-line": 0.43379721840092383, "driven_lanedir_consec": 0.3669537212540881, "sim_compute_sim_state": 0.024222803910573323, "sim_compute_performance-ego": 0.04067688544591268, "sim_compute_robot_state-ego": 0.04191006580988566}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0186092467375774, "sim_physics": 0.01400010108947754, "survival_time": 14.950000000000076, "driven_lanedir": 0.278693738387092, "sim_render-ego": 0.03967993974685669, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.10370560566584268, "deviation-heading": 5.726585942672637, "set_robot_commands": 0.057928702036539714, "deviation-center-line": 0.20571761688152945, "driven_lanedir_consec": 0.278693738387092, "sim_compute_sim_state": 0.024303854306538895, "sim_compute_performance-ego": 0.04093309005101522, "sim_compute_robot_state-ego": 0.04171016295750936}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4028491889883631, "sim_physics": 0.015435947461074658, "survival_time": 4.449999999999992, "driven_lanedir": 0.1357801998353101, "sim_render-ego": 0.03990194770727265, "in-drivable-lane": 1.9999999999999971, "agent_compute-ego": 0.10219046774874913, "deviation-heading": 1.7065959883516244, "set_robot_commands": 0.05701296249132478, "deviation-center-line": 0.05815481250886279, "driven_lanedir_consec": 0.1357801998353101, "sim_compute_sim_state": 0.02443735251265965, "sim_compute_performance-ego": 0.04036290993851222, "sim_compute_robot_state-ego": 0.041976770658171576}}
set_robot_commands_max	0.05888615335736956
set_robot_commands_mean	0.05756301779795484
set_robot_commands_median	0.05751800775527954
set_robot_commands_min	0.056469263349260605
sim_compute_performance-ego_max	0.04241517611912319
sim_compute_performance-ego_mean	0.041178881297205906
sim_compute_performance-ego_median	0.04093309005101522
sim_compute_performance-ego_min	0.04036290993851222
sim_compute_robot_state-ego_max	0.04292419297354562
sim_compute_robot_state-ego_mean	0.0422715076688396
sim_compute_robot_state-ego_median	0.041976770658171576
sim_compute_robot_state-ego_min	0.04171016295750936
sim_compute_sim_state_max	0.025133814130510603
sim_compute_sim_state_mean	0.02450299191079464
sim_compute_sim_state_median	0.02441713469369071
sim_compute_sim_state_min	0.024222803910573323
sim_physics_max	0.015435947461074658
sim_physics_mean	0.014009168624367673
sim_physics_median	0.01400010108947754
sim_physics_min	0.012643439429146903
sim_render-ego_max	0.04113616943359375
sim_render-ego_mean	0.03985480500721817
sim_render-ego_median	0.03967993974685669
sim_render-ego_min	0.03914703641619001
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.5700000000000305
survival_time_min	1.7500000000000009

No reset possible

19095

2929

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-23 22:30:27+00:00

2019-04-23 22:40:10+00:00

0:09:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1551337078797541
survival_time_median	1.2500000000000004
deviation-center-line_median	0.055355632452204186
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1966029930114746
agent_compute-ego_mean	0.1852099615732829
agent_compute-ego_median	0.18516989707946777
agent_compute-ego_min	0.17265071868896484
deviation-center-line_max	0.05891457513644157
deviation-center-line_mean	0.055713413292700055
deviation-center-line_min	0.05356368932010889
deviation-heading_max	0.6371320835248153
deviation-heading_mean	0.5751402717200784
deviation-heading_median	0.5779157330161527
deviation-heading_min	0.5219268270799169
driven_any_max	0.2108783141331917
driven_any_mean	0.2010494282428316
driven_any_median	0.20656574157389143
driven_any_min	0.1885143188679434
driven_lanedir_consec_max	0.16914317354275576
driven_lanedir_consec_mean	0.15205038716783675
driven_lanedir_consec_min	0.13525154325934974
driven_lanedir_max	0.16914317354275576
driven_lanedir_mean	0.15205038716783675
driven_lanedir_median	0.1551337078797541
driven_lanedir_min	0.13525154325934974
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.189402120935117, "sim_physics": 0.04360111236572266, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13652836766880516, "sim_render-ego": 0.06851385116577148, "in-drivable-lane": 0, "agent_compute-ego": 0.18516989707946777, "deviation-heading": 0.6371320835248153, "set_robot_commands": 0.10292353630065916, "deviation-center-line": 0.05891457513644157, "driven_lanedir_consec": 0.13652836766880516, "sim_compute_sim_state": 0.039341459274291994, "sim_compute_performance-ego": 0.0706052303314209, "sim_compute_robot_state-ego": 0.07919203758239746, "sim_compute_robot_state-npc0": 0.07068253517150878, "sim_compute_robot_state-npc1": 0.070816650390625, "sim_compute_robot_state-npc2": 0.07234042167663574, "sim_compute_robot_state-npc3": 0.07114178657531739}, "udem1-1-0": {"driven_any": 0.20656574157389143, "sim_physics": 0.044847145080566406, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1551337078797541, "sim_render-ego": 0.06688555717468261, "in-drivable-lane": 0, "agent_compute-ego": 0.17265071868896484, "deviation-heading": 0.5779157330161527, "set_robot_commands": 0.0947851848602295, "deviation-center-line": 0.055355632452204186, "driven_lanedir_consec": 0.1551337078797541, "sim_compute_sim_state": 0.04167136192321777, "sim_compute_performance-ego": 0.06800448417663574, "sim_compute_robot_state-ego": 0.07001549720764161, "sim_compute_robot_state-npc0": 0.06773423194885254, "sim_compute_robot_state-npc1": 0.07086549758911133, "sim_compute_robot_state-npc2": 0.06996227264404296, "sim_compute_robot_state-npc3": 0.06892379760742187}, "udem1-2-0": {"driven_any": 0.2108783141331917, "sim_physics": 0.04887870788574219, "survival_time": 1.2500000000000004, "driven_lanedir": 0.16914317354275576, "sim_render-ego": 0.0652895736694336, "in-drivable-lane": 0, "agent_compute-ego": 0.1796750831604004, "deviation-heading": 0.5219268270799169, "set_robot_commands": 0.09823362350463868, "deviation-center-line": 0.05356368932010889, "driven_lanedir_consec": 0.16914317354275576, "sim_compute_sim_state": 0.03987832069396973, "sim_compute_performance-ego": 0.06755706787109375, "sim_compute_robot_state-ego": 0.07436331748962402, "sim_compute_robot_state-npc0": 0.0667752742767334, "sim_compute_robot_state-npc1": 0.06847697257995605, "sim_compute_robot_state-npc2": 0.06456386566162109, "sim_compute_robot_state-npc3": 0.0726176929473877}, "udem1-3-0": {"driven_any": 0.20988664570401444, "sim_physics": 0.05490082740783691, "survival_time": 1.2500000000000004, "driven_lanedir": 0.16419514348851894, "sim_render-ego": 0.07240614891052247, "in-drivable-lane": 0, "agent_compute-ego": 0.1966029930114746, "deviation-heading": 0.5392776940582371, "set_robot_commands": 0.10616441726684572, "deviation-center-line": 0.055241438756970546, "driven_lanedir_consec": 0.16419514348851894, "sim_compute_sim_state": 0.045960159301757814, "sim_compute_performance-ego": 0.07441719055175781, "sim_compute_robot_state-ego": 0.08212591171264648, "sim_compute_robot_state-npc0": 0.07942649841308594, "sim_compute_robot_state-npc1": 0.07384804725646972, "sim_compute_robot_state-npc2": 0.07470393180847168, "sim_compute_robot_state-npc3": 0.0777189826965332}, "udem1-4-0": {"driven_any": 0.1885143188679434, "sim_physics": 0.045842111110687256, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13525154325934974, "sim_render-ego": 0.0711792806784312, "in-drivable-lane": 0, "agent_compute-ego": 0.1919511159261068, "deviation-heading": 0.5994490209212702, "set_robot_commands": 0.10987581809361777, "deviation-center-line": 0.05549173079777506, "driven_lanedir_consec": 0.13525154325934974, "sim_compute_sim_state": 0.04257375995318095, "sim_compute_performance-ego": 0.0726219614346822, "sim_compute_robot_state-ego": 0.08128927151362102, "sim_compute_robot_state-npc0": 0.07586240768432617, "sim_compute_robot_state-npc1": 0.07650600870450337, "sim_compute_robot_state-npc2": 0.07498219609260559, "sim_compute_robot_state-npc3": 0.0773764153321584}}
set_robot_commands_max	0.10987581809361777
set_robot_commands_mean	0.10239651600519815
set_robot_commands_median	0.10292353630065916
set_robot_commands_min	0.0947851848602295
sim_compute_performance-ego_max	0.07441719055175781
sim_compute_performance-ego_mean	0.07064118687311807
sim_compute_performance-ego_median	0.0706052303314209
sim_compute_performance-ego_min	0.06755706787109375
sim_compute_robot_state-ego_max	0.08212591171264648
sim_compute_robot_state-ego_mean	0.07739720710118611
sim_compute_robot_state-ego_median	0.07919203758239746
sim_compute_robot_state-ego_min	0.07001549720764161
sim_compute_robot_state-npc0_max	0.07942649841308594
sim_compute_robot_state-npc0_mean	0.07209618949890137
sim_compute_robot_state-npc0_median	0.07068253517150878
sim_compute_robot_state-npc0_min	0.0667752742767334
sim_compute_robot_state-npc1_max	0.07650600870450337
sim_compute_robot_state-npc1_mean	0.07210263530413309
sim_compute_robot_state-npc1_median	0.07086549758911133
sim_compute_robot_state-npc1_min	0.06847697257995605
sim_compute_robot_state-npc2_max	0.07498219609260559
sim_compute_robot_state-npc2_mean	0.07131053757667541
sim_compute_robot_state-npc2_median	0.07234042167663574
sim_compute_robot_state-npc2_min	0.06456386566162109
sim_compute_robot_state-npc3_max	0.0777189826965332
sim_compute_robot_state-npc3_mean	0.07355573503176371
sim_compute_robot_state-npc3_median	0.0726176929473877
sim_compute_robot_state-npc3_min	0.06892379760742187
sim_compute_sim_state_max	0.045960159301757814
sim_compute_sim_state_mean	0.041885012229283654
sim_compute_sim_state_median	0.04167136192321777
sim_compute_sim_state_min	0.039341459274291994
sim_physics_max	0.05490082740783691
sim_physics_mean	0.047613980770111086
sim_physics_median	0.045842111110687256
sim_physics_min	0.04360111236572266
sim_render-ego_max	0.07240614891052247
sim_render-ego_mean	0.06885488231976827
sim_render-ego_median	0.06851385116577148
sim_render-ego_min	0.0652895736694336
simulation-passed	1
survival_time_max	1.2500000000000004
survival_time_mean	1.2400000000000004
survival_time_min	1.2000000000000004

No reset possible

19085

2916

Python template

step1-simulation

aborted

2019-04-23 14:20:22+00:00

2019-04-23 14:20:23+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19077

2917

Python template

step1-simulation

aborted

2019-04-23 14:19:05+00:00

2019-04-23 14:19:06+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19068

2914

Python template

step1-simulation

host-error

2019-04-23 14:02:26+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19066

2915

Python template

step1-simulation

host-error

2019-04-23 14:02:13+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19045

2911

Thies Lennart Alff 🇩🇪

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-23 12:18:19+00:00

2019-04-23 12:18:55+00:00

0:00:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11593705447155464
error_L2	0.020467587433067872

No reset possible

19030

2899

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-23 08:19:12+00:00

2019-04-23 08:42:19+00:00

0:23:07

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19026

2896

Masaya Kambara 🇯🇵

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-23 04:08:40+00:00

2019-04-23 04:09:12+00:00

0:00:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10697185795927296
error_L2	0.02113942377298879

No reset possible

19024

2894

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-22 19:02:22+00:00

2019-04-22 19:23:06+00:00

0:20:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4231728070685388
survival_time_median	14.950000000000076
deviation-center-line_median	0.4328406814068501
in-drivable-lane_median	1.2499999999999956

other stats

agent_compute-ego_max	0.10691293319066364
agent_compute-ego_mean	0.10627351411183676
agent_compute-ego_median	0.10643937826156616
agent_compute-ego_min	0.10547462542851764
deviation-center-line_max	0.8841205287559929
deviation-center-line_mean	0.5931696261775761
deviation-center-line_min	0.40489415349387253
deviation-heading_max	7.922009573227652
deviation-heading_mean	4.737536067183697
deviation-heading_median	4.144066449269679
deviation-heading_min	2.211953298383846
driven_any_max	0.8744729629993296
driven_any_mean	0.7583690515097921
driven_any_median	0.7583884348442157
driven_any_min	0.627786668603224
driven_lanedir_consec_max	0.7815468025811008
driven_lanedir_consec_mean	0.4779567158038735
driven_lanedir_consec_min	0.1971426096050748
driven_lanedir_max	0.7815468025811008
driven_lanedir_mean	0.5606522910247365
driven_lanedir_median	0.5128823922835757
driven_lanedir_min	0.4231728070685388
in-drivable-lane_max	6.200000000000088
in-drivable-lane_mean	2.4000000000000297
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7583884348442157, "sim_physics": 0.01431755224863688, "survival_time": 14.950000000000076, "driven_lanedir": 0.5919999329562469, "sim_render-ego": 0.04050283352533976, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.10668960412343344, "deviation-heading": 4.144066449269679, "set_robot_commands": 0.05798778931299845, "deviation-center-line": 0.4328406814068501, "driven_lanedir_consec": 0.5809677466179184, "sim_compute_sim_state": 0.02799408594767253, "sim_compute_performance-ego": 0.0416594139734904, "sim_compute_robot_state-ego": 0.04319280544916789}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8744729629993296, "sim_physics": 0.013482000827789309, "survival_time": 14.950000000000076, "driven_lanedir": 0.7815468025811008, "sim_render-ego": 0.040039502779642744, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.10585102955500283, "deviation-heading": 2.211953298383846, "set_robot_commands": 0.058552598158518473, "deviation-center-line": 0.4250801698469875, "driven_lanedir_consec": 0.7815468025811008, "sim_compute_sim_state": 0.025029048124949136, "sim_compute_performance-ego": 0.041507378419240314, "sim_compute_robot_state-ego": 0.04301145315170288}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.627786668603224, "sim_physics": 0.01441104253133138, "survival_time": 14.950000000000076, "driven_lanedir": 0.4936595202342202, "sim_render-ego": 0.04052102247873942, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.10643937826156616, "deviation-heading": 7.168576664124991, "set_robot_commands": 0.057451278368632, "deviation-center-line": 0.8841205287559929, "driven_lanedir_consec": 0.1971426096050748, "sim_compute_sim_state": 0.025141291618347168, "sim_compute_performance-ego": 0.04191749970118205, "sim_compute_robot_state-ego": 0.042994513511657714}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7092101949120804, "sim_physics": 0.013726127942403158, "survival_time": 14.950000000000076, "driven_lanedir": 0.5128823922835757, "sim_render-ego": 0.03973158836364746, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.10691293319066364, "deviation-heading": 7.922009573227652, "set_robot_commands": 0.05765774250030518, "deviation-center-line": 0.8189125973841773, "driven_lanedir_consec": 0.4069536131467349, "sim_compute_sim_state": 0.02455374876658122, "sim_compute_performance-ego": 0.04098138252894084, "sim_compute_robot_state-ego": 0.04257425228754679}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8219869961901108, "sim_physics": 0.013602335453033448, "survival_time": 14.950000000000076, "driven_lanedir": 0.4231728070685388, "sim_render-ego": 0.03977086146672567, "in-drivable-lane": 6.200000000000088, "agent_compute-ego": 0.10547462542851764, "deviation-heading": 2.2410743509123177, "set_robot_commands": 0.05823314269383748, "deviation-center-line": 0.40489415349387253, "driven_lanedir_consec": 0.4231728070685388, "sim_compute_sim_state": 0.025750524202982582, "sim_compute_performance-ego": 0.041333889961242674, "sim_compute_robot_state-ego": 0.04271794637044271}}
set_robot_commands_max	0.058552598158518473
set_robot_commands_mean	0.05797651020685832
set_robot_commands_median	0.05798778931299845
set_robot_commands_min	0.057451278368632
sim_compute_performance-ego_max	0.04191749970118205
sim_compute_performance-ego_mean	0.04147991291681925
sim_compute_performance-ego_median	0.041507378419240314
sim_compute_performance-ego_min	0.04098138252894084
sim_compute_robot_state-ego_max	0.04319280544916789
sim_compute_robot_state-ego_mean	0.0428981941541036
sim_compute_robot_state-ego_median	0.042994513511657714
sim_compute_robot_state-ego_min	0.04257425228754679
sim_compute_sim_state_max	0.02799408594767253
sim_compute_sim_state_mean	0.025693739732106525
sim_compute_sim_state_median	0.025141291618347168
sim_compute_sim_state_min	0.02455374876658122
sim_physics_max	0.01441104253133138
sim_physics_mean	0.013907811800638836
sim_physics_median	0.013726127942403158
sim_physics_min	0.013482000827789309
sim_render-ego_max	0.04052102247873942
sim_render-ego_mean	0.040113161722819014
sim_render-ego_median	0.040039502779642744
sim_render-ego_min	0.03973158836364746
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

19013

2892

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:29:56+00:00

2019-04-22 17:29:57+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18996

2891

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:28:49+00:00

2019-04-22 17:28:50+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18993

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:28:27+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18991

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:28:13+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18987

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:28:05+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18968

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

2019-04-22 16:56:13+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18967

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

2019-04-22 16:54:56+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18942

2880

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-21 01:54:04+00:00

2019-04-21 02:00:03+00:00

0:05:59

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18942-41914', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18942-41914', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18942-41914', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18931

2872

Peter Almasi 🇭🇺

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-20 22:09:47+00:00

2019-04-20 22:13:58+00:00

0:04:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07678841536831582
survival_time_median	1.5000000000000009
deviation-center-line_median	0.03319152889890695
in-drivable-lane_median	0.4000000000000003

other stats

agent_compute-ego_max	0.1077473908662796
agent_compute-ego_mean	0.10381741030127176
agent_compute-ego_median	0.10254991799592972
agent_compute-ego_min	0.10214935178342072
deviation-center-line_max	0.05149164161867685
deviation-center-line_mean	0.03581531641749656
deviation-center-line_min	0.029531190799550133
deviation-heading_max	0.648597963513407
deviation-heading_mean	0.6150237684465392
deviation-heading_median	0.6186656506626875
deviation-heading_min	0.5844272988212307
driven_any_max	0.1818308284279582
driven_any_mean	0.16521555597813048
driven_any_median	0.17534454253699744
driven_any_min	0.14279704705791363
driven_lanedir_consec_max	0.0954553471142532
driven_lanedir_consec_mean	0.07872747915463238
driven_lanedir_consec_min	0.068621281382796
driven_lanedir_max	0.0954553471142532
driven_lanedir_mean	0.07872747915463238
driven_lanedir_median	0.07678841536831582
driven_lanedir_min	0.068621281382796
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.3200000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1818308284279582, "sim_physics": 0.01448269933462143, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07903972610165377, "sim_render-ego": 0.04165160655975342, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1077473908662796, "deviation-heading": 0.5844272988212307, "set_robot_commands": 0.05955598503351211, "deviation-center-line": 0.030289711762761348, "driven_lanedir_consec": 0.07903972610165377, "sim_compute_sim_state": 0.02544119209051132, "sim_compute_performance-ego": 0.04205574095249176, "sim_compute_robot_state-ego": 0.044843174517154694}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17703451811846327, "sim_physics": 0.01342308521270752, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07373262580614315, "sim_render-ego": 0.04370548725128174, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1024032195409139, "deviation-heading": 0.6186656506626875, "set_robot_commands": 0.05802590052286784, "deviation-center-line": 0.03319152889890695, "driven_lanedir_consec": 0.07373262580614315, "sim_compute_sim_state": 0.02567621072133382, "sim_compute_performance-ego": 0.04131317933400472, "sim_compute_robot_state-ego": 0.042883650461832686}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17534454253699744, "sim_physics": 0.013254575431346892, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07678841536831582, "sim_render-ego": 0.03969958424568176, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.10254991799592972, "deviation-heading": 0.593072898178222, "set_robot_commands": 0.06134090572595596, "deviation-center-line": 0.029531190799550133, "driven_lanedir_consec": 0.07678841536831582, "sim_compute_sim_state": 0.024450033903121948, "sim_compute_performance-ego": 0.0410628467798233, "sim_compute_robot_state-ego": 0.04327700287103653}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14279704705791363, "sim_physics": 0.013653214161212629, "survival_time": 1.3000000000000005, "driven_lanedir": 0.068621281382796, "sim_render-ego": 0.04105500991527851, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.10423717131981484, "deviation-heading": 0.6303550310571486, "set_robot_commands": 0.057106659962580755, "deviation-center-line": 0.03457250900758751, "driven_lanedir_consec": 0.068621281382796, "sim_compute_sim_state": 0.02574918820307805, "sim_compute_performance-ego": 0.04165837397942176, "sim_compute_robot_state-ego": 0.04371825548318716}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14907084374931986, "sim_physics": 0.014097555823948072, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0954553471142532, "sim_render-ego": 0.04052244062009065, "in-drivable-lane": 0, "agent_compute-ego": 0.10214935178342072, "deviation-heading": 0.648597963513407, "set_robot_commands": 0.05870510184246561, "deviation-center-line": 0.05149164161867685, "driven_lanedir_consec": 0.0954553471142532, "sim_compute_sim_state": 0.024873163389123005, "sim_compute_performance-ego": 0.041883748510609504, "sim_compute_robot_state-ego": 0.04287761190663213}}
set_robot_commands_max	0.06134090572595596
set_robot_commands_mean	0.05894691061747646
set_robot_commands_median	0.05870510184246561
set_robot_commands_min	0.057106659962580755
sim_compute_performance-ego_max	0.04205574095249176
sim_compute_performance-ego_mean	0.04159477791127021
sim_compute_performance-ego_median	0.04165837397942176
sim_compute_performance-ego_min	0.0410628467798233
sim_compute_robot_state-ego_max	0.044843174517154694
sim_compute_robot_state-ego_mean	0.04351993904796864
sim_compute_robot_state-ego_median	0.04327700287103653
sim_compute_robot_state-ego_min	0.04287761190663213
sim_compute_sim_state_max	0.02574918820307805
sim_compute_sim_state_mean	0.02523795766143363
sim_compute_sim_state_median	0.02544119209051132
sim_compute_sim_state_min	0.024450033903121948
sim_physics_max	0.01448269933462143
sim_physics_mean	0.013782225992767308
sim_physics_median	0.013653214161212629
sim_physics_min	0.013254575431346892
sim_render-ego_max	0.04370548725128174
sim_render-ego_mean	0.04132682571841721
sim_render-ego_median	0.04105500991527851
sim_render-ego_min	0.03969958424568176
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.4300000000000006
survival_time_min	1.1500000000000004

No reset possible

18925

2364

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-20 15:45:27+00:00

2019-04-20 15:59:13+00:00

0:13:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1580542822678884
agent_compute-ego_mean	0.14453993683476146
agent_compute-ego_median	0.1409772704629337
agent_compute-ego_min	0.1391913202073839
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.038013876609082495, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06739228626467147, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1402721405029297, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.1042969361791071, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03779539522135033, "sim_compute_performance-ego": 0.06988521342007618, "sim_compute_robot_state-ego": 0.0753628262933695, "sim_compute_robot_state-npc0": 0.07229493698983822, "sim_compute_robot_state-npc1": 0.07189641808563808, "sim_compute_robot_state-npc2": 0.0700787013431765, "sim_compute_robot_state-npc3": 0.07101989692112184}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04201485352082686, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06819286129691383, "in-drivable-lane": 0, "agent_compute-ego": 0.14420467073267157, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.099333026192405, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03843327002091841, "sim_compute_performance-ego": 0.06546618721701881, "sim_compute_robot_state-ego": 0.07199782133102417, "sim_compute_robot_state-npc0": 0.07187854701822455, "sim_compute_robot_state-npc1": 0.07112338326194069, "sim_compute_robot_state-npc2": 0.067904916676608, "sim_compute_robot_state-npc3": 0.07211802764372392}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03953252898322211, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06559571160210503, "in-drivable-lane": 0, "agent_compute-ego": 0.1391913202073839, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09710801972283258, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.040556907653808594, "sim_compute_performance-ego": 0.06886355612013075, "sim_compute_robot_state-ego": 0.0728003978729248, "sim_compute_robot_state-npc0": 0.07058929867214626, "sim_compute_robot_state-npc1": 0.07253641022576227, "sim_compute_robot_state-npc2": 0.06670414076911078, "sim_compute_robot_state-npc3": 0.06559866269429525}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.04303941627343496, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0725682924191157, "in-drivable-lane": 0, "agent_compute-ego": 0.1580542822678884, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.11556598047415416, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04262366394201914, "sim_compute_performance-ego": 0.07647331555684407, "sim_compute_robot_state-ego": 0.0833865503470103, "sim_compute_robot_state-npc0": 0.07762818038463593, "sim_compute_robot_state-npc1": 0.07595815261205037, "sim_compute_robot_state-npc2": 0.07553509871164958, "sim_compute_robot_state-npc3": 0.07675296068191528}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03974534483516917, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.0684549282578861, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1409772704629337, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.10209608779234045, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.04008882185992073, "sim_compute_performance-ego": 0.07097912535947912, "sim_compute_robot_state-ego": 0.07402409525478587, "sim_compute_robot_state-npc0": 0.0706995971062604, "sim_compute_robot_state-npc1": 0.07090373600230497, "sim_compute_robot_state-npc2": 0.07136543708689072, "sim_compute_robot_state-npc3": 0.07041381036534029}}
set_robot_commands_max	0.11556598047415416
set_robot_commands_mean	0.10368001007216784
set_robot_commands_median	0.10209608779234045
set_robot_commands_min	0.09710801972283258
sim_compute_performance-ego_max	0.07647331555684407
sim_compute_performance-ego_mean	0.07033347953470978
sim_compute_performance-ego_median	0.06988521342007618
sim_compute_performance-ego_min	0.06546618721701881
sim_compute_robot_state-ego_max	0.0833865503470103
sim_compute_robot_state-ego_mean	0.07551433821982292
sim_compute_robot_state-ego_median	0.07402409525478587
sim_compute_robot_state-ego_min	0.07199782133102417
sim_compute_robot_state-npc0_max	0.07762818038463593
sim_compute_robot_state-npc0_mean	0.07261811203422107
sim_compute_robot_state-npc0_median	0.07187854701822455
sim_compute_robot_state-npc0_min	0.07058929867214626
sim_compute_robot_state-npc1_max	0.07595815261205037
sim_compute_robot_state-npc1_mean	0.07248362003753928
sim_compute_robot_state-npc1_median	0.07189641808563808
sim_compute_robot_state-npc1_min	0.07090373600230497
sim_compute_robot_state-npc2_max	0.07553509871164958
sim_compute_robot_state-npc2_mean	0.07031765891748712
sim_compute_robot_state-npc2_median	0.0700787013431765
sim_compute_robot_state-npc2_min	0.06670414076911078
sim_compute_robot_state-npc3_max	0.07675296068191528
sim_compute_robot_state-npc3_mean	0.07118067166127931
sim_compute_robot_state-npc3_median	0.07101989692112184
sim_compute_robot_state-npc3_min	0.06559866269429525
sim_compute_sim_state_max	0.04262366394201914
sim_compute_sim_state_mean	0.03989961173960344
sim_compute_sim_state_median	0.04008882185992073
sim_compute_sim_state_min	0.03779539522135033
sim_physics_max	0.04303941627343496
sim_physics_mean	0.04046920404434712
sim_physics_median	0.03974534483516917
sim_physics_min	0.038013876609082495
sim_render-ego_max	0.0725682924191157
sim_render-ego_mean	0.06844081596813842
sim_render-ego_median	0.06819286129691383
sim_render-ego_min	0.06559571160210503
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18911

2378

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

error

2019-04-20 15:24:08+00:00

2019-04-20 15:44:57+00:00

0:20:49

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18890

2410

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-20 15:02:34+00:00

2019-04-20 15:23:34+00:00

0:21:00

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18878

2413

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-20 14:43:15+00:00

2019-04-20 15:00:08+00:00

0:16:53

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18878-879761', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18878-879761', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18878-879761', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18866

2432

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-20 14:39:58+00:00

2019-04-20 14:40:29+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18862

2437

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-20 14:37:45+00:00

2019-04-20 14:38:45+00:00

0:01:00

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18856

2442

random_agent

step1-simulation

success

2019-04-20 14:24:33+00:00

2019-04-20 14:34:31+00:00

0:09:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.148835919120095
agent_compute-ego_mean	0.12463872233552824
agent_compute-ego_median	0.12224797641529755
agent_compute-ego_min	0.11366104629804503
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02541676107442604, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04942638469192217, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.11366104629804503, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0681791935326918, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.028281252339201153, "sim_compute_performance-ego": 0.050884669681765, "sim_compute_robot_state-ego": 0.05138322542298515, "sim_compute_robot_state-npc0": 0.05346777304163519, "sim_compute_robot_state-npc1": 0.04939475599324928, "sim_compute_robot_state-npc2": 0.0510383776898654, "sim_compute_robot_state-npc3": 0.049788353578099666}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03830636631358753, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06203748963095925, "in-drivable-lane": 0, "agent_compute-ego": 0.148835919120095, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09358052232048727, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03550737012516369, "sim_compute_performance-ego": 0.06450630859895186, "sim_compute_robot_state-ego": 0.06607660380276767, "sim_compute_robot_state-npc0": 0.06524333086880771, "sim_compute_robot_state-npc1": 0.06506854295730591, "sim_compute_robot_state-npc2": 0.06326451626690952, "sim_compute_robot_state-npc3": 0.0662027272311124}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.031679259406195745, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.04802078141106499, "in-drivable-lane": 0, "agent_compute-ego": 0.11393778059217664, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07341698540581597, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.02844472991095649, "sim_compute_performance-ego": 0.04925490485297309, "sim_compute_robot_state-ego": 0.05053374502393934, "sim_compute_robot_state-npc0": 0.052143218782213, "sim_compute_robot_state-npc1": 0.052734560436672635, "sim_compute_robot_state-npc2": 0.0500413629743788, "sim_compute_robot_state-npc3": 0.051483678817749026}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.030042588710784912, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05394482612609863, "in-drivable-lane": 0, "agent_compute-ego": 0.12451088925202689, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07491019864877065, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.029866332809130352, "sim_compute_performance-ego": 0.05153625210126241, "sim_compute_robot_state-ego": 0.05357967317104339, "sim_compute_robot_state-npc0": 0.054794823129971824, "sim_compute_robot_state-npc1": 0.05481426417827606, "sim_compute_robot_state-npc2": 0.05141488711039225, "sim_compute_robot_state-npc3": 0.05134714643160502}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.030750442953670725, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05419954482246848, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12224797641529755, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07140540726044599, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.030784186194924748, "sim_compute_performance-ego": 0.05063435610602884, "sim_compute_robot_state-ego": 0.0555034455131082, "sim_compute_robot_state-npc0": 0.05687521485721364, "sim_compute_robot_state-npc1": 0.05428753530277925, "sim_compute_robot_state-npc2": 0.054066850858576154, "sim_compute_robot_state-npc3": 0.05427965697120218}}
set_robot_commands_max	0.09358052232048727
set_robot_commands_mean	0.07629846143364234
set_robot_commands_median	0.07341698540581597
set_robot_commands_min	0.0681791935326918
sim_compute_performance-ego_max	0.06450630859895186
sim_compute_performance-ego_mean	0.05336329826819623
sim_compute_performance-ego_median	0.050884669681765
sim_compute_performance-ego_min	0.04925490485297309
sim_compute_robot_state-ego_max	0.06607660380276767
sim_compute_robot_state-ego_mean	0.055415338586768746
sim_compute_robot_state-ego_median	0.05357967317104339
sim_compute_robot_state-ego_min	0.05053374502393934
sim_compute_robot_state-npc0_max	0.06524333086880771
sim_compute_robot_state-npc0_mean	0.05650487213596827
sim_compute_robot_state-npc0_median	0.054794823129971824
sim_compute_robot_state-npc0_min	0.052143218782213
sim_compute_robot_state-npc1_max	0.06506854295730591
sim_compute_robot_state-npc1_mean	0.05525993177365662
sim_compute_robot_state-npc1_median	0.05428753530277925
sim_compute_robot_state-npc1_min	0.04939475599324928
sim_compute_robot_state-npc2_max	0.06326451626690952
sim_compute_robot_state-npc2_mean	0.05396519898002442
sim_compute_robot_state-npc2_median	0.05141488711039225
sim_compute_robot_state-npc2_min	0.0500413629743788
sim_compute_robot_state-npc3_max	0.0662027272311124
sim_compute_robot_state-npc3_mean	0.054620312605953646
sim_compute_robot_state-npc3_median	0.051483678817749026
sim_compute_robot_state-npc3_min	0.049788353578099666
sim_compute_sim_state_max	0.03550737012516369
sim_compute_sim_state_mean	0.030576774275875285
sim_compute_sim_state_median	0.029866332809130352
sim_compute_sim_state_min	0.028281252339201153
sim_physics_max	0.03830636631358753
sim_physics_mean	0.031239083691732988
sim_physics_median	0.030750442953670725
sim_physics_min	0.02541676107442604
sim_render-ego_max	0.06203748963095925
sim_render-ego_mean	0.05352580533650271
sim_render-ego_median	0.05394482612609863
sim_render-ego_min	0.04802078141106499
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18836

2471

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-20 14:11:22+00:00

2019-04-20 14:24:24+00:00

0:13:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17866418759028116
agent_compute-ego_mean	0.15536178642803314
agent_compute-ego_median	0.163845956325531
agent_compute-ego_min	0.12159702452746304
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.039494604434607165, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.07224907065337559, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.17489517859692844, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.10727733935949936, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04371999794582151, "sim_compute_performance-ego": 0.07750493625424942, "sim_compute_robot_state-ego": 0.08322751746987397, "sim_compute_robot_state-npc0": 0.0744871013569382, "sim_compute_robot_state-npc1": 0.07209134551714051, "sim_compute_robot_state-npc2": 0.07530253788210312, "sim_compute_robot_state-npc3": 0.07515076421341806}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.029955479231747715, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0489994233304804, "in-drivable-lane": 0, "agent_compute-ego": 0.12159702452746304, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07227324897592718, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.029047592119737103, "sim_compute_performance-ego": 0.05213117599487305, "sim_compute_robot_state-ego": 0.0681367191401395, "sim_compute_robot_state-npc0": 0.05294422669844194, "sim_compute_robot_state-npc1": 0.05028800530867143, "sim_compute_robot_state-npc2": 0.052216090939261696, "sim_compute_robot_state-npc3": 0.051519659432497894}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03577732510036892, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.057664415571424696, "in-drivable-lane": 0, "agent_compute-ego": 0.13780658509996202, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.0810608016120063, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03552348878648546, "sim_compute_performance-ego": 0.06286159621344672, "sim_compute_robot_state-ego": 0.0652750915951199, "sim_compute_robot_state-npc0": 0.061895667182074655, "sim_compute_robot_state-npc1": 0.06056399875217014, "sim_compute_robot_state-npc2": 0.060643074247572155, "sim_compute_robot_state-npc3": 0.06314203474256727}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.047769129276275635, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.07695520917574565, "in-drivable-lane": 0, "agent_compute-ego": 0.17866418759028116, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.12064134577910106, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04272224009037018, "sim_compute_performance-ego": 0.07631948590278625, "sim_compute_robot_state-ego": 0.0852792610724767, "sim_compute_robot_state-npc0": 0.08436957995096843, "sim_compute_robot_state-npc1": 0.07950289050738017, "sim_compute_robot_state-npc2": 0.07918021082878113, "sim_compute_robot_state-npc3": 0.07974827289581299}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.04416796740363626, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06588919373119578, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.163845956325531, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.11079958957784317, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.0412559754708234, "sim_compute_performance-ego": 0.07052241002812105, "sim_compute_robot_state-ego": 0.07737094163894653, "sim_compute_robot_state-npc0": 0.07234371409696691, "sim_compute_robot_state-npc1": 0.07098827291937436, "sim_compute_robot_state-npc2": 0.07069149788688212, "sim_compute_robot_state-npc3": 0.07442966278861551}}
set_robot_commands_max	0.12064134577910106
set_robot_commands_mean	0.0984104650608754
set_robot_commands_median	0.10727733935949936
set_robot_commands_min	0.07227324897592718
sim_compute_performance-ego_max	0.07750493625424942
sim_compute_performance-ego_mean	0.0678679208786953
sim_compute_performance-ego_median	0.07052241002812105
sim_compute_performance-ego_min	0.05213117599487305
sim_compute_robot_state-ego_max	0.0852792610724767
sim_compute_robot_state-ego_mean	0.07585790618331131
sim_compute_robot_state-ego_median	0.07737094163894653
sim_compute_robot_state-ego_min	0.0652750915951199
sim_compute_robot_state-npc0_max	0.08436957995096843
sim_compute_robot_state-npc0_mean	0.06920805785707802
sim_compute_robot_state-npc0_median	0.07234371409696691
sim_compute_robot_state-npc0_min	0.05294422669844194
sim_compute_robot_state-npc1_max	0.07950289050738017
sim_compute_robot_state-npc1_mean	0.06668690260094733
sim_compute_robot_state-npc1_median	0.07098827291937436
sim_compute_robot_state-npc1_min	0.05028800530867143
sim_compute_robot_state-npc2_max	0.07918021082878113
sim_compute_robot_state-npc2_mean	0.06760668235692005
sim_compute_robot_state-npc2_median	0.07069149788688212
sim_compute_robot_state-npc2_min	0.052216090939261696
sim_compute_robot_state-npc3_max	0.07974827289581299
sim_compute_robot_state-npc3_mean	0.06879807881458236
sim_compute_robot_state-npc3_median	0.07442966278861551
sim_compute_robot_state-npc3_min	0.051519659432497894
sim_compute_sim_state_max	0.04371999794582151
sim_compute_sim_state_mean	0.03845385888264753
sim_compute_sim_state_median	0.0412559754708234
sim_compute_sim_state_min	0.029047592119737103
sim_physics_max	0.047769129276275635
sim_physics_mean	0.03943290108932714
sim_physics_median	0.039494604434607165
sim_physics_min	0.029955479231747715
sim_render-ego_max	0.07695520917574565
sim_render-ego_mean	0.06435146249244442
sim_render-ego_median	0.06588919373119578
sim_render-ego_min	0.0489994233304804
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18831

2479

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 14:09:16+00:00

2019-04-20 14:10:04+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18825

2501

test for ppo

step1-simulation

error

2019-04-20 14:05:49+00:00

2019-04-20 14:08:30+00:00

0:02:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18807

2512

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-20 14:02:50+00:00

2019-04-20 14:05:04+00:00

0:02:14

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18796

2532

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-20 14:01:10+00:00

2019-04-20 14:02:32+00:00

0:01:22

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18782

2555

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-20 13:50:52+00:00

2019-04-20 14:00:05+00:00

0:09:13

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18782-372170', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18782-372170', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18782-372170', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18772

2568

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-20 13:31:21+00:00

2019-04-20 13:46:23+00:00

0:15:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.08414551458860699
agent_compute-ego_mean	0.07816023289299277
agent_compute-ego_median	0.07892393523996527
agent_compute-ego_min	0.07299032578101525
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.048657339497616414, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06952786696584601, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07492326435289885, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.10109213025946366, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.04056982743112664, "sim_compute_performance-ego": 0.07068770559210526, "sim_compute_robot_state-ego": 0.072125075992785, "sim_compute_robot_state-npc0": 0.06976299034921747, "sim_compute_robot_state-npc1": 0.0688316822052002, "sim_compute_robot_state-npc2": 0.07179935605902421, "sim_compute_robot_state-npc3": 0.07109667627434982}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.051153634723864104, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.08242241959822805, "in-drivable-lane": 0, "agent_compute-ego": 0.08414551458860699, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.1210481555838334, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.04176450403113114, "sim_compute_performance-ego": 0.07523737455669202, "sim_compute_robot_state-ego": 0.08412721282557438, "sim_compute_robot_state-npc0": 0.08075187708202161, "sim_compute_robot_state-npc1": 0.07428693143944991, "sim_compute_robot_state-npc2": 0.07619540942342658, "sim_compute_robot_state-npc3": 0.07770099137958728}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.04482449018038236, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06336607077182868, "in-drivable-lane": 0, "agent_compute-ego": 0.07299032578101525, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.09948548903832068, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03721389403709999, "sim_compute_performance-ego": 0.06744847542200333, "sim_compute_robot_state-ego": 0.07603191718077049, "sim_compute_robot_state-npc0": 0.06598445085378793, "sim_compute_robot_state-npc1": 0.06756264735490848, "sim_compute_robot_state-npc2": 0.06936956063295022, "sim_compute_robot_state-npc3": 0.06497881351373135}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.05900730549449652, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.071481724859963, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07981812450247751, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.11433584253552934, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.04201704011836522, "sim_compute_performance-ego": 0.07678160197298292, "sim_compute_robot_state-ego": 0.08338552125742738, "sim_compute_robot_state-npc0": 0.07441733252834266, "sim_compute_robot_state-npc1": 0.0737194880633287, "sim_compute_robot_state-npc2": 0.07428735074862627, "sim_compute_robot_state-npc3": 0.07478130703241052}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.04331887310201472, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.0690377950668335, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07892393523996527, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.1095984469760548, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.04072937640276822, "sim_compute_performance-ego": 0.07262582128698175, "sim_compute_robot_state-ego": 0.07749313116073608, "sim_compute_robot_state-npc0": 0.07193788615140048, "sim_compute_robot_state-npc1": 0.07307111675089056, "sim_compute_robot_state-npc2": 0.07135370102795688, "sim_compute_robot_state-npc3": 0.07174596461382779}}
set_robot_commands_max	0.1210481555838334
set_robot_commands_mean	0.10911201287864036
set_robot_commands_median	0.1095984469760548
set_robot_commands_min	0.09948548903832068
sim_compute_performance-ego_max	0.07678160197298292
sim_compute_performance-ego_mean	0.07255619576615305
sim_compute_performance-ego_median	0.07262582128698175
sim_compute_performance-ego_min	0.06744847542200333
sim_compute_robot_state-ego_max	0.08412721282557438
sim_compute_robot_state-ego_mean	0.07863257168345868
sim_compute_robot_state-ego_median	0.07749313116073608
sim_compute_robot_state-ego_min	0.072125075992785
sim_compute_robot_state-npc0_max	0.08075187708202161
sim_compute_robot_state-npc0_mean	0.07257090739295405
sim_compute_robot_state-npc0_median	0.07193788615140048
sim_compute_robot_state-npc0_min	0.06598445085378793
sim_compute_robot_state-npc1_max	0.07428693143944991
sim_compute_robot_state-npc1_mean	0.07149437316275556
sim_compute_robot_state-npc1_median	0.07307111675089056
sim_compute_robot_state-npc1_min	0.06756264735490848
sim_compute_robot_state-npc2_max	0.07619540942342658
sim_compute_robot_state-npc2_mean	0.07260107557839683
sim_compute_robot_state-npc2_median	0.07179935605902421
sim_compute_robot_state-npc2_min	0.06936956063295022
sim_compute_robot_state-npc3_max	0.07770099137958728
sim_compute_robot_state-npc3_mean	0.07206075056278136
sim_compute_robot_state-npc3_median	0.07174596461382779
sim_compute_robot_state-npc3_min	0.06497881351373135
sim_compute_sim_state_max	0.04201704011836522
sim_compute_sim_state_mean	0.040458928404098246
sim_compute_sim_state_median	0.04072937640276822
sim_compute_sim_state_min	0.03721389403709999
sim_physics_max	0.05900730549449652
sim_physics_mean	0.04939232859967483
sim_physics_median	0.048657339497616414
sim_physics_min	0.04331887310201472
sim_render-ego_max	0.08242241959822805
sim_render-ego_mean	0.07116717545253984
sim_render-ego_median	0.06952786696584601
sim_render-ego_min	0.06336607077182868
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18769

2569

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-20 13:14:32+00:00

2019-04-20 13:31:01+00:00

0:16:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.08355978915565893
agent_compute-ego_mean	0.07690582168099154
agent_compute-ego_median	0.07534927568937602
agent_compute-ego_min	0.07103919371580467
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.04724882527401573, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06920212946440044, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07534927568937602, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.10687687773453562, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.0404653925644724, "sim_compute_performance-ego": 0.07170846838700144, "sim_compute_robot_state-ego": 0.07483455005444978, "sim_compute_robot_state-npc0": 0.07233804401598479, "sim_compute_robot_state-npc1": 0.07181373395417866, "sim_compute_robot_state-npc2": 0.07178120613098145, "sim_compute_robot_state-npc3": 0.0705617578406083}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.049941646425347576, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.07475378011402331, "in-drivable-lane": 0, "agent_compute-ego": 0.08355978915565893, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.10922165920859889, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.043499846207468135, "sim_compute_performance-ego": 0.07410137276900441, "sim_compute_robot_state-ego": 0.08143994055296246, "sim_compute_robot_state-npc0": 0.07576810058794524, "sim_compute_robot_state-npc1": 0.0751178452843114, "sim_compute_robot_state-npc2": 0.07339357702355635, "sim_compute_robot_state-npc3": 0.07468998432159424}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.0482637698833759, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.0735946251795842, "in-drivable-lane": 0, "agent_compute-ego": 0.07103919371580467, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.10158121280181102, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.04167299392895821, "sim_compute_performance-ego": 0.0731804737677941, "sim_compute_robot_state-ego": 0.07830111185709636, "sim_compute_robot_state-npc0": 0.07023232411115597, "sim_compute_robot_state-npc1": 0.07316300196525378, "sim_compute_robot_state-npc2": 0.07426623197702262, "sim_compute_robot_state-npc3": 0.073713773336166}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.0519629632922965, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06918671097553952, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07260298393142055, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.10051185648206254, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.04012395294619278, "sim_compute_performance-ego": 0.07407264978113309, "sim_compute_robot_state-ego": 0.075933382544719, "sim_compute_robot_state-npc0": 0.07110148752239388, "sim_compute_robot_state-npc1": 0.07254652909829583, "sim_compute_robot_state-npc2": 0.07225088334419358, "sim_compute_robot_state-npc3": 0.07269770326748701}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.04765684496272694, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.07197370854291049, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08197786591269753, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.11182878776030108, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.043981936844912445, "sim_compute_performance-ego": 0.07573822411623868, "sim_compute_robot_state-ego": 0.08019729635932228, "sim_compute_robot_state-npc0": 0.07754245129498569, "sim_compute_robot_state-npc1": 0.07816307653080333, "sim_compute_robot_state-npc2": 0.07742563702843407, "sim_compute_robot_state-npc3": 0.08045829968018965}}
set_robot_commands_max	0.11182878776030108
set_robot_commands_mean	0.10600407879746183
set_robot_commands_median	0.10687687773453562
set_robot_commands_min	0.10051185648206254
sim_compute_performance-ego_max	0.07573822411623868
sim_compute_performance-ego_mean	0.07376023776423435
sim_compute_performance-ego_median	0.07407264978113309
sim_compute_performance-ego_min	0.07170846838700144
sim_compute_robot_state-ego_max	0.08143994055296246
sim_compute_robot_state-ego_mean	0.07814125627370996
sim_compute_robot_state-ego_median	0.07830111185709636
sim_compute_robot_state-ego_min	0.07483455005444978
sim_compute_robot_state-npc0_max	0.07754245129498569
sim_compute_robot_state-npc0_mean	0.07339648150649311
sim_compute_robot_state-npc0_median	0.07233804401598479
sim_compute_robot_state-npc0_min	0.07023232411115597
sim_compute_robot_state-npc1_max	0.07816307653080333
sim_compute_robot_state-npc1_mean	0.0741608373665686
sim_compute_robot_state-npc1_median	0.07316300196525378
sim_compute_robot_state-npc1_min	0.07181373395417866
sim_compute_robot_state-npc2_max	0.07742563702843407
sim_compute_robot_state-npc2_mean	0.07382350710083761
sim_compute_robot_state-npc2_median	0.07339357702355635
sim_compute_robot_state-npc2_min	0.07178120613098145
sim_compute_robot_state-npc3_max	0.08045829968018965
sim_compute_robot_state-npc3_mean	0.07442430368920903
sim_compute_robot_state-npc3_median	0.073713773336166
sim_compute_robot_state-npc3_min	0.0705617578406083
sim_compute_sim_state_max	0.043981936844912445
sim_compute_sim_state_mean	0.041948824498400795
sim_compute_sim_state_median	0.04167299392895821
sim_compute_sim_state_min	0.04012395294619278
sim_physics_max	0.0519629632922965
sim_physics_mean	0.04901480996755253
sim_physics_median	0.0482637698833759
sim_physics_min	0.04724882527401573
sim_render-ego_max	0.07475378011402331
sim_render-ego_mean	0.07174219085529158
sim_render-ego_median	0.07197370854291049
sim_render-ego_min	0.06918671097553952
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18767

2560

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-20 13:00:55+00:00

2019-04-20 13:10:09+00:00

0:09:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08155588920299824
agent_compute-ego_mean	0.07813160158592725
agent_compute-ego_median	0.07783857772224828
agent_compute-ego_min	0.07601778681685285
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.029623790485102955, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.07016601795103491, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07601778681685285, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.11026537709119844, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.0411670760410588, "sim_compute_performance-ego": 0.07269787206882383, "sim_compute_robot_state-ego": 0.08100810865076577}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.026291306202228252, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.07216889124650222, "in-drivable-lane": 0, "agent_compute-ego": 0.08155588920299824, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.11649694809546836, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.04224838660313533, "sim_compute_performance-ego": 0.07619835780217098, "sim_compute_robot_state-ego": 0.08425745597252479}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.02705636430293956, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.07109572025055581, "in-drivable-lane": 0, "agent_compute-ego": 0.07721338373549441, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.11159206451253688, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.042348658784906915, "sim_compute_performance-ego": 0.07382785005772367, "sim_compute_robot_state-ego": 0.08228558682380839}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.03158011541261778, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.07049871801020025, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07803237045204246, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.11034864645737869, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04246274193564614, "sim_compute_performance-ego": 0.07455599701011574, "sim_compute_robot_state-ego": 0.08043072773860051}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.026146280138116137, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.07012512181934558, "in-drivable-lane": 0, "agent_compute-ego": 0.07783857772224828, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10621560874738192, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04162327866805227, "sim_compute_performance-ego": 0.07330401947623805, "sim_compute_robot_state-ego": 0.0820718250776592}}
set_robot_commands_max	0.11649694809546836
set_robot_commands_mean	0.11098372898079284
set_robot_commands_median	0.11034864645737869
set_robot_commands_min	0.10621560874738192
sim_compute_performance-ego_max	0.07619835780217098
sim_compute_performance-ego_mean	0.07411681928301446
sim_compute_performance-ego_median	0.07382785005772367
sim_compute_performance-ego_min	0.07269787206882383
sim_compute_robot_state-ego_max	0.08425745597252479
sim_compute_robot_state-ego_mean	0.08201074085267172
sim_compute_robot_state-ego_median	0.0820718250776592
sim_compute_robot_state-ego_min	0.08043072773860051
sim_compute_sim_state_max	0.04246274193564614
sim_compute_sim_state_mean	0.04197002840655989
sim_compute_sim_state_median	0.04224838660313533
sim_compute_sim_state_min	0.0411670760410588
sim_physics_max	0.03158011541261778
sim_physics_mean	0.028139571308200932
sim_physics_median	0.02705636430293956
sim_physics_min	0.026146280138116137
sim_render-ego_max	0.07216889124650222
sim_render-ego_mean	0.07081089385552775
sim_render-ego_median	0.07049871801020025
sim_render-ego_min	0.07012512181934558
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18764

2570

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 12:53:47+00:00

2019-04-20 13:00:04+00:00

0:06:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18764-446786', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18764-446786', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18764-446786', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18762

2573

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-20 12:52:42+00:00

2019-04-20 12:53:12+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18760

2574

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-20 12:51:30+00:00

2019-04-20 12:52:02+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18758

2578

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-20 12:50:37+00:00

2019-04-20 12:51:07+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18754

2583

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

success

2019-04-20 12:42:25+00:00

2019-04-20 12:49:47+00:00

0:07:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07825514746875298
agent_compute-ego_mean	0.06529540561184047
agent_compute-ego_median	0.06089320549598107
agent_compute-ego_min	0.05607109948208457
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.028496829474844585, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.08351551323402219, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07825514746875298, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.09485652970104684, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03881542275591594, "sim_compute_performance-ego": 0.08607882115899063, "sim_compute_robot_state-ego": 0.07094141913623345}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.020946035018334024, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05431067026578463, "in-drivable-lane": 0, "agent_compute-ego": 0.06089320549598107, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.08046348278339092, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.034622953488276556, "sim_compute_performance-ego": 0.05799566782437838, "sim_compute_robot_state-ego": 0.05876286213214581}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.02014210376333683, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.053889736216119, "in-drivable-lane": 0, "agent_compute-ego": 0.060079346311853285, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08290217785125083, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03439189018087184, "sim_compute_performance-ego": 0.0622875081731918, "sim_compute_robot_state-ego": 0.058943053509326694}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.029377009842421985, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06500722025776957, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0711782293005304, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.09622848950899564, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.038552512179364215, "sim_compute_performance-ego": 0.06709406402084854, "sim_compute_robot_state-ego": 0.07255098059937194}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.01860361977627403, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05136728286743164, "in-drivable-lane": 0, "agent_compute-ego": 0.05607109948208457, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07348760178214625, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03047873471912585, "sim_compute_performance-ego": 0.051463729456851355, "sim_compute_robot_state-ego": 0.05345901062614039}}
set_robot_commands_max	0.09622848950899564
set_robot_commands_mean	0.0855876563253661
set_robot_commands_median	0.08290217785125083
set_robot_commands_min	0.07348760178214625
sim_compute_performance-ego_max	0.08607882115899063
sim_compute_performance-ego_mean	0.06498395812685213
sim_compute_performance-ego_median	0.0622875081731918
sim_compute_performance-ego_min	0.051463729456851355
sim_compute_robot_state-ego_max	0.07255098059937194
sim_compute_robot_state-ego_mean	0.06293146520064366
sim_compute_robot_state-ego_median	0.058943053509326694
sim_compute_robot_state-ego_min	0.05345901062614039
sim_compute_sim_state_max	0.03881542275591594
sim_compute_sim_state_mean	0.03537230266471088
sim_compute_sim_state_median	0.034622953488276556
sim_compute_sim_state_min	0.03047873471912585
sim_physics_max	0.029377009842421985
sim_physics_mean	0.02351311957504229
sim_physics_median	0.020946035018334024
sim_physics_min	0.01860361977627403
sim_render-ego_max	0.08351551323402219
sim_render-ego_mean	0.06161808456822541
sim_render-ego_median	0.05431067026578463
sim_render-ego_min	0.05136728286743164
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18751

2652

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 12:21:02+00:00

2019-04-20 12:41:58+00:00

0:20:56

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18747

2586

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-20 12:00:22+00:00

2019-04-20 12:18:08+00:00

0:17:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2669581009393145
survival_time_median	5.649999999999988
deviation-center-line_median	0.31157834685612
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.26836184305804117
agent_compute-ego_mean	0.24726587770216005
agent_compute-ego_median	0.2455954952577574
agent_compute-ego_min	0.2356866636583882
deviation-center-line_max	0.3276637821158961
deviation-center-line_mean	0.30647701924881493
deviation-center-line_min	0.27012225998005635
deviation-heading_max	2.122093830186374
deviation-heading_mean	2.089786847247409
deviation-heading_median	2.091625485283885
deviation-heading_min	2.056626108349156
driven_any_max	0.3400895101097615
driven_any_mean	0.30862154144931947
driven_any_median	0.3046324577614352
driven_any_min	0.27784567616675965
driven_lanedir_consec_max	0.30277002567255096
driven_lanedir_consec_mean	0.27066610542837477
driven_lanedir_consec_min	0.24048611502492137
driven_lanedir_max	0.30277002567255096
driven_lanedir_mean	0.27066610542837477
driven_lanedir_median	0.2669581009393145
driven_lanedir_min	0.24048611502492137
in-drivable-lane_max	0.14999999999999947
in-drivable-lane_mean	0.06999999999999976
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.27784567616675965, "sim_physics": 0.027872664587838308, "survival_time": 5.249999999999989, "driven_lanedir": 0.24048611502492137, "sim_render-ego": 0.07151421138218471, "in-drivable-lane": 0, "agent_compute-ego": 0.24827099300566177, "deviation-heading": 2.115892052861963, "set_robot_commands": 0.10008974983578636, "deviation-center-line": 0.27012225998005635, "driven_lanedir_consec": 0.24048611502492137, "sim_compute_sim_state": 0.03771811894008092, "sim_compute_performance-ego": 0.07318927674066453, "sim_compute_robot_state-ego": 0.07428736459641229}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3013832800803159, "sim_physics": 0.027842012899262563, "survival_time": 5.599999999999988, "driven_lanedir": 0.2642950126530038, "sim_render-ego": 0.07098839112690516, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.26836184305804117, "deviation-heading": 2.122093830186374, "set_robot_commands": 0.10778523981571198, "deviation-center-line": 0.31157834685612, "driven_lanedir_consec": 0.2642950126530038, "sim_compute_sim_state": 0.04080824128219059, "sim_compute_performance-ego": 0.07393113417284829, "sim_compute_robot_state-ego": 0.08027245317186628}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.31915678312832507, "sim_physics": 0.024412147000304658, "survival_time": 5.849999999999987, "driven_lanedir": 0.27882127285208336, "sim_render-ego": 0.06809034918108557, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2384143935309516, "deviation-heading": 2.062696759555665, "set_robot_commands": 0.09710403385325377, "deviation-center-line": 0.3228051071284931, "driven_lanedir_consec": 0.27882127285208336, "sim_compute_sim_state": 0.04047851073436248, "sim_compute_performance-ego": 0.07257640667450733, "sim_compute_robot_state-ego": 0.07178965796772231}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3400895101097615, "sim_physics": 0.02780887003867857, "survival_time": 6.199999999999986, "driven_lanedir": 0.30277002567255096, "sim_render-ego": 0.06584607208928754, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.2356866636583882, "deviation-heading": 2.056626108349156, "set_robot_commands": 0.0966911392827188, "deviation-center-line": 0.3276637821158961, "driven_lanedir_consec": 0.30277002567255096, "sim_compute_sim_state": 0.038801329751168526, "sim_compute_performance-ego": 0.06958785749250843, "sim_compute_robot_state-ego": 0.07009097645359655}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3046324577614352, "sim_physics": 0.02878467382582943, "survival_time": 5.649999999999988, "driven_lanedir": 0.2669581009393145, "sim_render-ego": 0.06670690848764065, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2455954952577574, "deviation-heading": 2.091625485283885, "set_robot_commands": 0.10287301308285872, "deviation-center-line": 0.30021560016350923, "driven_lanedir_consec": 0.2669581009393145, "sim_compute_sim_state": 0.03976082168849169, "sim_compute_performance-ego": 0.06830799474125415, "sim_compute_robot_state-ego": 0.07244628087609215}}
set_robot_commands_max	0.10778523981571198
set_robot_commands_mean	0.10090863517406592
set_robot_commands_median	0.10008974983578636
set_robot_commands_min	0.0966911392827188
sim_compute_performance-ego_max	0.07393113417284829
sim_compute_performance-ego_mean	0.07151853396435655
sim_compute_performance-ego_median	0.07257640667450733
sim_compute_performance-ego_min	0.06830799474125415
sim_compute_robot_state-ego_max	0.08027245317186628
sim_compute_robot_state-ego_mean	0.07377734661313792
sim_compute_robot_state-ego_median	0.07244628087609215
sim_compute_robot_state-ego_min	0.07009097645359655
sim_compute_sim_state_max	0.04080824128219059
sim_compute_sim_state_mean	0.03951340447925884
sim_compute_sim_state_median	0.03976082168849169
sim_compute_sim_state_min	0.03771811894008092
sim_physics_max	0.02878467382582943
sim_physics_mean	0.027344073670382708
sim_physics_median	0.027842012899262563
sim_physics_min	0.024412147000304658
sim_render-ego_max	0.07151421138218471
sim_render-ego_mean	0.06862918645342073
sim_render-ego_median	0.06809034918108557
sim_render-ego_min	0.06584607208928754
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	5.7099999999999875
survival_time_min	5.249999999999989

No reset possible

18746

2591

baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-20 11:55:17+00:00

2019-04-20 12:00:06+00:00

0:04:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18746-526014', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18746-526014', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18746-526014', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18742

2595

baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-20 11:30:52+00:00

2019-04-20 11:51:53+00:00

0:21:01

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18741

2596

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 11:28:43+00:00

2019-04-20 11:29:31+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18740

2597

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 11:26:52+00:00

2019-04-20 11:27:40+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18730

2685

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 11:05:08+00:00

2019-04-20 11:26:04+00:00

0:20:56

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18713

2637

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-20 10:43:07+00:00

2019-04-20 11:00:07+00:00

0:17:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18713-698266', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18713-698266', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18713-698266', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18703

2656

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 10:21:40+00:00

2019-04-20 10:42:36+00:00

0:20:56

Waited 1201 seconds [...]

Waited 1201 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18689

2695

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 10:00:20+00:00

2019-04-20 10:21:20+00:00

0:21:00

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18687

2677

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 09:59:33+00:00

2019-04-20 10:00:10+00:00

0:00:37

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18687-57432', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18687-57432', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18687-57432', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18672

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 09:38:00+00:00

2019-04-20 09:58:52+00:00

0:20:52

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18669

2719

test for ppo

step1-simulation

error

2019-04-20 09:36:49+00:00

2019-04-20 09:37:51+00:00

0:01:02

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18659

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-20 09:34:54+00:00

2019-04-20 09:36:18+00:00

0:01:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18639

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 09:13:29+00:00

2019-04-20 09:34:20+00:00

0:20:51

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18631

2791

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-20 09:11:43+00:00

2019-04-20 09:13:19+00:00

0:01:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18618

2823

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-20 09:00:15+00:00

2019-04-20 09:11:08+00:00

0:10:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1562624302777377
agent_compute-ego_mean	0.1349868424801705
agent_compute-ego_median	0.13809049394395617
agent_compute-ego_min	0.10258772688091926
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.024698693797273456, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04504828633002515, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.10258772688091926, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.06666149283355137, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.026820214289539263, "sim_compute_performance-ego": 0.04725152591489396, "sim_compute_robot_state-ego": 0.048892070662300544, "sim_compute_robot_state-npc0": 0.0474900299648069, "sim_compute_robot_state-npc1": 0.04848270596198316, "sim_compute_robot_state-npc2": 0.04697425410432635, "sim_compute_robot_state-npc3": 0.04735410888240023}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04274551434950395, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06675882231105458, "in-drivable-lane": 0, "agent_compute-ego": 0.1562624302777377, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09835230220447888, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03822626850821755, "sim_compute_performance-ego": 0.06761089238253506, "sim_compute_robot_state-ego": 0.07203516093167392, "sim_compute_robot_state-npc0": 0.06516838073730469, "sim_compute_robot_state-npc1": 0.06574489311738448, "sim_compute_robot_state-npc2": 0.06698794798417525, "sim_compute_robot_state-npc3": 0.0664075179533525}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.035280031628078884, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06124912897745768, "in-drivable-lane": 0, "agent_compute-ego": 0.13809049394395617, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08817516962687175, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03234473334418403, "sim_compute_performance-ego": 0.06013687981499566, "sim_compute_robot_state-ego": 0.06361044777764215, "sim_compute_robot_state-npc0": 0.0644652313656277, "sim_compute_robot_state-npc1": 0.0634494834476047, "sim_compute_robot_state-npc2": 0.06177381409539117, "sim_compute_robot_state-npc3": 0.060238281885782875}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.04015779991944631, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06412013868490855, "in-drivable-lane": 0, "agent_compute-ego": 0.15329742928346, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08755839864412944, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.0363262395064036, "sim_compute_performance-ego": 0.06572407484054565, "sim_compute_robot_state-ego": 0.07219889760017395, "sim_compute_robot_state-npc0": 0.06402864555517833, "sim_compute_robot_state-npc1": 0.06514148414134979, "sim_compute_robot_state-npc2": 0.063225323955218, "sim_compute_robot_state-npc3": 0.06561204294363658}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03277147517484777, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05343645460465375, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12469613201477948, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07925653808257159, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.032782547614153695, "sim_compute_performance-ego": 0.05326286133597879, "sim_compute_robot_state-ego": 0.05822802291196935, "sim_compute_robot_state-npc0": 0.05583376744214226, "sim_compute_robot_state-npc1": 0.05749453165951897, "sim_compute_robot_state-npc2": 0.06448968719033633, "sim_compute_robot_state-npc3": 0.057980614549973435}}
set_robot_commands_max	0.09835230220447888
set_robot_commands_mean	0.08400078027832061
set_robot_commands_median	0.08755839864412944
set_robot_commands_min	0.06666149283355137
sim_compute_performance-ego_max	0.06761089238253506
sim_compute_performance-ego_mean	0.05879724685778982
sim_compute_performance-ego_median	0.06013687981499566
sim_compute_performance-ego_min	0.04725152591489396
sim_compute_robot_state-ego_max	0.07219889760017395
sim_compute_robot_state-ego_mean	0.06299291997675198
sim_compute_robot_state-ego_median	0.06361044777764215
sim_compute_robot_state-ego_min	0.048892070662300544
sim_compute_robot_state-npc0_max	0.06516838073730469
sim_compute_robot_state-npc0_mean	0.05939721101301197
sim_compute_robot_state-npc0_median	0.06402864555517833
sim_compute_robot_state-npc0_min	0.0474900299648069
sim_compute_robot_state-npc1_max	0.06574489311738448
sim_compute_robot_state-npc1_mean	0.060062619665568216
sim_compute_robot_state-npc1_median	0.0634494834476047
sim_compute_robot_state-npc1_min	0.04848270596198316
sim_compute_robot_state-npc2_max	0.06698794798417525
sim_compute_robot_state-npc2_mean	0.06069020546588942
sim_compute_robot_state-npc2_median	0.063225323955218
sim_compute_robot_state-npc2_min	0.04697425410432635
sim_compute_robot_state-npc3_max	0.0664075179533525
sim_compute_robot_state-npc3_mean	0.05951851324302913
sim_compute_robot_state-npc3_median	0.060238281885782875
sim_compute_robot_state-npc3_min	0.04735410888240023
sim_compute_sim_state_max	0.03822626850821755
sim_compute_sim_state_mean	0.03330000065249963
sim_compute_sim_state_median	0.032782547614153695
sim_compute_sim_state_min	0.026820214289539263
sim_physics_max	0.04274551434950395
sim_physics_mean	0.03513070297383007
sim_physics_median	0.035280031628078884
sim_physics_min	0.024698693797273456
sim_render-ego_max	0.06675882231105458
sim_render-ego_mean	0.05812256618161994
sim_render-ego_median	0.06124912897745768
sim_render-ego_min	0.04504828633002515
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18617

2831

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 08:59:56+00:00

2019-04-20 09:00:04+00:00

0:00:08

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18617-730198', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18617-730198', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18617-730198', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18608

2831

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

2019-04-20 08:53:45+00:00

2019-04-20 08:58:37+00:00

0:04:52

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18578

2767

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-20 08:15:52+00:00

2019-04-20 08:39:14+00:00

0:23:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7694621834299573
survival_time_median	5.14999999999999
deviation-center-line_median	0.4421102295268088
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.10400201638539631
agent_compute-ego_mean	0.07923731555009532
agent_compute-ego_median	0.07594463065430358
agent_compute-ego_min	0.067479583952162
deviation-center-line_max	1.3419543347800764
deviation-center-line_mean	0.7121800931411963
deviation-center-line_min	0.21608627312674303
deviation-heading_max	6.754180180019825
deviation-heading_mean	2.09223389551525
deviation-heading_median	0.6665609404145512
deviation-heading_min	0.5934284990377303
driven_any_max	2.354970292328982
driven_any_mean	1.2252487678176502
driven_any_median	0.7806726417806844
driven_any_min	0.4568939924166112
driven_lanedir_consec_max	1.8162739185163108
driven_lanedir_consec_mean	0.9114985044283108
driven_lanedir_consec_min	0.4451417992187281
driven_lanedir_max	1.8162739185163108
driven_lanedir_mean	1.058958777359573
driven_lanedir_median	0.7694621834299573
driven_lanedir_min	0.4451417992187281
in-drivable-lane_max	2.0000000000000133
in-drivable-lane_mean	0.4000000000000027
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4568939924166112, "sim_physics": 0.01861406507946196, "survival_time": 3.149999999999997, "driven_lanedir": 0.4451417992187281, "sim_render-ego": 0.05566598120189849, "in-drivable-lane": 0, "agent_compute-ego": 0.067479583952162, "deviation-heading": 0.5934284990377303, "set_robot_commands": 0.06602236581227136, "deviation-center-line": 0.21608627312674303, "driven_lanedir_consec": 0.4451417992187281, "sim_compute_sim_state": 0.026733462772672138, "sim_compute_performance-ego": 0.04544463611784435, "sim_compute_robot_state-ego": 0.04785253509642586}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8494652614234544, "sim_physics": 0.018447029388557048, "survival_time": 11.800000000000033, "driven_lanedir": 1.8162739185163108, "sim_render-ego": 0.05078626184140222, "in-drivable-lane": 0, "agent_compute-ego": 0.0764461422370652, "deviation-heading": 1.8313805529470184, "set_robot_commands": 0.07166966038235163, "deviation-center-line": 1.13943941566687, "driven_lanedir_consec": 1.8162739185163108, "sim_compute_sim_state": 0.03166819527997809, "sim_compute_performance-ego": 0.052531955605846344, "sim_compute_robot_state-ego": 0.05312132330264075}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7806726417806844, "sim_physics": 0.02031699893544021, "survival_time": 5.14999999999999, "driven_lanedir": 0.7694621834299573, "sim_render-ego": 0.049075128962692706, "in-drivable-lane": 0, "agent_compute-ego": 0.07231420452154956, "deviation-heading": 0.6156193051571278, "set_robot_commands": 0.07082518559057736, "deviation-center-line": 0.4421102295268088, "driven_lanedir_consec": 0.7694621834299573, "sim_compute_sim_state": 0.02935890086646219, "sim_compute_performance-ego": 0.0505755711527704, "sim_compute_robot_state-ego": 0.05310738433911962}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.02222944091964554, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.05422450683929108, "in-drivable-lane": 0, "agent_compute-ego": 0.07594463065430358, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.07719484790340884, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.03157914339841067, "sim_compute_performance-ego": 0.05584504578139756, "sim_compute_robot_state-ego": 0.056622599507426166}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.354970292328982, "sim_physics": 0.026129910945892332, "survival_time": 14.950000000000076, "driven_lanedir": 1.5908608446353467, "sim_render-ego": 0.07093718290328979, "in-drivable-lane": 2.0000000000000133, "agent_compute-ego": 0.10400201638539631, "deviation-heading": 6.754180180019825, "set_robot_commands": 0.1080346179008484, "deviation-center-line": 1.3419543347800764, "driven_lanedir_consec": 0.8535594799790358, "sim_compute_sim_state": 0.042489210764567055, "sim_compute_performance-ego": 0.07369055350621541, "sim_compute_robot_state-ego": 0.07720199743906657}}
set_robot_commands_max	0.1080346179008484
set_robot_commands_mean	0.07874933551789152
set_robot_commands_median	0.07166966038235163
set_robot_commands_min	0.06602236581227136
sim_compute_performance-ego_max	0.07369055350621541
sim_compute_performance-ego_mean	0.05561755243281481
sim_compute_performance-ego_median	0.052531955605846344
sim_compute_performance-ego_min	0.04544463611784435
sim_compute_robot_state-ego_max	0.07720199743906657
sim_compute_robot_state-ego_mean	0.057581167936935795
sim_compute_robot_state-ego_median	0.05312132330264075
sim_compute_robot_state-ego_min	0.04785253509642586
sim_compute_sim_state_max	0.042489210764567055
sim_compute_sim_state_mean	0.03236578261641802
sim_compute_sim_state_median	0.03157914339841067
sim_compute_sim_state_min	0.026733462772672138
sim_physics_max	0.026129910945892332
sim_physics_mean	0.021147489053799415
sim_physics_median	0.02031699893544021
sim_physics_min	0.018447029388557048
sim_render-ego_max	0.07093718290328979
sim_render-ego_mean	0.056137812349714857
sim_render-ego_median	0.05422450683929108
sim_render-ego_min	0.049075128962692706
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.920000000000019
survival_time_min	3.149999999999997

No reset possible

18567

2864

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 17:33:40+00:00

2019-04-19 17:58:42+00:00

0:25:02

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18556

2365

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-19 16:21:25+00:00

2019-04-19 16:32:53+00:00

0:11:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14402173324064774
agent_compute-ego_mean	0.1224643643887546
agent_compute-ego_median	0.12591800093650818
agent_compute-ego_min	0.08282546727162488
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.0236680417690637, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04104254380711969, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08282546727162488, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0649380144083275, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.023154537632780255, "sim_compute_performance-ego": 0.04268571565736015, "sim_compute_robot_state-ego": 0.04332695367201319, "sim_compute_robot_state-npc0": 0.04248256953257435, "sim_compute_robot_state-npc1": 0.04137215524349573, "sim_compute_robot_state-npc2": 0.0416970837791011, "sim_compute_robot_state-npc3": 0.04243716653787865}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04294522242112593, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06711515513333408, "in-drivable-lane": 0, "agent_compute-ego": 0.14402173324064774, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.10086426409808072, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03918989138169722, "sim_compute_performance-ego": 0.06915653293783014, "sim_compute_robot_state-ego": 0.07277185808528554, "sim_compute_robot_state-npc0": 0.06866191733967174, "sim_compute_robot_state-npc1": 0.06897230039943349, "sim_compute_robot_state-npc2": 0.06704248081554066, "sim_compute_robot_state-npc3": 0.06768562576987526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.0396784782409668, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.07189056078592936, "in-drivable-lane": 0, "agent_compute-ego": 0.14067614873250325, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09868440098232692, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.040924321280585395, "sim_compute_performance-ego": 0.07215551800198025, "sim_compute_robot_state-ego": 0.08010979758368598, "sim_compute_robot_state-npc0": 0.06960563659667969, "sim_compute_robot_state-npc1": 0.06879372596740722, "sim_compute_robot_state-npc2": 0.07061807314554851, "sim_compute_robot_state-npc3": 0.07312415440877279}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0343136340379715, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.060622721910476685, "in-drivable-lane": 0, "agent_compute-ego": 0.12591800093650818, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08943462371826172, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03400590022404989, "sim_compute_performance-ego": 0.06337450444698334, "sim_compute_robot_state-ego": 0.06516440212726593, "sim_compute_robot_state-npc0": 0.06402056912581126, "sim_compute_robot_state-npc1": 0.06253069639205933, "sim_compute_robot_state-npc2": 0.060456703106562294, "sim_compute_robot_state-npc3": 0.06130200127760569}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03524064667084638, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05681224430308623, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11888047176248888, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08335775487563189, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03491743171916289, "sim_compute_performance-ego": 0.06252736554426305, "sim_compute_robot_state-ego": 0.06303722016951617, "sim_compute_robot_state-npc0": 0.06189298980376299, "sim_compute_robot_state-npc1": 0.060573360499213726, "sim_compute_robot_state-npc2": 0.06163199158275828, "sim_compute_robot_state-npc3": 0.06349683158537921}}
set_robot_commands_max	0.10086426409808072
set_robot_commands_mean	0.08745581161652576
set_robot_commands_median	0.08943462371826172
set_robot_commands_min	0.0649380144083275
sim_compute_performance-ego_max	0.07215551800198025
sim_compute_performance-ego_mean	0.061979927317683384
sim_compute_performance-ego_median	0.06337450444698334
sim_compute_performance-ego_min	0.04268571565736015
sim_compute_robot_state-ego_max	0.08010979758368598
sim_compute_robot_state-ego_mean	0.06488204632755337
sim_compute_robot_state-ego_median	0.06516440212726593
sim_compute_robot_state-ego_min	0.04332695367201319
sim_compute_robot_state-npc0_max	0.06960563659667969
sim_compute_robot_state-npc0_mean	0.061332736479700015
sim_compute_robot_state-npc0_median	0.06402056912581126
sim_compute_robot_state-npc0_min	0.04248256953257435
sim_compute_robot_state-npc1_max	0.06897230039943349
sim_compute_robot_state-npc1_mean	0.06044844770032191
sim_compute_robot_state-npc1_median	0.06253069639205933
sim_compute_robot_state-npc1_min	0.04137215524349573
sim_compute_robot_state-npc2_max	0.07061807314554851
sim_compute_robot_state-npc2_mean	0.06028926648590216
sim_compute_robot_state-npc2_median	0.06163199158275828
sim_compute_robot_state-npc2_min	0.0416970837791011
sim_compute_robot_state-npc3_max	0.07312415440877279
sim_compute_robot_state-npc3_mean	0.06160915591590231
sim_compute_robot_state-npc3_median	0.06349683158537921
sim_compute_robot_state-npc3_min	0.04243716653787865
sim_compute_sim_state_max	0.040924321280585395
sim_compute_sim_state_mean	0.03443841644765513
sim_compute_sim_state_median	0.03491743171916289
sim_compute_sim_state_min	0.023154537632780255
sim_physics_max	0.04294522242112593
sim_physics_mean	0.03516920462799487
sim_physics_median	0.03524064667084638
sim_physics_min	0.0236680417690637
sim_render-ego_max	0.07189056078592936
sim_render-ego_mean	0.05949664518798921
sim_render-ego_median	0.060622721910476685
sim_render-ego_min	0.04104254380711969
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18545

2374

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

error

2019-04-19 16:00:19+00:00

2019-04-19 16:21:18+00:00

0:20:59

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18530

2399

Liam Paull 🇨🇦

random_agent

step1-simulation

host-error

2019-04-19 15:45:14+00:00

2019-04-19 16:00:03+00:00

0:14:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    shutil.rmtree(wd)
  File "/usr/lib/python3.6/shutil.py", line 471, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/usr/lib/python3.6/shutil.py", line 469, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2399/step1-simulation-ip-172-31-25-98-9766-job18530'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18514

2412

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-19 15:21:52+00:00

2019-04-19 15:44:08+00:00

0:22:16

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18500

2440

random_agent

step1-simulation

success

2019-04-19 15:14:03+00:00

2019-04-19 15:21:32+00:00

0:07:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.1736084991031223
agent_compute-ego_mean	0.1480477445982627
agent_compute-ego_median	0.15791415817597332
agent_compute-ego_min	0.10982875104220408
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.017783565341301683, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04813589689866552, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.10982875104220408, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.06831178125345481, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.027915770152829728, "sim_compute_performance-ego": 0.05935276679272922, "sim_compute_robot_state-ego": 0.050890886558676664}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.020528982986103405, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.061284005641937256, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13612028685483066, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08864499764008955, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03637916933406483, "sim_compute_performance-ego": 0.06528500535271385, "sim_compute_robot_state-ego": 0.06675598296252164}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.025379901462131076, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.07387521002027723, "in-drivable-lane": 0, "agent_compute-ego": 0.1736084991031223, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.10756120151943632, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04199096361796061, "sim_compute_performance-ego": 0.07453336715698242, "sim_compute_robot_state-ego": 0.08304079373677571}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02747221291065216, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0671819547812144, "in-drivable-lane": 0, "agent_compute-ego": 0.162767027815183, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10161752502123517, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04025696714719137, "sim_compute_performance-ego": 0.0713722010453542, "sim_compute_robot_state-ego": 0.07898471256097157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.025219408904804903, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06821730908225565, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.15791415817597332, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09935784339904784, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03963197680080638, "sim_compute_performance-ego": 0.07111765707240385, "sim_compute_robot_state-ego": 0.07239883086260628}}
set_robot_commands_max	0.10756120151943632
set_robot_commands_mean	0.09309866976665274
set_robot_commands_median	0.09935784339904784
set_robot_commands_min	0.06831178125345481
sim_compute_performance-ego_max	0.07453336715698242
sim_compute_performance-ego_mean	0.06833219948403671
sim_compute_performance-ego_median	0.07111765707240385
sim_compute_performance-ego_min	0.05935276679272922
sim_compute_robot_state-ego_max	0.08304079373677571
sim_compute_robot_state-ego_mean	0.07041424133631037
sim_compute_robot_state-ego_median	0.07239883086260628
sim_compute_robot_state-ego_min	0.050890886558676664
sim_compute_sim_state_max	0.04199096361796061
sim_compute_sim_state_mean	0.037234969410570584
sim_compute_sim_state_median	0.03963197680080638
sim_compute_sim_state_min	0.027915770152829728
sim_physics_max	0.02747221291065216
sim_physics_mean	0.023276814320998644
sim_physics_median	0.025219408904804903
sim_physics_min	0.017783565341301683
sim_render-ego_max	0.07387521002027723
sim_render-ego_mean	0.06373887528487002
sim_render-ego_median	0.0671819547812144
sim_render-ego_min	0.04813589689866552
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18497

2442

random_agent

step1-simulation

success

2019-04-19 15:00:24+00:00

2019-04-19 15:12:33+00:00

0:12:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17294395764668782
agent_compute-ego_mean	0.1498280920064586
agent_compute-ego_median	0.14134377241134644
agent_compute-ego_min	0.1306461165933048
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03357449567542886, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05902249408218096, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14131318398241727, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08416055733302855, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03355777488564545, "sim_compute_performance-ego": 0.06467400406891445, "sim_compute_robot_state-ego": 0.06210794538821814, "sim_compute_robot_state-npc0": 0.06146328854111006, "sim_compute_robot_state-npc1": 0.05824053062582916, "sim_compute_robot_state-npc2": 0.06049114353251907, "sim_compute_robot_state-npc3": 0.058459902709385135}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.037796383554285225, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06013170155611905, "in-drivable-lane": 0, "agent_compute-ego": 0.14134377241134644, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09602716836062344, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03662410107525913, "sim_compute_performance-ego": 0.06273075667294589, "sim_compute_robot_state-ego": 0.07111922719261864, "sim_compute_robot_state-npc0": 0.06436167521910234, "sim_compute_robot_state-npc1": 0.06429966471411964, "sim_compute_robot_state-npc2": 0.06611522219397804, "sim_compute_robot_state-npc3": 0.06510084867477417}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.042190202077229816, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06821013026767307, "in-drivable-lane": 0, "agent_compute-ego": 0.17294395764668782, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.107263798183865, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.040205791261461045, "sim_compute_performance-ego": 0.0704549577501085, "sim_compute_robot_state-ego": 0.07632368405659994, "sim_compute_robot_state-npc0": 0.0729044861263699, "sim_compute_robot_state-npc1": 0.07298725975884332, "sim_compute_robot_state-npc2": 0.07286382251315647, "sim_compute_robot_state-npc3": 0.07145364019605849}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.04172914723555247, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06719040373961131, "in-drivable-lane": 0, "agent_compute-ego": 0.16289342939853668, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09865672886371613, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04041146735350291, "sim_compute_performance-ego": 0.07171460489432017, "sim_compute_robot_state-ego": 0.07797464728355408, "sim_compute_robot_state-npc0": 0.07120036085446675, "sim_compute_robot_state-npc1": 0.07184850176175435, "sim_compute_robot_state-npc2": 0.0724567323923111, "sim_compute_robot_state-npc3": 0.07624835272630055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03387134215411018, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05703379827387193, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1306461165933048, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08031994805616491, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.032867918996249926, "sim_compute_performance-ego": 0.06018577603732839, "sim_compute_robot_state-ego": 0.06408600596820607, "sim_compute_robot_state-npc0": 0.06038417185054106, "sim_compute_robot_state-npc1": 0.06064567495794857, "sim_compute_robot_state-npc2": 0.06075645544949699, "sim_compute_robot_state-npc3": 0.06068957202574786}}
set_robot_commands_max	0.107263798183865
set_robot_commands_mean	0.0932856401594796
set_robot_commands_median	0.09602716836062344
set_robot_commands_min	0.08031994805616491
sim_compute_performance-ego_max	0.07171460489432017
sim_compute_performance-ego_mean	0.06595201988472349
sim_compute_performance-ego_median	0.06467400406891445
sim_compute_performance-ego_min	0.06018577603732839
sim_compute_robot_state-ego_max	0.07797464728355408
sim_compute_robot_state-ego_mean	0.07032230197783937
sim_compute_robot_state-ego_median	0.07111922719261864
sim_compute_robot_state-ego_min	0.06210794538821814
sim_compute_robot_state-npc0_max	0.0729044861263699
sim_compute_robot_state-npc0_mean	0.06606279651831802
sim_compute_robot_state-npc0_median	0.06436167521910234
sim_compute_robot_state-npc0_min	0.06038417185054106
sim_compute_robot_state-npc1_max	0.07298725975884332
sim_compute_robot_state-npc1_mean	0.06560432636369902
sim_compute_robot_state-npc1_median	0.06429966471411964
sim_compute_robot_state-npc1_min	0.05824053062582916
sim_compute_robot_state-npc2_max	0.07286382251315647
sim_compute_robot_state-npc2_mean	0.06653667521629233
sim_compute_robot_state-npc2_median	0.06611522219397804
sim_compute_robot_state-npc2_min	0.06049114353251907
sim_compute_robot_state-npc3_max	0.07624835272630055
sim_compute_robot_state-npc3_mean	0.06639046326645325
sim_compute_robot_state-npc3_median	0.06510084867477417
sim_compute_robot_state-npc3_min	0.058459902709385135
sim_compute_sim_state_max	0.04041146735350291
sim_compute_sim_state_mean	0.03673341071442369
sim_compute_sim_state_median	0.03662410107525913
sim_compute_sim_state_min	0.032867918996249926
sim_physics_max	0.042190202077229816
sim_physics_mean	0.03783231413932131
sim_physics_median	0.037796383554285225
sim_physics_min	0.03357449567542886
sim_render-ego_max	0.06821013026767307
sim_render-ego_mean	0.06231770558389127
sim_render-ego_median	0.06013170155611905
sim_render-ego_min	0.05703379827387193
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18495

2443

random_agent

step1-simulation

host-error

2019-04-19 14:58:56+00:00

2019-04-19 15:00:04+00:00

0:01:08

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18495-755906', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18495-755906', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18495-755906', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18479

2467

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 14:49:38+00:00

2019-04-19 14:58:09+00:00

0:08:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.163339763879776
agent_compute-ego_mean	0.15084440136509364
agent_compute-ego_median	0.16268006360755777
agent_compute-ego_min	0.13093347982926803
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.026367322453912698, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06727194786071777, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.16268006360755777, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.10109206865418632, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03883635323002653, "sim_compute_performance-ego": 0.0695679727590309, "sim_compute_robot_state-ego": 0.07487310103650363}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.020017271692102604, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05692288008603183, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13093347982926803, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08450076254931363, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.033852019093253395, "sim_compute_performance-ego": 0.058552411469546234, "sim_compute_robot_state-ego": 0.06080541827461936}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.0268535402086046, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.07044065793355306, "in-drivable-lane": 0, "agent_compute-ego": 0.16287283367580838, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.1045506371392144, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04061183399624295, "sim_compute_performance-ego": 0.07141631444295247, "sim_compute_robot_state-ego": 0.07618485556708442}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.028322612245877583, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06962844729423523, "in-drivable-lane": 0, "agent_compute-ego": 0.163339763879776, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.11044284204641978, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04011919101079305, "sim_compute_performance-ego": 0.07271907230218251, "sim_compute_robot_state-ego": 0.0798426369825999}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02280352746739107, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.058909994714400345, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13439586583305807, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08568623486687155, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03571998021181892, "sim_compute_performance-ego": 0.060918068184572106, "sim_compute_robot_state-ego": 0.0643888746990877}}
set_robot_commands_max	0.11044284204641978
set_robot_commands_mean	0.09725450905120114
set_robot_commands_median	0.10109206865418632
set_robot_commands_min	0.08450076254931363
sim_compute_performance-ego_max	0.07271907230218251
sim_compute_performance-ego_mean	0.06663476783165685
sim_compute_performance-ego_median	0.0695679727590309
sim_compute_performance-ego_min	0.058552411469546234
sim_compute_robot_state-ego_max	0.0798426369825999
sim_compute_robot_state-ego_mean	0.071218977311979
sim_compute_robot_state-ego_median	0.07487310103650363
sim_compute_robot_state-ego_min	0.06080541827461936
sim_compute_sim_state_max	0.04061183399624295
sim_compute_sim_state_mean	0.03782787550842696
sim_compute_sim_state_median	0.03883635323002653
sim_compute_sim_state_min	0.033852019093253395
sim_physics_max	0.028322612245877583
sim_physics_mean	0.024872854813577712
sim_physics_median	0.026367322453912698
sim_physics_min	0.020017271692102604
sim_render-ego_max	0.07044065793355306
sim_render-ego_mean	0.06463478557778765
sim_render-ego_median	0.06727194786071777
sim_render-ego_min	0.05692288008603183
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18460

2500

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-19 14:39:33+00:00

2019-04-19 14:48:10+00:00

0:08:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07873045423447866
survival_time_median	1.3000000000000005
deviation-center-line_median	0.03936720267638018
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.28489641959850603
agent_compute-ego_mean	0.17811607268686822
agent_compute-ego_median	0.1713171104590098
agent_compute-ego_min	0.1126998519897461
deviation-center-line_max	0.04980496068492879
deviation-center-line_mean	0.039816273193017816
deviation-center-line_min	0.031969842247881554
deviation-heading_max	0.7460198506571741
deviation-heading_mean	0.66041686575062
deviation-heading_median	0.6485891606790272
deviation-heading_min	0.6155493585508223
driven_any_max	0.17175455156647726
driven_any_mean	0.15160953645964412
driven_any_median	0.14876144912397907
driven_any_min	0.142244599848304
driven_lanedir_consec_max	0.08479500792909178
driven_lanedir_consec_mean	0.07537003639516282
driven_lanedir_consec_min	0.06160971326410758
driven_lanedir_max	0.08479500792909178
driven_lanedir_mean	0.07537003639516282
driven_lanedir_median	0.07873045423447866
driven_lanedir_min	0.06160971326410758
in-drivable-lane_max	0.4000000000000003
in-drivable-lane_mean	0.19000000000000017
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.1428603181758708, "sim_physics": 0.042706569035847984, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0803827248376523, "sim_render-ego": 0.06212703386942545, "in-drivable-lane": 0, "agent_compute-ego": 0.1713171104590098, "deviation-heading": 0.7460198506571741, "set_robot_commands": 0.08804232875506084, "deviation-center-line": 0.04980496068492879, "driven_lanedir_consec": 0.0803827248376523, "sim_compute_sim_state": 0.03776408235232035, "sim_compute_performance-ego": 0.06740627686182658, "sim_compute_robot_state-ego": 0.07137786348660786, "sim_compute_robot_state-npc0": 0.06850138306617737, "sim_compute_robot_state-npc1": 0.06621675690015157, "sim_compute_robot_state-npc2": 0.06776437163352966, "sim_compute_robot_state-npc3": 0.06822920838991801}, "udem1-1-0": {"driven_any": 0.142244599848304, "sim_physics": 0.057307848563561074, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06160971326410758, "sim_render-ego": 0.10171127319335938, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.28489641959850603, "deviation-heading": 0.6155493585508223, "set_robot_commands": 0.08953370497776912, "deviation-center-line": 0.031969842247881554, "driven_lanedir_consec": 0.06160971326410758, "sim_compute_sim_state": 0.04013699751633864, "sim_compute_performance-ego": 0.1207364430794349, "sim_compute_robot_state-ego": 0.07107882316295917, "sim_compute_robot_state-npc0": 0.07051756748786339, "sim_compute_robot_state-npc1": 0.07098659185262826, "sim_compute_robot_state-npc2": 0.06975792004511906, "sim_compute_robot_state-npc3": 0.06739655824807975}, "udem1-2-0": {"driven_any": 0.17175455156647726, "sim_physics": 0.038686337009552985, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07873045423447866, "sim_render-ego": 0.052386776093513734, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1386217224982477, "deviation-heading": 0.6485891606790272, "set_robot_commands": 0.08150628305250598, "deviation-center-line": 0.03936720267638018, "driven_lanedir_consec": 0.07873045423447866, "sim_compute_sim_state": 0.03228982033268098, "sim_compute_performance-ego": 0.05349745288971932, "sim_compute_robot_state-ego": 0.05666125974347515, "sim_compute_robot_state-npc0": 0.059926148383848125, "sim_compute_robot_state-npc1": 0.058233991745979555, "sim_compute_robot_state-npc2": 0.05829463466521232, "sim_compute_robot_state-npc3": 0.05821381076689689}, "udem1-3-0": {"driven_any": 0.1524267635835895, "sim_physics": 0.028173341751098632, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08479500792909178, "sim_render-ego": 0.0407029914855957, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1126998519897461, "deviation-heading": 0.6543448394000807, "set_robot_commands": 0.05449670791625977, "deviation-center-line": 0.041893613607874455, "driven_lanedir_consec": 0.08479500792909178, "sim_compute_sim_state": 0.023068790435791017, "sim_compute_performance-ego": 0.04150714874267578, "sim_compute_robot_state-ego": 0.04300199508666992, "sim_compute_robot_state-npc0": 0.04060181617736816, "sim_compute_robot_state-npc1": 0.04120401382446289, "sim_compute_robot_state-npc2": 0.04106091499328613, "sim_compute_robot_state-npc3": 0.04089272499084472}, "udem1-4-0": {"driven_any": 0.14876144912397907, "sim_physics": 0.04290689871861385, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07133228171048378, "sim_render-ego": 0.07187497615814209, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1830452588888315, "deviation-heading": 0.6375811194659956, "set_robot_commands": 0.09760247744046724, "deviation-center-line": 0.03604574674802411, "driven_lanedir_consec": 0.07133228171048378, "sim_compute_sim_state": 0.0369417300591102, "sim_compute_performance-ego": 0.06898122567396897, "sim_compute_robot_state-ego": 0.07067176928887, "sim_compute_robot_state-npc0": 0.0694661415540255, "sim_compute_robot_state-npc1": 0.07108189509465145, "sim_compute_robot_state-npc2": 0.06736381237323467, "sim_compute_robot_state-npc3": 0.06674582224625808}}
set_robot_commands_max	0.09760247744046724
set_robot_commands_mean	0.0822363004284126
set_robot_commands_median	0.08804232875506084
set_robot_commands_min	0.05449670791625977
sim_compute_performance-ego_max	0.1207364430794349
sim_compute_performance-ego_mean	0.07042570944952511
sim_compute_performance-ego_median	0.06740627686182658
sim_compute_performance-ego_min	0.04150714874267578
sim_compute_robot_state-ego_max	0.07137786348660786
sim_compute_robot_state-ego_mean	0.06255834215371643
sim_compute_robot_state-ego_median	0.07067176928887
sim_compute_robot_state-ego_min	0.04300199508666992
sim_compute_robot_state-npc0_max	0.07051756748786339
sim_compute_robot_state-npc0_mean	0.06180261133385652
sim_compute_robot_state-npc0_median	0.06850138306617737
sim_compute_robot_state-npc0_min	0.04060181617736816
sim_compute_robot_state-npc1_max	0.07108189509465145
sim_compute_robot_state-npc1_mean	0.06154464988357474
sim_compute_robot_state-npc1_median	0.06621675690015157
sim_compute_robot_state-npc1_min	0.04120401382446289
sim_compute_robot_state-npc2_max	0.06975792004511906
sim_compute_robot_state-npc2_mean	0.060848330742076365
sim_compute_robot_state-npc2_median	0.06736381237323467
sim_compute_robot_state-npc2_min	0.04106091499328613
sim_compute_robot_state-npc3_max	0.06822920838991801
sim_compute_robot_state-npc3_mean	0.06029562492839948
sim_compute_robot_state-npc3_median	0.06674582224625808
sim_compute_robot_state-npc3_min	0.04089272499084472
sim_compute_sim_state_max	0.04013699751633864
sim_compute_sim_state_mean	0.034040284139248235
sim_compute_sim_state_median	0.0369417300591102
sim_compute_sim_state_min	0.023068790435791017
sim_physics_max	0.057307848563561074
sim_physics_mean	0.041956199015734906
sim_physics_median	0.042706569035847984
sim_physics_min	0.028173341751098632
sim_render-ego_max	0.10171127319335938
sim_render-ego_mean	0.06576061016000727
sim_render-ego_median	0.06212703386942545
sim_render-ego_min	0.0407029914855957
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3200000000000007
survival_time_min	1.2000000000000004

No reset possible

18440

2528

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-19 14:36:22+00:00

2019-04-19 14:39:09+00:00

0:02:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18425

2547

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 14:28:10+00:00

2019-04-19 14:35:39+00:00

0:07:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07178291907677284
agent_compute-ego_mean	0.06776709547596091
agent_compute-ego_median	0.07018945275283442
agent_compute-ego_min	0.057832946168615465
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.03846477589956144, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06566526250141423, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07018945275283442, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.09761795183507407, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03674626641157197, "sim_compute_performance-ego": 0.06998442731252531, "sim_compute_robot_state-ego": 0.07422776629285115}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.02224089549137996, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06391114455003005, "in-drivable-lane": 0, "agent_compute-ego": 0.07178291907677284, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.10110656114724968, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.039385043657743014, "sim_compute_performance-ego": 0.06897597129528339, "sim_compute_robot_state-ego": 0.07122939366560715}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.019712417683702833, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.0561393271101282, "in-drivable-lane": 0, "agent_compute-ego": 0.057832946168615465, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07416313252550491, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03455388799626777, "sim_compute_performance-ego": 0.05742406337819201, "sim_compute_robot_state-ego": 0.05978233256238572}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.025883648421738174, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06515588603176914, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06738773545066079, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0985062436743097, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.0393935297871684, "sim_compute_performance-ego": 0.07592551524822529, "sim_compute_robot_state-ego": 0.07084843614599207}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.027566263550206235, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.0682259107890882, "in-drivable-lane": 0, "agent_compute-ego": 0.07164242393092106, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.09700180982288562, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04098675752940931, "sim_compute_performance-ego": 0.06885810274826853, "sim_compute_robot_state-ego": 0.07556435308958355}}
set_robot_commands_max	0.10110656114724968
set_robot_commands_mean	0.0936791398010048
set_robot_commands_median	0.09761795183507407
set_robot_commands_min	0.07416313252550491
sim_compute_performance-ego_max	0.07592551524822529
sim_compute_performance-ego_mean	0.06823361599649891
sim_compute_performance-ego_median	0.06897597129528339
sim_compute_performance-ego_min	0.05742406337819201
sim_compute_robot_state-ego_max	0.07556435308958355
sim_compute_robot_state-ego_mean	0.07033045635128392
sim_compute_robot_state-ego_median	0.07122939366560715
sim_compute_robot_state-ego_min	0.05978233256238572
sim_compute_sim_state_max	0.04098675752940931
sim_compute_sim_state_mean	0.03821309707643209
sim_compute_sim_state_median	0.039385043657743014
sim_compute_sim_state_min	0.03455388799626777
sim_physics_max	0.03846477589956144
sim_physics_mean	0.026773600209317728
sim_physics_median	0.025883648421738174
sim_physics_min	0.019712417683702833
sim_render-ego_max	0.0682259107890882
sim_render-ego_mean	0.06381950619648596
sim_render-ego_median	0.06515588603176914
sim_render-ego_min	0.0561393271101282
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18402

2595

baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-19 14:05:49+00:00

2019-04-19 14:26:44+00:00

0:20:55

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18399

2599

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-19 14:00:37+00:00

2019-04-19 14:05:23+00:00

0:04:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1308389514621231
survival_time_median	1.3500000000000003
deviation-center-line_median	0.05853847922783886
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1844816974231175
agent_compute-ego_mean	0.1541584761976274
agent_compute-ego_median	0.1549344857533773
agent_compute-ego_min	0.10598422862865307
deviation-center-line_max	0.06837546273023085
deviation-center-line_mean	0.060203695260344595
deviation-center-line_min	0.049572891980426616
deviation-heading_max	0.7940586055832765
deviation-heading_mean	0.7026982610010043
deviation-heading_median	0.6874748194128056
deviation-heading_min	0.6470282446207654
driven_any_max	0.21648936246532177
driven_any_mean	0.17857871806025688
driven_any_median	0.1789914594008935
driven_any_min	0.13828208402794617
driven_lanedir_consec_max	0.1693713531436276
driven_lanedir_consec_mean	0.12644170338186206
driven_lanedir_consec_min	0.0781093425688213
driven_lanedir_max	0.1693713531436276
driven_lanedir_mean	0.12644170338186206
driven_lanedir_median	0.1308389514621231
driven_lanedir_min	0.0781093425688213
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.13828208402794617, "sim_physics": 0.02080537875493367, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0781093425688213, "sim_render-ego": 0.05345489581425985, "in-drivable-lane": 0, "agent_compute-ego": 0.1549344857533773, "deviation-heading": 0.7343226770736135, "set_robot_commands": 0.08214955528577168, "deviation-center-line": 0.049572891980426616, "driven_lanedir_consec": 0.0781093425688213, "sim_compute_sim_state": 0.03216389815012614, "sim_compute_performance-ego": 0.05417029062906901, "sim_compute_robot_state-ego": 0.058063805103302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16488324834203677, "sim_physics": 0.01592331462436252, "survival_time": 1.3500000000000003, "driven_lanedir": 0.10524973334209033, "sim_render-ego": 0.04332114149022986, "in-drivable-lane": 0, "agent_compute-ego": 0.10598422862865307, "deviation-heading": 0.7940586055832765, "set_robot_commands": 0.06123194871125398, "deviation-center-line": 0.057784573246873895, "driven_lanedir_consec": 0.10524973334209033, "sim_compute_sim_state": 0.02501338499563712, "sim_compute_performance-ego": 0.04504405127631293, "sim_compute_robot_state-ego": 0.04655753241644965}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1942474360650862, "sim_physics": 0.02583192927496774, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14863913639264803, "sim_render-ego": 0.07438018492289952, "in-drivable-lane": 0, "agent_compute-ego": 0.1844816974231175, "deviation-heading": 0.6874748194128056, "set_robot_commands": 0.1107140864644732, "deviation-center-line": 0.06674706911635277, "driven_lanedir_consec": 0.14863913639264803, "sim_compute_sim_state": 0.042536684444972446, "sim_compute_performance-ego": 0.07077424015317645, "sim_compute_robot_state-ego": 0.07157160554613386}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21648936246532177, "sim_physics": 0.02732419116156442, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1693713531436276, "sim_render-ego": 0.05963680573872158, "in-drivable-lane": 0, "agent_compute-ego": 0.15171601942607335, "deviation-heading": 0.6506069583145604, "set_robot_commands": 0.07811752387455531, "deviation-center-line": 0.06837546273023085, "driven_lanedir_consec": 0.1693713531436276, "sim_compute_sim_state": 0.03515125172478812, "sim_compute_performance-ego": 0.05943569966724941, "sim_compute_robot_state-ego": 0.06082088606698172}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1789914594008935, "sim_physics": 0.029793207462017354, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1308389514621231, "sim_render-ego": 0.07012106822087215, "in-drivable-lane": 0, "agent_compute-ego": 0.17367594975691575, "deviation-heading": 0.6470282446207654, "set_robot_commands": 0.1045216230245737, "deviation-center-line": 0.05853847922783886, "driven_lanedir_consec": 0.1308389514621231, "sim_compute_sim_state": 0.04575211268204909, "sim_compute_performance-ego": 0.07327158634479229, "sim_compute_robot_state-ego": 0.08063078843630277}}
set_robot_commands_max	0.1107140864644732
set_robot_commands_mean	0.08734694747212557
set_robot_commands_median	0.08214955528577168
set_robot_commands_min	0.06123194871125398
sim_compute_performance-ego_max	0.07327158634479229
sim_compute_performance-ego_mean	0.06053917361412001
sim_compute_performance-ego_median	0.05943569966724941
sim_compute_performance-ego_min	0.04504405127631293
sim_compute_robot_state-ego_max	0.08063078843630277
sim_compute_robot_state-ego_mean	0.063528923513834
sim_compute_robot_state-ego_median	0.06082088606698172
sim_compute_robot_state-ego_min	0.04655753241644965
sim_compute_sim_state_max	0.04575211268204909
sim_compute_sim_state_mean	0.03612346639951458
sim_compute_sim_state_median	0.03515125172478812
sim_compute_sim_state_min	0.02501338499563712
sim_physics_max	0.029793207462017354
sim_physics_mean	0.02393560425556914
sim_physics_median	0.02583192927496774
sim_physics_min	0.01592331462436252
sim_render-ego_max	0.07438018492289952
sim_render-ego_mean	0.06018281923739659
sim_render-ego_median	0.05963680573872158
sim_render-ego_min	0.04332114149022986
simulation-passed	1
survival_time_max	1.4000000000000006
survival_time_mean	1.3300000000000003
survival_time_min	1.2000000000000004

No reset possible

18385

2608

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-19 13:51:51+00:00

2019-04-19 14:00:16+00:00

0:08:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18385-249543', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18385-249543', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18385-249543', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18376

2628

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 13:43:31+00:00

2019-04-19 13:51:10+00:00

0:07:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.17661463672464545
agent_compute-ego_mean	0.14876863971309312
agent_compute-ego_median	0.1422954236759859
agent_compute-ego_min	0.1387231085035536
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02152724086113696, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.061043361447892096, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.143939549068235, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09036863974805148, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03471605732755841, "sim_compute_performance-ego": 0.06401335518315153, "sim_compute_robot_state-ego": 0.0662557988796594}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.024298787117004395, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.07211128690026024, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.17661463672464545, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.11110720309344203, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04149626601826061, "sim_compute_performance-ego": 0.0749936428937045, "sim_compute_robot_state-ego": 0.08421392874284224}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.020329485999213324, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06729264259338379, "in-drivable-lane": 0, "agent_compute-ego": 0.1387231085035536, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.09237996737162273, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.034421650568644206, "sim_compute_performance-ego": 0.06380173365275064, "sim_compute_robot_state-ego": 0.06711714532640245}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.023320262630780537, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06257605055967967, "in-drivable-lane": 0, "agent_compute-ego": 0.14227048059304556, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09171788891156514, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03690450886885325, "sim_compute_performance-ego": 0.06703911225001018, "sim_compute_robot_state-ego": 0.06926475962003072}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.023379196138942945, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06314251002143412, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1422954236759859, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.0901013682870304, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.036939270356122184, "sim_compute_performance-ego": 0.06640266670900233, "sim_compute_robot_state-ego": 0.06797060896368588}}
set_robot_commands_max	0.11110720309344203
set_robot_commands_mean	0.09513501348234236
set_robot_commands_median	0.09171788891156514
set_robot_commands_min	0.0901013682870304
sim_compute_performance-ego_max	0.0749936428937045
sim_compute_performance-ego_mean	0.06725010213772384
sim_compute_performance-ego_median	0.06640266670900233
sim_compute_performance-ego_min	0.06380173365275064
sim_compute_robot_state-ego_max	0.08421392874284224
sim_compute_robot_state-ego_mean	0.07096444830652414
sim_compute_robot_state-ego_median	0.06797060896368588
sim_compute_robot_state-ego_min	0.0662557988796594
sim_compute_sim_state_max	0.04149626601826061
sim_compute_sim_state_mean	0.03689555062788773
sim_compute_sim_state_median	0.03690450886885325
sim_compute_sim_state_min	0.034421650568644206
sim_physics_max	0.024298787117004395
sim_physics_mean	0.022570994549415628
sim_physics_median	0.023320262630780537
sim_physics_min	0.020329485999213324
sim_render-ego_max	0.07211128690026024
sim_render-ego_mean	0.06523317030452999
sim_render-ego_median	0.06314251002143412
sim_render-ego_min	0.061043361447892096
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18357

2660

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 13:22:15+00:00

2019-04-19 13:43:13+00:00

0:20:58

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18341

2699

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 13:00:57+00:00

2019-04-19 13:21:56+00:00

0:20:59

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18333

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-19 12:46:09+00:00

2019-04-19 13:00:06+00:00

0:13:57

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18333-274205', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18333-274205', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18333-274205', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18322

2730

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-19 12:44:12+00:00

2019-04-19 12:45:37+00:00

0:01:25

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18306

2766

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-19 12:27:27+00:00

2019-04-19 12:43:51+00:00

0:16:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6730551409975218
survival_time_median	4.549999999999992
deviation-center-line_median	0.42131021260548374
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.0964065416653951
agent_compute-ego_mean	0.09275313507401674
agent_compute-ego_median	0.09293568506836893
agent_compute-ego_min	0.08775860660678737
deviation-center-line_max	1.0842307418861934
deviation-center-line_mean	0.5404537478577274
deviation-center-line_min	0.22342669485957453
deviation-heading_max	6.026585770221163
deviation-heading_mean	2.0509329750873984
deviation-heading_median	0.775499637202119
deviation-heading_min	0.6665609404145512
driven_any_max	2.3550597934316317
driven_any_mean	1.027555385350624
driven_any_median	0.6842416511385191
driven_any_min	0.464934149561738
driven_lanedir_consec_max	0.9366003280870024
driven_lanedir_consec_mean	0.6360094805539629
driven_lanedir_consec_min	0.29577837994694395
driven_lanedir_max	1.5484435304448845
driven_lanedir_mean	0.8121985261662044
driven_lanedir_median	0.6730551409975218
driven_lanedir_min	0.4496510119998618
in-drivable-lane_max	2.6500000000000243
in-drivable-lane_mean	0.640000000000005
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.464934149561738, "sim_physics": 0.025907237082719803, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4496510119998618, "sim_render-ego": 0.061773162335157394, "in-drivable-lane": 0, "agent_compute-ego": 0.09293568506836893, "deviation-heading": 0.6686974327882999, "set_robot_commands": 0.09174720197916032, "deviation-center-line": 0.22342669485957453, "driven_lanedir_consec": 0.4496510119998618, "sim_compute_sim_state": 0.036624323576688766, "sim_compute_performance-ego": 0.06624811142683029, "sim_compute_robot_state-ego": 0.06895078346133232}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6841149070667243, "sim_physics": 0.026035198798546422, "survival_time": 4.549999999999992, "driven_lanedir": 0.453242619301751, "sim_render-ego": 0.06742332269857218, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09248431960305016, "deviation-heading": 2.117321094810859, "set_robot_commands": 0.09711300147758736, "deviation-center-line": 0.3832423171480537, "driven_lanedir_consec": 0.29577837994694395, "sim_compute_sim_state": 0.03884922803103269, "sim_compute_performance-ego": 0.06910841281597431, "sim_compute_robot_state-ego": 0.06974908545777038}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9494264255545056, "sim_physics": 0.02536599866805538, "survival_time": 6.199999999999986, "driven_lanedir": 0.9366003280870024, "sim_render-ego": 0.06592111625979023, "in-drivable-lane": 0, "agent_compute-ego": 0.09418052242648216, "deviation-heading": 0.775499637202119, "set_robot_commands": 0.0979879286981398, "deviation-center-line": 0.5900587727893317, "driven_lanedir_consec": 0.9366003280870024, "sim_compute_sim_state": 0.039374332274160075, "sim_compute_performance-ego": 0.06947439524435228, "sim_compute_robot_state-ego": 0.07342495264545564}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.02554430018414508, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.06800873724968878, "in-drivable-lane": 0, "agent_compute-ego": 0.08775860660678737, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.08894225529261998, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.03652761008713271, "sim_compute_performance-ego": 0.06812317292768877, "sim_compute_robot_state-ego": 0.06846496823069813}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3550597934316317, "sim_physics": 0.025463032722473144, "survival_time": 14.950000000000076, "driven_lanedir": 1.5484435304448845, "sim_render-ego": 0.06736125389734904, "in-drivable-lane": 2.6500000000000243, "agent_compute-ego": 0.0964065416653951, "deviation-heading": 6.026585770221163, "set_robot_commands": 0.10213220119476318, "deviation-center-line": 1.0842307418861934, "driven_lanedir_consec": 0.8249625417384845, "sim_compute_sim_state": 0.040310712655385335, "sim_compute_performance-ego": 0.06926129261652629, "sim_compute_robot_state-ego": 0.07453067859013875}}
set_robot_commands_max	0.10213220119476318
set_robot_commands_mean	0.09558451772845414
set_robot_commands_median	0.09711300147758736
set_robot_commands_min	0.08894225529261998
sim_compute_performance-ego_max	0.06947439524435228
sim_compute_performance-ego_mean	0.06844307700627439
sim_compute_performance-ego_median	0.06910841281597431
sim_compute_performance-ego_min	0.06624811142683029
sim_compute_robot_state-ego_max	0.07453067859013875
sim_compute_robot_state-ego_mean	0.07102409367707904
sim_compute_robot_state-ego_median	0.06974908545777038
sim_compute_robot_state-ego_min	0.06846496823069813
sim_compute_sim_state_max	0.040310712655385335
sim_compute_sim_state_mean	0.03833724132487991
sim_compute_sim_state_median	0.03884922803103269
sim_compute_sim_state_min	0.03652761008713271
sim_physics_max	0.026035198798546422
sim_physics_mean	0.025663153491187966
sim_physics_median	0.02554430018414508
sim_physics_min	0.02536599866805538
sim_render-ego_max	0.06800873724968878
sim_render-ego_mean	0.06609751848811152
sim_render-ego_median	0.06736125389734904
sim_render-ego_min	0.061773162335157394
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.690000000000009
survival_time_min	3.1999999999999966

No reset possible

18301

2782

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-19 12:26:14+00:00

2019-04-19 12:26:48+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18292

2791

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-19 12:23:16+00:00

2019-04-19 12:25:14+00:00

0:01:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18277

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 12:10:44+00:00

2019-04-19 12:22:32+00:00

0:11:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1502863069375356
agent_compute-ego_mean	0.14455761286207075
agent_compute-ego_median	0.1472125212351481
agent_compute-ego_min	0.13393856146756342
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03689458235254828, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06058234988518481, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14732498042988326, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09005417913760778, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03779626792331912, "sim_compute_performance-ego": 0.06486659679772719, "sim_compute_robot_state-ego": 0.06825757476518739, "sim_compute_robot_state-npc0": 0.06484244904428157, "sim_compute_robot_state-npc1": 0.06420534961628464, "sim_compute_robot_state-npc2": 0.06371463919585606, "sim_compute_robot_state-npc3": 0.06264403631102364}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03378425403074785, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.057839897545901214, "in-drivable-lane": 0, "agent_compute-ego": 0.14402569424022327, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08894497698003595, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03580289537256414, "sim_compute_performance-ego": 0.06005478988994251, "sim_compute_robot_state-ego": 0.06232659925114025, "sim_compute_robot_state-npc0": 0.06455204703591087, "sim_compute_robot_state-npc1": 0.059168642217462715, "sim_compute_robot_state-npc2": 0.05941550840031017, "sim_compute_robot_state-npc3": 0.06219621138139205}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.0377018133799235, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06428098148769802, "in-drivable-lane": 0, "agent_compute-ego": 0.1472125212351481, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09638048807779948, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03801131778293186, "sim_compute_performance-ego": 0.06810765266418457, "sim_compute_robot_state-ego": 0.07188622156778972, "sim_compute_robot_state-npc0": 0.06790016492207845, "sim_compute_robot_state-npc1": 0.07106898095872667, "sim_compute_robot_state-npc2": 0.06681940290662977, "sim_compute_robot_state-npc3": 0.06829575962490506}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03543547789255778, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06538577377796173, "in-drivable-lane": 0, "agent_compute-ego": 0.1502863069375356, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09424816568692523, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.036404550075531006, "sim_compute_performance-ego": 0.06714780628681183, "sim_compute_robot_state-ego": 0.0695024033387502, "sim_compute_robot_state-npc0": 0.06579004724820454, "sim_compute_robot_state-npc1": 0.06321418782075246, "sim_compute_robot_state-npc2": 0.06552306811014812, "sim_compute_robot_state-npc3": 0.06542892754077911}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03608659085105447, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06023994964711806, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13393856146756342, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08643677655388327, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.034518915064194626, "sim_compute_performance-ego": 0.06088602893492755, "sim_compute_robot_state-ego": 0.06201021811541389, "sim_compute_robot_state-npc0": 0.06153339147567749, "sim_compute_robot_state-npc1": 0.0598293472738827, "sim_compute_robot_state-npc2": 0.06015070396311143, "sim_compute_robot_state-npc3": 0.05932199954986572}}
set_robot_commands_max	0.09638048807779948
set_robot_commands_mean	0.09121291728725034
set_robot_commands_median	0.09005417913760778
set_robot_commands_min	0.08643677655388327
sim_compute_performance-ego_max	0.06810765266418457
sim_compute_performance-ego_mean	0.06421257491471874
sim_compute_performance-ego_median	0.06486659679772719
sim_compute_performance-ego_min	0.06005478988994251
sim_compute_robot_state-ego_max	0.07188622156778972
sim_compute_robot_state-ego_mean	0.06679660340765628
sim_compute_robot_state-ego_median	0.06825757476518739
sim_compute_robot_state-ego_min	0.06201021811541389
sim_compute_robot_state-npc0_max	0.06790016492207845
sim_compute_robot_state-npc0_mean	0.06492361994523058
sim_compute_robot_state-npc0_median	0.06484244904428157
sim_compute_robot_state-npc0_min	0.06153339147567749
sim_compute_robot_state-npc1_max	0.07106898095872667
sim_compute_robot_state-npc1_mean	0.06349730157742184
sim_compute_robot_state-npc1_median	0.06321418782075246
sim_compute_robot_state-npc1_min	0.059168642217462715
sim_compute_robot_state-npc2_max	0.06681940290662977
sim_compute_robot_state-npc2_mean	0.06312466451521112
sim_compute_robot_state-npc2_median	0.06371463919585606
sim_compute_robot_state-npc2_min	0.05941550840031017
sim_compute_robot_state-npc3_max	0.06829575962490506
sim_compute_robot_state-npc3_mean	0.06357738688159312
sim_compute_robot_state-npc3_median	0.06264403631102364
sim_compute_robot_state-npc3_min	0.05932199954986572
sim_compute_sim_state_max	0.03801131778293186
sim_compute_sim_state_mean	0.03650678924370815
sim_compute_sim_state_median	0.036404550075531006
sim_compute_sim_state_min	0.034518915064194626
sim_physics_max	0.0377018133799235
sim_physics_mean	0.03598054370136637
sim_physics_median	0.03608659085105447
sim_physics_min	0.03378425403074785
sim_render-ego_max	0.06538577377796173
sim_render-ego_mean	0.06166579046877276
sim_render-ego_median	0.06058234988518481
sim_render-ego_min	0.057839897545901214
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18273

2847

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 12:09:48+00:00

2019-04-19 12:10:18+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18255

2743

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-19 12:03:54+00:00

2019-04-19 12:09:15+00:00

0:05:21

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18237

2446

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-19 11:00:19+00:00

2019-04-19 11:21:58+00:00

0:21:39

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18222

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-19 10:54:42+00:00

2019-04-19 11:00:07+00:00

0:05:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18222-121596', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18222-121596', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18222-121596', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18184

2766

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 10:27:52+00:00

2019-04-19 10:52:52+00:00

0:25:00

Waited 1201 seconds [...]

Waited 1201 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18169

2840

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-18 15:09:00+00:00

2019-04-18 15:14:09+00:00

0:05:09

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18164

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-18 13:44:45+00:00

2019-04-18 13:55:07+00:00

0:10:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2342705027983982
survival_time_median	1.7500000000000009
deviation-center-line_median	0.10801953665034704
in-drivable-lane_median	0.7000000000000004

other stats

agent_compute-ego_max	0.14865932257279105
agent_compute-ego_mean	0.12810928068384148
agent_compute-ego_median	0.12264578683035714
agent_compute-ego_min	0.10789848055158342
deviation-center-line_max	0.17768774509810673
deviation-center-line_mean	0.08758489727910898
deviation-center-line_min	0.019005533143064354
deviation-heading_max	0.759385645220147
deviation-heading_mean	0.3195081252333424
deviation-heading_median	0.1806788823983304
deviation-heading_min	0.118601117425238
driven_any_max	2.812198352312563
driven_any_mean	1.6891781761410722
driven_any_median	1.608242001486626
driven_any_min	0.3130680825984642
driven_lanedir_consec_max	1.7389031534183392
driven_lanedir_consec_mean	0.9694700664283822
driven_lanedir_consec_min	0.28316071129320397
driven_lanedir_max	1.7389031534183392
driven_lanedir_mean	0.9694700664283822
driven_lanedir_median	1.2342705027983982
driven_lanedir_min	0.28316071129320397
in-drivable-lane_max	1.5999999999999988
in-drivable-lane_mean	0.7299999999999995
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.03126245996226435, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06230301442353622, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.14865932257279105, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.09641902343086574, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.037513567053753395, "sim_compute_performance-ego": 0.06518521516219429, "sim_compute_robot_state-ego": 0.11700710006382156, "sim_compute_robot_state-npc0": 0.06612089405889096, "sim_compute_robot_state-npc1": 0.062425582305244774, "sim_compute_robot_state-npc2": 0.06441759026568869, "sim_compute_robot_state-npc3": 0.06502063378043797}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.03577818024543024, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.06203660657328944, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.14718868655543174, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.09322933227785173, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.036336887267328075, "sim_compute_performance-ego": 0.0633294120911629, "sim_compute_robot_state-ego": 0.0712102267049974, "sim_compute_robot_state-npc0": 0.06752487151853499, "sim_compute_robot_state-npc1": 0.06613025742192422, "sim_compute_robot_state-npc2": 0.06649934476421725, "sim_compute_robot_state-npc3": 0.06779004681494928}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.022780793053763255, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.0452660151890346, "in-drivable-lane": 0, "agent_compute-ego": 0.12264578683035714, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.070566041128976, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.02776510374886649, "sim_compute_performance-ego": 0.05512574740818569, "sim_compute_robot_state-ego": 0.051310368946620395, "sim_compute_robot_state-npc0": 0.05499546868460519, "sim_compute_robot_state-npc1": 0.06001349857875279, "sim_compute_robot_state-npc2": 0.05543681553431919, "sim_compute_robot_state-npc3": 0.05178495815822056}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.022168854304722378, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.05007319450378418, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.10789848055158342, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.0669525078364781, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.029116903032575334, "sim_compute_performance-ego": 0.05258626256670271, "sim_compute_robot_state-ego": 0.05294383593967983, "sim_compute_robot_state-npc0": 0.05358373778206962, "sim_compute_robot_state-npc1": 0.05270145961216518, "sim_compute_robot_state-npc2": 0.05300942829677037, "sim_compute_robot_state-npc3": 0.05290861129760742}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.02425800429450141, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.05089496052454389, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.11415412690904406, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.06920957943749806, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.028737628270709324, "sim_compute_performance-ego": 0.05101604310293046, "sim_compute_robot_state-ego": 0.05242665230281769, "sim_compute_robot_state-npc0": 0.051686464794098386, "sim_compute_robot_state-npc1": 0.053488515672229585, "sim_compute_robot_state-npc2": 0.048896577623155385, "sim_compute_robot_state-npc3": 0.04990322627718487}}
set_robot_commands_max	0.09641902343086574
set_robot_commands_mean	0.07927529682233393
set_robot_commands_median	0.070566041128976
set_robot_commands_min	0.0669525078364781
sim_compute_performance-ego_max	0.06518521516219429
sim_compute_performance-ego_mean	0.05744853606623521
sim_compute_performance-ego_median	0.05512574740818569
sim_compute_performance-ego_min	0.05101604310293046
sim_compute_robot_state-ego_max	0.11700710006382156
sim_compute_robot_state-ego_mean	0.06897963679158738
sim_compute_robot_state-ego_median	0.05294383593967983
sim_compute_robot_state-ego_min	0.051310368946620395
sim_compute_robot_state-npc0_max	0.06752487151853499
sim_compute_robot_state-npc0_mean	0.05878228736763984
sim_compute_robot_state-npc0_median	0.05499546868460519
sim_compute_robot_state-npc0_min	0.051686464794098386
sim_compute_robot_state-npc1_max	0.06613025742192422
sim_compute_robot_state-npc1_mean	0.05895186271806331
sim_compute_robot_state-npc1_median	0.06001349857875279
sim_compute_robot_state-npc1_min	0.05270145961216518
sim_compute_robot_state-npc2_max	0.06649934476421725
sim_compute_robot_state-npc2_mean	0.057651951296830185
sim_compute_robot_state-npc2_median	0.05543681553431919
sim_compute_robot_state-npc2_min	0.048896577623155385
sim_compute_robot_state-npc3_max	0.06779004681494928
sim_compute_robot_state-npc3_mean	0.05748149526568001
sim_compute_robot_state-npc3_median	0.05290861129760742
sim_compute_robot_state-npc3_min	0.04990322627718487
sim_compute_sim_state_max	0.037513567053753395
sim_compute_sim_state_mean	0.031894017874646526
sim_compute_sim_state_median	0.029116903032575334
sim_compute_sim_state_min	0.02776510374886649
sim_physics_max	0.03577818024543024
sim_physics_mean	0.027249658372136325
sim_physics_median	0.02425800429450141
sim_physics_min	0.022168854304722378
sim_render-ego_max	0.06230301442353622
sim_render-ego_mean	0.054114758242837666
sim_render-ego_median	0.05089496052454389
sim_render-ego_min	0.0452660151890346
simulation-passed	1
survival_time_max	3.149999999999997
survival_time_mean	1.899999999999999
survival_time_min	0.35

No reset possible

18134

2746

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-17 23:38:37+00:00

2019-04-17 23:59:13+00:00

0:20:36

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18124

2766

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-17 23:27:18+00:00

2019-04-17 23:36:51+00:00

0:09:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7228967559718358
survival_time_median	3.2499999999999964
deviation-center-line_median	0.21900935794473772
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1023223770989312
agent_compute-ego_mean	0.09456441256904168
agent_compute-ego_median	0.0956063145085385
agent_compute-ego_min	0.07895101400522085
deviation-center-line_max	0.5065994846190616
deviation-center-line_mean	0.28354172170862213
deviation-center-line_min	0.14528240970253897
deviation-heading_max	0.8304841410235163
deviation-heading_mean	0.6261585394985024
deviation-heading_median	0.7288577096427167
deviation-heading_min	0.2991384123178083
driven_any_max	1.8303885941075289
driven_any_mean	1.1981961215569938
driven_any_median	1.0441270996059235
driven_any_min	0.6418804451673847
driven_lanedir_consec_max	1.724598884038755
driven_lanedir_consec_mean	0.9565500702313808
driven_lanedir_consec_min	0.6167687783151763
driven_lanedir_max	1.724598884038755
driven_lanedir_mean	1.0453133236367833
driven_lanedir_median	1.00377789173911
driven_lanedir_min	0.6167687783151763
in-drivable-lane_max	1.85
in-drivable-lane_mean	0.37
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6418804451673847, "sim_physics": 0.02285388039379585, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6167687783151763, "sim_render-ego": 0.06956942488507527, "in-drivable-lane": 0, "agent_compute-ego": 0.10038548562584854, "deviation-heading": 0.4631570475986671, "set_robot_commands": 0.10580605995364306, "deviation-center-line": 0.14528240970253897, "driven_lanedir_consec": 0.6167687783151763, "sim_compute_sim_state": 0.0376258943139053, "sim_compute_performance-ego": 0.07003735332954221, "sim_compute_robot_state-ego": 0.09474172824766576}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.751397989106969, "sim_physics": 0.021876308896126004, "survival_time": 5.449999999999989, "driven_lanedir": 1.724598884038755, "sim_render-ego": 0.06565276635896175, "in-drivable-lane": 0, "agent_compute-ego": 0.0955568716066693, "deviation-heading": 0.8304841410235163, "set_robot_commands": 0.10844029855290684, "deviation-center-line": 0.5065994846190616, "driven_lanedir_consec": 1.724598884038755, "sim_compute_sim_state": 0.04014407385379896, "sim_compute_performance-ego": 0.06956721008370775, "sim_compute_robot_state-ego": 0.07391850663981306}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8303885941075289, "sim_physics": 0.023443529480382017, "survival_time": 5.699999999999988, "driven_lanedir": 1.1667130229988478, "sim_render-ego": 0.06627476215362549, "in-drivable-lane": 1.85, "agent_compute-ego": 0.0956063145085385, "deviation-heading": 0.8091553869098038, "set_robot_commands": 0.09963224436107436, "deviation-center-line": 0.36484047417990967, "driven_lanedir_consec": 0.7228967559718358, "sim_compute_sim_state": 0.039108684188441226, "sim_compute_performance-ego": 0.0705266228893347, "sim_compute_robot_state-ego": 0.07514576326336778}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7231864797971632, "sim_physics": 0.02469477653503418, "survival_time": 2.25, "driven_lanedir": 0.7147080410920275, "sim_render-ego": 0.07118090523613824, "in-drivable-lane": 0, "agent_compute-ego": 0.1023223770989312, "deviation-heading": 0.2991384123178083, "set_robot_commands": 0.11126394271850586, "deviation-center-line": 0.21900935794473772, "driven_lanedir_consec": 0.7147080410920275, "sim_compute_sim_state": 0.042134571075439456, "sim_compute_performance-ego": 0.07590635617574056, "sim_compute_robot_state-ego": 0.0824808226691352}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0441270996059235, "sim_physics": 0.017747116088867188, "survival_time": 3.2499999999999964, "driven_lanedir": 1.00377789173911, "sim_render-ego": 0.05056664026700533, "in-drivable-lane": 0, "agent_compute-ego": 0.07895101400522085, "deviation-heading": 0.7288577096427167, "set_robot_commands": 0.0754901959345891, "deviation-center-line": 0.18197688209686272, "driven_lanedir_consec": 1.00377789173911, "sim_compute_sim_state": 0.030815843435434195, "sim_compute_performance-ego": 0.05044474234947791, "sim_compute_robot_state-ego": 0.05431055289048415}}
set_robot_commands_max	0.11126394271850586
set_robot_commands_mean	0.10012654830414384
set_robot_commands_median	0.10580605995364306
set_robot_commands_min	0.0754901959345891
sim_compute_performance-ego_max	0.07590635617574056
sim_compute_performance-ego_mean	0.06729645696556062
sim_compute_performance-ego_median	0.07003735332954221
sim_compute_performance-ego_min	0.05044474234947791
sim_compute_robot_state-ego_max	0.09474172824766576
sim_compute_robot_state-ego_mean	0.0761194747420932
sim_compute_robot_state-ego_median	0.07514576326336778
sim_compute_robot_state-ego_min	0.05431055289048415
sim_compute_sim_state_max	0.042134571075439456
sim_compute_sim_state_mean	0.03796581337340383
sim_compute_sim_state_median	0.039108684188441226
sim_compute_sim_state_min	0.030815843435434195
sim_physics_max	0.02469477653503418
sim_physics_mean	0.02212312227884105
sim_physics_median	0.02285388039379585
sim_physics_min	0.017747116088867188
sim_render-ego_max	0.07118090523613824
sim_render-ego_mean	0.06464889978016122
sim_render-ego_median	0.06627476215362549
sim_render-ego_min	0.05056664026700533
simulation-passed	1
survival_time_max	5.699999999999988
survival_time_mean	3.739999999999995
survival_time_min	2.0500000000000007

No reset possible

18117

2770

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-17 23:15:51+00:00

2019-04-17 23:26:25+00:00

0:10:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7147080410920275
survival_time_median	2.25
deviation-center-line_median	0.18197688209686272
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.11061846798863904
agent_compute-ego_mean	0.0899922001567423
agent_compute-ego_median	0.08245043020982008
agent_compute-ego_min	0.07420681744087033
deviation-center-line_max	0.21900935794473772
deviation-center-line_mean	0.18097511294261331
deviation-center-line_min	0.11211727091670978
deviation-heading_max	0.7288577096427167
deviation-heading_mean	0.3901871803928817
deviation-heading_median	0.2991384123178083
deviation-heading_min	0.28544212439480954
driven_any_max	1.0441270996059235
driven_any_mean	0.7198612600825226
driven_any_median	0.7231864797971632
driven_any_min	0.4499679685950936
driven_lanedir_consec_max	1.00377789173911
driven_lanedir_consec_mean	0.6998809553822265
driven_lanedir_consec_min	0.4149663101303833
driven_lanedir_max	1.00377789173911
driven_lanedir_mean	0.6998809553822265
driven_lanedir_median	0.7147080410920275
driven_lanedir_min	0.4149663101303833
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.010000000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4499679685950936, "sim_physics": 0.03578896358095367, "survival_time": 1.4500000000000006, "driven_lanedir": 0.4149663101303833, "sim_render-ego": 0.07528331361967942, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.11061846798863904, "deviation-heading": 0.35018791170681224, "set_robot_commands": 0.10901595806253368, "deviation-center-line": 0.11211727091670978, "driven_lanedir_consec": 0.4149663101303833, "sim_compute_sim_state": 0.04407645916116649, "sim_compute_performance-ego": 0.07574124993949101, "sim_compute_robot_state-ego": 0.08140526146724306, "sim_compute_robot_state-npc0": 0.07742677885910561, "sim_compute_robot_state-npc1": 0.07910116787614493, "sim_compute_robot_state-npc2": 0.07762078581185176, "sim_compute_robot_state-npc3": 0.0784359307124697}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7231955523561998, "sim_physics": 0.040668185551961264, "survival_time": 2.25, "driven_lanedir": 0.7155240513920358, "sim_render-ego": 0.0732258054945204, "in-drivable-lane": 0, "agent_compute-ego": 0.10307684474521212, "deviation-heading": 0.2873097439022619, "set_robot_commands": 0.10946033795674642, "deviation-center-line": 0.21151737345504665, "driven_lanedir_consec": 0.7155240513920358, "sim_compute_sim_state": 0.0443820317586263, "sim_compute_performance-ego": 0.07548288239373101, "sim_compute_robot_state-ego": 0.08161473804050022, "sim_compute_robot_state-npc0": 0.07577260335286458, "sim_compute_robot_state-npc1": 0.07689132690429687, "sim_compute_robot_state-npc2": 0.07588725619845921, "sim_compute_robot_state-npc3": 0.07797790103488499}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7231864797971632, "sim_physics": 0.027618916829427083, "survival_time": 2.25, "driven_lanedir": 0.7147080410920275, "sim_render-ego": 0.05544411341349284, "in-drivable-lane": 0, "agent_compute-ego": 0.07960844039916992, "deviation-heading": 0.2991384123178083, "set_robot_commands": 0.07784985966152615, "deviation-center-line": 0.21900935794473772, "driven_lanedir_consec": 0.7147080410920275, "sim_compute_sim_state": 0.032103570302327473, "sim_compute_performance-ego": 0.057915549808078344, "sim_compute_robot_state-ego": 0.06126422882080078, "sim_compute_robot_state-npc0": 0.06108192337883843, "sim_compute_robot_state-npc1": 0.05775189399719238, "sim_compute_robot_state-npc2": 0.05857103135850694, "sim_compute_robot_state-npc3": 0.10212541156344944}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0441270996059235, "sim_physics": 0.03061444209172175, "survival_time": 3.2499999999999964, "driven_lanedir": 1.00377789173911, "sim_render-ego": 0.056138467788696286, "in-drivable-lane": 0, "agent_compute-ego": 0.08245043020982008, "deviation-heading": 0.7288577096427167, "set_robot_commands": 0.08286962875953087, "deviation-center-line": 0.18197688209686272, "driven_lanedir_consec": 1.00377789173911, "sim_compute_sim_state": 0.033267864814171426, "sim_compute_performance-ego": 0.057942918630746694, "sim_compute_robot_state-ego": 0.06108110501216008, "sim_compute_robot_state-npc0": 0.05932452128483699, "sim_compute_robot_state-npc1": 0.05802691166217511, "sim_compute_robot_state-npc2": 0.05809003023000864, "sim_compute_robot_state-npc3": 0.0588438657613901}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6588292000582325, "sim_physics": 0.024473626439164325, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6504284825575758, "sim_render-ego": 0.05214975519878108, "in-drivable-lane": 0, "agent_compute-ego": 0.07420681744087033, "deviation-heading": 0.28544212439480954, "set_robot_commands": 0.07642072584570908, "deviation-center-line": 0.18025468029970973, "driven_lanedir_consec": 0.6504284825575758, "sim_compute_sim_state": 0.03215312957763672, "sim_compute_performance-ego": 0.05158747696295017, "sim_compute_robot_state-ego": 0.05653184216196944, "sim_compute_robot_state-npc0": 0.05602353375132491, "sim_compute_robot_state-npc1": 0.05518614955064727, "sim_compute_robot_state-npc2": 0.053516073924739185, "sim_compute_robot_state-npc3": 0.05713067403653773}}
set_robot_commands_max	0.10946033795674642
set_robot_commands_mean	0.09112330205720924
set_robot_commands_median	0.08286962875953087
set_robot_commands_min	0.07642072584570908
sim_compute_performance-ego_max	0.07574124993949101
sim_compute_performance-ego_mean	0.06373401554699945
sim_compute_performance-ego_median	0.057942918630746694
sim_compute_performance-ego_min	0.05158747696295017
sim_compute_robot_state-ego_max	0.08161473804050022
sim_compute_robot_state-ego_mean	0.06837943510053471
sim_compute_robot_state-ego_median	0.06126422882080078
sim_compute_robot_state-ego_min	0.05653184216196944
sim_compute_robot_state-npc0_max	0.07742677885910561
sim_compute_robot_state-npc0_mean	0.06592587212539411
sim_compute_robot_state-npc0_median	0.06108192337883843
sim_compute_robot_state-npc0_min	0.05602353375132491
sim_compute_robot_state-npc1_max	0.07910116787614493
sim_compute_robot_state-npc1_mean	0.06539148999809132
sim_compute_robot_state-npc1_median	0.05802691166217511
sim_compute_robot_state-npc1_min	0.05518614955064727
sim_compute_robot_state-npc2_max	0.07762078581185176
sim_compute_robot_state-npc2_mean	0.06473703550471314
sim_compute_robot_state-npc2_median	0.05857103135850694
sim_compute_robot_state-npc2_min	0.053516073924739185
sim_compute_robot_state-npc3_max	0.10212541156344944
sim_compute_robot_state-npc3_mean	0.07490275662174639
sim_compute_robot_state-npc3_median	0.07797790103488499
sim_compute_robot_state-npc3_min	0.05713067403653773
sim_compute_sim_state_max	0.0443820317586263
sim_compute_sim_state_mean	0.03719661112278568
sim_compute_sim_state_median	0.033267864814171426
sim_compute_sim_state_min	0.032103570302327473
sim_physics_max	0.040668185551961264
sim_physics_mean	0.03183282689864562
sim_physics_median	0.03061444209172175
sim_physics_min	0.024473626439164325
sim_render-ego_max	0.07528331361967942
sim_render-ego_mean	0.062448291103034
sim_render-ego_median	0.056138467788696286
sim_render-ego_min	0.05214975519878108
simulation-passed	1
survival_time_max	3.2499999999999964
survival_time_mean	2.2499999999999996
survival_time_min	1.4500000000000006

No reset possible

18113

2771

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-17 23:01:30+00:00

2019-04-17 23:15:14+00:00

0:13:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7147080410920275
survival_time_median	2.25
deviation-center-line_median	0.18197688209686272
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1091274982545434
agent_compute-ego_mean	0.1041855020047924
agent_compute-ego_median	0.10485049573386589
agent_compute-ego_min	0.0990788247850206
deviation-center-line_max	0.21900935794473772
deviation-center-line_mean	0.1853553473932396
deviation-center-line_min	0.13415185877827113
deviation-heading_max	0.7288577096427167
deviation-heading_mean	0.42544533477950913
deviation-heading_median	0.2991384123178083
deviation-heading_min	0.28279628779958255
driven_any_max	1.0441270996059235
driven_any_mean	0.7583553902902767
driven_any_median	0.7231864797971632
driven_any_min	0.6424111923305719
driven_lanedir_consec_max	1.00377789173911
driven_lanedir_consec_mean	0.7234281475036286
driven_lanedir_consec_min	0.5327022905881464
driven_lanedir_max	1.00377789173911
driven_lanedir_mean	0.7234281475036286
driven_lanedir_median	0.7147080410920275
driven_lanedir_min	0.5327022905881464
in-drivable-lane_max	0.19999999999999973
in-drivable-lane_mean	0.039999999999999945
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6424111923305719, "sim_physics": 0.035764432534938904, "survival_time": 2.0500000000000007, "driven_lanedir": 0.5327022905881464, "sim_render-ego": 0.06975206514684165, "in-drivable-lane": 0.19999999999999973, "agent_compute-ego": 0.10485049573386589, "deviation-heading": 0.5309921397426286, "set_robot_commands": 0.1058957576751709, "deviation-center-line": 0.13415185877827113, "driven_lanedir_consec": 0.5327022905881464, "sim_compute_sim_state": 0.04135531913943407, "sim_compute_performance-ego": 0.07443685066409228, "sim_compute_robot_state-ego": 0.07929971159958257, "sim_compute_robot_state-npc0": 0.07708495419199873, "sim_compute_robot_state-npc1": 0.07752477831956817, "sim_compute_robot_state-npc2": 0.0892030029762082, "sim_compute_robot_state-npc3": 0.07613421067958925}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.723222979659492, "sim_physics": 0.04418900277879503, "survival_time": 2.25, "driven_lanedir": 0.7155240315412832, "sim_render-ego": 0.06893535719977485, "in-drivable-lane": 0, "agent_compute-ego": 0.10179255803426109, "deviation-heading": 0.28279628779958255, "set_robot_commands": 0.11627813975016275, "deviation-center-line": 0.21138395784661687, "driven_lanedir_consec": 0.7155240315412832, "sim_compute_sim_state": 0.04406704372829861, "sim_compute_performance-ego": 0.07260098457336425, "sim_compute_robot_state-ego": 0.08539368841383192, "sim_compute_robot_state-npc0": 0.07604411443074545, "sim_compute_robot_state-npc1": 0.07487342092725965, "sim_compute_robot_state-npc2": 0.07497069570753309, "sim_compute_robot_state-npc3": 0.07570009231567383}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7231864797971632, "sim_physics": 0.03813249270121256, "survival_time": 2.25, "driven_lanedir": 0.7147080410920275, "sim_render-ego": 0.0712873723771837, "in-drivable-lane": 0, "agent_compute-ego": 0.0990788247850206, "deviation-heading": 0.2991384123178083, "set_robot_commands": 0.10396117634243436, "deviation-center-line": 0.21900935794473772, "driven_lanedir_consec": 0.7147080410920275, "sim_compute_sim_state": 0.04268792470296224, "sim_compute_performance-ego": 0.0741635693444146, "sim_compute_robot_state-ego": 0.07413735389709472, "sim_compute_robot_state-npc0": 0.07078869077894423, "sim_compute_robot_state-npc1": 0.07101794878641764, "sim_compute_robot_state-npc2": 0.07134664323594835, "sim_compute_robot_state-npc3": 0.07326970630221896}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0441270996059235, "sim_physics": 0.039931319310114934, "survival_time": 3.2499999999999964, "driven_lanedir": 1.00377789173911, "sim_render-ego": 0.0698153569148137, "in-drivable-lane": 0, "agent_compute-ego": 0.10607813321627103, "deviation-heading": 0.7288577096427167, "set_robot_commands": 0.10789650403536284, "deviation-center-line": 0.18197688209686272, "driven_lanedir_consec": 1.00377789173911, "sim_compute_sim_state": 0.04248568094693697, "sim_compute_performance-ego": 0.07499542969923753, "sim_compute_robot_state-ego": 0.07805921114408053, "sim_compute_robot_state-npc0": 0.07381147237924429, "sim_compute_robot_state-npc1": 0.07383533624502328, "sim_compute_robot_state-npc2": 0.07351500071012057, "sim_compute_robot_state-npc3": 0.07570362824660082}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6588292000582325, "sim_physics": 0.03953737165869736, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6504284825575758, "sim_render-ego": 0.07061850152364592, "in-drivable-lane": 0, "agent_compute-ego": 0.1091274982545434, "deviation-heading": 0.28544212439480954, "set_robot_commands": 0.1130681037902832, "deviation-center-line": 0.18025468029970973, "driven_lanedir_consec": 0.6504284825575758, "sim_compute_sim_state": 0.042075494440590465, "sim_compute_performance-ego": 0.07484292402500059, "sim_compute_robot_state-ego": 0.08181616736621392, "sim_compute_robot_state-npc0": 0.0767166323778106, "sim_compute_robot_state-npc1": 0.07529485516431855, "sim_compute_robot_state-npc2": 0.07582143457924448, "sim_compute_robot_state-npc3": 0.08164839628266125}}
set_robot_commands_max	0.11627813975016275
set_robot_commands_mean	0.1094199363186828
set_robot_commands_median	0.10789650403536284
set_robot_commands_min	0.10396117634243436
sim_compute_performance-ego_max	0.07499542969923753
sim_compute_performance-ego_mean	0.07420795166122185
sim_compute_performance-ego_median	0.07443685066409228
sim_compute_performance-ego_min	0.07260098457336425
sim_compute_robot_state-ego_max	0.08539368841383192
sim_compute_robot_state-ego_mean	0.07974122648416074
sim_compute_robot_state-ego_median	0.07929971159958257
sim_compute_robot_state-ego_min	0.07413735389709472
sim_compute_robot_state-npc0_max	0.07708495419199873
sim_compute_robot_state-npc0_mean	0.07488917283174865
sim_compute_robot_state-npc0_median	0.07604411443074545
sim_compute_robot_state-npc0_min	0.07078869077894423
sim_compute_robot_state-npc1_max	0.07752477831956817
sim_compute_robot_state-npc1_mean	0.07450926788851746
sim_compute_robot_state-npc1_median	0.07487342092725965
sim_compute_robot_state-npc1_min	0.07101794878641764
sim_compute_robot_state-npc2_max	0.0892030029762082
sim_compute_robot_state-npc2_mean	0.07697135544181093
sim_compute_robot_state-npc2_median	0.07497069570753309
sim_compute_robot_state-npc2_min	0.07134664323594835
sim_compute_robot_state-npc3_max	0.08164839628266125
sim_compute_robot_state-npc3_mean	0.07649120676534882
sim_compute_robot_state-npc3_median	0.07570362824660082
sim_compute_robot_state-npc3_min	0.07326970630221896
sim_compute_sim_state_max	0.04406704372829861
sim_compute_sim_state_mean	0.04253429259164447
sim_compute_sim_state_median	0.04248568094693697
sim_compute_sim_state_min	0.04135531913943407
sim_physics_max	0.04418900277879503
sim_physics_mean	0.039510923796751765
sim_physics_median	0.03953737165869736
sim_physics_min	0.035764432534938904
sim_render-ego_max	0.0712873723771837
sim_render-ego_mean	0.07008173063245196
sim_render-ego_median	0.0698153569148137
sim_render-ego_min	0.06893535719977485
simulation-passed	1
survival_time_max	3.2499999999999964
survival_time_mean	2.3699999999999997
survival_time_min	2.0500000000000007

No reset possible

18109

2750

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-17 22:40:26+00:00

2019-04-17 23:01:09+00:00

0:20:43

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18108

2730

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 21:45:13+00:00

2019-04-17 22:05:38+00:00

0:20:25

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18105

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 21:23:53+00:00

2019-04-17 21:44:24+00:00

0:20:31

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18102

2727

test for ppo

step1-simulation

success

2019-04-17 15:49:48+00:00

2019-04-17 16:02:41+00:00

0:12:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	7.228848925677767e-05
survival_time_median	5.4999999999999885
deviation-center-line_median	0.1324459009546012
in-drivable-lane_median	3.499999999999993

other stats

agent_compute-ego_max	0.09471704097504312
agent_compute-ego_mean	0.09401003159692636
agent_compute-ego_median	0.0943566083908081
agent_compute-ego_min	0.09269439782335163
deviation-center-line_max	0.6005292987834467
deviation-center-line_mean	0.2330004976539236
deviation-center-line_min	0.04013987126515997
deviation-heading_max	3.62066529019223
deviation-heading_mean	1.7660449280678516
deviation-heading_median	1.5052442740294427
deviation-heading_min	0.44282551418890487
driven_any_max	5.732120479033137
driven_any_mean	2.7174756080701696
driven_any_median	2.5163965102096797
driven_any_min	0.7559319329049349
driven_lanedir_consec_max	0.1215065410816405
driven_lanedir_consec_mean	0.0018750847723860264
driven_lanedir_consec_min	-0.1841554241774044
driven_lanedir_max	0.1215065410816405
driven_lanedir_mean	0.00915343744822148
driven_lanedir_median	-0.0035231524912962
driven_lanedir_min	-0.11352328003052747
in-drivable-lane_max	5.45000000000001
in-drivable-lane_mean	3.0999999999999988
in-drivable-lane_min	0.8500000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.523116227354183, "sim_physics": 0.0192474297114781, "survival_time": 3.4999999999999956, "driven_lanedir": 0.1215065410816405, "sim_render-ego": 0.03785481452941895, "in-drivable-lane": 1.899999999999998, "agent_compute-ego": 0.0943566083908081, "deviation-heading": 1.010622642946293, "set_robot_commands": 0.054278319222586496, "deviation-center-line": 0.059470843644524665, "driven_lanedir_consec": 0.1215065410816405, "sim_compute_sim_state": 0.021667865344456264, "sim_compute_performance-ego": 0.03758268015725272, "sim_compute_robot_state-ego": 0.039097956248692105, "sim_compute_robot_state-npc0": 0.03908535071781703, "sim_compute_robot_state-npc1": 0.03859239646366664, "sim_compute_robot_state-npc2": 0.03809235095977783, "sim_compute_robot_state-npc3": 0.038448524475097653}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.059812890848916, "sim_physics": 0.019058920812944993, "survival_time": 7.049999999999983, "driven_lanedir": -0.013524099775679588, "sim_render-ego": 0.03767422581395359, "in-drivable-lane": 3.7999999999999896, "agent_compute-ego": 0.09471704097504312, "deviation-heading": 2.250866918982386, "set_robot_commands": 0.0542361854661441, "deviation-center-line": 0.33241657362188554, "driven_lanedir_consec": 0.07547517095973344, "sim_compute_sim_state": 0.021803372295190256, "sim_compute_performance-ego": 0.03775910790084947, "sim_compute_robot_state-ego": 0.03926271580635233, "sim_compute_robot_state-npc0": 0.039321197685620465, "sim_compute_robot_state-npc1": 0.038487476660004745, "sim_compute_robot_state-npc2": 0.03856576757228121, "sim_compute_robot_state-npc3": 0.038723079870778616}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5163965102096797, "sim_physics": 0.018932052092118696, "survival_time": 5.4999999999999885, "driven_lanedir": 0.05483117845697016, "sim_render-ego": 0.0377591154792092, "in-drivable-lane": 3.499999999999993, "agent_compute-ego": 0.0945206490429965, "deviation-heading": 1.5052442740294427, "set_robot_commands": 0.053798495639454234, "deviation-center-line": 0.1324459009546012, "driven_lanedir_consec": 7.228848925677767e-05, "sim_compute_sim_state": 0.021900976787913928, "sim_compute_performance-ego": 0.03778879859230735, "sim_compute_robot_state-ego": 0.03935992067510431, "sim_compute_robot_state-npc0": 0.03982304443012585, "sim_compute_robot_state-npc1": 0.039029684933749115, "sim_compute_robot_state-npc2": 0.03850607005032626, "sim_compute_robot_state-npc3": 0.03872247175736861}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.732120479033137, "sim_physics": 0.017204635020153063, "survival_time": 10.650000000000016, "driven_lanedir": -0.11352328003052747, "sim_render-ego": 0.03751836248406782, "in-drivable-lane": 5.45000000000001, "agent_compute-ego": 0.09269439782335163, "deviation-heading": 3.62066529019223, "set_robot_commands": 0.053363856015630734, "deviation-center-line": 0.6005292987834467, "driven_lanedir_consec": -0.1841554241774044, "sim_compute_sim_state": 0.02168623494430327, "sim_compute_performance-ego": 0.037569591137165195, "sim_compute_robot_state-ego": 0.039136662729469265, "sim_compute_robot_state-npc0": 0.03962791022000738, "sim_compute_robot_state-npc1": 0.03816802400938222, "sim_compute_robot_state-npc2": 0.038229827030163976, "sim_compute_robot_state-npc3": 0.038483393584058875}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7559319329049349, "sim_physics": 0.01819236190230758, "survival_time": 1.3500000000000003, "driven_lanedir": -0.0035231524912962, "sim_render-ego": 0.037824507112856266, "in-drivable-lane": 0.8500000000000005, "agent_compute-ego": 0.09376146175243236, "deviation-heading": 0.44282551418890487, "set_robot_commands": 0.05315015934131763, "deviation-center-line": 0.04013987126515997, "driven_lanedir_consec": -0.0035231524912962, "sim_compute_sim_state": 0.022914515601264104, "sim_compute_performance-ego": 0.03764237297905816, "sim_compute_robot_state-ego": 0.03936153871041757, "sim_compute_robot_state-npc0": 0.039121680789523654, "sim_compute_robot_state-npc1": 0.038304902889110426, "sim_compute_robot_state-npc2": 0.03822286040694625, "sim_compute_robot_state-npc3": 0.03893889321221246}}
set_robot_commands_max	0.054278319222586496
set_robot_commands_mean	0.05376540313702664
set_robot_commands_median	0.053798495639454234
set_robot_commands_min	0.05315015934131763
sim_compute_performance-ego_max	0.03778879859230735
sim_compute_performance-ego_mean	0.037668510153326576
sim_compute_performance-ego_median	0.03764237297905816
sim_compute_performance-ego_min	0.037569591137165195
sim_compute_robot_state-ego_max	0.03936153871041757
sim_compute_robot_state-ego_mean	0.03924375883400712
sim_compute_robot_state-ego_median	0.03926271580635233
sim_compute_robot_state-ego_min	0.039097956248692105
sim_compute_robot_state-npc0_max	0.03982304443012585
sim_compute_robot_state-npc0_mean	0.03939583676861888
sim_compute_robot_state-npc0_median	0.039321197685620465
sim_compute_robot_state-npc0_min	0.03908535071781703
sim_compute_robot_state-npc1_max	0.039029684933749115
sim_compute_robot_state-npc1_mean	0.03851649699118263
sim_compute_robot_state-npc1_median	0.038487476660004745
sim_compute_robot_state-npc1_min	0.03816802400938222
sim_compute_robot_state-npc2_max	0.03856576757228121
sim_compute_robot_state-npc2_mean	0.038323375203899106
sim_compute_robot_state-npc2_median	0.038229827030163976
sim_compute_robot_state-npc2_min	0.03809235095977783
sim_compute_robot_state-npc3_max	0.03893889321221246
sim_compute_robot_state-npc3_mean	0.03866327257990324
sim_compute_robot_state-npc3_median	0.03872247175736861
sim_compute_robot_state-npc3_min	0.038448524475097653
sim_compute_sim_state_max	0.022914515601264104
sim_compute_sim_state_mean	0.021994592994625563
sim_compute_sim_state_median	0.021803372295190256
sim_compute_sim_state_min	0.021667865344456264
sim_physics_max	0.0192474297114781
sim_physics_mean	0.01852707990780049
sim_physics_median	0.018932052092118696
sim_physics_min	0.017204635020153063
sim_render-ego_max	0.03785481452941895
sim_render-ego_mean	0.03772620508390116
sim_render-ego_median	0.0377591154792092
sim_render-ego_min	0.03751836248406782
simulation-passed	1
survival_time_max	10.650000000000016
survival_time_mean	5.609999999999998
survival_time_min	1.3500000000000003

No reset possible

18101

2726

Ashwin Ram 🇸🇬

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-17 15:47:16+00:00

2019-04-17 15:47:35+00:00

0:00:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11428325305211055
error_L2	0.019503682398122037

No reset possible

18099

2719

test for ppo

step1-simulation

error

2019-04-17 15:19:23+00:00

2019-04-17 15:20:05+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18097

2720

test for ppo

step1-simulation

error

2019-04-17 15:18:24+00:00

2019-04-17 15:18:56+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18096

2723

test for ppo

step1-simulation

error

2019-04-17 15:17:08+00:00

2019-04-17 15:17:49+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18086

2707

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-17 14:58:37+00:00

2019-04-17 15:17:02+00:00

0:18:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1958036315014096
survival_time_median	4.149999999999993
deviation-center-line_median	0.21450264924921497
in-drivable-lane_median	0.6500000000000002

other stats

agent_compute-ego_max	0.07339835616777528
agent_compute-ego_mean	0.0700250487711814
agent_compute-ego_median	0.06986484876493128
agent_compute-ego_min	0.06841963871269469
deviation-center-line_max	0.5158092388455554
deviation-center-line_mean	0.3086710387100332
deviation-center-line_min	0.12642786562036365
deviation-heading_max	2.972039227722927
deviation-heading_mean	1.6515356959157443
deviation-heading_median	1.5713797444096391
deviation-heading_min	0.392677436637527
driven_any_max	2.998642112628
driven_any_mean	1.6714902557846858
driven_any_median	1.3306443111865334
driven_any_min	0.6579554917149006
driven_lanedir_consec_max	1.5164752893596227
driven_lanedir_consec_mean	1.014176648484046
driven_lanedir_consec_min	0.26808797076402924
driven_lanedir_max	1.6306617923430684
driven_lanedir_mean	1.0898159416391529
driven_lanedir_median	1.1958036315014096
driven_lanedir_min	0.29633956075111334
in-drivable-lane_max	3.499999999999991
in-drivable-lane_mean	1.2199999999999969
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.998642112628, "sim_physics": 0.028991740847390795, "survival_time": 9.45, "driven_lanedir": 1.4881384928632364, "sim_render-ego": 0.05724767654661148, "in-drivable-lane": 3.499999999999991, "agent_compute-ego": 0.06995860230985773, "deviation-heading": 2.972039227722927, "set_robot_commands": 0.08421564606762437, "deviation-center-line": 0.5000772658102186, "driven_lanedir_consec": 1.2523801200582323, "sim_compute_sim_state": 0.03363081891700704, "sim_compute_performance-ego": 0.05860818126214244, "sim_compute_robot_state-ego": 0.062243308970537134, "sim_compute_robot_state-npc0": 0.06009826836762605, "sim_compute_robot_state-npc1": 0.05888930704227831, "sim_compute_robot_state-npc2": 0.05898890041169666, "sim_compute_robot_state-npc3": 0.05971963317305953}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6579554917149006, "sim_physics": 0.026878292967633503, "survival_time": 2.0500000000000007, "driven_lanedir": 0.29633956075111334, "sim_render-ego": 0.0515864825830227, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.06986484876493128, "deviation-heading": 0.9695085798990638, "set_robot_commands": 0.0788092496918469, "deviation-center-line": 0.12642786562036365, "driven_lanedir_consec": 0.26808797076402924, "sim_compute_sim_state": 0.030295430160150297, "sim_compute_performance-ego": 0.05523187939713641, "sim_compute_robot_state-ego": 0.057104750377375904, "sim_compute_robot_state-npc0": 0.05638431339729123, "sim_compute_robot_state-npc1": 0.055493697887513696, "sim_compute_robot_state-npc2": 0.055261402595333936, "sim_compute_robot_state-npc3": 0.05494055515382349}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8514251443949954, "sim_physics": 0.03343385120607772, "survival_time": 2.6499999999999986, "driven_lanedir": 0.8381362307369362, "sim_render-ego": 0.06490516662597656, "in-drivable-lane": 0, "agent_compute-ego": 0.07339835616777528, "deviation-heading": 0.392677436637527, "set_robot_commands": 0.09816556606652602, "deviation-center-line": 0.21450264924921497, "driven_lanedir_consec": 0.8381362307369362, "sim_compute_sim_state": 0.03754276149677781, "sim_compute_performance-ego": 0.06552810039160387, "sim_compute_robot_state-ego": 0.06981064238638249, "sim_compute_robot_state-npc0": 0.07075116319476434, "sim_compute_robot_state-npc1": 0.06855931821859108, "sim_compute_robot_state-npc2": 0.06874218077029821, "sim_compute_robot_state-npc3": 0.06786884901658544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.5187842189990004, "sim_physics": 0.02765385816051702, "survival_time": 7.84999999999998, "driven_lanedir": 1.6306617923430684, "sim_render-ego": 0.055696956670967634, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.06841963871269469, "deviation-heading": 2.352073490909565, "set_robot_commands": 0.08238392878489889, "deviation-center-line": 0.5158092388455554, "driven_lanedir_consec": 1.5164752893596227, "sim_compute_sim_state": 0.03273389749466234, "sim_compute_performance-ego": 0.05681974113367166, "sim_compute_robot_state-ego": 0.05930892221487251, "sim_compute_robot_state-npc0": 0.05869301261415907, "sim_compute_robot_state-npc1": 0.05835597074715195, "sim_compute_robot_state-npc2": 0.05753424365049715, "sim_compute_robot_state-npc3": 0.0573875463692246}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3306443111865334, "sim_physics": 0.027812228145369565, "survival_time": 4.149999999999993, "driven_lanedir": 1.1958036315014096, "sim_render-ego": 0.05246379863784974, "in-drivable-lane": 0, "agent_compute-ego": 0.068483797900648, "deviation-heading": 1.5713797444096391, "set_robot_commands": 0.07747513414865517, "deviation-center-line": 0.1865381740248133, "driven_lanedir_consec": 1.1958036315014096, "sim_compute_sim_state": 0.03101130278713732, "sim_compute_performance-ego": 0.05285769485565553, "sim_compute_robot_state-ego": 0.05382430122559329, "sim_compute_robot_state-npc0": 0.05475799434156303, "sim_compute_robot_state-npc1": 0.051957371723221006, "sim_compute_robot_state-npc2": 0.054079667631402074, "sim_compute_robot_state-npc3": 0.05340442600020443}}
set_robot_commands_max	0.09816556606652602
set_robot_commands_mean	0.08420990495191025
set_robot_commands_median	0.08238392878489889
set_robot_commands_min	0.07747513414865517
sim_compute_performance-ego_max	0.06552810039160387
sim_compute_performance-ego_mean	0.05780911940804199
sim_compute_performance-ego_median	0.05681974113367166
sim_compute_performance-ego_min	0.05285769485565553
sim_compute_robot_state-ego_max	0.06981064238638249
sim_compute_robot_state-ego_mean	0.06045838503495227
sim_compute_robot_state-ego_median	0.05930892221487251
sim_compute_robot_state-ego_min	0.05382430122559329
sim_compute_robot_state-npc0_max	0.07075116319476434
sim_compute_robot_state-npc0_mean	0.06013695038308074
sim_compute_robot_state-npc0_median	0.05869301261415907
sim_compute_robot_state-npc0_min	0.05475799434156303
sim_compute_robot_state-npc1_max	0.06855931821859108
sim_compute_robot_state-npc1_mean	0.05865113312375121
sim_compute_robot_state-npc1_median	0.05835597074715195
sim_compute_robot_state-npc1_min	0.051957371723221006
sim_compute_robot_state-npc2_max	0.06874218077029821
sim_compute_robot_state-npc2_mean	0.05892127901184561
sim_compute_robot_state-npc2_median	0.05753424365049715
sim_compute_robot_state-npc2_min	0.054079667631402074
sim_compute_robot_state-npc3_max	0.06786884901658544
sim_compute_robot_state-npc3_mean	0.0586642019425795
sim_compute_robot_state-npc3_median	0.0573875463692246
sim_compute_robot_state-npc3_min	0.05340442600020443
sim_compute_sim_state_max	0.03754276149677781
sim_compute_sim_state_mean	0.03304284217114696
sim_compute_sim_state_median	0.03273389749466234
sim_compute_sim_state_min	0.030295430160150297
sim_physics_max	0.03343385120607772
sim_physics_mean	0.02895399426539772
sim_physics_median	0.027812228145369565
sim_physics_min	0.026878292967633503
sim_render-ego_max	0.06490516662597656
sim_render-ego_mean	0.05638001621288562
sim_render-ego_median	0.055696956670967634
sim_render-ego_min	0.0515864825830227
simulation-passed	1
survival_time_max	9.45
survival_time_mean	5.229999999999994
survival_time_min	2.0500000000000007

No reset possible

18073

2684

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success