Evaluator 754

Baseline-IL-logs-tensorflow

step1-simulation

timeout

5 years, 11 months

1:05:09

I can see how the jo [...]

I can see how the job 19216 is timeout because passed 3909 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19209

2965

Baseline-IL-logs-tensorflow

step1-simulation

host-error

5 years, 11 months

0:26:36

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19209-450992', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19209-450992', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19209-450992', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19204

2899

Baseline-IL-logs-tensorflow

step1-simulation

success

5 years, 11 months

0:13:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2418853264796177
survival_time_median	9.299999999999995
deviation-center-line_median	0.10706951123633884
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.2614386184241182
agent_compute-ego_mean	0.23317115586269535
agent_compute-ego_median	0.24705642782231813
agent_compute-ego_min	0.17983492984566635
deviation-center-line_max	0.1433672380888186
deviation-center-line_mean	0.11292218378226174
deviation-center-line_min	0.09222892157295536
deviation-heading_max	0.7805558374584566
deviation-heading_mean	0.6996384743444903
deviation-heading_median	0.7349686563173903
deviation-heading_min	0.6085891537615041
driven_any_max	1.5735900985041886
driven_any_mean	1.3394880718680744
driven_any_median	1.5735900977233197
driven_any_min	0.9883350320437068
driven_lanedir_consec_max	1.3337597103964112
driven_lanedir_consec_mean	1.0463872229739533
driven_lanedir_consec_min	0.6581540708146552
driven_lanedir_max	1.3337597103964112
driven_lanedir_mean	1.0463872229739533
driven_lanedir_median	1.2418853264796177
driven_lanedir_min	0.6581540708146552
in-drivable-lane_max	1.6500000000000163
in-drivable-lane_mean	1.480000000000008
in-drivable-lane_min	1.1999999999999955
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9883350320437068, "sim_physics": 0.024945072767113437, "survival_time": 5.949999999999987, "driven_lanedir": 0.6581540708146552, "sim_render-ego": 0.06280877209511124, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.22671646631064535, "deviation-heading": 0.7349686563173903, "set_robot_commands": 0.096032575398934, "deviation-center-line": 0.09222892157295536, "driven_lanedir_consec": 0.6581540708146552, "sim_compute_sim_state": 0.03904351667195809, "sim_compute_performance-ego": 0.06785360103895684, "sim_compute_robot_state-ego": 0.07058345970987272}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9883350327037668, "sim_physics": 0.02747899343987473, "survival_time": 5.949999999999987, "driven_lanedir": 0.7558112912751023, "sim_render-ego": 0.06375128882271903, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.25080933691072865, "deviation-heading": 0.6085891537615041, "set_robot_commands": 0.10603653282678428, "deviation-center-line": 0.11972417031346812, "driven_lanedir_consec": 0.7558112912751023, "sim_compute_sim_state": 0.040587303017367835, "sim_compute_performance-ego": 0.07108816980313853, "sim_compute_robot_state-ego": 0.0772460729134183}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5735900985041886, "sim_physics": 0.01990229340009792, "survival_time": 9.299999999999995, "driven_lanedir": 1.3337597103964112, "sim_render-ego": 0.04945287653194961, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.17983492984566635, "deviation-heading": 0.609584123382812, "set_robot_commands": 0.0716127246938726, "deviation-center-line": 0.1433672380888186, "driven_lanedir_consec": 1.3337597103964112, "sim_compute_sim_state": 0.031307772923541324, "sim_compute_performance-ego": 0.053815443028685864, "sim_compute_robot_state-ego": 0.05569101789946197}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5735900983653894, "sim_physics": 0.02808522665372459, "survival_time": 9.299999999999995, "driven_lanedir": 1.2423257159039798, "sim_render-ego": 0.06445973150191768, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.2614386184241182, "deviation-heading": 0.7644946008022887, "set_robot_commands": 0.10468911355541598, "deviation-center-line": 0.10222107769972771, "driven_lanedir_consec": 1.2423257159039798, "sim_compute_sim_state": 0.04104329180973832, "sim_compute_performance-ego": 0.07172394055192188, "sim_compute_robot_state-ego": 0.0779868184879262}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5735900977233197, "sim_physics": 0.02638024668539724, "survival_time": 9.299999999999995, "driven_lanedir": 1.2418853264796177, "sim_render-ego": 0.06443483086042506, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.24705642782231813, "deviation-heading": 0.7805558374584566, "set_robot_commands": 0.09948162237803142, "deviation-center-line": 0.10706951123633884, "driven_lanedir_consec": 1.2418853264796177, "sim_compute_sim_state": 0.040280425420371434, "sim_compute_performance-ego": 0.07034794617724675, "sim_compute_robot_state-ego": 0.0766724899250974}}
set_robot_commands_max	0.10603653282678428
set_robot_commands_mean	0.09557051377060766
set_robot_commands_median	0.09948162237803142
set_robot_commands_min	0.0716127246938726
sim_compute_performance-ego_max	0.07172394055192188
sim_compute_performance-ego_mean	0.06696582011998997
sim_compute_performance-ego_median	0.07034794617724675
sim_compute_performance-ego_min	0.053815443028685864
sim_compute_robot_state-ego_max	0.0779868184879262
sim_compute_robot_state-ego_mean	0.07163597178715532
sim_compute_robot_state-ego_median	0.0766724899250974
sim_compute_robot_state-ego_min	0.05569101789946197
sim_compute_sim_state_max	0.04104329180973832
sim_compute_sim_state_mean	0.038452461968595406
sim_compute_sim_state_median	0.040280425420371434
sim_compute_sim_state_min	0.031307772923541324
sim_physics_max	0.02808522665372459
sim_physics_mean	0.025358366589241583
sim_physics_median	0.02638024668539724
sim_physics_min	0.01990229340009792
sim_render-ego_max	0.06445973150191768
sim_render-ego_mean	0.06098149996242453
sim_render-ego_median	0.06375128882271903
sim_render-ego_min	0.04945287653194961
simulation-passed	1
survival_time_max	9.299999999999995
survival_time_mean	7.959999999999994
survival_time_min	5.949999999999987

No reset possible

19202

2932

Baseline solution using reinforcement learning

step1-simulation

error

5 years, 11 months

0:01:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19195

2804

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

error

5 years, 11 months

0:02:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19194

2843

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19180

2912

Thies Lennart Alff 🇩🇪

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:06:14

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19174

2944

Baseline solution using reinforcement learning

step1-simulation

host-error

5 years, 11 months

0:02:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19174-517981', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19174-517981', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19174-517981', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19170

2917

Python template

step2-scoring

success

yes

5 years, 11 months

0:00:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.26542305478577

other stats

efficiency	-63.02377221914047
fleet_size	-1000000000

No reset possible

19161

2916

Python template

step1-simulation

success

yes

5 years, 11 months

0:03:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19155

2298

Andrea Censi 🇨🇭

Python template

step2-scoring

success

yes

5 years, 11 months

0:00:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-65.8759034009321

other stats

fleet_size	-1000000000
service_quality	-32.882125850233

No reset possible

19151

2310

Andrea Censi 🇨🇭

Python template

step2-scoring

success

yes

5 years, 11 months

0:00:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-64.07769033093837

other stats

fleet_size	-1000000000
service_quality	-32.85323258273458

No reset possible

19148

2297

Andrea Censi 🇨🇭

Java template

step1-simulation

error

yes

5 years, 11 months

0:00:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19147

2311

Andrea Censi 🇨🇭

Python template

aido2-AMOD-fleet_size

step2-scoring

success

yes

5 years, 11 months

0:00:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

fleet_size

-1000000000

other stats

efficiency	-62.55208909761053
service_quality	-32.09069227440324

No reset possible

19138

2311

Andrea Censi 🇨🇭

Python template

aido2-AMOD-fleet_size

step1-simulation

success

yes

5 years, 11 months

0:04:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19131

2298

Andrea Censi 🇨🇭

Python template

step1-simulation

host-error

yes

5 years, 11 months

0:04:42

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19131-342531', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19131-342531', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19131-342531', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19126

2957

Baseline-IL-logs-tensorflow

step1-simulation

error

5 years, 11 months

0:20:47

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19125

2961

Baseline-IL-logs-tensorflow

step1-simulation

host-error

5 years, 11 months

0:18:37

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19125-374845', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19125-374845', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19125-374845', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19111

2944

Baseline solution using reinforcement learning

step1-simulation

success

5 years, 11 months

0:04:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.085334074888332
survival_time_median	1.5500000000000007
deviation-center-line_median	0.04542203542390335
in-drivable-lane_median	0.30000000000000027

other stats

agent_compute-ego_max	0.10577230299672773
agent_compute-ego_mean	0.10285008198539349
agent_compute-ego_median	0.10193390230978688
agent_compute-ego_min	0.10009634154183523
deviation-center-line_max	0.060521149863315055
deviation-center-line_mean	0.04638000404438392
deviation-center-line_min	0.03424810351722895
deviation-heading_max	0.765939662696353
deviation-heading_mean	0.7241711694945083
deviation-heading_median	0.7283123934950898
deviation-heading_min	0.6738235770016104
driven_any_max	0.17081669371127153
driven_any_mean	0.163571713491043
driven_any_median	0.16436592861650576
driven_any_min	0.15412836169977118
driven_lanedir_consec_max	0.10316794072225076
driven_lanedir_consec_mean	0.08533934842212579
driven_lanedir_consec_min	0.06220919888587706
driven_lanedir_max	0.10316794072225076
driven_lanedir_mean	0.08533934842212579
driven_lanedir_median	0.085334074888332
driven_lanedir_min	0.06220919888587706
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.3100000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1703973469092162, "sim_physics": 0.014472053896996283, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0940301074678236, "sim_render-ego": 0.06489969068957914, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10577230299672773, "deviation-heading": 0.7283123934950898, "set_robot_commands": 0.05939211383942635, "deviation-center-line": 0.04630746818408264, "driven_lanedir_consec": 0.0940301074678236, "sim_compute_sim_state": 0.02472607551082488, "sim_compute_performance-ego": 0.041872809010167274, "sim_compute_robot_state-ego": 0.043543077284289945}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15412836169977118, "sim_physics": 0.014158769087357954, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06220919888587706, "sim_render-ego": 0.0404670744231253, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.10143700512972743, "deviation-heading": 0.6738235770016104, "set_robot_commands": 0.06006835446213231, "deviation-center-line": 0.03424810351722895, "driven_lanedir_consec": 0.06220919888587706, "sim_compute_sim_state": 0.02467185078245221, "sim_compute_performance-ego": 0.04143378228852243, "sim_compute_robot_state-ego": 0.043315735730257904}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17081669371127153, "sim_physics": 0.01307032448904855, "survival_time": 1.7500000000000009, "driven_lanedir": 0.08195542014634549, "sim_render-ego": 0.03842430114746094, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.10009634154183523, "deviation-heading": 0.7300248833738348, "set_robot_commands": 0.056131839752197266, "deviation-center-line": 0.04540126323338957, "driven_lanedir_consec": 0.08195542014634549, "sim_compute_sim_state": 0.024086965833391465, "sim_compute_performance-ego": 0.04016662325177874, "sim_compute_robot_state-ego": 0.04180552618844169}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16436592861650576, "sim_physics": 0.014170723576699532, "survival_time": 1.5500000000000007, "driven_lanedir": 0.085334074888332, "sim_render-ego": 0.03978622344232375, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.10193390230978688, "deviation-heading": 0.7227553309056538, "set_robot_commands": 0.05634227106648107, "deviation-center-line": 0.04542203542390335, "driven_lanedir_consec": 0.085334074888332, "sim_compute_sim_state": 0.024209860832460465, "sim_compute_performance-ego": 0.04090766752919843, "sim_compute_robot_state-ego": 0.04244194492217033}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15815023651845014, "sim_physics": 0.015023249846238356, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10316794072225076, "sim_render-ego": 0.03980543980231652, "in-drivable-lane": 0, "agent_compute-ego": 0.1050108579488901, "deviation-heading": 0.765939662696353, "set_robot_commands": 0.05870985984802246, "deviation-center-line": 0.060521149863315055, "driven_lanedir_consec": 0.10316794072225076, "sim_compute_sim_state": 0.024346140714792103, "sim_compute_performance-ego": 0.04140321108011099, "sim_compute_robot_state-ego": 0.042818353726313665}}
set_robot_commands_max	0.06006835446213231
set_robot_commands_mean	0.05812888779365189
set_robot_commands_median	0.05870985984802246
set_robot_commands_min	0.056131839752197266
sim_compute_performance-ego_max	0.041872809010167274
sim_compute_performance-ego_mean	0.041156818631955576
sim_compute_performance-ego_median	0.04140321108011099
sim_compute_performance-ego_min	0.04016662325177874
sim_compute_robot_state-ego_max	0.043543077284289945
sim_compute_robot_state-ego_mean	0.04278492757029471
sim_compute_robot_state-ego_median	0.042818353726313665
sim_compute_robot_state-ego_min	0.04180552618844169
sim_compute_sim_state_max	0.02472607551082488
sim_compute_sim_state_mean	0.024408178734784226
sim_compute_sim_state_median	0.024346140714792103
sim_compute_sim_state_min	0.024086965833391465
sim_physics_max	0.015023249846238356
sim_physics_mean	0.014179024179268135
sim_physics_median	0.014170723576699532
sim_physics_min	0.01307032448904855
sim_render-ego_max	0.06489969068957914
sim_render-ego_mean	0.04467654590096112
sim_render-ego_median	0.03980543980231652
sim_render-ego_min	0.03842430114746094
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.560000000000001
survival_time_min	1.3000000000000005

No reset possible

19110

2941

Baseline solution using reinforcement learning

step1-simulation

error

5 years, 11 months

0:01:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19103

2921

challenge-aido_LF-template-pytorch

step1-simulation

host-error

5 years, 11 months

0:03:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2921/step1-simulation-ip-172-31-25-98-9756-job19103/tmp/tmpmazq0xz5/episodes/ETHZ_autolab_technical_track-2-0/camera.mp4']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19092

2924

challenge-aido_LF-template-pytorch

step1-simulation

error

5 years, 11 months

0:21:18

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19079

2917

Python template

step1-simulation

aborted

5 years, 11 months

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19072

2916

Python template

step1-simulation

aborted

5 years, 11 months

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19060

2914

Python template

step1-simulation

host-error

5 years, 11 months

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19057

2915

Python template

step1-simulation

host-error

5 years, 11 months

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19043

2903

Baseline-IL-logs-tensorflow

step1-simulation

error

5 years, 11 months

0:22:52

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19040

2899

Baseline-IL-logs-tensorflow

step1-simulation

success

5 years, 11 months

0:11:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.241909119941953
survival_time_median	9.299999999999995
deviation-center-line_median	0.10714018633444104
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.14226519805128857
agent_compute-ego_mean	0.1412269724797371
agent_compute-ego_median	0.14105851509991815
agent_compute-ego_min	0.1405166938525288
deviation-center-line_max	0.14875027319617723
deviation-center-line_mean	0.11384500786418664
deviation-center-line_min	0.09221981561953582
deviation-heading_max	0.7806157212361973
deviation-heading_mean	0.700498229183083
deviation-heading_median	0.7348736366682634
deviation-heading_min	0.6068221000075904
driven_any_max	1.5735900986718017
driven_any_mean	1.3394880710222876
driven_any_median	1.573590097829998
driven_any_min	0.9883350278551606
driven_lanedir_consec_max	1.3336873245708152
driven_lanedir_consec_mean	1.0463944001532002
driven_lanedir_consec_min	0.6581679255061745
driven_lanedir_max	1.3336873245708152
driven_lanedir_mean	1.0463944001532002
driven_lanedir_median	1.241909119941953
driven_lanedir_min	0.6581679255061745
in-drivable-lane_max	1.6500000000000163
in-drivable-lane_mean	1.480000000000008
in-drivable-lane_min	1.1999999999999955
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9883350278551606, "sim_physics": 0.01393636334843996, "survival_time": 5.949999999999987, "driven_lanedir": 0.6581679255061745, "sim_render-ego": 0.039276507722229514, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1405166938525288, "deviation-heading": 0.7348736366682634, "set_robot_commands": 0.058065428453333234, "deviation-center-line": 0.09221981561953582, "driven_lanedir_consec": 0.6581679255061745, "sim_compute_sim_state": 0.024111477266840573, "sim_compute_performance-ego": 0.04025240305091152, "sim_compute_robot_state-ego": 0.0417388707649808}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9883350324331732, "sim_physics": 0.01462892524334563, "survival_time": 5.949999999999987, "driven_lanedir": 0.755864715603633, "sim_render-ego": 0.03988859633437725, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.14105851509991815, "deviation-heading": 0.6068221000075904, "set_robot_commands": 0.05779473320776675, "deviation-center-line": 0.11889969401850048, "driven_lanedir_consec": 0.755864715603633, "sim_compute_sim_state": 0.02438022308990735, "sim_compute_performance-ego": 0.04040346826825823, "sim_compute_robot_state-ego": 0.04174595720627729}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5735900983213051, "sim_physics": 0.014875106914069064, "survival_time": 9.299999999999995, "driven_lanedir": 1.3336873245708152, "sim_render-ego": 0.03901692744224302, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.14065530607777255, "deviation-heading": 0.6158066899212176, "set_robot_commands": 0.05821847018375192, "deviation-center-line": 0.14875027319617723, "driven_lanedir_consec": 1.3336873245708152, "sim_compute_sim_state": 0.024165240667199574, "sim_compute_performance-ego": 0.04027016444872784, "sim_compute_robot_state-ego": 0.04179323232302102}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.573590097829998, "sim_physics": 0.014507361637648717, "survival_time": 9.299999999999995, "driven_lanedir": 1.2423429151434249, "sim_render-ego": 0.03941872683904504, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.14226519805128857, "deviation-heading": 0.764372998082146, "set_robot_commands": 0.05759146649350402, "deviation-center-line": 0.10221507015227856, "driven_lanedir_consec": 1.2423429151434249, "sim_compute_sim_state": 0.02439051289712229, "sim_compute_performance-ego": 0.04084831027574437, "sim_compute_robot_state-ego": 0.042021464276057414}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5735900986718017, "sim_physics": 0.014379575688351867, "survival_time": 9.299999999999995, "driven_lanedir": 1.241909119941953, "sim_render-ego": 0.03916673506459882, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.1416391493171774, "deviation-heading": 0.7806157212361973, "set_robot_commands": 0.05812755066861389, "deviation-center-line": 0.10714018633444104, "driven_lanedir_consec": 1.241909119941953, "sim_compute_sim_state": 0.02427273796450707, "sim_compute_performance-ego": 0.04031663171706661, "sim_compute_robot_state-ego": 0.041610857491852137}}
set_robot_commands_max	0.05821847018375192
set_robot_commands_mean	0.05795952980139396
set_robot_commands_median	0.058065428453333234
set_robot_commands_min	0.05759146649350402
sim_compute_performance-ego_max	0.04084831027574437
sim_compute_performance-ego_mean	0.04041819555214172
sim_compute_performance-ego_median	0.04031663171706661
sim_compute_performance-ego_min	0.04025240305091152
sim_compute_robot_state-ego_max	0.042021464276057414
sim_compute_robot_state-ego_mean	0.04178207641243773
sim_compute_robot_state-ego_median	0.04174595720627729
sim_compute_robot_state-ego_min	0.041610857491852137
sim_compute_sim_state_max	0.02439051289712229
sim_compute_sim_state_mean	0.024264038377115372
sim_compute_sim_state_median	0.02427273796450707
sim_compute_sim_state_min	0.024111477266840573
sim_physics_max	0.014875106914069064
sim_physics_mean	0.014465466566371049
sim_physics_median	0.014507361637648717
sim_physics_min	0.01393636334843996
sim_render-ego_max	0.03988859633437725
sim_render-ego_mean	0.039353498680498734
sim_render-ego_median	0.039276507722229514
sim_render-ego_min	0.03901692744224302
simulation-passed	1
survival_time_max	9.299999999999995
survival_time_mean	7.959999999999994
survival_time_min	5.949999999999987

No reset possible

19037

2900

Baseline-IL-logs-tensorflow

step1-simulation

error

5 years, 11 months

0:22:20

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19014

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

5 years, 11 months

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19012

2891

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

5 years, 11 months

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19011

2892

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

5 years, 11 months

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19006

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

5 years, 11 months

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18971

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

5 years, 11 months

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18970

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

5 years, 11 months

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18944

2876

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

5 years, 11 months

0:16:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.225306900765771
survival_time_median	10.750000000000018
deviation-center-line_median	0.40864173779456053
in-drivable-lane_median	1.7000000000000242

other stats

agent_compute-ego_max	0.13806029142335405
agent_compute-ego_mean	0.11951158629927965
agent_compute-ego_median	0.11692599437696516
agent_compute-ego_min	0.11110777924530696
deviation-center-line_max	0.6491801892887803
deviation-center-line_mean	0.3683230725655418
deviation-center-line_min	0.1475671628461062
deviation-heading_max	2.2060076411946548
deviation-heading_mean	1.4163758252990906
deviation-heading_median	1.5250264276913703
deviation-heading_min	0.6970592634293067
driven_any_max	1.6057043265958648
driven_any_mean	1.3484469345214642
driven_any_median	1.5756972277649912
driven_any_min	0.9900494571900692
driven_lanedir_consec_max	1.4904214722299334
driven_lanedir_consec_mean	1.0721437270256324
driven_lanedir_consec_min	0.6474115509746436
driven_lanedir_max	1.4904214722299334
driven_lanedir_mean	1.0721437270256324
driven_lanedir_median	1.225306900765771
driven_lanedir_min	0.6474115509746436
in-drivable-lane_max	2.0499999999999927
in-drivable-lane_mean	1.4300000000000082
in-drivable-lane_min	0.25000000000000355
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.019794314885310988, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.051697883674566694, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1198724688385888, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07531051670047019, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.030877794293190937, "sim_compute_performance-ego": 0.054788519152634434, "sim_compute_robot_state-ego": 0.05736781881867553}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.018095486355523993, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.04673890649837299, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11110777924530696, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.0655883385317169, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.030851698269809248, "sim_compute_performance-ego": 0.049207885770032, "sim_compute_robot_state-ego": 0.0518089123885997}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.018551661829242793, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.04996874193439569, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.11692599437696516, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.07314210087729142, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.03097539846138035, "sim_compute_performance-ego": 0.05309614044668429, "sim_compute_robot_state-ego": 0.053437932189804555}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.021375320124071697, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.057341371580611825, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.13806029142335405, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.08613611487455146, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.03486359285753827, "sim_compute_performance-ego": 0.059405079553293626, "sim_compute_robot_state-ego": 0.06172459846319154}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.019004668350572938, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.04892420327221906, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.1115913976121832, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.06827927518773962, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.028926894620612816, "sim_compute_performance-ego": 0.04819745377258018, "sim_compute_robot_state-ego": 0.051702256555910465}}
set_robot_commands_max	0.08613611487455146
set_robot_commands_mean	0.07369126923435391
set_robot_commands_median	0.07314210087729142
set_robot_commands_min	0.0655883385317169
sim_compute_performance-ego_max	0.059405079553293626
sim_compute_performance-ego_mean	0.0529390157390449
sim_compute_performance-ego_median	0.05309614044668429
sim_compute_performance-ego_min	0.04819745377258018
sim_compute_robot_state-ego_max	0.06172459846319154
sim_compute_robot_state-ego_mean	0.05520830368323636
sim_compute_robot_state-ego_median	0.053437932189804555
sim_compute_robot_state-ego_min	0.051702256555910465
sim_compute_sim_state_max	0.03486359285753827
sim_compute_sim_state_mean	0.03129907570050632
sim_compute_sim_state_median	0.030877794293190937
sim_compute_sim_state_min	0.028926894620612816
sim_physics_max	0.021375320124071697
sim_physics_mean	0.01936429030894448
sim_physics_median	0.019004668350572938
sim_physics_min	0.018095486355523993
sim_render-ego_max	0.057341371580611825
sim_render-ego_mean	0.050934221392033255
sim_render-ego_median	0.04996874193439569
sim_render-ego_min	0.04673890649837299
simulation-passed	1
survival_time_max	11.150000000000023
survival_time_mean	9.300000000000004
survival_time_min	6.849999999999984

No reset possible

18923

2365

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

5 years, 11 months

0:13:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15133856236934662
agent_compute-ego_mean	0.1405763618704166
agent_compute-ego_median	0.13915024562315506
agent_compute-ego_min	0.1331235976780162
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.038743743356668726, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0649448925594114, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13590473049091842, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09896556836254192, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03971881236670152, "sim_compute_performance-ego": 0.06675202441665362, "sim_compute_robot_state-ego": 0.07523500244572477, "sim_compute_robot_state-npc0": 0.07098910943517145, "sim_compute_robot_state-npc1": 0.07177502704116534, "sim_compute_robot_state-npc2": 0.0696849912967322, "sim_compute_robot_state-npc3": 0.07057940285160856}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.040795662186362526, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06848837028850209, "in-drivable-lane": 0, "agent_compute-ego": 0.13915024562315506, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.0971014066175981, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03866506164724177, "sim_compute_performance-ego": 0.07104680754921654, "sim_compute_robot_state-ego": 0.07622906836596402, "sim_compute_robot_state-npc0": 0.07674732533368198, "sim_compute_robot_state-npc1": 0.07073670083826239, "sim_compute_robot_state-npc2": 0.0719578970562328, "sim_compute_robot_state-npc3": 0.07234569029374556}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.041597101423475474, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.07029157214694554, "in-drivable-lane": 0, "agent_compute-ego": 0.1433646731906467, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.10091351403130425, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.04316767586602105, "sim_compute_performance-ego": 0.07230516539679634, "sim_compute_robot_state-ego": 0.07917027473449707, "sim_compute_robot_state-npc0": 0.07382361094156902, "sim_compute_robot_state-npc1": 0.07427145640055338, "sim_compute_robot_state-npc2": 0.07350305451287163, "sim_compute_robot_state-npc3": 0.07709288597106934}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.04500626524289449, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.07632528742154439, "in-drivable-lane": 0, "agent_compute-ego": 0.15133856236934662, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10731038947900136, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04518581430117289, "sim_compute_performance-ego": 0.07701630393664043, "sim_compute_robot_state-ego": 0.08293281992276509, "sim_compute_robot_state-npc0": 0.07948242624600728, "sim_compute_robot_state-npc1": 0.07667374114195506, "sim_compute_robot_state-npc2": 0.07597085336844127, "sim_compute_robot_state-npc3": 0.08163547019163768}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.04077748340718886, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06791461916530833, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1331235976780162, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09607085760901957, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03765725388246424, "sim_compute_performance-ego": 0.06852037766400505, "sim_compute_robot_state-ego": 0.07322987388162051, "sim_compute_robot_state-npc0": 0.06789214470807244, "sim_compute_robot_state-npc1": 0.06951902193181655, "sim_compute_robot_state-npc2": 0.0706250457202687, "sim_compute_robot_state-npc3": 0.07209551684996661}}
set_robot_commands_max	0.10731038947900136
set_robot_commands_mean	0.10007234721989304
set_robot_commands_median	0.09896556836254192
set_robot_commands_min	0.09607085760901957
sim_compute_performance-ego_max	0.07701630393664043
sim_compute_performance-ego_mean	0.07112813579266239
sim_compute_performance-ego_median	0.07104680754921654
sim_compute_performance-ego_min	0.06675202441665362
sim_compute_robot_state-ego_max	0.08293281992276509
sim_compute_robot_state-ego_mean	0.07735940787011428
sim_compute_robot_state-ego_median	0.07622906836596402
sim_compute_robot_state-ego_min	0.07322987388162051
sim_compute_robot_state-npc0_max	0.07948242624600728
sim_compute_robot_state-npc0_mean	0.07378692333290042
sim_compute_robot_state-npc0_median	0.07382361094156902
sim_compute_robot_state-npc0_min	0.06789214470807244
sim_compute_robot_state-npc1_max	0.07667374114195506
sim_compute_robot_state-npc1_mean	0.07259518947075054
sim_compute_robot_state-npc1_median	0.07177502704116534
sim_compute_robot_state-npc1_min	0.06951902193181655
sim_compute_robot_state-npc2_max	0.07597085336844127
sim_compute_robot_state-npc2_mean	0.07234836839090933
sim_compute_robot_state-npc2_median	0.0719578970562328
sim_compute_robot_state-npc2_min	0.0696849912967322
sim_compute_robot_state-npc3_max	0.08163547019163768
sim_compute_robot_state-npc3_mean	0.07474979323160555
sim_compute_robot_state-npc3_median	0.07234569029374556
sim_compute_robot_state-npc3_min	0.07057940285160856
sim_compute_sim_state_max	0.04518581430117289
sim_compute_sim_state_mean	0.04087892361272029
sim_compute_sim_state_median	0.03971881236670152
sim_compute_sim_state_min	0.03765725388246424
sim_physics_max	0.04500626524289449
sim_physics_mean	0.041384051123318014
sim_physics_median	0.040795662186362526
sim_physics_min	0.038743743356668726
sim_render-ego_max	0.07632528742154439
sim_render-ego_mean	0.06959294831634236
sim_render-ego_median	0.06848837028850209
sim_render-ego_min	0.0649448925594114
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18909

2380

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

error

5 years, 11 months

0:20:54

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18889

2409

Baseline solution using reinforcement learning

step1-simulation

error

5 years, 11 months

0:20:51

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18880

2410

Baseline solution using reinforcement learning

step1-simulation

host-error

5 years, 11 months

0:13:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18880-715367', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18880-715367', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18880-715367', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18859

2441

Jacopo Tani

random_agent

step1-simulation

success

5 years, 11 months

0:11:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15699051221211752
agent_compute-ego_mean	0.13638364523381594
agent_compute-ego_median	0.12920344226500569
agent_compute-ego_min	0.11710084609265596
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.027866003648290096, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05051010959553269, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.11710084609265596, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0697605384970611, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.027509473404794368, "sim_compute_performance-ego": 0.05342809209283793, "sim_compute_robot_state-ego": 0.052393949256753024, "sim_compute_robot_state-npc0": 0.051940854990257405, "sim_compute_robot_state-npc1": 0.05172225664246757, "sim_compute_robot_state-npc2": 0.050097987336932485, "sim_compute_robot_state-npc3": 0.05051924597542241}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03778539462523027, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06124591827392578, "in-drivable-lane": 0, "agent_compute-ego": 0.15162388844923538, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.0948150699788874, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03668172792954878, "sim_compute_performance-ego": 0.06411312385038896, "sim_compute_robot_state-ego": 0.06687732718207619, "sim_compute_robot_state-npc0": 0.06613851677287709, "sim_compute_robot_state-npc1": 0.06591765447096391, "sim_compute_robot_state-npc2": 0.06592994928359985, "sim_compute_robot_state-npc3": 0.06859129667282104}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.039975378248426646, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.0645380867852105, "in-drivable-lane": 0, "agent_compute-ego": 0.15699051221211752, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.10458111233181425, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.038348187340630426, "sim_compute_performance-ego": 0.06682846811082628, "sim_compute_robot_state-ego": 0.07293391227722168, "sim_compute_robot_state-npc0": 0.07277081277635362, "sim_compute_robot_state-npc1": 0.07036996947394478, "sim_compute_robot_state-npc2": 0.07151979870266384, "sim_compute_robot_state-npc3": 0.08661032782660591}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03233079115549723, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05408217509587606, "in-drivable-lane": 0, "agent_compute-ego": 0.1269995371500651, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07784273723761241, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03287709256013235, "sim_compute_performance-ego": 0.05633631845315298, "sim_compute_robot_state-ego": 0.058045998215675354, "sim_compute_robot_state-npc0": 0.05376513799031576, "sim_compute_robot_state-npc1": 0.05522323648134867, "sim_compute_robot_state-npc2": 0.05502571165561676, "sim_compute_robot_state-npc3": 0.05679074923197428}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.029433779856737924, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05452997193616979, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12920344226500569, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07976120359757367, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03065036324893727, "sim_compute_performance-ego": 0.05439810893114875, "sim_compute_robot_state-ego": 0.05747040580300724, "sim_compute_robot_state-npc0": 0.05526059164720423, "sim_compute_robot_state-npc1": 0.056087157305549175, "sim_compute_robot_state-npc2": 0.055797082536360794, "sim_compute_robot_state-npc3": 0.056735929320840275}}
set_robot_commands_max	0.10458111233181425
set_robot_commands_mean	0.08535213232858976
set_robot_commands_median	0.07976120359757367
set_robot_commands_min	0.0697605384970611
sim_compute_performance-ego_max	0.06682846811082628
sim_compute_performance-ego_mean	0.059020822287670985
sim_compute_performance-ego_median	0.05633631845315298
sim_compute_performance-ego_min	0.05342809209283793
sim_compute_robot_state-ego_max	0.07293391227722168
sim_compute_robot_state-ego_mean	0.06154431854694668
sim_compute_robot_state-ego_median	0.058045998215675354
sim_compute_robot_state-ego_min	0.052393949256753024
sim_compute_robot_state-npc0_max	0.07277081277635362
sim_compute_robot_state-npc0_mean	0.05997518283540162
sim_compute_robot_state-npc0_median	0.05526059164720423
sim_compute_robot_state-npc0_min	0.051940854990257405
sim_compute_robot_state-npc1_max	0.07036996947394478
sim_compute_robot_state-npc1_mean	0.05986405487485482
sim_compute_robot_state-npc1_median	0.056087157305549175
sim_compute_robot_state-npc1_min	0.05172225664246757
sim_compute_robot_state-npc2_max	0.07151979870266384
sim_compute_robot_state-npc2_mean	0.05967410590303475
sim_compute_robot_state-npc2_median	0.055797082536360794
sim_compute_robot_state-npc2_min	0.050097987336932485
sim_compute_robot_state-npc3_max	0.08661032782660591
sim_compute_robot_state-npc3_mean	0.06384950980553278
sim_compute_robot_state-npc3_median	0.05679074923197428
sim_compute_robot_state-npc3_min	0.05051924597542241
sim_compute_sim_state_max	0.038348187340630426
sim_compute_sim_state_mean	0.03321336889680864
sim_compute_sim_state_median	0.03287709256013235
sim_compute_sim_state_min	0.027509473404794368
sim_physics_max	0.039975378248426646
sim_physics_mean	0.03347826950683643
sim_physics_median	0.03233079115549723
sim_physics_min	0.027866003648290096
sim_render-ego_max	0.0645380867852105
sim_render-ego_mean	0.05698125233734297
sim_render-ego_median	0.05452997193616979
sim_render-ego_min	0.05051010959553269
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18843

2467

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:08:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.1804946715181524
agent_compute-ego_mean	0.16110907921380896
agent_compute-ego_median	0.17343068652682833
agent_compute-ego_min	0.12156476614610204
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01684734506427117, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.049975624624288305, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12156476614610204, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07261259150954913, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.030387855925649968, "sim_compute_performance-ego": 0.05227855916293162, "sim_compute_robot_state-ego": 0.0520071398537114}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.03130994601683183, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0746564810926264, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1804946715181524, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.11464256048202516, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04581990567120639, "sim_compute_performance-ego": 0.07927183671431108, "sim_compute_robot_state-ego": 0.08338497985493053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.02800990210639106, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.07143624623616536, "in-drivable-lane": 0, "agent_compute-ego": 0.17343068652682833, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.1081315040588379, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.042629612816704646, "sim_compute_performance-ego": 0.07641043663024902, "sim_compute_robot_state-ego": 0.0846866077846951}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.024363150199254353, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.064695010582606, "in-drivable-lane": 0, "agent_compute-ego": 0.15630781650543213, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09818853437900545, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03989759087562561, "sim_compute_performance-ego": 0.07142145931720734, "sim_compute_robot_state-ego": 0.07562655707200368}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02805204952464384, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07268657053218168, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.17374745537252986, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.11120270630892586, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04369938724181231, "sim_compute_performance-ego": 0.07609918538261862, "sim_compute_robot_state-ego": 0.0863044402178596}}
set_robot_commands_max	0.11464256048202516
set_robot_commands_mean	0.10095557934766868
set_robot_commands_median	0.1081315040588379
set_robot_commands_min	0.07261259150954913
sim_compute_performance-ego_max	0.07927183671431108
sim_compute_performance-ego_mean	0.07109629544146354
sim_compute_performance-ego_median	0.07609918538261862
sim_compute_performance-ego_min	0.05227855916293162
sim_compute_robot_state-ego_max	0.0863044402178596
sim_compute_robot_state-ego_mean	0.07640194495664006
sim_compute_robot_state-ego_median	0.08338497985493053
sim_compute_robot_state-ego_min	0.0520071398537114
sim_compute_sim_state_max	0.04581990567120639
sim_compute_sim_state_mean	0.04048687050619979
sim_compute_sim_state_median	0.042629612816704646
sim_compute_sim_state_min	0.030387855925649968
sim_physics_max	0.03130994601683183
sim_physics_mean	0.025716478582278452
sim_physics_median	0.02800990210639106
sim_physics_min	0.01684734506427117
sim_render-ego_max	0.0746564810926264
sim_render-ego_mean	0.06668998661357356
sim_render-ego_median	0.07143624623616536
sim_render-ego_min	0.049975624624288305
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18797

2555

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:13:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.10292404125898312
agent_compute-ego_mean	0.0786809234800731
agent_compute-ego_median	0.07595130016929225
agent_compute-ego_min	0.06316052737988924
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.05593784733822471, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06205662426195647, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06316052737988924, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.08445611501994886, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.035093538384688525, "sim_compute_performance-ego": 0.05861728818793046, "sim_compute_robot_state-ego": 0.06643866739775005, "sim_compute_robot_state-npc0": 0.06036159364800704, "sim_compute_robot_state-npc1": 0.06378067920082493, "sim_compute_robot_state-npc2": 0.0706918666237279, "sim_compute_robot_state-npc3": 0.059179140392102696}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.03907714392009534, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06301549861305639, "in-drivable-lane": 0, "agent_compute-ego": 0.07595130016929225, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.09963748329564144, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.0372687766426488, "sim_compute_performance-ego": 0.06570425786470112, "sim_compute_robot_state-ego": 0.0679287032077187, "sim_compute_robot_state-npc0": 0.07014910170906469, "sim_compute_robot_state-npc1": 0.06701893555490594, "sim_compute_robot_state-npc2": 0.0686898106022885, "sim_compute_robot_state-npc3": 0.06593886174653706}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.025854043471507535, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.04175685613583296, "in-drivable-lane": 0, "agent_compute-ego": 0.10292404125898312, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.06080418366652269, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.02385376049922063, "sim_compute_performance-ego": 0.04195824647561098, "sim_compute_robot_state-ego": 0.043069020295754455, "sim_compute_robot_state-npc0": 0.04410540140592135, "sim_compute_robot_state-npc1": 0.04227041586851462, "sim_compute_robot_state-npc2": 0.04252299895653358, "sim_compute_robot_state-npc3": 0.04195669981149527}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.05658093976302886, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.07161951400864293, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07886888275683766, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.10151265708493516, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.0403072800434811, "sim_compute_performance-ego": 0.06831577126408966, "sim_compute_robot_state-ego": 0.07689800396771498, "sim_compute_robot_state-npc0": 0.07785449565296441, "sim_compute_robot_state-npc1": 0.072568953876764, "sim_compute_robot_state-npc2": 0.08006357139265033, "sim_compute_robot_state-npc3": 0.07571426579650019}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.03703011165965687, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06739853187040849, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07249986583536322, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.10470663417469372, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03921570561148904, "sim_compute_performance-ego": 0.06960422884334218, "sim_compute_robot_state-ego": 0.07260404933582652, "sim_compute_robot_state-npc0": 0.06997274810617621, "sim_compute_robot_state-npc1": 0.06919141791083595, "sim_compute_robot_state-npc2": 0.0703301104632291, "sim_compute_robot_state-npc3": 0.06994401866739447}}
set_robot_commands_max	0.10470663417469372
set_robot_commands_mean	0.09022341464834838
set_robot_commands_median	0.09963748329564144
set_robot_commands_min	0.06080418366652269
sim_compute_performance-ego_max	0.06960422884334218
sim_compute_performance-ego_mean	0.06083995852713488
sim_compute_performance-ego_median	0.06570425786470112
sim_compute_performance-ego_min	0.04195824647561098
sim_compute_robot_state-ego_max	0.07689800396771498
sim_compute_robot_state-ego_mean	0.06538768884095295
sim_compute_robot_state-ego_median	0.0679287032077187
sim_compute_robot_state-ego_min	0.043069020295754455
sim_compute_robot_state-npc0_max	0.07785449565296441
sim_compute_robot_state-npc0_mean	0.06448866810442674
sim_compute_robot_state-npc0_median	0.06997274810617621
sim_compute_robot_state-npc0_min	0.04410540140592135
sim_compute_robot_state-npc1_max	0.072568953876764
sim_compute_robot_state-npc1_mean	0.0629660804823691
sim_compute_robot_state-npc1_median	0.06701893555490594
sim_compute_robot_state-npc1_min	0.04227041586851462
sim_compute_robot_state-npc2_max	0.08006357139265033
sim_compute_robot_state-npc2_mean	0.06645967160768589
sim_compute_robot_state-npc2_median	0.0703301104632291
sim_compute_robot_state-npc2_min	0.04252299895653358
sim_compute_robot_state-npc3_max	0.07571426579650019
sim_compute_robot_state-npc3_mean	0.06254659728280594
sim_compute_robot_state-npc3_median	0.06593886174653706
sim_compute_robot_state-npc3_min	0.04195669981149527
sim_compute_sim_state_max	0.0403072800434811
sim_compute_sim_state_mean	0.03514781223630562
sim_compute_sim_state_median	0.0372687766426488
sim_compute_sim_state_min	0.02385376049922063
sim_physics_max	0.05658093976302886
sim_physics_mean	0.04289601723050266
sim_physics_median	0.03907714392009534
sim_physics_min	0.025854043471507535
sim_render-ego_max	0.07161951400864293
sim_render-ego_mean	0.06116940497797944
sim_render-ego_median	0.06301549861305639
sim_render-ego_min	0.04175685613583296
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18788

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

5 years, 11 months

0:03:54

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18788-219824', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18788-219824', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18788-219824', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18774

2556

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:13:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.08403618712174266
agent_compute-ego_mean	0.06692844338755541
agent_compute-ego_median	0.0587003353314522
agent_compute-ego_min	0.05511458826736665
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.051260835246035925, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.07021929841292532, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07928107161270945, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.10403177361739308, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.04193893231843647, "sim_compute_performance-ego": 0.07356366860239129, "sim_compute_robot_state-ego": 0.0787659720370644, "sim_compute_robot_state-npc0": 0.07312848944413035, "sim_compute_robot_state-npc1": 0.07187392586155941, "sim_compute_robot_state-npc2": 0.07332578709251002, "sim_compute_robot_state-npc3": 0.0730176473918714}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.04804188326785439, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.07608851633573833, "in-drivable-lane": 0, "agent_compute-ego": 0.08403618712174266, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.11439187275735956, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.041548465427599456, "sim_compute_performance-ego": 0.07773952735097785, "sim_compute_robot_state-ego": 0.08164329277841668, "sim_compute_robot_state-npc0": 0.07590856677607487, "sim_compute_robot_state-npc1": 0.0746036454250938, "sim_compute_robot_state-npc2": 0.07354867458343506, "sim_compute_robot_state-npc3": 0.07204430981686241}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.0331266904488588, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.05187321320558206, "in-drivable-lane": 0, "agent_compute-ego": 0.0587003353314522, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07955644069573818, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03047278599861341, "sim_compute_performance-ego": 0.04920883056445, "sim_compute_robot_state-ego": 0.05370847384134928, "sim_compute_robot_state-npc0": 0.0545193904485458, "sim_compute_robot_state-npc1": 0.05086249571580153, "sim_compute_robot_state-npc2": 0.05235403623336401, "sim_compute_robot_state-npc3": 0.05578302114437788}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03739755925997882, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.05169011505556778, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05511458826736665, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.0728889116099183, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03078600050697864, "sim_compute_performance-ego": 0.052228789933970274, "sim_compute_robot_state-ego": 0.05395728433635873, "sim_compute_robot_state-npc0": 0.050836636986531, "sim_compute_robot_state-npc1": 0.05181477775036449, "sim_compute_robot_state-npc2": 0.05261945724487305, "sim_compute_robot_state-npc3": 0.05371902358364051}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.0308597900650718, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.05279052257537842, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.05751003460450606, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07681825486096469, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.030550095168027012, "sim_compute_performance-ego": 0.053913338617845016, "sim_compute_robot_state-ego": 0.056694561784917656, "sim_compute_robot_state-npc0": 0.05395826968279752, "sim_compute_robot_state-npc1": 0.05369916287335483, "sim_compute_robot_state-npc2": 0.05289924144744873, "sim_compute_robot_state-npc3": 0.05447439713911577}}
set_robot_commands_max	0.11439187275735956
set_robot_commands_mean	0.08953745070827476
set_robot_commands_median	0.07955644069573818
set_robot_commands_min	0.0728889116099183
sim_compute_performance-ego_max	0.07773952735097785
sim_compute_performance-ego_mean	0.06133083101392689
sim_compute_performance-ego_median	0.053913338617845016
sim_compute_performance-ego_min	0.04920883056445
sim_compute_robot_state-ego_max	0.08164329277841668
sim_compute_robot_state-ego_mean	0.06495391695562135
sim_compute_robot_state-ego_median	0.056694561784917656
sim_compute_robot_state-ego_min	0.05370847384134928
sim_compute_robot_state-npc0_max	0.07590856677607487
sim_compute_robot_state-npc0_mean	0.0616702706676159
sim_compute_robot_state-npc0_median	0.0545193904485458
sim_compute_robot_state-npc0_min	0.050836636986531
sim_compute_robot_state-npc1_max	0.0746036454250938
sim_compute_robot_state-npc1_mean	0.06057080152523482
sim_compute_robot_state-npc1_median	0.05369916287335483
sim_compute_robot_state-npc1_min	0.05086249571580153
sim_compute_robot_state-npc2_max	0.07354867458343506
sim_compute_robot_state-npc2_mean	0.06094943932032617
sim_compute_robot_state-npc2_median	0.05289924144744873
sim_compute_robot_state-npc2_min	0.05235403623336401
sim_compute_robot_state-npc3_max	0.0730176473918714
sim_compute_robot_state-npc3_mean	0.0618076798151736
sim_compute_robot_state-npc3_median	0.05578302114437788
sim_compute_robot_state-npc3_min	0.05371902358364051
sim_compute_sim_state_max	0.04193893231843647
sim_compute_sim_state_mean	0.035059255883930995
sim_compute_sim_state_median	0.03078600050697864
sim_compute_sim_state_min	0.03047278599861341
sim_physics_max	0.051260835246035925
sim_physics_mean	0.04013735165755995
sim_physics_median	0.03739755925997882
sim_physics_min	0.0308597900650718
sim_render-ego_max	0.07608851633573833
sim_render-ego_mean	0.06053233311703839
sim_render-ego_median	0.05279052257537842
sim_render-ego_min	0.05169011505556778
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18773

2557

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18770

2591

baseline-IL-logs-tensorflow

step1-simulation

error

5 years, 11 months

0:20:56

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18766

2564

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:13:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487132829419987
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041400208354252
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07942534946813816
agent_compute-ego_mean	0.07290200587709585
agent_compute-ego_median	0.07884595944331242
agent_compute-ego_min	0.05725789697546708
deviation-center-line_max	0.1279102488429998
deviation-center-line_mean	0.10518151035257096
deviation-center-line_min	0.06917270915638028
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550057
deviation-heading_median	0.36368201628851926
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903464
driven_any_median	0.6642785413159032
driven_any_min	0.3059207793076613
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.588039443394122
driven_lanedir_consec_min	0.28022225990343186
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.588039443394122
driven_lanedir_median	0.5487132829419987
driven_lanedir_min	0.28022225990343186
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.04899970787327464, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.07181034727794368, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07942534946813816, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.11232644755665848, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.041829452282044946, "sim_compute_performance-ego": 0.0747546713526656, "sim_compute_robot_state-ego": 0.08497626607011004, "sim_compute_robot_state-npc0": 0.07369070809061934, "sim_compute_robot_state-npc1": 0.07550713783357202, "sim_compute_robot_state-npc2": 0.07484797733586009, "sim_compute_robot_state-npc3": 0.07507605668975086}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.04601645469665527, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.07052156558403602, "in-drivable-lane": 0, "agent_compute-ego": 0.07884595944331242, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.11067079580747163, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03985085854163536, "sim_compute_performance-ego": 0.0743877520928016, "sim_compute_robot_state-ego": 0.08240446677574745, "sim_compute_robot_state-npc0": 0.07343098750481239, "sim_compute_robot_state-npc1": 0.07214189492739163, "sim_compute_robot_state-npc2": 0.07319259643554688, "sim_compute_robot_state-npc3": 0.07290364228762113}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.04758335174398219, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.07487681064199894, "in-drivable-lane": 0, "agent_compute-ego": 0.07904484931458818, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.11457947467235809, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.04428586046746437, "sim_compute_performance-ego": 0.07884234570442362, "sim_compute_robot_state-ego": 0.0870072435825429, "sim_compute_robot_state-npc0": 0.07719826698303223, "sim_compute_robot_state-npc1": 0.07744727236159304, "sim_compute_robot_state-npc2": 0.08242019186628625, "sim_compute_robot_state-npc3": 0.07579222131282726}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.038253294242607365, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06217508001641913, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06993597418397338, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.09372917112413344, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03687898929302509, "sim_compute_performance-ego": 0.06441091967153025, "sim_compute_robot_state-ego": 0.06956345170408815, "sim_compute_robot_state-npc0": 0.06643980937999683, "sim_compute_robot_state-npc1": 0.06658737738053877, "sim_compute_robot_state-npc2": 0.06532626099638887, "sim_compute_robot_state-npc3": 0.06365841299622924}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.028254603084764983, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05127608776092529, "in-drivable-lane": 0, "agent_compute-ego": 0.05725789697546708, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.06944295607115093, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.031418649773848686, "sim_compute_performance-ego": 0.05137274139805844, "sim_compute_robot_state-ego": 0.057538672497397976, "sim_compute_robot_state-npc0": 0.05374398984407123, "sim_compute_robot_state-npc1": 0.05463110145769621, "sim_compute_robot_state-npc2": 0.05385183660607589, "sim_compute_robot_state-npc3": 0.05507546976992959}}
set_robot_commands_max	0.11457947467235809
set_robot_commands_mean	0.1001497690463545
set_robot_commands_median	0.11067079580747163
set_robot_commands_min	0.06944295607115093
sim_compute_performance-ego_max	0.07884234570442362
sim_compute_performance-ego_mean	0.0687536860438959
sim_compute_performance-ego_median	0.0743877520928016
sim_compute_performance-ego_min	0.05137274139805844
sim_compute_robot_state-ego_max	0.0870072435825429
sim_compute_robot_state-ego_mean	0.0762980201259773
sim_compute_robot_state-ego_median	0.08240446677574745
sim_compute_robot_state-ego_min	0.057538672497397976
sim_compute_robot_state-npc0_max	0.07719826698303223
sim_compute_robot_state-npc0_mean	0.06890075236050641
sim_compute_robot_state-npc0_median	0.07343098750481239
sim_compute_robot_state-npc0_min	0.05374398984407123
sim_compute_robot_state-npc1_max	0.07744727236159304
sim_compute_robot_state-npc1_mean	0.06926295679215834
sim_compute_robot_state-npc1_median	0.07214189492739163
sim_compute_robot_state-npc1_min	0.05463110145769621
sim_compute_robot_state-npc2_max	0.08242019186628625
sim_compute_robot_state-npc2_mean	0.0699277726480316
sim_compute_robot_state-npc2_median	0.07319259643554688
sim_compute_robot_state-npc2_min	0.05385183660607589
sim_compute_robot_state-npc3_max	0.07579222131282726
sim_compute_robot_state-npc3_mean	0.06850116061127162
sim_compute_robot_state-npc3_median	0.07290364228762113
sim_compute_robot_state-npc3_min	0.05507546976992959
sim_compute_sim_state_max	0.04428586046746437
sim_compute_sim_state_mean	0.03885276207160369
sim_compute_sim_state_median	0.03985085854163536
sim_compute_sim_state_min	0.031418649773848686
sim_physics_max	0.04899970787327464
sim_physics_mean	0.041821482328256894
sim_physics_median	0.04601645469665527
sim_physics_min	0.028254603084764983
sim_render-ego_max	0.07487681064199894
sim_render-ego_mean	0.06613197825626461
sim_render-ego_median	0.07052156558403602
sim_render-ego_min	0.05127608776092529
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18763

2569

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

5 years, 11 months

0:06:31

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18763-236838', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18763-236838', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18763-236838', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18761

2573

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18759

2577

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18757

2578

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18756

2581

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18755

2582

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:02:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18752

2595

baseline-IL-logs-tensorflow

step1-simulation

error

5 years, 11 months

0:20:52

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18748

2590

baseline-IL-logs-tensorflow

step1-simulation

error

5 years, 11 months

0:20:54

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18745

2594

baseline-IL-logs-tensorflow

step1-simulation

host-error

5 years, 11 months

0:09:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18745-908452', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18745-908452', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18745-908452', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18744

2869

Shashank Gaur

PredictorLast

aido2-PRED

step1-simulation

success

5 years, 11 months

0:00:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.13621657638068962
error_L2	0.02837324598882077

No reset possible

18738

2598

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:20:56

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18735

2604

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:09:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1152989236932052
agent_compute-ego_mean	0.07906697018060058
agent_compute-ego_median	0.07472580816687607
agent_compute-ego_min	0.0624160868056277
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.031187694247176007, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06981079462097912, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07472580816687607, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.10874021344068574, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.04293409789480814, "sim_compute_performance-ego": 0.07433941596891822, "sim_compute_robot_state-ego": 0.08031357497703738}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.0285340272463285, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.07066621230198787, "in-drivable-lane": 0, "agent_compute-ego": 0.07961755532484788, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.1133584242600661, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.04131097059983473, "sim_compute_performance-ego": 0.07441252011519212, "sim_compute_robot_state-ego": 0.08069358422205998}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.021266546655208503, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05432839596525152, "in-drivable-lane": 0, "agent_compute-ego": 0.0624160868056277, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08495536256343761, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03313912736608627, "sim_compute_performance-ego": 0.06082854879663346, "sim_compute_robot_state-ego": 0.06106435491683635}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02477317851978344, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.060049096306601726, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06327647691244608, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.08939541041196047, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03575249032659845, "sim_compute_performance-ego": 0.06185472928560697, "sim_compute_robot_state-ego": 0.06331238903842129}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.02992540911624306, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.07482208076276277, "in-drivable-lane": 0, "agent_compute-ego": 0.1152989236932052, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.11900323315670616, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04634711616917661, "sim_compute_performance-ego": 0.0812762599242361, "sim_compute_robot_state-ego": 0.08735508040377968}}
set_robot_commands_max	0.11900323315670616
set_robot_commands_mean	0.1030905287665712
set_robot_commands_median	0.10874021344068574
set_robot_commands_min	0.08495536256343761
sim_compute_performance-ego_max	0.0812762599242361
sim_compute_performance-ego_mean	0.07054229481811737
sim_compute_performance-ego_median	0.07433941596891822
sim_compute_performance-ego_min	0.06082854879663346
sim_compute_robot_state-ego_max	0.08735508040377968
sim_compute_robot_state-ego_mean	0.07454779671162695
sim_compute_robot_state-ego_median	0.08031357497703738
sim_compute_robot_state-ego_min	0.06106435491683635
sim_compute_sim_state_max	0.04634711616917661
sim_compute_sim_state_mean	0.03989676047130084
sim_compute_sim_state_median	0.04131097059983473
sim_compute_sim_state_min	0.03313912736608627
sim_physics_max	0.031187694247176007
sim_physics_mean	0.027137371156947903
sim_physics_median	0.0285340272463285
sim_physics_min	0.021266546655208503
sim_render-ego_max	0.07482208076276277
sim_render-ego_mean	0.0659353159915166
sim_render-ego_median	0.06981079462097912
sim_render-ego_min	0.05432839596525152
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18726

2616

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:07:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.1840631085283616
agent_compute-ego_mean	0.1345888409210463
agent_compute-ego_median	0.12005366919175632
agent_compute-ego_min	0.11314997573693591
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01864706795170622, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.050436406765344007, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12005366919175632, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07264933046304954, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.030080286961681437, "sim_compute_performance-ego": 0.05240551480707133, "sim_compute_robot_state-ego": 0.0539868507745131}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.021352730014107445, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05819534171711315, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13708448951894586, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08698200637643988, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03614399108019742, "sim_compute_performance-ego": 0.0628957369110801, "sim_compute_robot_state-ego": 0.06603332541205666}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01895056300693088, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.050048181745741105, "in-drivable-lane": 0, "agent_compute-ego": 0.11859296162923176, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07379041777716742, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.0309329350789388, "sim_compute_performance-ego": 0.055011743969387475, "sim_compute_robot_state-ego": 0.05423863728841146}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.019008437792460125, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.04862926403681437, "in-drivable-lane": 0, "agent_compute-ego": 0.11314997573693591, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07133400440216064, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02939818302790324, "sim_compute_performance-ego": 0.051054030656814575, "sim_compute_robot_state-ego": 0.050078983108202614}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.03398018724778119, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07591844656888176, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1840631085283616, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.1207748861873851, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04454185331568999, "sim_compute_performance-ego": 0.07933877846773933, "sim_compute_robot_state-ego": 0.09254335655885584}}
set_robot_commands_max	0.1207748861873851
set_robot_commands_mean	0.08510612904124053
set_robot_commands_median	0.07379041777716742
set_robot_commands_min	0.07133400440216064
sim_compute_performance-ego_max	0.07933877846773933
sim_compute_performance-ego_mean	0.06014116096241856
sim_compute_performance-ego_median	0.055011743969387475
sim_compute_performance-ego_min	0.051054030656814575
sim_compute_robot_state-ego_max	0.09254335655885584
sim_compute_robot_state-ego_mean	0.06337623062840794
sim_compute_robot_state-ego_median	0.05423863728841146
sim_compute_robot_state-ego_min	0.050078983108202614
sim_compute_sim_state_max	0.04454185331568999
sim_compute_sim_state_mean	0.03421944989288218
sim_compute_sim_state_median	0.0309329350789388
sim_compute_sim_state_min	0.02939818302790324
sim_physics_max	0.03398018724778119
sim_physics_mean	0.022387797202597173
sim_physics_median	0.019008437792460125
sim_physics_min	0.01864706795170622
sim_render-ego_max	0.07591844656888176
sim_render-ego_mean	0.05664552816677888
sim_render-ego_median	0.050436406765344007
sim_render-ego_min	0.04862926403681437
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18712

2652

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

5 years, 11 months

0:17:31

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18712-236149', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18712-236149', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18712-236149', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18702

2680

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 88, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 88, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18685

2685

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

5 years, 11 months

0:20:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18685-674472', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18685-674472', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18685-674472', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18670

2712

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:21:43

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18661

2730

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

5 years, 11 months

0:01:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18643

2766

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:20:56

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18636

2778

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:00:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18634

2783

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:00:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18627

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

5 years, 11 months

0:01:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18621

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:07:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.1596608649600636
agent_compute-ego_mean	0.14704373801505227
agent_compute-ego_median	0.14493922467501658
agent_compute-ego_min	0.12976359261406792
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.022682005504392228, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0630504365237254, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14493922467501658, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09103037276357975, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03685004306289385, "sim_compute_performance-ego": 0.06667338677172391, "sim_compute_robot_state-ego": 0.07161652816916411}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.02334000305695967, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06657493656331842, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1596608649600636, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.10449814254587347, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.038985604589635674, "sim_compute_performance-ego": 0.07126933878118341, "sim_compute_robot_state-ego": 0.07613360339945013}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.022027375962999137, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05856173833211263, "in-drivable-lane": 0, "agent_compute-ego": 0.12976359261406792, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08972161610921224, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03529581493801541, "sim_compute_performance-ego": 0.06286973423428005, "sim_compute_robot_state-ego": 0.06411451233757867}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02599528928597768, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06793303787708282, "in-drivable-lane": 0, "agent_compute-ego": 0.15933950742085776, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10398488243420918, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03971808652083079, "sim_compute_performance-ego": 0.07210468252499898, "sim_compute_robot_state-ego": 0.07722292343775432}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.026806996149175307, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.061187432092778826, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14151550040525548, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.0937258250573102, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03758616307202507, "sim_compute_performance-ego": 0.06602209105211146, "sim_compute_robot_state-ego": 0.0715740813928492}}
set_robot_commands_max	0.10449814254587347
set_robot_commands_mean	0.09659216778203696
set_robot_commands_median	0.0937258250573102
set_robot_commands_min	0.08972161610921224
sim_compute_performance-ego_max	0.07210468252499898
sim_compute_performance-ego_mean	0.06778784667285956
sim_compute_performance-ego_median	0.06667338677172391
sim_compute_performance-ego_min	0.06286973423428005
sim_compute_robot_state-ego_max	0.07722292343775432
sim_compute_robot_state-ego_mean	0.0721323297473593
sim_compute_robot_state-ego_median	0.07161652816916411
sim_compute_robot_state-ego_min	0.06411451233757867
sim_compute_sim_state_max	0.03971808652083079
sim_compute_sim_state_mean	0.03768714243668016
sim_compute_sim_state_median	0.03758616307202507
sim_compute_sim_state_min	0.03529581493801541
sim_physics_max	0.026806996149175307
sim_physics_mean	0.024170333991900803
sim_physics_median	0.02334000305695967
sim_physics_min	0.022027375962999137
sim_render-ego_max	0.06793303787708282
sim_render-ego_mean	0.06346151627780362
sim_render-ego_median	0.0630504365237254
sim_render-ego_min	0.05856173833211263
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18619

2831

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18611

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

5 years, 11 months

0:02:02

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18611-66917', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18611-66917', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18611-66917', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18590

2860

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:23:49

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18580

2844

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:04:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18568

2861

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:24:45

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18551

2371

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

error

5 years, 11 months

0:20:48

Waited 1201 seconds [...]

Waited 1201 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18544

2375

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

5 years, 11 months

0:11:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2394590679116675
survival_time_median	5.549999999999988
deviation-center-line_median	0.04756896992501765
in-drivable-lane_median	0.9999999999999964

other stats

agent_compute-ego_max	0.07251002337481524
agent_compute-ego_mean	0.06076363224882979
agent_compute-ego_median	0.0608320070637597
agent_compute-ego_min	0.04534603158632914
deviation-center-line_max	0.06628159589691172
deviation-center-line_mean	0.055053867384428454
deviation-center-line_min	0.04756874938348469
deviation-heading_max	0.3902119203851745
deviation-heading_mean	0.3724667982759654
deviation-heading_median	0.39020902164128224
deviation-heading_min	0.34585149487811473
driven_any_max	1.5771689201187185
driven_any_mean	1.343168920198914
driven_any_median	1.5771689201187176
driven_any_min	0.992168920319208
driven_lanedir_consec_max	1.344898529895705
driven_lanedir_consec_mean	1.047634910702065
driven_lanedir_consec_min	0.6544587706938922
driven_lanedir_max	1.344898529895705
driven_lanedir_mean	1.047634910702065
driven_lanedir_median	1.2394590679116675
driven_lanedir_min	0.6544587706938922
in-drivable-lane_max	0.9999999999999964
in-drivable-lane_mean	0.8799999999999969
in-drivable-lane_min	0.6999999999999975
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.01921679245101081, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.04529178804821438, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.04534603158632914, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.0694419178697798, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.02749738759464688, "sim_compute_performance-ego": 0.046202146344714694, "sim_compute_robot_state-ego": 0.04942488670349121}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.02336257365014818, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.055175728268093534, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0608320070637597, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.0864373611079322, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.03436064057879978, "sim_compute_performance-ego": 0.05993694729275174, "sim_compute_robot_state-ego": 0.06441444158554077}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.022216399510701496, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.05818702293945863, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.06075319943127331, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.0857638238786577, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.03309653685973571, "sim_compute_performance-ego": 0.0605115439440753, "sim_compute_robot_state-ego": 0.06369112418578551}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.02336720088580707, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.06459333445574786, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.06437689978797156, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.09688668208079296, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.03797132474882109, "sim_compute_performance-ego": 0.06759615631790848, "sim_compute_robot_state-ego": 0.07005420246639767}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.027734477240760048, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.07407834508397558, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.07251002337481524, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.11395228016483892, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.042669130875183654, "sim_compute_performance-ego": 0.07799544849911251, "sim_compute_robot_state-ego": 0.08625141564790192}}
set_robot_commands_max	0.11395228016483892
set_robot_commands_mean	0.09049641302040032
set_robot_commands_median	0.0864373611079322
set_robot_commands_min	0.0694419178697798
sim_compute_performance-ego_max	0.07799544849911251
sim_compute_performance-ego_mean	0.06244844847971254
sim_compute_performance-ego_median	0.0605115439440753
sim_compute_performance-ego_min	0.046202146344714694
sim_compute_robot_state-ego_max	0.08625141564790192
sim_compute_robot_state-ego_mean	0.06676721411782342
sim_compute_robot_state-ego_median	0.06441444158554077
sim_compute_robot_state-ego_min	0.04942488670349121
sim_compute_sim_state_max	0.042669130875183654
sim_compute_sim_state_mean	0.03511900413143742
sim_compute_sim_state_median	0.03436064057879978
sim_compute_sim_state_min	0.02749738759464688
sim_physics_max	0.027734477240760048
sim_physics_mean	0.02317948874768552
sim_physics_median	0.02336257365014818
sim_physics_min	0.01921679245101081
sim_render-ego_max	0.07407834508397558
sim_render-ego_mean	0.059465243759097994
sim_render-ego_median	0.05818702293945863
sim_render-ego_min	0.04529178804821438
simulation-passed	1
survival_time_max	5.549999999999988
survival_time_mean	4.769999999999992
survival_time_min	3.599999999999995

No reset possible

18541

2379

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

5 years, 11 months

0:03:20

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18541-552365', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18541-552365', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18541-552365', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18527

2396

Liam Paull 🇨🇦

random_agent

step1-simulation

success

5 years, 11 months

0:11:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14540768721524408
agent_compute-ego_mean	0.12124346555129303
agent_compute-ego_median	0.11588393847147624
agent_compute-ego_min	0.09183073043823242
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.024374561489753005, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.043635908162818766, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.09183073043823242, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.06289725033742077, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.026646474622330576, "sim_compute_performance-ego": 0.046731813898626365, "sim_compute_robot_state-ego": 0.04866179430259848, "sim_compute_robot_state-npc0": 0.04412879583970556, "sim_compute_robot_state-npc1": 0.045455842647912366, "sim_compute_robot_state-npc2": 0.04755321988519633, "sim_compute_robot_state-npc3": 0.05137717498923248}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04511890628121116, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06626650420102206, "in-drivable-lane": 0, "agent_compute-ego": 0.13890982216054742, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09491324424743652, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.042231603102250534, "sim_compute_performance-ego": 0.06890067187222568, "sim_compute_robot_state-ego": 0.07535447857596657, "sim_compute_robot_state-npc0": 0.0727224349975586, "sim_compute_robot_state-npc1": 0.07044868035749956, "sim_compute_robot_state-npc2": 0.07409690185026689, "sim_compute_robot_state-npc3": 0.07090605930848555}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03502741919623481, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05837703810797797, "in-drivable-lane": 0, "agent_compute-ego": 0.11588393847147624, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09597302542792428, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03546269204881456, "sim_compute_performance-ego": 0.06449655956692166, "sim_compute_robot_state-ego": 0.06855724122789171, "sim_compute_robot_state-npc0": 0.06086090405782064, "sim_compute_robot_state-npc1": 0.06172419653998481, "sim_compute_robot_state-npc2": 0.06434620751274957, "sim_compute_robot_state-npc3": 0.06396760940551757}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03259675701459249, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05800696710745493, "in-drivable-lane": 0, "agent_compute-ego": 0.11418514947096509, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07978948950767517, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03579933941364288, "sim_compute_performance-ego": 0.05811346570650736, "sim_compute_robot_state-ego": 0.06403066714604695, "sim_compute_robot_state-npc0": 0.06120425462722778, "sim_compute_robot_state-npc1": 0.05910720427831014, "sim_compute_robot_state-npc2": 0.059505959351857506, "sim_compute_robot_state-npc3": 0.06020082533359528}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.04033512928906609, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.0642773053225349, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14540768721524408, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09716437143438005, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03913114702000337, "sim_compute_performance-ego": 0.06820491482229794, "sim_compute_robot_state-ego": 0.07336604945799884, "sim_compute_robot_state-npc0": 0.07019438463098862, "sim_compute_robot_state-npc1": 0.06891012542388018, "sim_compute_robot_state-npc2": 0.06960442136315738, "sim_compute_robot_state-npc3": 0.0680729957187877}}
set_robot_commands_max	0.09716437143438005
set_robot_commands_mean	0.08614747619096737
set_robot_commands_median	0.09491324424743652
set_robot_commands_min	0.06289725033742077
sim_compute_performance-ego_max	0.06890067187222568
sim_compute_performance-ego_mean	0.0612894851733158
sim_compute_performance-ego_median	0.06449655956692166
sim_compute_performance-ego_min	0.046731813898626365
sim_compute_robot_state-ego_max	0.07535447857596657
sim_compute_robot_state-ego_mean	0.06599404614210051
sim_compute_robot_state-ego_median	0.06855724122789171
sim_compute_robot_state-ego_min	0.04866179430259848
sim_compute_robot_state-npc0_max	0.0727224349975586
sim_compute_robot_state-npc0_mean	0.06182215483066024
sim_compute_robot_state-npc0_median	0.06120425462722778
sim_compute_robot_state-npc0_min	0.04412879583970556
sim_compute_robot_state-npc1_max	0.07044868035749956
sim_compute_robot_state-npc1_mean	0.06112920984951742
sim_compute_robot_state-npc1_median	0.06172419653998481
sim_compute_robot_state-npc1_min	0.045455842647912366
sim_compute_robot_state-npc2_max	0.07409690185026689
sim_compute_robot_state-npc2_mean	0.06302134199264554
sim_compute_robot_state-npc2_median	0.06434620751274957
sim_compute_robot_state-npc2_min	0.04755321988519633
sim_compute_robot_state-npc3_max	0.07090605930848555
sim_compute_robot_state-npc3_mean	0.06290493295112372
sim_compute_robot_state-npc3_median	0.06396760940551757
sim_compute_robot_state-npc3_min	0.05137717498923248
sim_compute_sim_state_max	0.042231603102250534
sim_compute_sim_state_mean	0.03585425124140838
sim_compute_sim_state_median	0.03579933941364288
sim_compute_sim_state_min	0.026646474622330576
sim_physics_max	0.04511890628121116
sim_physics_mean	0.035490554654171516
sim_physics_median	0.03502741919623481
sim_physics_min	0.024374561489753005
sim_render-ego_max	0.06626650420102206
sim_render-ego_mean	0.05811274458036173
sim_render-ego_median	0.05837703810797797
sim_render-ego_min	0.043635908162818766
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18515

2413

Baseline solution using reinforcement learning

step1-simulation

error

5 years, 11 months

0:22:13

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18498

2447

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

error

5 years, 11 months

0:21:02

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18494

2442

Jacopo Tani

random_agent

step1-simulation

host-error

5 years, 11 months

0:01:28

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18494-647142', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18494-647142', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18494-647142', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18476

2472

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:12:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1691677815773908
agent_compute-ego_mean	0.15051038385739254
agent_compute-ego_median	0.1528439223766327
agent_compute-ego_min	0.11593411727385088
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03703349491335311, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.062146177831685766, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1458122820224402, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.10906602301687564, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.038083274409456074, "sim_compute_performance-ego": 0.06647011468995292, "sim_compute_robot_state-ego": 0.07436001525734956, "sim_compute_robot_state-npc0": 0.06897694209836563, "sim_compute_robot_state-npc1": 0.06491554908032687, "sim_compute_robot_state-npc2": 0.06502743487088185, "sim_compute_robot_state-npc3": 0.06675901952779519}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.02966153621673584, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.04926911809227683, "in-drivable-lane": 0, "agent_compute-ego": 0.11593411727385088, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07331277023662221, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03023838996887207, "sim_compute_performance-ego": 0.05147193778644909, "sim_compute_robot_state-ego": 0.0547092231837186, "sim_compute_robot_state-npc0": 0.05352763154289939, "sim_compute_robot_state-npc1": 0.054443939165635544, "sim_compute_robot_state-npc2": 0.05392330343073064, "sim_compute_robot_state-npc3": 0.05435554547743364}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.037526141272650824, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06877147886488173, "in-drivable-lane": 0, "agent_compute-ego": 0.16879381603664825, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.101681121190389, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.04050818019443088, "sim_compute_performance-ego": 0.07111130820380317, "sim_compute_robot_state-ego": 0.07615937127007379, "sim_compute_robot_state-npc0": 0.07170840899149576, "sim_compute_robot_state-npc1": 0.071697113249037, "sim_compute_robot_state-npc2": 0.07223588625590006, "sim_compute_robot_state-npc3": 0.0708634270562066}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03650325536727905, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06463334957758586, "in-drivable-lane": 0, "agent_compute-ego": 0.1528439223766327, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0916493038336436, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03781705598036448, "sim_compute_performance-ego": 0.06530832747618358, "sim_compute_robot_state-ego": 0.07277242342631023, "sim_compute_robot_state-npc0": 0.06492069860299428, "sim_compute_robot_state-npc1": 0.06595207750797272, "sim_compute_robot_state-npc2": 0.06661497553189595, "sim_compute_robot_state-npc3": 0.06397366027037303}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.04212598940905403, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06745235358967501, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1691677815773908, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.10057647087994744, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.04006840200985179, "sim_compute_performance-ego": 0.0705841113539303, "sim_compute_robot_state-ego": 0.07882178180357989, "sim_compute_robot_state-npc0": 0.07094034026650821, "sim_compute_robot_state-npc1": 0.07117955824908088, "sim_compute_robot_state-npc2": 0.07396570724599502, "sim_compute_robot_state-npc3": 0.07233791491564583}}
set_robot_commands_max	0.10906602301687564
set_robot_commands_mean	0.0952571378314956
set_robot_commands_median	0.10057647087994744
set_robot_commands_min	0.07331277023662221
sim_compute_performance-ego_max	0.07111130820380317
sim_compute_performance-ego_mean	0.06498915990206382
sim_compute_performance-ego_median	0.06647011468995292
sim_compute_performance-ego_min	0.05147193778644909
sim_compute_robot_state-ego_max	0.07882178180357989
sim_compute_robot_state-ego_mean	0.07136456298820641
sim_compute_robot_state-ego_median	0.07436001525734956
sim_compute_robot_state-ego_min	0.0547092231837186
sim_compute_robot_state-npc0_max	0.07170840899149576
sim_compute_robot_state-npc0_mean	0.06601480430045265
sim_compute_robot_state-npc0_median	0.06897694209836563
sim_compute_robot_state-npc0_min	0.05352763154289939
sim_compute_robot_state-npc1_max	0.071697113249037
sim_compute_robot_state-npc1_mean	0.0656376474504106
sim_compute_robot_state-npc1_median	0.06595207750797272
sim_compute_robot_state-npc1_min	0.054443939165635544
sim_compute_robot_state-npc2_max	0.07396570724599502
sim_compute_robot_state-npc2_mean	0.0663534614670807
sim_compute_robot_state-npc2_median	0.06661497553189595
sim_compute_robot_state-npc2_min	0.05392330343073064
sim_compute_robot_state-npc3_max	0.07233791491564583
sim_compute_robot_state-npc3_mean	0.06565791344949086
sim_compute_robot_state-npc3_median	0.06675901952779519
sim_compute_robot_state-npc3_min	0.05435554547743364
sim_compute_sim_state_max	0.04050818019443088
sim_compute_sim_state_mean	0.03734306051259506
sim_compute_sim_state_median	0.038083274409456074
sim_compute_sim_state_min	0.03023838996887207
sim_physics_max	0.04212598940905403
sim_physics_mean	0.03657008343581457
sim_physics_median	0.03703349491335311
sim_physics_min	0.02966153621673584
sim_render-ego_max	0.06877147886488173
sim_render-ego_mean	0.06245449559122104
sim_render-ego_median	0.06463334957758586
sim_render-ego_min	0.04926911809227683
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18472

2479

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18467

2487

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:03:04

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18426

2544

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

success

5 years, 11 months

0:07:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07831648500954233
agent_compute-ego_mean	0.0658376177005672
agent_compute-ego_median	0.06849582902677767
agent_compute-ego_min	0.048479095418402486
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02943482922344673, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.07075731638001233, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07831648500954233, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.10924240147195212, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.04271637521139005, "sim_compute_performance-ego": 0.07711660280460264, "sim_compute_robot_state-ego": 0.08403164293707871}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.022467402311471794, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06008492983304537, "in-drivable-lane": 0, "agent_compute-ego": 0.060477064206049994, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.08135521411895752, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.034916932766254134, "sim_compute_performance-ego": 0.06273663960970365, "sim_compute_robot_state-ego": 0.06584086784949669}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.018607961370589884, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.04633714290375405, "in-drivable-lane": 0, "agent_compute-ego": 0.048479095418402486, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.06720449569377493, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.02900475644050761, "sim_compute_performance-ego": 0.04754371338702263, "sim_compute_robot_state-ego": 0.050621448679173245}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.023465780111459587, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05754883996732942, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06849582902677767, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.09310298175602168, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03530337260319637, "sim_compute_performance-ego": 0.05944248346182016, "sim_compute_robot_state-ego": 0.06209177499289041}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.02883833960482949, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06909262506585372, "in-drivable-lane": 0, "agent_compute-ego": 0.0734196148420635, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10226746609336453, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.043052535308034795, "sim_compute_performance-ego": 0.11888438776919716, "sim_compute_robot_state-ego": 0.07849304927022834}}
set_robot_commands_max	0.10924240147195212
set_robot_commands_mean	0.09063451182681416
set_robot_commands_median	0.09310298175602168
set_robot_commands_min	0.06720449569377493
sim_compute_performance-ego_max	0.11888438776919716
sim_compute_performance-ego_mean	0.07314476540646925
sim_compute_performance-ego_median	0.06273663960970365
sim_compute_performance-ego_min	0.04754371338702263
sim_compute_robot_state-ego_max	0.08403164293707871
sim_compute_robot_state-ego_mean	0.06821575674577349
sim_compute_robot_state-ego_median	0.06584086784949669
sim_compute_robot_state-ego_min	0.050621448679173245
sim_compute_sim_state_max	0.043052535308034795
sim_compute_sim_state_mean	0.03699879446587659
sim_compute_sim_state_median	0.03530337260319637
sim_compute_sim_state_min	0.02900475644050761
sim_physics_max	0.02943482922344673
sim_physics_mean	0.024562862524359495
sim_physics_median	0.023465780111459587
sim_physics_min	0.018607961370589884
sim_render-ego_max	0.07075731638001233
sim_render-ego_mean	0.06076417082999898
sim_render-ego_median	0.06008492983304537
sim_render-ego_min	0.04633714290375405
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18422

2548

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:06:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06966581711402306
agent_compute-ego_mean	0.058379109053576295
agent_compute-ego_median	0.06104085947337903
agent_compute-ego_min	0.04393858176011305
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02377205941735244, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05843633267937637, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06376345273925037, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0886874431517066, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.0343460920380383, "sim_compute_performance-ego": 0.06066514515295261, "sim_compute_robot_state-ego": 0.06108650928590356}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.015038022628197305, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.04041127058175894, "in-drivable-lane": 0, "agent_compute-ego": 0.04393858176011305, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.06287497740525466, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.02375943844134991, "sim_compute_performance-ego": 0.0408545915897076, "sim_compute_robot_state-ego": 0.04215068083543043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.016860145203610684, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.049417135563302544, "in-drivable-lane": 0, "agent_compute-ego": 0.05348683418111598, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07445919767339179, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.029618116135292864, "sim_compute_performance-ego": 0.05187221283608295, "sim_compute_robot_state-ego": 0.053127101127137526}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.025347914014543806, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06210785121708126, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06966581711402306, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.09561700349325662, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03770972870208405, "sim_compute_performance-ego": 0.06386886324201312, "sim_compute_robot_state-ego": 0.06866234213441283}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.022298160352204974, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.060206168576290735, "in-drivable-lane": 0, "agent_compute-ego": 0.06104085947337903, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0834503173828125, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.0357508659362793, "sim_compute_performance-ego": 0.06362537333839818, "sim_compute_robot_state-ego": 0.06662620368756746}}
set_robot_commands_max	0.09561700349325662
set_robot_commands_mean	0.08101778782128444
set_robot_commands_median	0.0834503173828125
set_robot_commands_min	0.06287497740525466
sim_compute_performance-ego_max	0.06386886324201312
sim_compute_performance-ego_mean	0.05617723723183089
sim_compute_performance-ego_median	0.06066514515295261
sim_compute_performance-ego_min	0.0408545915897076
sim_compute_robot_state-ego_max	0.06866234213441283
sim_compute_robot_state-ego_mean	0.05833056741409036
sim_compute_robot_state-ego_median	0.06108650928590356
sim_compute_robot_state-ego_min	0.04215068083543043
sim_compute_sim_state_max	0.03770972870208405
sim_compute_sim_state_mean	0.032236848250608886
sim_compute_sim_state_median	0.0343460920380383
sim_compute_sim_state_min	0.02375943844134991
sim_physics_max	0.025347914014543806
sim_physics_mean	0.02066326032318184
sim_physics_median	0.022298160352204974
sim_physics_min	0.015038022628197305
sim_render-ego_max	0.06210785121708126
sim_render-ego_mean	0.05411575172356197
sim_render-ego_median	0.05843633267937637
sim_render-ego_min	0.04041127058175894
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18417

2557

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18397

2590

baseline-IL-logs-tensorflow

step1-simulation

error

5 years, 11 months

0:21:45

Waited 1201 seconds [...]

Waited 1201 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18390

2599

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

host-error

5 years, 11 months

0:03:53

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18390-942083', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18390-942083', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18390-942083', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18378

2621

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:11:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16102799309624566
agent_compute-ego_mean	0.14663247300379229
agent_compute-ego_median	0.1487816459727737
agent_compute-ego_min	0.13274389505386353
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03650906850706856, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06411531736265938, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1487816459727737, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09300556272830604, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03656472799912939, "sim_compute_performance-ego": 0.06510808332911078, "sim_compute_robot_state-ego": 0.06982127675470316, "sim_compute_robot_state-npc0": 0.06739270462180083, "sim_compute_robot_state-npc1": 0.06777514601653477, "sim_compute_robot_state-npc2": 0.06589929562694621, "sim_compute_robot_state-npc3": 0.06338540563043558}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03578934886238792, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.059414045377211136, "in-drivable-lane": 0, "agent_compute-ego": 0.13274389505386353, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08631982044740157, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03357099403034557, "sim_compute_performance-ego": 0.06489579785953868, "sim_compute_robot_state-ego": 0.06528731367804787, "sim_compute_robot_state-npc0": 0.06185707720843228, "sim_compute_robot_state-npc1": 0.06120041825554587, "sim_compute_robot_state-npc2": 0.06539294936440208, "sim_compute_robot_state-npc3": 0.06047376719388095}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03610971768697103, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.0630643367767334, "in-drivable-lane": 0, "agent_compute-ego": 0.16102799309624566, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09975778261820475, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03647578027513292, "sim_compute_performance-ego": 0.06339968575371636, "sim_compute_robot_state-ego": 0.06798357433742946, "sim_compute_robot_state-npc0": 0.06688112682766384, "sim_compute_robot_state-npc1": 0.06581744617886014, "sim_compute_robot_state-npc2": 0.06672817336188422, "sim_compute_robot_state-npc3": 0.0659917672475179}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03524955610434214, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06392476459344228, "in-drivable-lane": 0, "agent_compute-ego": 0.15261106689771017, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09432561695575714, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.037382895747820534, "sim_compute_performance-ego": 0.06433877348899841, "sim_compute_robot_state-ego": 0.06979423264662425, "sim_compute_robot_state-npc0": 0.0652715265750885, "sim_compute_robot_state-npc1": 0.06745591262976329, "sim_compute_robot_state-npc2": 0.0709586242834727, "sim_compute_robot_state-npc3": 0.06796363989512126}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.036830463830162495, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05957033353693345, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13799776399836822, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08601414105471443, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.036087842548594755, "sim_compute_performance-ego": 0.06306592155905331, "sim_compute_robot_state-ego": 0.06766795060213875, "sim_compute_robot_state-npc0": 0.06231006804634543, "sim_compute_robot_state-npc1": 0.063911332803614, "sim_compute_robot_state-npc2": 0.061377034467809344, "sim_compute_robot_state-npc3": 0.06267970449784223}}
set_robot_commands_max	0.09975778261820475
set_robot_commands_mean	0.09188458476087678
set_robot_commands_median	0.09300556272830604
set_robot_commands_min	0.08601414105471443
sim_compute_performance-ego_max	0.06510808332911078
sim_compute_performance-ego_mean	0.06416165239808351
sim_compute_performance-ego_median	0.06433877348899841
sim_compute_performance-ego_min	0.06306592155905331
sim_compute_robot_state-ego_max	0.06982127675470316
sim_compute_robot_state-ego_mean	0.0681108696037887
sim_compute_robot_state-ego_median	0.06798357433742946
sim_compute_robot_state-ego_min	0.06528731367804787
sim_compute_robot_state-npc0_max	0.06739270462180083
sim_compute_robot_state-npc0_mean	0.06474250065586618
sim_compute_robot_state-npc0_median	0.0652715265750885
sim_compute_robot_state-npc0_min	0.06185707720843228
sim_compute_robot_state-npc1_max	0.06777514601653477
sim_compute_robot_state-npc1_mean	0.06523205117686362
sim_compute_robot_state-npc1_median	0.06581744617886014
sim_compute_robot_state-npc1_min	0.06120041825554587
sim_compute_robot_state-npc2_max	0.0709586242834727
sim_compute_robot_state-npc2_mean	0.06607121542090291
sim_compute_robot_state-npc2_median	0.06589929562694621
sim_compute_robot_state-npc2_min	0.061377034467809344
sim_compute_robot_state-npc3_max	0.06796363989512126
sim_compute_robot_state-npc3_mean	0.06409885689295959
sim_compute_robot_state-npc3_median	0.06338540563043558
sim_compute_robot_state-npc3_min	0.06047376719388095
sim_compute_sim_state_max	0.037382895747820534
sim_compute_sim_state_mean	0.03601644812020464
sim_compute_sim_state_median	0.03647578027513292
sim_compute_sim_state_min	0.03357099403034557
sim_physics_max	0.036830463830162495
sim_physics_mean	0.03609763099818643
sim_physics_median	0.03610971768697103
sim_physics_min	0.03524955610434214
sim_render-ego_max	0.06411531736265938
sim_render-ego_mean	0.062017759529395936
sim_render-ego_median	0.0630643367767334
sim_render-ego_min	0.059414045377211136
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18358

2661

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:21:03

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18342

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:20:44

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18337

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

5 years, 11 months

0:13:20

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18337-250357', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18337-250357', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18337-250357', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18327

2724

test for ppo

step1-simulation

error

5 years, 11 months

0:01:12

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18319

2739

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

5 years, 11 months

0:01:34

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18311

2754

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:08:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07553845330288536
agent_compute-ego_mean	0.07152601103996767
agent_compute-ego_median	0.06998911270728478
agent_compute-ego_min	0.06969287918835151
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02586368816654857, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06457493944865901, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06969287918835151, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.100293301954502, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.0394394601263651, "sim_compute_performance-ego": 0.06794353519997946, "sim_compute_robot_state-ego": 0.07017201039849258}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.02232839510991023, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06552145114311805, "in-drivable-lane": 0, "agent_compute-ego": 0.06998911270728478, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.09383075970869796, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03812991655789889, "sim_compute_performance-ego": 0.0649187106352586, "sim_compute_robot_state-ego": 0.06624162197113037}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.025987427285377018, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06454898955974173, "in-drivable-lane": 0, "agent_compute-ego": 0.07246479075005714, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.09665663698886304, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.04094521035539343, "sim_compute_performance-ego": 0.07131465445173547, "sim_compute_robot_state-ego": 0.07609071630112668}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.027294654112595775, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06636410755115552, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0699448192512596, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.10053488186427526, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03852273605682038, "sim_compute_performance-ego": 0.06815215519496373, "sim_compute_robot_state-ego": 0.07179129516685402}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.029053757065220884, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.07235101649635717, "in-drivable-lane": 0, "agent_compute-ego": 0.07553845330288536, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10666244280965705, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04123609316976447, "sim_compute_performance-ego": 0.07444259994908382, "sim_compute_robot_state-ego": 0.0792462010132639}}
set_robot_commands_max	0.10666244280965705
set_robot_commands_mean	0.09959560466519908
set_robot_commands_median	0.100293301954502
set_robot_commands_min	0.09383075970869796
sim_compute_performance-ego_max	0.07444259994908382
sim_compute_performance-ego_mean	0.06935433108620423
sim_compute_performance-ego_median	0.06815215519496373
sim_compute_performance-ego_min	0.0649187106352586
sim_compute_robot_state-ego_max	0.0792462010132639
sim_compute_robot_state-ego_mean	0.0727083689701735
sim_compute_robot_state-ego_median	0.07179129516685402
sim_compute_robot_state-ego_min	0.06624162197113037
sim_compute_sim_state_max	0.04123609316976447
sim_compute_sim_state_mean	0.03965468325324846
sim_compute_sim_state_median	0.0394394601263651
sim_compute_sim_state_min	0.03812991655789889
sim_physics_max	0.029053757065220884
sim_physics_mean	0.026105584347930495
sim_physics_median	0.025987427285377018
sim_physics_min	0.02232839510991023
sim_render-ego_max	0.07235101649635717
sim_render-ego_mean	0.06667210083980629
sim_render-ego_median	0.06552145114311805
sim_render-ego_min	0.06454898955974173
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18285

2812

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

5 years, 11 months

0:14:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.1722251360233013
agent_compute-ego_mean	0.13203204627935236
agent_compute-ego_median	0.1212950107899118
agent_compute-ego_min	0.11221403844894902
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.04564174016316732, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06596200049869598, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14058738284640843, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.09280141951545837, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03769309180123465, "sim_compute_performance-ego": 0.06895508084978376, "sim_compute_robot_state-ego": 0.0737171210939922, "sim_compute_robot_state-npc0": 0.06685804185413179, "sim_compute_robot_state-npc1": 0.06541015609862312, "sim_compute_robot_state-npc2": 0.0676513739994594, "sim_compute_robot_state-npc3": 0.06756063113136897}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.027872539034076764, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05655531789742264, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.11383866328819126, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07085530898150276, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.02825636022231158, "sim_compute_performance-ego": 0.047758565229528094, "sim_compute_robot_state-ego": 0.050295722250844915, "sim_compute_robot_state-npc0": 0.05388883983387666, "sim_compute_robot_state-npc1": 0.05419343125586416, "sim_compute_robot_state-npc2": 0.05180288763607249, "sim_compute_robot_state-npc3": 0.049816440133487475}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03030776208446872, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.04397447647586945, "in-drivable-lane": 0, "agent_compute-ego": 0.11221403844894902, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.05954935089234383, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.02479250969425325, "sim_compute_performance-ego": 0.04330172461848105, "sim_compute_robot_state-ego": 0.045970955202656406, "sim_compute_robot_state-npc0": 0.044796170726899176, "sim_compute_robot_state-npc1": 0.04502468724404612, "sim_compute_robot_state-npc2": 0.04386217363419071, "sim_compute_robot_state-npc3": 0.043284243152987574}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03714516822327959, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.0507867970365159, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1212950107899118, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08466126310064438, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.030819230891288595, "sim_compute_performance-ego": 0.05695153804535561, "sim_compute_robot_state-ego": 0.0564777191649092, "sim_compute_robot_state-npc0": 0.05246540333362336, "sim_compute_robot_state-npc1": 0.05200648307800293, "sim_compute_robot_state-npc2": 0.05226805362295597, "sim_compute_robot_state-npc3": 0.05369020776545748}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.04899561405181885, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.07255591337497418, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1722251360233013, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.10376164087882409, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.041267573833465576, "sim_compute_performance-ego": 0.07555622320908767, "sim_compute_robot_state-ego": 0.08525939629628108, "sim_compute_robot_state-npc0": 0.07499982302005474, "sim_compute_robot_state-npc1": 0.07621587698276226, "sim_compute_robot_state-npc2": 0.07620617976555458, "sim_compute_robot_state-npc3": 0.07598810471021213}}
set_robot_commands_max	0.10376164087882409
set_robot_commands_mean	0.08232579667375468
set_robot_commands_median	0.08466126310064438
set_robot_commands_min	0.05954935089234383
sim_compute_performance-ego_max	0.07555622320908767
sim_compute_performance-ego_mean	0.058504626390447234
sim_compute_performance-ego_median	0.05695153804535561
sim_compute_performance-ego_min	0.04330172461848105
sim_compute_robot_state-ego_max	0.08525939629628108
sim_compute_robot_state-ego_mean	0.06234418280173676
sim_compute_robot_state-ego_median	0.0564777191649092
sim_compute_robot_state-ego_min	0.045970955202656406
sim_compute_robot_state-npc0_max	0.07499982302005474
sim_compute_robot_state-npc0_mean	0.058601655753717154
sim_compute_robot_state-npc0_median	0.05388883983387666
sim_compute_robot_state-npc0_min	0.044796170726899176
sim_compute_robot_state-npc1_max	0.07621587698276226
sim_compute_robot_state-npc1_mean	0.05857012693185972
sim_compute_robot_state-npc1_median	0.05419343125586416
sim_compute_robot_state-npc1_min	0.04502468724404612
sim_compute_robot_state-npc2_max	0.07620617976555458
sim_compute_robot_state-npc2_mean	0.05835813373164663
sim_compute_robot_state-npc2_median	0.05226805362295597
sim_compute_robot_state-npc2_min	0.04386217363419071
sim_compute_robot_state-npc3_max	0.07598810471021213
sim_compute_robot_state-npc3_mean	0.05806792537870272
sim_compute_robot_state-npc3_median	0.05369020776545748
sim_compute_robot_state-npc3_min	0.043284243152987574
sim_compute_sim_state_max	0.041267573833465576
sim_compute_sim_state_mean	0.03256575328851073
sim_compute_sim_state_median	0.030819230891288595
sim_compute_sim_state_min	0.02479250969425325
sim_physics_max	0.04899561405181885
sim_physics_mean	0.037992564711362246
sim_physics_median	0.03714516822327959
sim_physics_min	0.027872539034076764
sim_render-ego_max	0.07255591337497418
sim_render-ego_mean	0.05796690105669563
sim_render-ego_median	0.05655531789742264
sim_render-ego_min	0.04397447647586945
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

18279

2818

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:07:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.166051983833313
agent_compute-ego_mean	0.14498851926162715
agent_compute-ego_median	0.1426873803138733
agent_compute-ego_min	0.1320679727590309
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.022997073407443065, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05921552316197809, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1320679727590309, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08485387856105589, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03516536388757094, "sim_compute_performance-ego": 0.06112448674327922, "sim_compute_robot_state-ego": 0.06214054125659871}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.021814042871648617, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06430841034108942, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14090549403970892, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.09184265678579157, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03531711209904064, "sim_compute_performance-ego": 0.06549456444653598, "sim_compute_robot_state-ego": 0.07134312933141534}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.024500036239624025, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0619263384077284, "in-drivable-lane": 0, "agent_compute-ego": 0.14322976536220974, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08651497099134657, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03755075136820475, "sim_compute_performance-ego": 0.06514872974819608, "sim_compute_robot_state-ego": 0.07192144393920899}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.022495587666829422, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.057935227950414024, "in-drivable-lane": 0, "agent_compute-ego": 0.1426873803138733, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08284427722295125, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03595344225565592, "sim_compute_performance-ego": 0.058810800313949585, "sim_compute_robot_state-ego": 0.06173320114612579}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.026511851479025447, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07151123004801133, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.166051983833313, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.10374809713924632, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04111329597585341, "sim_compute_performance-ego": 0.07560863915611715, "sim_compute_robot_state-ego": 0.07904936636195463}}
set_robot_commands_max	0.10374809713924632
set_robot_commands_mean	0.08996077614007832
set_robot_commands_median	0.08651497099134657
set_robot_commands_min	0.08284427722295125
sim_compute_performance-ego_max	0.07560863915611715
sim_compute_performance-ego_mean	0.06523744408161561
sim_compute_performance-ego_median	0.06514872974819608
sim_compute_performance-ego_min	0.058810800313949585
sim_compute_robot_state-ego_max	0.07904936636195463
sim_compute_robot_state-ego_mean	0.06923753640706069
sim_compute_robot_state-ego_median	0.07134312933141534
sim_compute_robot_state-ego_min	0.06173320114612579
sim_compute_sim_state_max	0.04111329597585341
sim_compute_sim_state_mean	0.037019993117265136
sim_compute_sim_state_median	0.03595344225565592
sim_compute_sim_state_min	0.03516536388757094
sim_physics_max	0.026511851479025447
sim_physics_mean	0.023663718332914113
sim_physics_median	0.022997073407443065
sim_physics_min	0.021814042871648617
sim_render-ego_max	0.07151123004801133
sim_render-ego_mean	0.06297934598184425
sim_render-ego_median	0.0619263384077284
sim_render-ego_min	0.057935227950414024
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18275

2835

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:00:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18254

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

5 years, 11 months

0:05:17

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18236

2439

Jacopo Tani

random_agent

step1-simulation

success

5 years, 11 months

0:08:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.16962295069414027
agent_compute-ego_mean	0.153791580232016
agent_compute-ego_median	0.14812542633576828
agent_compute-ego_min	0.14240119722154404
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02314284162701301, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06157010906147507, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14294905482598072, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08825571132156085, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03570660555137778, "sim_compute_performance-ego": 0.06695162575199919, "sim_compute_robot_state-ego": 0.06918868928585413}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.02336949110031128, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0633815201846036, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14812542633576828, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0973821444944902, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.040418955412777985, "sim_compute_performance-ego": 0.0674968578598716, "sim_compute_robot_state-ego": 0.07430643926967274}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.023745256000094944, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06176024013095432, "in-drivable-lane": 0, "agent_compute-ego": 0.14240119722154404, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08932823075188531, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.037892479366726343, "sim_compute_performance-ego": 0.06421423488193088, "sim_compute_robot_state-ego": 0.07171555625067817}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02643222113450368, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06867470343907674, "in-drivable-lane": 0, "agent_compute-ego": 0.1658592720826467, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10321728885173798, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04202570021152496, "sim_compute_performance-ego": 0.07460477948188782, "sim_compute_robot_state-ego": 0.081918070713679}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.0292209456948673, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07027755064122818, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.16962295069414027, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.10483585035099705, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04205882198670331, "sim_compute_performance-ego": 0.07432021463618559, "sim_compute_robot_state-ego": 0.07848532410228953}}
set_robot_commands_max	0.10483585035099705
set_robot_commands_mean	0.09660384515413424
set_robot_commands_median	0.0973821444944902
set_robot_commands_min	0.08825571132156085
sim_compute_performance-ego_max	0.07460477948188782
sim_compute_performance-ego_mean	0.06951754252237502
sim_compute_performance-ego_median	0.0674968578598716
sim_compute_performance-ego_min	0.06421423488193088
sim_compute_robot_state-ego_max	0.081918070713679
sim_compute_robot_state-ego_mean	0.07512281592443472
sim_compute_robot_state-ego_median	0.07430643926967274
sim_compute_robot_state-ego_min	0.06918868928585413
sim_compute_sim_state_max	0.04205882198670331
sim_compute_sim_state_mean	0.03962051250582208
sim_compute_sim_state_median	0.040418955412777985
sim_compute_sim_state_min	0.03570660555137778
sim_physics_max	0.0292209456948673
sim_physics_mean	0.02518215111135804
sim_physics_median	0.023745256000094944
sim_physics_min	0.02314284162701301
sim_render-ego_max	0.07027755064122818
sim_render-ego_mean	0.06513282469146757
sim_render-ego_median	0.0633815201846036
sim_render-ego_min	0.06157010906147507
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18227

2538

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:02:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18216

2616

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:07:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.17404522985782264
agent_compute-ego_mean	0.15060917616141084
agent_compute-ego_median	0.14745421707630155
agent_compute-ego_min	0.11884862581888836
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03092618708340627, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.07153637904041218, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.17404522985782264, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.10651281644713204, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.042921911995365936, "sim_compute_performance-ego": 0.07779285592852898, "sim_compute_robot_state-ego": 0.08758028048389363}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.02384474060752175, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.07041649926792491, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1730452613397078, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.10810041969472713, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04176872426813299, "sim_compute_performance-ego": 0.07557103308764371, "sim_compute_robot_state-ego": 0.0823648138479753}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.0171377076043023, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05086525281270345, "in-drivable-lane": 0, "agent_compute-ego": 0.11884862581888836, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07151718669467502, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.029321728812323675, "sim_compute_performance-ego": 0.05338909890916613, "sim_compute_robot_state-ego": 0.05174462000528971}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.023087923725446064, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06127047538757324, "in-drivable-lane": 0, "agent_compute-ego": 0.14745421707630155, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09220337867736816, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.037267530957857765, "sim_compute_performance-ego": 0.06711442271868388, "sim_compute_robot_state-ego": 0.06610159079233806}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02353446273242726, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.058795399525586295, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1396525467143339, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08111905701020185, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03488394092111027, "sim_compute_performance-ego": 0.06075201665653902, "sim_compute_robot_state-ego": 0.06105654029285207}}
set_robot_commands_max	0.10810041969472713
set_robot_commands_mean	0.09189057170482084
set_robot_commands_median	0.09220337867736816
set_robot_commands_min	0.07151718669467502
sim_compute_performance-ego_max	0.07779285592852898
sim_compute_performance-ego_mean	0.06692388546011234
sim_compute_performance-ego_median	0.06711442271868388
sim_compute_performance-ego_min	0.05338909890916613
sim_compute_robot_state-ego_max	0.08758028048389363
sim_compute_robot_state-ego_mean	0.06976956908446975
sim_compute_robot_state-ego_median	0.06610159079233806
sim_compute_robot_state-ego_min	0.05174462000528971
sim_compute_sim_state_max	0.042921911995365936
sim_compute_sim_state_mean	0.03723276739095813
sim_compute_sim_state_median	0.037267530957857765
sim_compute_sim_state_min	0.029321728812323675
sim_physics_max	0.03092618708340627
sim_physics_mean	0.02370620435062073
sim_physics_median	0.02353446273242726
sim_physics_min	0.0171377076043023
sim_render-ego_max	0.07153637904041218
sim_render-ego_mean	0.06257680120684002
sim_render-ego_median	0.06127047538757324
sim_render-ego_min	0.05086525281270345
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18191

2804

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

5 years, 11 months

0:10:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.17070842139861164
agent_compute-ego_mean	0.14064249798595202
agent_compute-ego_median	0.1373847430607058
agent_compute-ego_min	0.11287521256340874
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.020472544544147996, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0566027839228792, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1373847430607058, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08030179311644356, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.034736889713215376, "sim_compute_performance-ego": 0.05956256164694732, "sim_compute_robot_state-ego": 0.06151747253705871}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.017031631686470726, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.04651680317792026, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.11396684429862282, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.06933544982563365, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.028848182071339, "sim_compute_performance-ego": 0.04911812327124856, "sim_compute_robot_state-ego": 0.04968340288509022}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01770319938659668, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.04813402493794759, "in-drivable-lane": 0, "agent_compute-ego": 0.11287521256340874, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07038119633992514, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.0306054327223036, "sim_compute_performance-ego": 0.04981485472785102, "sim_compute_robot_state-ego": 0.05193926493326823}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.031254847844441734, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.07011009256045024, "in-drivable-lane": 0, "agent_compute-ego": 0.16827726860841116, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10637276371320088, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04050868252913157, "sim_compute_performance-ego": 0.07346587876478831, "sim_compute_robot_state-ego": 0.07947032153606415}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.026974169646992403, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07042780693839579, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.17070842139861164, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.10903259936500996, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04129139465444228, "sim_compute_performance-ego": 0.07341315816430484, "sim_compute_robot_state-ego": 0.08092862367630005}}
set_robot_commands_max	0.10903259936500996
set_robot_commands_mean	0.08708476047204264
set_robot_commands_median	0.08030179311644356
set_robot_commands_min	0.06933544982563365
sim_compute_performance-ego_max	0.07346587876478831
sim_compute_performance-ego_mean	0.06107491531502801
sim_compute_performance-ego_median	0.05956256164694732
sim_compute_performance-ego_min	0.04911812327124856
sim_compute_robot_state-ego_max	0.08092862367630005
sim_compute_robot_state-ego_mean	0.06470781711355626
sim_compute_robot_state-ego_median	0.06151747253705871
sim_compute_robot_state-ego_min	0.04968340288509022
sim_compute_sim_state_max	0.04129139465444228
sim_compute_sim_state_mean	0.035198116338086366
sim_compute_sim_state_median	0.034736889713215376
sim_compute_sim_state_min	0.028848182071339
sim_physics_max	0.031254847844441734
sim_physics_mean	0.022687278621729905
sim_physics_median	0.020472544544147996
sim_physics_min	0.017031631686470726
sim_render-ego_max	0.07042780693839579
sim_render-ego_mean	0.058358302307518616
sim_render-ego_median	0.0566027839228792
sim_render-ego_min	0.04651680317792026
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18168

2832

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:05:12

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18156

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:11:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2342705027983982
survival_time_median	1.7500000000000009
deviation-center-line_median	0.10801953665034704
in-drivable-lane_median	0.7000000000000004

other stats

agent_compute-ego_max	0.14199242384537406
agent_compute-ego_mean	0.12389859582403392
agent_compute-ego_median	0.11542831148420062
agent_compute-ego_min	0.11084410122462682
deviation-center-line_max	0.17768774509810673
deviation-center-line_mean	0.08758489727910898
deviation-center-line_min	0.019005533143064354
deviation-heading_max	0.759385645220147
deviation-heading_mean	0.3195081252333424
deviation-heading_median	0.1806788823983304
deviation-heading_min	0.118601117425238
driven_any_max	2.812198352312563
driven_any_mean	1.6891781761410722
driven_any_median	1.608242001486626
driven_any_min	0.3130680825984642
driven_lanedir_consec_max	1.7389031534183392
driven_lanedir_consec_mean	0.9694700664283822
driven_lanedir_consec_min	0.28316071129320397
driven_lanedir_max	1.7389031534183392
driven_lanedir_mean	0.9694700664283822
driven_lanedir_median	1.2342705027983982
driven_lanedir_min	0.28316071129320397
in-drivable-lane_max	1.5999999999999988
in-drivable-lane_mean	0.7299999999999995
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.031230729559193485, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.0626777047696321, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.14199242384537406, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.08977446348770805, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.037306391674539315, "sim_compute_performance-ego": 0.10812824705372684, "sim_compute_robot_state-ego": 0.07179823129073433, "sim_compute_robot_state-npc0": 0.0633073267729386, "sim_compute_robot_state-npc1": 0.0642227089923361, "sim_compute_robot_state-npc2": 0.0649828288866126, "sim_compute_robot_state-npc3": 0.06214408252550208}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.034504198258922945, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.05815130664456275, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.1385893360260994, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.08486418185695525, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.03692435449169528, "sim_compute_performance-ego": 0.06118625210177514, "sim_compute_robot_state-ego": 0.06686919350777903, "sim_compute_robot_state-npc0": 0.0635512682699388, "sim_compute_robot_state-npc1": 0.0630883632167693, "sim_compute_robot_state-npc2": 0.0620149104825912, "sim_compute_robot_state-npc3": 0.06347593568986462}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.02318157468523298, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.05134286199297224, "in-drivable-lane": 0, "agent_compute-ego": 0.11542831148420062, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.07569783074515206, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.03243623461042132, "sim_compute_performance-ego": 0.05112062181745257, "sim_compute_robot_state-ego": 0.05323284012930734, "sim_compute_robot_state-npc0": 0.06375936099461146, "sim_compute_robot_state-npc1": 0.05890110560825893, "sim_compute_robot_state-npc2": 0.05670366968427386, "sim_compute_robot_state-npc3": 0.06095286778041294}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.022718334197998048, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.04744796071733747, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.11084410122462682, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.07238332203456334, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.027700574057442803, "sim_compute_performance-ego": 0.05085770743233817, "sim_compute_robot_state-ego": 0.05142371313912528, "sim_compute_robot_state-npc0": 0.04858671597072056, "sim_compute_robot_state-npc1": 0.05048356056213379, "sim_compute_robot_state-npc2": 0.05135841369628906, "sim_compute_robot_state-npc3": 0.05606036186218262}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.025608274671766493, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.04832498989407978, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.11263880653986856, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.06749243584890215, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.029929615202404204, "sim_compute_performance-ego": 0.04928319416348896, "sim_compute_robot_state-ego": 0.05179489226568313, "sim_compute_robot_state-npc0": 0.05315960399688236, "sim_compute_robot_state-npc1": 0.05075352532523019, "sim_compute_robot_state-npc2": 0.05084782933431958, "sim_compute_robot_state-npc3": 0.0524530221545507}}
set_robot_commands_max	0.08977446348770805
set_robot_commands_mean	0.07804244679465616
set_robot_commands_median	0.07569783074515206
set_robot_commands_min	0.06749243584890215
sim_compute_performance-ego_max	0.10812824705372684
sim_compute_performance-ego_mean	0.06411520451375635
sim_compute_performance-ego_median	0.05112062181745257
sim_compute_performance-ego_min	0.04928319416348896
sim_compute_robot_state-ego_max	0.07179823129073433
sim_compute_robot_state-ego_mean	0.05902377406652583
sim_compute_robot_state-ego_median	0.05323284012930734
sim_compute_robot_state-ego_min	0.05142371313912528
sim_compute_robot_state-npc0_max	0.06375936099461146
sim_compute_robot_state-npc0_mean	0.05847285520101836
sim_compute_robot_state-npc0_median	0.0633073267729386
sim_compute_robot_state-npc0_min	0.04858671597072056
sim_compute_robot_state-npc1_max	0.0642227089923361
sim_compute_robot_state-npc1_mean	0.05748985274094567
sim_compute_robot_state-npc1_median	0.05890110560825893
sim_compute_robot_state-npc1_min	0.05048356056213379
sim_compute_robot_state-npc2_max	0.0649828288866126
sim_compute_robot_state-npc2_mean	0.05718153041681726
sim_compute_robot_state-npc2_median	0.05670366968427386
sim_compute_robot_state-npc2_min	0.05084782933431958
sim_compute_robot_state-npc3_max	0.06347593568986462
sim_compute_robot_state-npc3_mean	0.059017254002502594
sim_compute_robot_state-npc3_median	0.06095286778041294
sim_compute_robot_state-npc3_min	0.0524530221545507
sim_compute_sim_state_max	0.037306391674539315
sim_compute_sim_state_mean	0.032859434007300584
sim_compute_sim_state_median	0.03243623461042132
sim_compute_sim_state_min	0.027700574057442803
sim_physics_max	0.034504198258922945
sim_physics_mean	0.027448622274622792
sim_physics_median	0.025608274671766493
sim_physics_min	0.022718334197998048
sim_render-ego_max	0.0626777047696321
sim_render-ego_mean	0.05358896480371687
sim_render-ego_median	0.05134286199297224
sim_render-ego_min	0.04744796071733747
simulation-passed	1
survival_time_max	3.149999999999997
survival_time_mean	1.899999999999999
survival_time_min	0.35

No reset possible

18153

2814

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

5 years, 11 months

0:05:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8171921272237834
survival_time_median	1.1000000000000003
deviation-center-line_median	0.025668493904927793
in-drivable-lane_median	0.04999999999999999

other stats

agent_compute-ego_max	0.09145561017488178
agent_compute-ego_mean	0.08669540634174672
agent_compute-ego_median	0.08524121408877165
agent_compute-ego_min	0.08471335305107965
deviation-center-line_max	0.057019386027434615
deviation-center-line_mean	0.03634226830745448
deviation-center-line_min	0.02280708605632212
deviation-heading_max	0.235756116193223
deviation-heading_mean	0.1638165081234764
deviation-heading_median	0.1411032446854075
deviation-heading_min	0.118601117425238
driven_any_max	1.028556309238097
driven_any_mean	0.8412197852214389
driven_any_median	0.956358012875939
driven_any_min	0.39300074524610096
driven_lanedir_consec_max	0.9648079053779924
driven_lanedir_consec_mean	0.6642871273891694
driven_lanedir_consec_min	0.31973792380899546
driven_lanedir_max	0.9648079053779924
driven_lanedir_mean	0.6642871273891694
driven_lanedir_median	0.8171921272237834
driven_lanedir_min	0.31973792380899546
in-drivable-lane_max	0.7000000000000004
in-drivable-lane_mean	0.1700000000000001
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.010421711465586786, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06757814987846043, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.08707420722298, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.05314645559891411, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.022226572036743164, "sim_compute_performance-ego": 0.037969288618668266, "sim_compute_robot_state-ego": 0.03906358843264372}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.010406172793844473, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.0373743720676588, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.08524121408877165, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.05408085947451384, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.022371727487315304, "sim_compute_performance-ego": 0.03749755154485288, "sim_compute_robot_state-ego": 0.03901063877603282}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.011353341015902432, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.03683184493671764, "in-drivable-lane": 0, "agent_compute-ego": 0.08499264717102051, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.059670209884643555, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.022790117697282272, "sim_compute_performance-ego": 0.03836502812125466, "sim_compute_robot_state-ego": 0.03926862369884144}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.012651337517632378, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.03706987698872884, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.08471335305107965, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.05255603790283203, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.02350004514058431, "sim_compute_performance-ego": 0.03740231196085612, "sim_compute_robot_state-ego": 0.03962323400709364}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.010889178828189247, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.03716817655061421, "in-drivable-lane": 0, "agent_compute-ego": 0.09145561017488178, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.05381633106030916, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.021934609664113897, "sim_compute_performance-ego": 0.03726025631553248, "sim_compute_robot_state-ego": 0.038743006555657634}}
set_robot_commands_max	0.059670209884643555
set_robot_commands_mean	0.05465397878424254
set_robot_commands_median	0.05381633106030916
set_robot_commands_min	0.05255603790283203
sim_compute_performance-ego_max	0.03836502812125466
sim_compute_performance-ego_mean	0.03769888731223288
sim_compute_performance-ego_median	0.03749755154485288
sim_compute_performance-ego_min	0.03726025631553248
sim_compute_robot_state-ego_max	0.03962323400709364
sim_compute_robot_state-ego_mean	0.039141818294053846
sim_compute_robot_state-ego_median	0.03906358843264372
sim_compute_robot_state-ego_min	0.038743006555657634
sim_compute_sim_state_max	0.02350004514058431
sim_compute_sim_state_mean	0.022564614405207788
sim_compute_sim_state_median	0.022371727487315304
sim_compute_sim_state_min	0.021934609664113897
sim_physics_max	0.012651337517632378
sim_physics_mean	0.011144348324231064
sim_physics_median	0.010889178828189247
sim_physics_min	0.010406172793844473
sim_render-ego_max	0.06757814987846043
sim_render-ego_mean	0.04320448408443599
sim_render-ego_median	0.03716817655061421
sim_render-ego_min	0.03683184493671764
simulation-passed	1
survival_time_max	1.1500000000000004
survival_time_mean	0.9600000000000004
survival_time_min	0.45

No reset possible

18131

2759

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:05:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24485310743273692
survival_time_median	1.0000000000000002
deviation-center-line_median	0.02780957766589444
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.05767548084259033
agent_compute-ego_mean	0.04717592854265858
agent_compute-ego_median	0.04526961550993078
agent_compute-ego_min	0.04188945293426514
deviation-center-line_max	0.1367821242164622
deviation-center-line_mean	0.05703768142247749
deviation-center-line_min	0.019515313732513393
deviation-heading_max	0.6295143987792059
deviation-heading_mean	0.33854872313755296
deviation-heading_median	0.3074760381865352
deviation-heading_min	0.16993642764665506
driven_any_max	0.9094890302704578
driven_any_mean	0.6148172530722962
driven_any_median	0.5457640496143875
driven_any_min	0.30227389810048894
driven_lanedir_consec_max	0.797287526441987
driven_lanedir_consec_mean	0.4211897171247365
driven_lanedir_consec_min	0.1644714808652381
driven_lanedir_max	0.797287526441987
driven_lanedir_mean	0.4229139258079286
driven_lanedir_median	0.24485310743273692
driven_lanedir_min	0.1644714808652381
in-drivable-lane_max	0.6500000000000002
in-drivable-lane_mean	0.2500000000000001
in-drivable-lane_min	0.04999999999999999
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.025756335258483885, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.05201034545898438, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.05767548084259033, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.08395911455154419, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.03451105356216431, "sim_compute_performance-ego": 0.05438735485076904, "sim_compute_robot_state-ego": 0.05881266593933106, "sim_compute_robot_state-npc0": 0.0595189094543457, "sim_compute_robot_state-npc1": 0.06016489267349243, "sim_compute_robot_state-npc2": 0.06183161735534668, "sim_compute_robot_state-npc3": 0.06012029647827148}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.022322612650254193, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.043440902934354896, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.04526961550993078, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.05532490505891688, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.024619523216696346, "sim_compute_performance-ego": 0.04213954420650706, "sim_compute_robot_state-ego": 0.042729672263650334, "sim_compute_robot_state-npc0": 0.04333144075730268, "sim_compute_robot_state-npc1": 0.0413368168999167, "sim_compute_robot_state-npc2": 0.0416116854723762, "sim_compute_robot_state-npc3": 0.04246633193072151}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.021898484230041503, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.03902778625488281, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.04188945293426514, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.05497398376464844, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.02285037040710449, "sim_compute_performance-ego": 0.043068957328796384, "sim_compute_robot_state-ego": 0.044974875450134275, "sim_compute_robot_state-npc0": 0.03966896533966065, "sim_compute_robot_state-npc1": 0.0409031867980957, "sim_compute_robot_state-npc2": 0.04108695983886719, "sim_compute_robot_state-npc3": 0.03968100547790528}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.02225773675101144, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.044589723859514506, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.04629777159009661, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.06298409189496722, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.025818475655147007, "sim_compute_performance-ego": 0.04528330905096872, "sim_compute_robot_state-ego": 0.048540711402893066, "sim_compute_robot_state-npc0": 0.04617920943668911, "sim_compute_robot_state-npc1": 0.04719902787889753, "sim_compute_robot_state-npc2": 0.046732451234545024, "sim_compute_robot_state-npc3": 0.046532588345663886}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.019161332038141063, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.04052541332860147, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.04474732183641003, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.057518805226972024, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.02343132418970908, "sim_compute_performance-ego": 0.04250617181101153, "sim_compute_robot_state-ego": 0.0433342533726846, "sim_compute_robot_state-npc0": 0.04449624399985037, "sim_compute_robot_state-npc1": 0.042685124181932016, "sim_compute_robot_state-npc2": 0.042835320195844094, "sim_compute_robot_state-npc3": 0.04102540016174317}}
set_robot_commands_max	0.08395911455154419
set_robot_commands_mean	0.06295218009940974
set_robot_commands_median	0.057518805226972024
set_robot_commands_min	0.05497398376464844
sim_compute_performance-ego_max	0.05438735485076904
sim_compute_performance-ego_mean	0.04547706744961054
sim_compute_performance-ego_median	0.043068957328796384
sim_compute_performance-ego_min	0.04213954420650706
sim_compute_robot_state-ego_max	0.05881266593933106
sim_compute_robot_state-ego_mean	0.047678435685738665
sim_compute_robot_state-ego_median	0.044974875450134275
sim_compute_robot_state-ego_min	0.042729672263650334
sim_compute_robot_state-npc0_max	0.0595189094543457
sim_compute_robot_state-npc0_mean	0.0466389537975697
sim_compute_robot_state-npc0_median	0.04449624399985037
sim_compute_robot_state-npc0_min	0.03966896533966065
sim_compute_robot_state-npc1_max	0.06016489267349243
sim_compute_robot_state-npc1_mean	0.04645780968646687
sim_compute_robot_state-npc1_median	0.042685124181932016
sim_compute_robot_state-npc1_min	0.0409031867980957
sim_compute_robot_state-npc2_max	0.06183161735534668
sim_compute_robot_state-npc2_mean	0.04681960681939584
sim_compute_robot_state-npc2_median	0.042835320195844094
sim_compute_robot_state-npc2_min	0.04108695983886719
sim_compute_robot_state-npc3_max	0.06012029647827148
sim_compute_robot_state-npc3_mean	0.045965124478861065
sim_compute_robot_state-npc3_median	0.04246633193072151
sim_compute_robot_state-npc3_min	0.03968100547790528
sim_compute_sim_state_max	0.03451105356216431
sim_compute_sim_state_mean	0.026246149406164248
sim_compute_sim_state_median	0.024619523216696346
sim_compute_sim_state_min	0.02285037040710449
sim_physics_max	0.025756335258483885
sim_physics_mean	0.022279300185586416
sim_physics_median	0.02225773675101144
sim_physics_min	0.019161332038141063
sim_render-ego_max	0.05201034545898438
sim_render-ego_mean	0.04391883436726761
sim_render-ego_median	0.043440902934354896
sim_render-ego_min	0.03902778625488281
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.0600000000000005
survival_time_min	0.49999999999999994

No reset possible

18125

2763

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

5 years, 11 months

0:07:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2448526305955765
survival_time_median	1.0000000000000002
deviation-center-line_median	0.02780956837444773
in-drivable-lane_median	0.4500000000000001

other stats

agent_compute-ego_max	0.0827965158404726
agent_compute-ego_mean	0.07559458852876741
agent_compute-ego_median	0.07758387327194213
agent_compute-ego_min	0.06726436614990235
deviation-center-line_max	0.1257230388091751
deviation-center-line_mean	0.05577343615770758
deviation-center-line_min	0.01951527185289407
deviation-heading_max	0.5595345336423936
deviation-heading_mean	0.32175424111925316
deviation-heading_median	0.3074760381865353
deviation-heading_min	0.16993642764665495
driven_any_max	1.135775595781212
driven_any_mean	0.7105521201006961
driven_any_median	0.5457640496143795
driven_any_min	0.3022738981004901
driven_lanedir_consec_max	0.8171012478585276
driven_lanedir_consec_mean	0.42515260445919045
driven_lanedir_consec_min	0.164471242446655
driven_lanedir_max	0.8171012478585276
driven_lanedir_mean	0.4357084916634508
driven_lanedir_median	0.2448526305955765
driven_lanedir_min	0.164471242446655
in-drivable-lane_max	0.6500000000000002
in-drivable-lane_mean	0.38000000000000017
in-drivable-lane_min	0.04999999999999999
per-episodes	details {"udem1-0-0": {"driven_any": 0.5457640496143795, "sim_physics": 0.04196057319641113, "survival_time": 1.0000000000000002, "driven_lanedir": 0.164471242446655, "sim_render-ego": 0.06884256601333619, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.07758387327194213, "deviation-heading": 0.18758204257854744, "set_robot_commands": 0.1014352321624756, "deviation-center-line": 0.01951527185289407, "driven_lanedir_consec": 0.164471242446655, "sim_compute_sim_state": 0.038642263412475585, "sim_compute_performance-ego": 0.06828436851501465, "sim_compute_robot_state-ego": 0.07706122398376465, "sim_compute_robot_state-npc0": 0.07054706811904907, "sim_compute_robot_state-npc1": 0.06775623559951782, "sim_compute_robot_state-npc2": 0.06580871343612671, "sim_compute_robot_state-npc3": 0.06718298196792602}, "udem1-1-0": {"driven_any": 0.5108934139126888, "sim_physics": 0.03536049057455624, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120319035776863, "sim_render-ego": 0.05600723098306095, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.06768515530754537, "deviation-heading": 0.3074760381865353, "set_robot_commands": 0.08553970561308019, "deviation-center-line": 0.02399913959382396, "driven_lanedir_consec": 0.1725821469418083, "sim_compute_sim_state": 0.037354286979226506, "sim_compute_performance-ego": 0.05964928514817182, "sim_compute_robot_state-ego": 0.06390250430387609, "sim_compute_robot_state-npc0": 0.06697355999666102, "sim_compute_robot_state-npc1": 0.06533572253058939, "sim_compute_robot_state-npc2": 0.06921897215001724, "sim_compute_robot_state-npc3": 0.06711944411782657}, "udem1-2-0": {"driven_any": 0.3022738981004901, "sim_physics": 0.05498483180999756, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955765, "sim_render-ego": 0.07431738376617432, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.08264303207397461, "deviation-heading": 0.16993642764665495, "set_robot_commands": 0.11439497470855713, "deviation-center-line": 0.02780956837444773, "driven_lanedir_consec": 0.2448526305955765, "sim_compute_sim_state": 0.03926968574523926, "sim_compute_performance-ego": 0.07306318283081055, "sim_compute_robot_state-ego": 0.08891410827636718, "sim_compute_robot_state-npc0": 0.07462360858917236, "sim_compute_robot_state-npc1": 0.07392127513885498, "sim_compute_robot_state-npc2": 0.07034058570861816, "sim_compute_robot_state-npc3": 0.06972041130065917}, "udem1-3-0": {"driven_any": 1.135775595781212, "sim_physics": 0.03840819001197815, "survival_time": 2.000000000000001, "driven_lanedir": 0.7709141470587263, "sim_render-ego": 0.064175546169281, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.06726436614990235, "deviation-heading": 0.3842421635421346, "set_robot_commands": 0.09282957315444948, "deviation-center-line": 0.08182016215819705, "driven_lanedir_consec": 0.7267557544533849, "sim_compute_sim_state": 0.03719984292984009, "sim_compute_performance-ego": 0.06677330136299134, "sim_compute_robot_state-ego": 0.07477616667747497, "sim_compute_robot_state-npc0": 0.06622142791748047, "sim_compute_robot_state-npc1": 0.06660382151603698, "sim_compute_robot_state-npc2": 0.06375371217727661, "sim_compute_robot_state-npc3": 0.06761605739593506}, "udem1-4-0": {"driven_any": 1.05805364309471, "sim_physics": 0.04021125851255475, "survival_time": 1.6500000000000008, "driven_lanedir": 0.8171012478585276, "sim_render-ego": 0.06951048879912405, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.0827965158404726, "deviation-heading": 0.5595345336423936, "set_robot_commands": 0.10948850891806862, "deviation-center-line": 0.1257230388091751, "driven_lanedir_consec": 0.8171012478585276, "sim_compute_sim_state": 0.042906883991125855, "sim_compute_performance-ego": 0.07545748623934659, "sim_compute_robot_state-ego": 0.08093377315636838, "sim_compute_robot_state-npc0": 0.07476110169381807, "sim_compute_robot_state-npc1": 0.07388767329129306, "sim_compute_robot_state-npc2": 0.0732686591870857, "sim_compute_robot_state-npc3": 0.07357215881347656}}
set_robot_commands_max	0.11439497470855713
set_robot_commands_mean	0.1007375989113262
set_robot_commands_median	0.1014352321624756
set_robot_commands_min	0.08553970561308019
sim_compute_performance-ego_max	0.07545748623934659
sim_compute_performance-ego_mean	0.06864552481926697
sim_compute_performance-ego_median	0.06828436851501465
sim_compute_performance-ego_min	0.05964928514817182
sim_compute_robot_state-ego_max	0.08891410827636718
sim_compute_robot_state-ego_mean	0.07711755527957027
sim_compute_robot_state-ego_median	0.07706122398376465
sim_compute_robot_state-ego_min	0.06390250430387609
sim_compute_robot_state-npc0_max	0.07476110169381807
sim_compute_robot_state-npc0_mean	0.07062535326323618
sim_compute_robot_state-npc0_median	0.07054706811904907
sim_compute_robot_state-npc0_min	0.06622142791748047
sim_compute_robot_state-npc1_max	0.07392127513885498
sim_compute_robot_state-npc1_mean	0.06950094561525846
sim_compute_robot_state-npc1_median	0.06775623559951782
sim_compute_robot_state-npc1_min	0.06533572253058939
sim_compute_robot_state-npc2_max	0.0732686591870857
sim_compute_robot_state-npc2_mean	0.06847812853182488
sim_compute_robot_state-npc2_median	0.06921897215001724
sim_compute_robot_state-npc2_min	0.06375371217727661
sim_compute_robot_state-npc3_max	0.07357215881347656
sim_compute_robot_state-npc3_mean	0.06904221071916468
sim_compute_robot_state-npc3_median	0.06761605739593506
sim_compute_robot_state-npc3_min	0.06711944411782657
sim_compute_sim_state_max	0.042906883991125855
sim_compute_sim_state_mean	0.03907459261158146
sim_compute_sim_state_median	0.038642263412475585
sim_compute_sim_state_min	0.03719984292984009
sim_physics_max	0.05498483180999756
sim_physics_mean	0.04218506882109956
sim_physics_median	0.04021125851255475
sim_physics_min	0.03536049057455624
sim_render-ego_max	0.07431738376617432
sim_render-ego_mean	0.06657064314619529
sim_render-ego_median	0.06884256601333619
sim_render-ego_min	0.05600723098306095
simulation-passed	1
survival_time_max	2.000000000000001
survival_time_mean	1.2000000000000004
survival_time_min	0.49999999999999994

No reset possible

18121

2782

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:00:29

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18116

2767

challenge-aido_LF-baseline-duckietown

step1-simulation

success

5 years, 11 months

0:09:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.00377789173911
survival_time_median	3.2499999999999964
deviation-center-line_median	0.21900935794473772
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.11267105464277596
agent_compute-ego_mean	0.09543570109323644
agent_compute-ego_median	0.10165862447207737
agent_compute-ego_min	0.07468362384372287
deviation-center-line_max	0.4689770137756189
deviation-center-line_mean	0.27364886169306224
deviation-center-line_min	0.10341927340234486
deviation-heading_max	1.712969333416413
deviation-heading_mean	0.8847821986249963
deviation-heading_median	0.7288577096427167
deviation-heading_min	0.2991384123178083
driven_any_max	1.670490923274393
driven_any_mean	1.0890541057135028
driven_any_median	1.0441270996059235
driven_any_min	0.4499043899468171
driven_lanedir_consec_max	1.1975698954357283
driven_lanedir_consec_mean	0.8846475566873979
driven_lanedir_consec_min	0.42343885474379217
driven_lanedir_max	1.3404805640356794
driven_lanedir_mean	0.9510849025026444
driven_lanedir_median	1.00377789173911
driven_lanedir_min	0.42343885474379217
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.19999999999999973
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4499043899468171, "sim_physics": 0.022191623161579, "survival_time": 1.4500000000000006, "driven_lanedir": 0.42343885474379217, "sim_render-ego": 0.07587921208348768, "in-drivable-lane": 0, "agent_compute-ego": 0.11267105464277596, "deviation-heading": 0.37026540014673776, "set_robot_commands": 0.10920865782375994, "deviation-center-line": 0.10341927340234486, "driven_lanedir_consec": 0.42343885474379217, "sim_compute_sim_state": 0.04366890315351815, "sim_compute_performance-ego": 0.07492797950218463, "sim_compute_robot_state-ego": 0.08139749231009648}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.670490923274393, "sim_physics": 0.02399386350925152, "survival_time": 5.1999999999999895, "driven_lanedir": 1.3404805640356794, "sim_render-ego": 0.07212215203505296, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.10325958178593564, "deviation-heading": 1.712969333416413, "set_robot_commands": 0.10832742085823646, "deviation-center-line": 0.4689770137756189, "driven_lanedir_consec": 1.1975698954357283, "sim_compute_sim_state": 0.04325931347333468, "sim_compute_performance-ego": 0.07625634395159207, "sim_compute_robot_state-ego": 0.07978655283267681}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5575616359432174, "sim_physics": 0.02820304251208748, "survival_time": 4.849999999999991, "driven_lanedir": 1.273019160902614, "sim_render-ego": 0.06170975055891214, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.10165862447207737, "deviation-heading": 1.3126801376013055, "set_robot_commands": 0.09522835003960992, "deviation-center-line": 0.3948617812457469, "driven_lanedir_consec": 1.0837431004263314, "sim_compute_sim_state": 0.03711066786775884, "sim_compute_performance-ego": 0.0666542200698066, "sim_compute_robot_state-ego": 0.06947647910757163}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7231864797971632, "sim_physics": 0.0149008486005995, "survival_time": 2.25, "driven_lanedir": 0.7147080410920275, "sim_render-ego": 0.04953182538350423, "in-drivable-lane": 0, "agent_compute-ego": 0.07468362384372287, "deviation-heading": 0.2991384123178083, "set_robot_commands": 0.06808371543884277, "deviation-center-line": 0.21900935794473772, "driven_lanedir_consec": 0.7147080410920275, "sim_compute_sim_state": 0.030440876219007703, "sim_compute_performance-ego": 0.05101411607530382, "sim_compute_robot_state-ego": 0.05351631376478407}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0441270996059235, "sim_physics": 0.01980598523066594, "survival_time": 3.2499999999999964, "driven_lanedir": 1.00377789173911, "sim_render-ego": 0.05860242476830116, "in-drivable-lane": 0, "agent_compute-ego": 0.0849056207216703, "deviation-heading": 0.7288577096427167, "set_robot_commands": 0.0861020565032959, "deviation-center-line": 0.18197688209686272, "driven_lanedir_consec": 1.00377789173911, "sim_compute_sim_state": 0.03428699053250826, "sim_compute_performance-ego": 0.06059406720674955, "sim_compute_robot_state-ego": 0.06379367388211764}}
set_robot_commands_max	0.10920865782375994
set_robot_commands_mean	0.093390040132749
set_robot_commands_median	0.09522835003960992
set_robot_commands_min	0.06808371543884277
sim_compute_performance-ego_max	0.07625634395159207
sim_compute_performance-ego_mean	0.06588934536112732
sim_compute_performance-ego_median	0.0666542200698066
sim_compute_performance-ego_min	0.05101411607530382
sim_compute_robot_state-ego_max	0.08139749231009648
sim_compute_robot_state-ego_mean	0.06959410237944932
sim_compute_robot_state-ego_median	0.06947647910757163
sim_compute_robot_state-ego_min	0.05351631376478407
sim_compute_sim_state_max	0.04366890315351815
sim_compute_sim_state_mean	0.03775335024922553
sim_compute_sim_state_median	0.03711066786775884
sim_compute_sim_state_min	0.030440876219007703
sim_physics_max	0.02820304251208748
sim_physics_mean	0.021819072602836685
sim_physics_median	0.022191623161579
sim_physics_min	0.0149008486005995
sim_render-ego_max	0.07587921208348768
sim_render-ego_mean	0.06356907296585164
sim_render-ego_median	0.06170975055891214
sim_render-ego_min	0.04953182538350423
simulation-passed	1
survival_time_max	5.1999999999999895
survival_time_mean	3.399999999999996
survival_time_min	1.4500000000000006

No reset possible

18115

2775

challenge-aido_LF-baseline-duckietown

step1-simulation

success

5 years, 11 months

0:13:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4380281995450126
survival_time_median	1.4000000000000006
deviation-center-line_median	0.106411290574279
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1286796530087789
agent_compute-ego_mean	0.1185618458234612
agent_compute-ego_median	0.12050384283065796
agent_compute-ego_min	0.10315867892482825
deviation-center-line_max	0.5428254881206602
deviation-center-line_mean	0.17342522915527556
deviation-center-line_min	0.010333848408794314
deviation-heading_max	0.8533642139079881
deviation-heading_mean	0.390217352251184
deviation-heading_median	0.2916676473310767
deviation-heading_min	0.2183616345419603
driven_any_max	1.8314424703628416
driven_any_mean	0.6745625204646781
driven_any_median	0.4499875272582833
driven_any_min	0.19211274131712497
driven_lanedir_consec_max	1.8017042703448944
driven_lanedir_consec_mean	0.633144830007711
driven_lanedir_consec_min	0.08627980441581551
driven_lanedir_max	1.8017042703448944
driven_lanedir_mean	0.633144830007711
driven_lanedir_median	0.4380281995450126
driven_lanedir_min	0.08627980441581551
in-drivable-lane_max	0.2
in-drivable-lane_mean	0.05000000000000001
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6266965227179437, "sim_physics": 0.04033440351486206, "survival_time": 2.000000000000001, "driven_lanedir": 0.6184231155724815, "sim_render-ego": 0.0696284294128418, "in-drivable-lane": 0, "agent_compute-ego": 0.1142910897731781, "deviation-heading": 0.2807729960802725, "set_robot_commands": 0.10584145188331603, "deviation-center-line": 0.16224057457720903, "driven_lanedir_consec": 0.6184231155724815, "sim_compute_sim_state": 0.04246671199798584, "sim_compute_performance-ego": 0.07531000971794129, "sim_compute_robot_state-ego": 0.07745130062103271, "sim_compute_robot_state-npc0": 0.07302354574203491, "sim_compute_robot_state-npc1": 0.0751651644706726, "sim_compute_robot_state-npc2": 0.07705407738685607, "sim_compute_robot_state-npc3": 0.07526472806930543}, "udem1-1-0": {"driven_any": 0.19211274131712497, "sim_physics": 0.04280310869216919, "survival_time": 0.6, "driven_lanedir": 0.08627980441581551, "sim_render-ego": 0.07601120074590047, "in-drivable-lane": 0.2, "agent_compute-ego": 0.1286796530087789, "deviation-heading": 0.2183616345419603, "set_robot_commands": 0.09943924347559611, "deviation-center-line": 0.010333848408794314, "driven_lanedir_consec": 0.08627980441581551, "sim_compute_sim_state": 0.0423134962717692, "sim_compute_performance-ego": 0.07447018225987752, "sim_compute_robot_state-ego": 0.07829670111338298, "sim_compute_robot_state-npc0": 0.07900847991307576, "sim_compute_robot_state-npc1": 0.07555588086446126, "sim_compute_robot_state-npc2": 0.07629720369974773, "sim_compute_robot_state-npc3": 0.07671119769414265}, "udem1-2-0": {"driven_any": 0.4499875272582833, "sim_physics": 0.053603129727499824, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4380281995450126, "sim_render-ego": 0.07414657729012626, "in-drivable-lane": 0, "agent_compute-ego": 0.12050384283065796, "deviation-heading": 0.30692026939462275, "set_robot_commands": 0.11508550814219884, "deviation-center-line": 0.106411290574279, "driven_lanedir_consec": 0.4380281995450126, "sim_compute_sim_state": 0.04065131289618356, "sim_compute_performance-ego": 0.07568073272705078, "sim_compute_robot_state-ego": 0.08445321662085396, "sim_compute_robot_state-npc0": 0.07427717958177839, "sim_compute_robot_state-npc1": 0.07354600088936943, "sim_compute_robot_state-npc2": 0.07629989726202828, "sim_compute_robot_state-npc3": 0.07803589957101005}, "udem1-3-0": {"driven_any": 0.27257334066719685, "sim_physics": 0.04925984494826373, "survival_time": 0.8500000000000002, "driven_lanedir": 0.22128876016035148, "sim_render-ego": 0.07461599742665011, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.12617596457986271, "deviation-heading": 0.2916676473310767, "set_robot_commands": 0.11036327305962056, "deviation-center-line": 0.04531494409543524, "driven_lanedir_consec": 0.22128876016035148, "sim_compute_sim_state": 0.04352102560155532, "sim_compute_performance-ego": 0.07561957134920008, "sim_compute_robot_state-ego": 0.08854924931245692, "sim_compute_robot_state-npc0": 0.07519019351286046, "sim_compute_robot_state-npc1": 0.07885799688451431, "sim_compute_robot_state-npc2": 0.07079233842737534, "sim_compute_robot_state-npc3": 0.07246432584874771}, "udem1-4-0": {"driven_any": 1.8314424703628416, "sim_physics": 0.04543664371758176, "survival_time": 5.699999999999988, "driven_lanedir": 1.8017042703448944, "sim_render-ego": 0.07012386698471873, "in-drivable-lane": 0, "agent_compute-ego": 0.10315867892482825, "deviation-heading": 0.8533642139079881, "set_robot_commands": 0.10489945662649054, "deviation-center-line": 0.5428254881206602, "driven_lanedir_consec": 1.8017042703448944, "sim_compute_sim_state": 0.0423944958469324, "sim_compute_performance-ego": 0.07278559291571901, "sim_compute_robot_state-ego": 0.07810851983856737, "sim_compute_robot_state-npc0": 0.07447769767359684, "sim_compute_robot_state-npc1": 0.07575564635427375, "sim_compute_robot_state-npc2": 0.07444706506896437, "sim_compute_robot_state-npc3": 0.07279124176293089}}
set_robot_commands_max	0.11508550814219884
set_robot_commands_mean	0.10712578663744445
set_robot_commands_median	0.10584145188331603
set_robot_commands_min	0.09943924347559611
sim_compute_performance-ego_max	0.07568073272705078
sim_compute_performance-ego_mean	0.07477321779395774
sim_compute_performance-ego_median	0.07531000971794129
sim_compute_performance-ego_min	0.07278559291571901
sim_compute_robot_state-ego_max	0.08854924931245692
sim_compute_robot_state-ego_mean	0.08137179750125878
sim_compute_robot_state-ego_median	0.07829670111338298
sim_compute_robot_state-ego_min	0.07745130062103271
sim_compute_robot_state-npc0_max	0.07900847991307576
sim_compute_robot_state-npc0_mean	0.07519541928466927
sim_compute_robot_state-npc0_median	0.07447769767359684
sim_compute_robot_state-npc0_min	0.07302354574203491
sim_compute_robot_state-npc1_max	0.07885799688451431
sim_compute_robot_state-npc1_mean	0.07577613789265826
sim_compute_robot_state-npc1_median	0.07555588086446126
sim_compute_robot_state-npc1_min	0.07354600088936943
sim_compute_robot_state-npc2_max	0.07705407738685607
sim_compute_robot_state-npc2_mean	0.07497811636899436
sim_compute_robot_state-npc2_median	0.07629720369974773
sim_compute_robot_state-npc2_min	0.07079233842737534
sim_compute_robot_state-npc3_max	0.07803589957101005
sim_compute_robot_state-npc3_mean	0.07505347858922734
sim_compute_robot_state-npc3_median	0.07526472806930543
sim_compute_robot_state-npc3_min	0.07246432584874771
sim_compute_sim_state_max	0.04352102560155532
sim_compute_sim_state_mean	0.042269408522885264
sim_compute_sim_state_median	0.0423944958469324
sim_compute_sim_state_min	0.04065131289618356
sim_physics_max	0.053603129727499824
sim_physics_mean	0.04628742612007532
sim_physics_median	0.04543664371758176
sim_physics_min	0.04033440351486206
sim_render-ego_max	0.07601120074590047
sim_render-ego_mean	0.07290521437204747
sim_render-ego_median	0.07414657729012626
sim_render-ego_min	0.0696284294128418
simulation-passed	1
survival_time_max	5.699999999999988
survival_time_mean	2.109999999999998
survival_time_min	0.6

No reset possible

18110

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

5 years, 11 months

0:20:45

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18106

2738

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:20:32

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18104

2739

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

5 years, 11 months

0:20:38

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18095

2725

test for ppo

step1-simulation

success

5 years, 11 months

0:10:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08687258338167902
survival_time_median	5.899999999999987
deviation-center-line_median	0.26198528385887015
in-drivable-lane_median	3.3499999999999943

other stats

agent_compute-ego_max	0.21642049153645831
agent_compute-ego_mean	0.1272842112163625
agent_compute-ego_median	0.10507031281789143
agent_compute-ego_min	0.09187430601853593
deviation-center-line_max	0.6883609878463818
deviation-center-line_mean	0.31446968852239193
deviation-center-line_min	0.03377302674005832
deviation-heading_max	5.069538199715202
deviation-heading_mean	2.4025002846918064
deviation-heading_median	1.9089066313664245
deviation-heading_min	0.5919317495046125
driven_any_max	6.915106228268957
driven_any_mean	3.627909229903539
driven_any_median	3.0450337392173283
driven_any_min	1.0853723398467976
driven_lanedir_consec_max	0.23127888244849035
driven_lanedir_consec_mean	0.08730398066882286
driven_lanedir_consec_min	-0.03993076062471079
driven_lanedir_max	0.18455346935000172
driven_lanedir_mean	0.08719563168430358
driven_lanedir_median	0.15728097635583738
driven_lanedir_min	-0.05799416955069159
in-drivable-lane_max	7.850000000000037
in-drivable-lane_mean	3.7400000000000033
in-drivable-lane_min	1.0000000000000004
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0450337392173283, "sim_physics": 0.018011790210917845, "survival_time": 5.899999999999987, "driven_lanedir": -0.05799416955069159, "sim_render-ego": 0.05196632773189221, "in-drivable-lane": 3.3499999999999943, "agent_compute-ego": 0.13069990125753111, "deviation-heading": 1.741544460913278, "set_robot_commands": 0.0756000886529179, "deviation-center-line": 0.26198528385887015, "driven_lanedir_consec": 0.08687258338167902, "sim_compute_sim_state": 0.0307111942161948, "sim_compute_performance-ego": 0.05470225972644353, "sim_compute_robot_state-ego": 0.05696787268428479}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0853723398467976, "sim_physics": 0.026146034399668377, "survival_time": 1.800000000000001, "driven_lanedir": 0.15728097635583738, "sim_render-ego": 0.06986796193652683, "in-drivable-lane": 1.0000000000000004, "agent_compute-ego": 0.21642049153645831, "deviation-heading": 0.5919317495046125, "set_robot_commands": 0.10302443636788262, "deviation-center-line": 0.03377302674005832, "driven_lanedir_consec": 0.15182855124551153, "sim_compute_sim_state": 0.04267093208101061, "sim_compute_performance-ego": 0.07278969552781847, "sim_compute_robot_state-ego": 0.0882815851105584}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.383202358518504, "sim_physics": 0.012751433111372447, "survival_time": 8.399999999999984, "driven_lanedir": 0.18455346935000172, "sim_render-ego": 0.04088383913040161, "in-drivable-lane": 4.14999999999999, "agent_compute-ego": 0.10507031281789143, "deviation-heading": 2.7005803819595156, "set_robot_commands": 0.06102209289868673, "deviation-center-line": 0.3780771210502041, "driven_lanedir_consec": 0.23127888244849035, "sim_compute_sim_state": 0.02497043496086484, "sim_compute_performance-ego": 0.042460701295307705, "sim_compute_robot_state-ego": 0.04492469344820295}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.710831483666113, "sim_physics": 0.011290353078108568, "survival_time": 5.1999999999999895, "driven_lanedir": -0.024114024740600204, "sim_render-ego": 0.03704312672981849, "in-drivable-lane": 2.3499999999999956, "agent_compute-ego": 0.09187430601853593, "deviation-heading": 1.9089066313664245, "set_robot_commands": 0.05467721361380357, "deviation-center-line": 0.2101520231164452, "driven_lanedir_consec": -0.03993076062471079, "sim_compute_sim_state": 0.022053622282468356, "sim_compute_performance-ego": 0.03777478979184078, "sim_compute_robot_state-ego": 0.039249880955769464}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 6.915106228268957, "sim_physics": 0.010484100977579751, "survival_time": 14.950000000000076, "driven_lanedir": 0.17625190700697058, "sim_render-ego": 0.03679489612579346, "in-drivable-lane": 7.850000000000037, "agent_compute-ego": 0.09235604445139568, "deviation-heading": 5.069538199715202, "set_robot_commands": 0.05420970439910889, "deviation-center-line": 0.6883609878463818, "driven_lanedir_consec": 0.0064706468931441385, "sim_compute_sim_state": 0.021789713700612383, "sim_compute_performance-ego": 0.037346846262613934, "sim_compute_robot_state-ego": 0.03895078976949056}}
set_robot_commands_max	0.10302443636788262
set_robot_commands_mean	0.06970670718647995
set_robot_commands_median	0.06102209289868673
set_robot_commands_min	0.05420970439910889
sim_compute_performance-ego_max	0.07278969552781847
sim_compute_performance-ego_mean	0.04901485852080488
sim_compute_performance-ego_median	0.042460701295307705
sim_compute_performance-ego_min	0.037346846262613934
sim_compute_robot_state-ego_max	0.0882815851105584
sim_compute_robot_state-ego_mean	0.05367496439366124
sim_compute_robot_state-ego_median	0.04492469344820295
sim_compute_robot_state-ego_min	0.03895078976949056
sim_compute_sim_state_max	0.04267093208101061
sim_compute_sim_state_mean	0.02843917944823019
sim_compute_sim_state_median	0.02497043496086484
sim_compute_sim_state_min	0.021789713700612383
sim_physics_max	0.026146034399668377
sim_physics_mean	0.015736742355529396
sim_physics_median	0.012751433111372447
sim_physics_min	0.010484100977579751
sim_render-ego_max	0.06986796193652683
sim_render-ego_mean	0.04731123033088652
sim_render-ego_median	0.04088383913040161
sim_render-ego_min	0.03679489612579346
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.250000000000009
survival_time_min	1.800000000000001

No reset possible

18094

2724

test for ppo

step1-simulation

error

5 years, 11 months

0:01:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18085

2703

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

5 years, 11 months

0:13:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.093761755921926
survival_time_median	5.4999999999999885
deviation-center-line_median	0.4939356602264637
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.06904124456738668
agent_compute-ego_mean	0.06729928439757996
agent_compute-ego_median	0.06689542531967163
agent_compute-ego_min	0.06675558810611423
deviation-center-line_max	0.7683076077633
deviation-center-line_mean	0.4812443430749914
deviation-center-line_min	0.24954940935417227
deviation-heading_max	4.692034420026289
deviation-heading_mean	2.0146753021023196
deviation-heading_median	1.6222145410168505
deviation-heading_min	0.4681622403509476
driven_any_max	4.7952460973249655
driven_any_mean	2.2017432142104463
driven_any_median	1.764845879789246
driven_any_min	1.0122426511141909
driven_lanedir_consec_max	1.754608790613027
driven_lanedir_consec_mean	1.1993777998005577
driven_lanedir_consec_min	0.9548999478863592
driven_lanedir_max	2.8007520710813
driven_lanedir_mean	1.6536679987622431
driven_lanedir_median	1.4853911586277155
driven_lanedir_min	0.994819140633679
in-drivable-lane_max	4.500000000000023
in-drivable-lane_mean	1.080000000000004
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1998616748949074, "sim_physics": 0.015810930471626117, "survival_time": 6.949999999999983, "driven_lanedir": 1.893615867546596, "sim_render-ego": 0.05372404023040113, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.06675558810611423, "deviation-heading": 1.6222145410168505, "set_robot_commands": 0.0758232864544546, "deviation-center-line": 0.5988392528563649, "driven_lanedir_consec": 0.9548999478863592, "sim_compute_sim_state": 0.03222701360853456, "sim_compute_performance-ego": 0.055784897838565085, "sim_compute_robot_state-ego": 0.05790362426702925}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.764845879789246, "sim_physics": 0.017499878189780497, "survival_time": 5.4999999999999885, "driven_lanedir": 1.4853911586277155, "sim_render-ego": 0.0503881497816606, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06696765206076882, "deviation-heading": 2.120001135598398, "set_robot_commands": 0.07429653514515269, "deviation-center-line": 0.4939356602264637, "driven_lanedir_consec": 1.1987993639477978, "sim_compute_sim_state": 0.030690273371609775, "sim_compute_performance-ego": 0.05108084028417414, "sim_compute_robot_state-ego": 0.05550844886086203}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.7952460973249655, "sim_physics": 0.015690186818440754, "survival_time": 14.950000000000076, "driven_lanedir": 2.8007520710813, "sim_render-ego": 0.05127746740976969, "in-drivable-lane": 4.500000000000023, "agent_compute-ego": 0.06689542531967163, "deviation-heading": 4.692034420026289, "set_robot_commands": 0.07305646578470866, "deviation-center-line": 0.7683076077633, "driven_lanedir_consec": 1.754608790613027, "sim_compute_sim_state": 0.031359736919403074, "sim_compute_performance-ego": 0.052848496437072755, "sim_compute_robot_state-ego": 0.0554111647605896}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2365197679289224, "sim_physics": 0.01702122874074168, "survival_time": 3.8499999999999943, "driven_lanedir": 1.093761755921926, "sim_render-ego": 0.053074059548316066, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06683651193395837, "deviation-heading": 1.1709641735191112, "set_robot_commands": 0.07453882229792608, "deviation-center-line": 0.24954940935417227, "driven_lanedir_consec": 1.093761755921926, "sim_compute_sim_state": 0.032309683886441315, "sim_compute_performance-ego": 0.05483082052949187, "sim_compute_robot_state-ego": 0.05641905982773025}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0122426511141909, "sim_physics": 0.018043355336264957, "survival_time": 3.149999999999997, "driven_lanedir": 0.994819140633679, "sim_render-ego": 0.05238323363046798, "in-drivable-lane": 0, "agent_compute-ego": 0.06904124456738668, "deviation-heading": 0.4681622403509476, "set_robot_commands": 0.07351176700894795, "deviation-center-line": 0.29558978517465606, "driven_lanedir_consec": 0.994819140633679, "sim_compute_sim_state": 0.03107587874881805, "sim_compute_performance-ego": 0.05287120077345106, "sim_compute_robot_state-ego": 0.054644618715558736}}
set_robot_commands_max	0.0758232864544546
set_robot_commands_mean	0.074245375338238
set_robot_commands_median	0.07429653514515269
set_robot_commands_min	0.07305646578470866
sim_compute_performance-ego_max	0.055784897838565085
sim_compute_performance-ego_mean	0.05348325117255098
sim_compute_performance-ego_median	0.05287120077345106
sim_compute_performance-ego_min	0.05108084028417414
sim_compute_robot_state-ego_max	0.05790362426702925
sim_compute_robot_state-ego_mean	0.055977383286353974
sim_compute_robot_state-ego_median	0.05550844886086203
sim_compute_robot_state-ego_min	0.054644618715558736
sim_compute_sim_state_max	0.032309683886441315
sim_compute_sim_state_mean	0.03153251730696136
sim_compute_sim_state_median	0.031359736919403074
sim_compute_sim_state_min	0.030690273371609775
sim_physics_max	0.018043355336264957
sim_physics_mean	0.016813115911370802
sim_physics_median	0.01702122874074168
sim_physics_min	0.015690186818440754
sim_render-ego_max	0.05372404023040113
sim_render-ego_mean	0.052169390120123095
sim_render-ego_median	0.05238323363046798
sim_render-ego_min	0.0503881497816606
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.880000000000008
survival_time_min	3.149999999999997

No reset possible

18081

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success