Duckietown Challenges Home Challenges Submissions

Submission 14715

Submission14715
Competinguser retired
Challengeaido-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update-
Complete
Detailsstatus not computed yet
Sisters
Result?
Jobs
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

Status not computed yet.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
93235sim-0of4failedno0:03:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93222sim-2of4successno0:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93220sim-3of4successno0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93219sim-1of4failedno0:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72211sim-1of4failedno0:02:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72207sim-0of4failedno0:02:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72205sim-3of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72201sim-2of4successno0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72191sim-3of4successno0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72188sim-2of4successno0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72180sim-3of4successno0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72178sim-2of4successno0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72177sim-0of4host-errorno0:02:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [e68510722cc99f6153aec5cc065ea91eda629cfbe07ca74ff5a651034830cf34,
│                 5b455098ce3970e685647ec1d9910c3440e9b88f5a00f87c5fcbc8582c518662,
│                 09e30ce4e84821f4b5d59556fd6f8e7009d9343283bd8007efd5d4dbca8b4cc6,
│                 f17e2dd963466afce6b87db0ed6ed0d0d4effaa531eab3469cc8dfc586ed3914,
│                 6cf30a11e37bb77718a3dfc3ac00e2811ebc6df5bb3f0587ceac57c3475407b0]
│      services: dict[6]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:ad8e323d063a2753833b524f3bfc6b6e9b1aded9be79d30d39b967569447e308
│                │ │ environment:
│                │ │ dict[11]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido-LFVI_multi-sim-validation
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 14715
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2021_04_20_22_17_53@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-05_da0892f3f057
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_17_57_45-87466/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:74989d3337d7fc221b8550c34dab1359eb18109113950b27deaa647a983417e0
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido-LFVI_multi-sim-validation
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 14715
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2021_04_20_22_17_53@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-05_da0892f3f057
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_17_57_45-87466/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/aido-submissions@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido-LFVI_multi-sim-validation
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 14715
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2021_04_20_22_17_53@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-05_da0892f3f057
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_17_57_45-87466/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego1:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/aido-submissions@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: ego1
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego1-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego1-out
│                │ │ │ challenge_name: aido-LFVI_multi-sim-validation
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 14715
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2021_04_20_22_17_53@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-05_da0892f3f057
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_17_57_45-87466/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego2:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/aido-submissions@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: ego2
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego2-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego2-out
│                │ │ │ challenge_name: aido-LFVI_multi-sim-validation
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 14715
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2021_04_20_22_17_53@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-05_da0892f3f057
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_17_57_45-87466/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego3:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/aido-submissions@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: ego3
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego3-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego3-out
│                │ │ │ challenge_name: aido-LFVI_multi-sim-validation
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 14715
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2021_04_20_22_17_53@sha256:3103688133b6ee1cad5aeb49c5899363c554ac9bbab249a0266ef5d7d39de1f3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-05_da0892f3f057
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFVI_multi-sim-validation/submission14715/sim-0of4-nogpu-production-b-spot-0-05_da0892f3f057-job72177-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_17_57_45-87466/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[5]
│                │ simulator: e68510722cc99f6153aec5cc065ea91eda629cfbe07ca74ff5a651034830cf34
│                │ solution-ego0: 5b455098ce3970e685647ec1d9910c3440e9b88f5a00f87c5fcbc8582c518662
│                │ solution-ego1: 09e30ce4e84821f4b5d59556fd6f8e7009d9343283bd8007efd5d4dbca8b4cc6
│                │ solution-ego2: f17e2dd963466afce6b87db0ed6ed0d0d4effaa531eab3469cc8dfc586ed3914
│                │ solution-ego3: 6cf30a11e37bb77718a3dfc3ac00e2811ebc6df5bb3f0587ceac57c3475407b0
│         names: dict[5]
│                │ e68510722cc99f6153aec5cc065ea91eda629cfbe07ca74ff5a651034830cf34: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_simulator_1
│                │ 5b455098ce3970e685647ec1d9910c3440e9b88f5a00f87c5fcbc8582c518662: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego0_1
│                │ 09e30ce4e84821f4b5d59556fd6f8e7009d9343283bd8007efd5d4dbca8b4cc6: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego1_1
│                │ f17e2dd963466afce6b87db0ed6ed0d0d4effaa531eab3469cc8dfc586ed3914: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego2_1
│                │ 6cf30a11e37bb77718a3dfc3ac00e2811ebc6df5bb3f0587ceac57c3475407b0: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego3_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |e68510722cc99f6153aec5cc065ea91eda629cfbe07ca74ff5a651034830cf34
│         |5b455098ce3970e685647ec1d9910c3440e9b88f5a00f87c5fcbc8582c518662
│         |09e30ce4e84821f4b5d59556fd6f8e7009d9343283bd8007efd5d4dbca8b4cc6
│         |f17e2dd963466afce6b87db0ed6ed0d0d4effaa531eab3469cc8dfc586ed3914
│         |6cf30a11e37bb77718a3dfc3ac00e2811ebc6df5bb3f0587ceac57c3475407b0
│         |
│  names: dict[5]
│         │ e68510722cc99f6153aec5cc065ea91eda629cfbe07ca74ff5a651034830cf34: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_simulator_1
│         │ 5b455098ce3970e685647ec1d9910c3440e9b88f5a00f87c5fcbc8582c518662: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego0_1
│         │ 09e30ce4e84821f4b5d59556fd6f8e7009d9343283bd8007efd5d4dbca8b4cc6: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego1_1
│         │ f17e2dd963466afce6b87db0ed6ed0d0d4effaa531eab3469cc8dfc586ed3914: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego2_1
│         │ 6cf30a11e37bb77718a3dfc3ac00e2811ebc6df5bb3f0587ceac57c3475407b0: nogpu-production-b-spot-0-05_da0892f3f057-job72177-478617_solution-ego3_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
72170sim-1of4host-errorno0:02:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69660sim-3of4successno0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69659sim-2of4successno0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69658sim-3of4successno0:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69656sim-1of4failedno0:02:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69655sim-2of4successno0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69654sim-0of4failedno0:02:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible