Duckietown Challenges Home Challenges Submissions

Submission 11304

Submission11304
Competingyes
Challengeaido5-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
JobsLFv-sim: 55014
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
55014LFv-simfailedyes0:04:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54990LFv-simhost-erroryes0:05:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [f3ac1c4cd47caf9cf1204f8b3e12a97a11d1856795f285f43d2b99cba6126b1c,
│                 83a59fc4288d124ecd04359e7338898a0e6ee56ebca63167f41d75dd78f1c188]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:6d0af9441525e1ed05be582f41e00fc178083c86797d28cd1a255c7025d0fd50
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 888
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 11304
│                │ │ │ submitter_name: mostafaelaraby
│                │ │ │ SUBMISSION_CONTAINER: docker.io/mostafaelaraby/aido-submissions:2020_11_09_06_24_33@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-06_a8b63b9ccd56}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-06_a8b63b9ccd56-job54990-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-06_a8b63b9ccd56-job54990-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_03_04_59_08-68715/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:c0096866077db3574e425d40603d8f5fc8ebbd164da7c0578df94ff4ede58d95
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 11304
│                │ │ │ submitter_name: mostafaelaraby
│                │ │ │ SUBMISSION_CONTAINER: docker.io/mostafaelaraby/aido-submissions:2020_11_09_06_24_33@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-06_a8b63b9ccd56}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-06_a8b63b9ccd56-job54990-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-06_a8b63b9ccd56-job54990-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_03_04_59_08-68715/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/mostafaelaraby/aido-submissions@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 11304
│                │ │ │ submitter_name: mostafaelaraby
│                │ │ │ SUBMISSION_CONTAINER: docker.io/mostafaelaraby/aido-submissions:2020_11_09_06_24_33@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-06_a8b63b9ccd56}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-06_a8b63b9ccd56-job54990-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-06_a8b63b9ccd56-job54990-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_03_04_59_08-68715/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[2]
│                │ evaluator: f3ac1c4cd47caf9cf1204f8b3e12a97a11d1856795f285f43d2b99cba6126b1c
│                │ simulator: 83a59fc4288d124ecd04359e7338898a0e6ee56ebca63167f41d75dd78f1c188
│         names: dict[2]
│                │ f3ac1c4cd47caf9cf1204f8b3e12a97a11d1856795f285f43d2b99cba6126b1c: nogpu-prod-06_a8b63b9ccd56-job54990-914198_evaluator_1
│                │ 83a59fc4288d124ecd04359e7338898a0e6ee56ebca63167f41d75dd78f1c188: nogpu-prod-06_a8b63b9ccd56-job54990-914198_simulator_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |f3ac1c4cd47caf9cf1204f8b3e12a97a11d1856795f285f43d2b99cba6126b1c
│         |83a59fc4288d124ecd04359e7338898a0e6ee56ebca63167f41d75dd78f1c188
│         |
│  names: dict[2]
│         │ f3ac1c4cd47caf9cf1204f8b3e12a97a11d1856795f285f43d2b99cba6126b1c: nogpu-prod-06_a8b63b9ccd56-job54990-914198_evaluator_1
│         │ 83a59fc4288d124ecd04359e7338898a0e6ee56ebca63167f41d75dd78f1c188: nogpu-prod-06_a8b63b9ccd56-job54990-914198_simulator_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54967LFv-simhost-erroryes0:02:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [4f43e3130af0306074dafdee70e956ea2c63c1ed71764f31d14d7f2245e939af,
│                 23743392fd0b0c40d529168dcddb94ba1d9a454501d05e9ae5614344ad50a1cb]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:6d0af9441525e1ed05be582f41e00fc178083c86797d28cd1a255c7025d0fd50
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 888
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 11304
│                │ │ │ submitter_name: mostafaelaraby
│                │ │ │ SUBMISSION_CONTAINER: docker.io/mostafaelaraby/aido-submissions:2020_11_09_06_24_33@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-02_67f7c0c46c90}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-02_67f7c0c46c90-job54967-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-02_67f7c0c46c90-job54967-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_03_04_58_34-82232/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:c0096866077db3574e425d40603d8f5fc8ebbd164da7c0578df94ff4ede58d95
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 11304
│                │ │ │ submitter_name: mostafaelaraby
│                │ │ │ SUBMISSION_CONTAINER: docker.io/mostafaelaraby/aido-submissions:2020_11_09_06_24_33@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-02_67f7c0c46c90}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-02_67f7c0c46c90-job54967-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-02_67f7c0c46c90-job54967-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_03_04_58_34-82232/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/mostafaelaraby/aido-submissions@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 11304
│                │ │ │ submitter_name: mostafaelaraby
│                │ │ │ SUBMISSION_CONTAINER: docker.io/mostafaelaraby/aido-submissions:2020_11_09_06_24_33@sha256:99a8b30ba765feb23cdf421e49b44a2556bd41653c2bc614b0fbc7596a4a882d
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-02_67f7c0c46c90}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-02_67f7c0c46c90-job54967-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission11304/LFv-sim-nogpu-prod-02_67f7c0c46c90-job54967-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_03_04_58_34-82232/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[2]
│                │ evaluator: 4f43e3130af0306074dafdee70e956ea2c63c1ed71764f31d14d7f2245e939af
│                │ simulator: 23743392fd0b0c40d529168dcddb94ba1d9a454501d05e9ae5614344ad50a1cb
│         names: dict[2]
│                │ 4f43e3130af0306074dafdee70e956ea2c63c1ed71764f31d14d7f2245e939af: nogpu-prod-02_67f7c0c46c90-job54967-716268_evaluator_1
│                │ 23743392fd0b0c40d529168dcddb94ba1d9a454501d05e9ae5614344ad50a1cb: nogpu-prod-02_67f7c0c46c90-job54967-716268_simulator_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |4f43e3130af0306074dafdee70e956ea2c63c1ed71764f31d14d7f2245e939af
│         |23743392fd0b0c40d529168dcddb94ba1d9a454501d05e9ae5614344ad50a1cb
│         |
│  names: dict[2]
│         │ 4f43e3130af0306074dafdee70e956ea2c63c1ed71764f31d14d7f2245e939af: nogpu-prod-02_67f7c0c46c90-job54967-716268_evaluator_1
│         │ 23743392fd0b0c40d529168dcddb94ba1d9a454501d05e9ae5614344ad50a1cb: nogpu-prod-02_67f7c0c46c90-job54967-716268_simulator_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible