Submission 10077

Submission

10077

Competing

yes

Challenge

aido5-LF-sanity

User

Yishu Malhotra 🇨🇦

Date submitted

2020-11-03 01:24:37+00:00

Last status update

2021-12-04 21:02:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sanity-check: 59835

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

59835

Click the images to see detailed statistics about the episode.

udem1-sc0-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

59835

sanity-check

success

yes

2020-12-05 14:05:19+00:00

2020-12-05 14:06:27+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.03849412454763135
survival_time_median	0.49999999999999994
deviation-center-line_median	0.007653860967456247
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.014046365564519709
agent_compute-ego_mean	0.014046365564519709
agent_compute-ego_median	0.014046365564519709
agent_compute-ego_min	0.014046365564519709
complete-iteration_max	0.17979855970902878
complete-iteration_mean	0.17979855970902878
complete-iteration_median	0.17979855970902878
complete-iteration_min	0.17979855970902878
deviation-center-line_max	0.007653860967456247
deviation-center-line_mean	0.007653860967456247
deviation-center-line_min	0.007653860967456247
deviation-heading_max	0.05340011542394386
deviation-heading_mean	0.05340011542394386
deviation-heading_median	0.05340011542394386
deviation-heading_min	0.05340011542394386
driven_any_max	0.038701798088548386
driven_any_mean	0.038701798088548386
driven_any_median	0.038701798088548386
driven_any_min	0.038701798088548386
driven_lanedir_consec_max	0.03849412454763135
driven_lanedir_consec_mean	0.03849412454763135
driven_lanedir_consec_min	0.03849412454763135
driven_lanedir_max	0.03849412454763135
driven_lanedir_mean	0.03849412454763135
driven_lanedir_median	0.03849412454763135
driven_lanedir_min	0.03849412454763135
get_duckie_state_max	0.002498214895075018
get_duckie_state_mean	0.002498214895075018
get_duckie_state_median	0.002498214895075018
get_duckie_state_min	0.002498214895075018
get_robot_state_max	0.008759108456698332
get_robot_state_mean	0.008759108456698332
get_robot_state_median	0.008759108456698332
get_robot_state_min	0.008759108456698332
get_state_dump_max	0.01167529279535467
get_state_dump_mean	0.01167529279535467
get_state_dump_median	0.01167529279535467
get_state_dump_min	0.01167529279535467
get_ui_image_max	0.03255532004616477
get_ui_image_mean	0.03255532004616477
get_ui_image_median	0.03255532004616477
get_ui_image_min	0.03255532004616477
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.038701798088548386, "get_ui_image": 0.03255532004616477, "step_physics": 0.0837341005151922, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03849412454763135, "get_state_dump": 0.01167529279535467, "sim_render-ego": 0.004484133286909623, "get_robot_state": 0.008759108456698332, "get_duckie_state": 0.002498214895075018, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014046365564519709, "deviation-heading": 0.05340011542394386, "complete-iteration": 0.17979855970902878, "set_robot_commands": 0.0032665512778542257, "deviation-center-line": 0.007653860967456247, "driven_lanedir_consec": 0.03849412454763135, "sim_compute_sim_state": 0.015762805938720703, "sim_compute_performance-ego": 0.002890955318104137}}
set_robot_commands_max	0.0032665512778542257
set_robot_commands_mean	0.0032665512778542257
set_robot_commands_median	0.0032665512778542257
set_robot_commands_min	0.0032665512778542257
sim_compute_performance-ego_max	0.002890955318104137
sim_compute_performance-ego_mean	0.002890955318104137
sim_compute_performance-ego_median	0.002890955318104137
sim_compute_performance-ego_min	0.002890955318104137
sim_compute_sim_state_max	0.015762805938720703
sim_compute_sim_state_mean	0.015762805938720703
sim_compute_sim_state_median	0.015762805938720703
sim_compute_sim_state_min	0.015762805938720703
sim_render-ego_max	0.004484133286909623
sim_render-ego_mean	0.004484133286909623
sim_render-ego_median	0.004484133286909623
sim_render-ego_min	0.004484133286909623
simulation-passed	1
step_physics_max	0.0837341005151922
step_physics_mean	0.0837341005151922
step_physics_median	0.0837341005151922
step_physics_min	0.0837341005151922
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

59830

sanity-check

success

yes

2020-12-05 14:03:05+00:00

2020-12-05 14:04:52+00:00

0:01:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59828

sanity-check

host-error

yes

2020-12-05 13:59:46+00:00

2020-12-05 14:00:12+00:00

0:00:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [8bf6af2075d872423e5438d04eceac2148c0076827778b1f645dca17f17d8cfa,
│                 10ba65e313ef0cd983a6c25bd324ac1ebc21f0c9206dd7909f7ca152d5309c5e,
│                 ebacd0eee23b8ca40ad64f04897440c1f1c2c4ed20e9f3e58a1a4d36fa82f877]
│      services: dict[4]
│                │ solution:
│                │ dict[6]
│                │ │ image: docker.io/yishu17/aido-submissions@sha256:c12b7f96f9bfd849c43e5ccefdee3e760782d058a9e88fa651ae960160dce1d2
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10077
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_01_22_58@sha256:c12b7f96f9bfd849c43e5ccefdee3e760782d058a9e88fa651ae960160dce1d2
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_71d9d0a909df}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-27614/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 0.5
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10077
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_01_22_58@sha256:c12b7f96f9bfd849c43e5ccefdee3e760782d058a9e88fa651ae960160dce1d2
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_71d9d0a909df}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-27614/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10077
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_01_22_58@sha256:c12b7f96f9bfd849c43e5ccefdee3e760782d058a9e88fa651ae960160dce1d2
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_71d9d0a909df}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-27614/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- udem1
│                │ │ │ |scenarios_per_map: 1
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |robots_parked: [parked]
│                │ │ │ |nduckies: 1
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10077
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_01_22_58@sha256:c12b7f96f9bfd849c43e5ccefdee3e760782d058a9e88fa651ae960160dce1d2
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_71d9d0a909df}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10077/sanity-check-gpu-prod-01_71d9d0a909df-job59828-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-27614/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: 8bf6af2075d872423e5438d04eceac2148c0076827778b1f645dca17f17d8cfa
│                │ simulator: 10ba65e313ef0cd983a6c25bd324ac1ebc21f0c9206dd7909f7ca152d5309c5e
│                │ solution: ebacd0eee23b8ca40ad64f04897440c1f1c2c4ed20e9f3e58a1a4d36fa82f877
│         names: dict[3]
│                │ 8bf6af2075d872423e5438d04eceac2148c0076827778b1f645dca17f17d8cfa: gpu-prod-01_71d9d0a909df-job59828-231301_evaluator_1
│                │ 10ba65e313ef0cd983a6c25bd324ac1ebc21f0c9206dd7909f7ca152d5309c5e: gpu-prod-01_71d9d0a909df-job59828-231301_simulator_1
│                │ ebacd0eee23b8ca40ad64f04897440c1f1c2c4ed20e9f3e58a1a4d36fa82f877: gpu-prod-01_71d9d0a909df-job59828-231301_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |8bf6af2075d872423e5438d04eceac2148c0076827778b1f645dca17f17d8cfa
│         |10ba65e313ef0cd983a6c25bd324ac1ebc21f0c9206dd7909f7ca152d5309c5e
│         |ebacd0eee23b8ca40ad64f04897440c1f1c2c4ed20e9f3e58a1a4d36fa82f877
│         |
│  names: dict[3]
│         │ 8bf6af2075d872423e5438d04eceac2148c0076827778b1f645dca17f17d8cfa: gpu-prod-01_71d9d0a909df-job59828-231301_evaluator_1
│         │ 10ba65e313ef0cd983a6c25bd324ac1ebc21f0c9206dd7909f7ca152d5309c5e: gpu-prod-01_71d9d0a909df-job59828-231301_simulator_1
│         │ ebacd0eee23b8ca40ad64f04897440c1f1c2c4ed20e9f3e58a1a4d36fa82f877: gpu-prod-01_71d9d0a909df-job59828-231301_solution_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59826

sanity-check

success

yes

2020-12-05 13:58:08+00:00

2020-12-05 13:59:13+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59822

sanity-check

success

yes

2020-12-05 13:56:27+00:00

2020-12-05 13:57:34+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59818

sanity-check

success

yes

2020-12-05 13:54:53+00:00

2020-12-05 13:56:02+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible