Submission 10075

Submission

10075

Competing

yes

Challenge

aido5-LF-sanity

User

Francois Hebert

Date submitted

2020-11-03 01:27:34+00:00

Last status update

2021-12-04 21:02:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sanity-check: 59836

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

59836

Click the images to see detailed statistics about the episode.

udem1-sc0-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

59836

sanity-check

success

yes

2020-12-05 14:06:20+00:00

2020-12-05 14:07:30+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.02892929085035645
survival_time_median	0.49999999999999994
deviation-center-line_median	0.007409933155752076
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.013998985290527344
agent_compute-ego_mean	0.013998985290527344
agent_compute-ego_median	0.013998985290527344
agent_compute-ego_min	0.013998985290527344
complete-iteration_max	0.1775463711131703
complete-iteration_mean	0.1775463711131703
complete-iteration_median	0.1775463711131703
complete-iteration_min	0.1775463711131703
deviation-center-line_max	0.007409933155752076
deviation-center-line_mean	0.007409933155752076
deviation-center-line_min	0.007409933155752076
deviation-heading_max	0.04945303767309817
deviation-heading_mean	0.04945303767309817
deviation-heading_median	0.04945303767309817
deviation-heading_min	0.04945303767309817
driven_any_max	0.029030347806307255
driven_any_mean	0.029030347806307255
driven_any_median	0.029030347806307255
driven_any_min	0.029030347806307255
driven_lanedir_consec_max	0.02892929085035645
driven_lanedir_consec_mean	0.02892929085035645
driven_lanedir_consec_min	0.02892929085035645
driven_lanedir_max	0.02892929085035645
driven_lanedir_mean	0.02892929085035645
driven_lanedir_median	0.02892929085035645
driven_lanedir_min	0.02892929085035645
get_duckie_state_max	0.002338431098244407
get_duckie_state_mean	0.002338431098244407
get_duckie_state_median	0.002338431098244407
get_duckie_state_min	0.002338431098244407
get_robot_state_max	0.008353623476895418
get_robot_state_mean	0.008353623476895418
get_robot_state_median	0.008353623476895418
get_robot_state_min	0.008353623476895418
get_state_dump_max	0.007998141375454989
get_state_dump_mean	0.007998141375454989
get_state_dump_median	0.007998141375454989
get_state_dump_min	0.007998141375454989
get_ui_image_max	0.034561569040471855
get_ui_image_mean	0.034561569040471855
get_ui_image_median	0.034561569040471855
get_ui_image_min	0.034561569040471855
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.029030347806307255, "get_ui_image": 0.034561569040471855, "step_physics": 0.08601080287586559, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02892929085035645, "get_state_dump": 0.007998141375454989, "sim_render-ego": 0.004090179096568714, "get_robot_state": 0.008353623476895418, "get_duckie_state": 0.002338431098244407, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013998985290527344, "deviation-heading": 0.04945303767309817, "complete-iteration": 0.1775463711131703, "set_robot_commands": 0.002568353306163441, "deviation-center-line": 0.007409933155752076, "driven_lanedir_consec": 0.02892929085035645, "sim_compute_sim_state": 0.015117623589255592, "sim_compute_performance-ego": 0.002433625134554776}}
set_robot_commands_max	0.002568353306163441
set_robot_commands_mean	0.002568353306163441
set_robot_commands_median	0.002568353306163441
set_robot_commands_min	0.002568353306163441
sim_compute_performance-ego_max	0.002433625134554776
sim_compute_performance-ego_mean	0.002433625134554776
sim_compute_performance-ego_median	0.002433625134554776
sim_compute_performance-ego_min	0.002433625134554776
sim_compute_sim_state_max	0.015117623589255592
sim_compute_sim_state_mean	0.015117623589255592
sim_compute_sim_state_median	0.015117623589255592
sim_compute_sim_state_min	0.015117623589255592
sim_render-ego_max	0.004090179096568714
sim_render-ego_mean	0.004090179096568714
sim_render-ego_median	0.004090179096568714
sim_render-ego_min	0.004090179096568714
simulation-passed	1
step_physics_max	0.08601080287586559
step_physics_mean	0.08601080287586559
step_physics_median	0.08601080287586559
step_physics_min	0.08601080287586559
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

59833

sanity-check

success

yes

2020-12-05 14:04:48+00:00

2020-12-05 14:05:43+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59832

sanity-check

success

yes

2020-12-05 14:03:06+00:00

2020-12-05 14:04:19+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59827

sanity-check

host-error

yes

2020-12-05 13:59:13+00:00

2020-12-05 14:00:05+00:00

0:00:52

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [5ec85679b2cf075cb610fb088bef4402cdd41bd59d0c61d0fc0137d08974e404]
│      services: dict[4]
│                │ solution:
│                │ dict[6]
│                │ │ image: docker.io/frankhebert/aido-submissions@sha256:33da2fa00052fd8a3644af6d568c0651957f79816f87c17ae137740cc1491674
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10075
│                │ │ │ submitter_name: FrankHebert
│                │ │ │ SUBMISSION_CONTAINER: docker.io/frankhebert/aido-submissions:2020_11_03_01_27_04@sha256:33da2fa00052fd8a3644af6d568c0651957f79816f87c17ae137740cc1491674
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_76cb96174d9a}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_13-31772/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 0.5
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10075
│                │ │ │ submitter_name: FrankHebert
│                │ │ │ SUBMISSION_CONTAINER: docker.io/frankhebert/aido-submissions:2020_11_03_01_27_04@sha256:33da2fa00052fd8a3644af6d568c0651957f79816f87c17ae137740cc1491674
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_76cb96174d9a}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_13-31772/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10075
│                │ │ │ submitter_name: FrankHebert
│                │ │ │ SUBMISSION_CONTAINER: docker.io/frankhebert/aido-submissions:2020_11_03_01_27_04@sha256:33da2fa00052fd8a3644af6d568c0651957f79816f87c17ae137740cc1491674
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_76cb96174d9a}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_13-31772/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- udem1
│                │ │ │ |scenarios_per_map: 1
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |robots_parked: [parked]
│                │ │ │ |nduckies: 1
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10075
│                │ │ │ submitter_name: FrankHebert
│                │ │ │ SUBMISSION_CONTAINER: docker.io/frankhebert/aido-submissions:2020_11_03_01_27_04@sha256:33da2fa00052fd8a3644af6d568c0651957f79816f87c17ae137740cc1491674
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_76cb96174d9a}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10075/sanity-check-gpu-prod-01_76cb96174d9a-job59827-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_13-31772/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {solution: 5ec85679b2cf075cb610fb088bef4402cdd41bd59d0c61d0fc0137d08974e404}
│         names: dict[1]
│                │ 5ec85679b2cf075cb610fb088bef4402cdd41bd59d0c61d0fc0137d08974e404: gpu-prod-01_76cb96174d9a-job59827-685450_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |5ec85679b2cf075cb610fb088bef4402cdd41bd59d0c61d0fc0137d08974e404
│         |
│  names: dict[1]
│         │ 5ec85679b2cf075cb610fb088bef4402cdd41bd59d0c61d0fc0137d08974e404: gpu-prod-01_76cb96174d9a-job59827-685450_solution_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59824

sanity-check

success

yes

2020-12-05 13:57:32+00:00

2020-12-05 13:58:42+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59823

sanity-check

success

yes

2020-12-05 13:56:30+00:00

2020-12-05 13:57:28+00:00

0:00:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59820

sanity-check

success

yes

2020-12-05 13:54:55+00:00

2020-12-05 13:55:59+00:00

0:01:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible