Duckietown Challenges Home Challenges Submissions

Submission 10076

Submission10076
Competingyes
Challengeaido5-LF-sanity
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssanity-check: 59834
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

59834

Click the images to see detailed statistics about the episode.

udem1-sc0-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59834sanity-checksuccessyes0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03793942009139828
survival_time_median0.49999999999999994
deviation-center-line_median0.0076474816889042195
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.011991500854492188
agent_compute-ego_mean0.011991500854492188
agent_compute-ego_median0.011991500854492188
agent_compute-ego_min0.011991500854492188
complete-iteration_max0.14890376004305753
complete-iteration_mean0.14890376004305753
complete-iteration_median0.14890376004305753
complete-iteration_min0.14890376004305753
deviation-center-line_max0.0076474816889042195
deviation-center-line_mean0.0076474816889042195
deviation-center-line_min0.0076474816889042195
deviation-heading_max0.05332170965414788
deviation-heading_mean0.05332170965414788
deviation-heading_median0.05332170965414788
deviation-heading_min0.05332170965414788
driven_any_max0.03814226055859868
driven_any_mean0.03814226055859868
driven_any_median0.03814226055859868
driven_any_min0.03814226055859868
driven_lanedir_consec_max0.03793942009139828
driven_lanedir_consec_mean0.03793942009139828
driven_lanedir_consec_min0.03793942009139828
driven_lanedir_max0.03793942009139828
driven_lanedir_mean0.03793942009139828
driven_lanedir_median0.03793942009139828
driven_lanedir_min0.03793942009139828
get_duckie_state_max0.002093120054765181
get_duckie_state_mean0.002093120054765181
get_duckie_state_median0.002093120054765181
get_duckie_state_min0.002093120054765181
get_robot_state_max0.007421992041847922
get_robot_state_mean0.007421992041847922
get_robot_state_median0.007421992041847922
get_robot_state_min0.007421992041847922
get_state_dump_max0.007246732711791992
get_state_dump_mean0.007246732711791992
get_state_dump_median0.007246732711791992
get_state_dump_min0.007246732711791992
get_ui_image_max0.02744787389581854
get_ui_image_mean0.02744787389581854
get_ui_image_median0.02744787389581854
get_ui_image_min0.02744787389581854
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.03814226055859868, "get_ui_image": 0.02744787389581854, "step_physics": 0.07152589884671298, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03793942009139828, "get_state_dump": 0.007246732711791992, "sim_render-ego": 0.003660527142611417, "get_robot_state": 0.007421992041847922, "get_duckie_state": 0.002093120054765181, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011991500854492188, "deviation-heading": 0.05332170965414788, "complete-iteration": 0.14890376004305753, "set_robot_commands": 0.0021763281388716264, "deviation-center-line": 0.0076474816889042195, "driven_lanedir_consec": 0.03793942009139828, "sim_compute_sim_state": 0.013082417574795807, "sim_compute_performance-ego": 0.0021805979988791728}}
set_robot_commands_max0.0021763281388716264
set_robot_commands_mean0.0021763281388716264
set_robot_commands_median0.0021763281388716264
set_robot_commands_min0.0021763281388716264
sim_compute_performance-ego_max0.0021805979988791728
sim_compute_performance-ego_mean0.0021805979988791728
sim_compute_performance-ego_median0.0021805979988791728
sim_compute_performance-ego_min0.0021805979988791728
sim_compute_sim_state_max0.013082417574795807
sim_compute_sim_state_mean0.013082417574795807
sim_compute_sim_state_median0.013082417574795807
sim_compute_sim_state_min0.013082417574795807
sim_render-ego_max0.003660527142611417
sim_render-ego_mean0.003660527142611417
sim_render-ego_median0.003660527142611417
sim_render-ego_min0.003660527142611417
simulation-passed1
step_physics_max0.07152589884671298
step_physics_mean0.07152589884671298
step_physics_median0.07152589884671298
step_physics_min0.07152589884671298
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
59831sanity-checksuccessyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
59829sanity-checkhost-erroryes0:00:47
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [afef278b7637683fe45041f31b6b59177b9d9b4d6dd13adcc7094877db263e2e,
│                 7ae8dd77470bfafa3adf77651efe1ad11f743f9a71341c10474bc568e1e6da06,
│                 1dccfbe0f94f91735476a35695015be3c3b6c543b5bf8ca6ceea5eaf5e5fca1b]
│      services: dict[4]
│                │ solution:
│                │ dict[6]
│                │ │ image: docker.io/yishu17/aido-submissions@sha256:3ca61454c5a822ee17860741147803d4053fca3c7caf731da0479cc9cef76b2b
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10076
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_02_43_15@sha256:3ca61454c5a822ee17860741147803d4053fca3c7caf731da0479cc9cef76b2b
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-04_666280d77871}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-91032/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 0.5
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10076
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_02_43_15@sha256:3ca61454c5a822ee17860741147803d4053fca3c7caf731da0479cc9cef76b2b
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-04_666280d77871}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-91032/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10076
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_02_43_15@sha256:3ca61454c5a822ee17860741147803d4053fca3c7caf731da0479cc9cef76b2b
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-04_666280d77871}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-91032/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- udem1
│                │ │ │ |scenarios_per_map: 1
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |robots_parked: [parked]
│                │ │ │ |nduckies: 1
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10076
│                │ │ │ submitter_name: yishu17
│                │ │ │ SUBMISSION_CONTAINER: docker.io/yishu17/aido-submissions:2020_11_03_02_43_15@sha256:3ca61454c5a822ee17860741147803d4053fca3c7caf731da0479cc9cef76b2b
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-04_666280d77871}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10076/sanity-check-nogpu-prod-04_666280d77871-job59829-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_59_46-91032/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: afef278b7637683fe45041f31b6b59177b9d9b4d6dd13adcc7094877db263e2e
│                │ simulator: 7ae8dd77470bfafa3adf77651efe1ad11f743f9a71341c10474bc568e1e6da06
│                │ solution: 1dccfbe0f94f91735476a35695015be3c3b6c543b5bf8ca6ceea5eaf5e5fca1b
│         names: dict[3]
│                │ afef278b7637683fe45041f31b6b59177b9d9b4d6dd13adcc7094877db263e2e: nogpu-prod-04_666280d77871-job59829-969470_evaluator_1
│                │ 7ae8dd77470bfafa3adf77651efe1ad11f743f9a71341c10474bc568e1e6da06: nogpu-prod-04_666280d77871-job59829-969470_simulator_1
│                │ 1dccfbe0f94f91735476a35695015be3c3b6c543b5bf8ca6ceea5eaf5e5fca1b: nogpu-prod-04_666280d77871-job59829-969470_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |afef278b7637683fe45041f31b6b59177b9d9b4d6dd13adcc7094877db263e2e
│         |7ae8dd77470bfafa3adf77651efe1ad11f743f9a71341c10474bc568e1e6da06
│         |1dccfbe0f94f91735476a35695015be3c3b6c543b5bf8ca6ceea5eaf5e5fca1b
│         |
│  names: dict[3]
│         │ afef278b7637683fe45041f31b6b59177b9d9b4d6dd13adcc7094877db263e2e: nogpu-prod-04_666280d77871-job59829-969470_evaluator_1
│         │ 7ae8dd77470bfafa3adf77651efe1ad11f743f9a71341c10474bc568e1e6da06: nogpu-prod-04_666280d77871-job59829-969470_simulator_1
│         │ 1dccfbe0f94f91735476a35695015be3c3b6c543b5bf8ca6ceea5eaf5e5fca1b: nogpu-prod-04_666280d77871-job59829-969470_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
59825sanity-checksuccessyes0:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
59821sanity-checksuccessyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
59819sanity-checksuccessyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible