41109 | sanity-check | success | yes | | | 0:01:14 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | driven_lanedir_consec_median | 0.026439455691182 | | survival_time_median | 0.49999999999999994 | | deviation-center-line_median | 0.007459502184251296 | | in-drivable-lane_median | 0.0 |
other stats| agent_compute-ego_max | 0.018185550516301937 | | agent_compute-ego_mean | 0.018185550516301937 | | agent_compute-ego_median | 0.018185550516301937 | | agent_compute-ego_min | 0.018185550516301937 | | complete-iteration_max | 0.2236754677512429 | | complete-iteration_mean | 0.2236754677512429 | | complete-iteration_median | 0.2236754677512429 | | complete-iteration_min | 0.2236754677512429 | | deviation-center-line_max | 0.007459502184251296 | | deviation-center-line_mean | 0.007459502184251296 | | deviation-center-line_min | 0.007459502184251296 | | deviation-heading_max | 0.05342528446687272 | | deviation-heading_mean | 0.05342528446687272 | | deviation-heading_median | 0.05342528446687272 | | deviation-heading_min | 0.05342528446687272 | | driven_any_max | 0.026581087229034826 | | driven_any_mean | 0.026581087229034826 | | driven_any_median | 0.026581087229034826 | | driven_any_min | 0.026581087229034826 | | driven_lanedir_consec_max | 0.026439455691182 | | driven_lanedir_consec_mean | 0.026439455691182 | | driven_lanedir_consec_min | 0.026439455691182 | | driven_lanedir_max | 0.026439455691182 | | driven_lanedir_mean | 0.026439455691182 | | driven_lanedir_median | 0.026439455691182 | | driven_lanedir_min | 0.026439455691182 | | get_duckie_state_max | 0.0037728222933682528 | | get_duckie_state_mean | 0.0037728222933682528 | | get_duckie_state_median | 0.0037728222933682528 | | get_duckie_state_min | 0.0037728222933682528 | | get_robot_state_max | 0.0128865892236883 | | get_robot_state_mean | 0.0128865892236883 | | get_robot_state_median | 0.0128865892236883 | | get_robot_state_min | 0.0128865892236883 | | get_state_dump_max | 0.01488980379971591 | | get_state_dump_mean | 0.01488980379971591 | | get_state_dump_median | 0.01488980379971591 | | get_state_dump_min | 0.01488980379971591 | | get_ui_image_max | 0.041940840807828034 | | get_ui_image_mean | 0.041940840807828034 | | get_ui_image_median | 0.041940840807828034 | | get_ui_image_min | 0.041940840807828034 | | in-drivable-lane_max | 0.0 | | in-drivable-lane_mean | 0.0 | | in-drivable-lane_min | 0.0 | | per-episodes | details{"udem1-sc0-0-ego": {"driven_any": 0.026581087229034826, "get_ui_image": 0.041940840807828034, "step_physics": 0.09614920616149902, "survival_time": 0.49999999999999994, "driven_lanedir": 0.026439455691182, "get_state_dump": 0.01488980379971591, "sim_render-ego": 0.005162325772372159, "get_robot_state": 0.0128865892236883, "get_duckie_state": 0.0037728222933682528, "in-drivable-lane": 0.0, "agent_compute-ego": 0.018185550516301937, "deviation-heading": 0.05342528446687272, "complete-iteration": 0.2236754677512429, "set_robot_commands": 0.00442294640974565, "deviation-center-line": 0.007459502184251296, "driven_lanedir_consec": 0.026439455691182, "sim_compute_sim_state": 0.022280606356534092, "sim_compute_performance-ego": 0.003836198286576705}} | | set_robot_commands_max | 0.00442294640974565 | | set_robot_commands_mean | 0.00442294640974565 | | set_robot_commands_median | 0.00442294640974565 | | set_robot_commands_min | 0.00442294640974565 | | sim_compute_performance-ego_max | 0.003836198286576705 | | sim_compute_performance-ego_mean | 0.003836198286576705 | | sim_compute_performance-ego_median | 0.003836198286576705 | | sim_compute_performance-ego_min | 0.003836198286576705 | | sim_compute_sim_state_max | 0.022280606356534092 | | sim_compute_sim_state_mean | 0.022280606356534092 | | sim_compute_sim_state_median | 0.022280606356534092 | | sim_compute_sim_state_min | 0.022280606356534092 | | sim_render-ego_max | 0.005162325772372159 | | sim_render-ego_mean | 0.005162325772372159 | | sim_render-ego_median | 0.005162325772372159 | | sim_render-ego_min | 0.005162325772372159 | | simulation-passed | 1 | | step_physics_max | 0.09614920616149902 | | step_physics_mean | 0.09614920616149902 | | step_physics_median | 0.09614920616149902 | | step_physics_min | 0.09614920616149902 | | survival_time_max | 0.49999999999999994 | | survival_time_mean | 0.49999999999999994 | | survival_time_min | 0.49999999999999994 |
| No reset possible |
41105 | sanity-check | host-error | yes | | | 0:01:01 | Uncaught exception:
[...]Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
write_logs(wd, project, services=config["services"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
services2id: Dict[str, str] = get_services_id(wd, project, services)
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 943, in get_services_id
raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError:
│ container_ids: [71e6ce04bee92f2e1ff83b77900157f83676d57fd95bef6e9e0f38a348ec1a52]
│ services: dict[4]
│ │ solution:
│ │ dict[5]
│ │ │ image: docker.io/jeromelabonte/aido-submissions@sha256:c9b20878a7e5970afa90813aaeb54977e8b0d4f2f51b9da96d45c023943cc2e5
│ │ │ environment:
│ │ │ dict[10]
│ │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│ │ │ │ AIDO_REQUIRE_GPU: 1
│ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│ │ │ │ challenge_name: aido5-LF-sanity-sim-validation
│ │ │ │ challenge_step_name: sanity-check
│ │ │ │ SUBMISSION_CONTAINER: docker.io/jeromelabonte/aido-submissions:2020_10_16_19_50_06@sha256:c9b20878a7e5970afa90813aaeb54977e8b0d4f2f51b9da96d45c023943cc2e5
│ │ │ │ username: aido
│ │ │ │ uid: 0
│ │ │ │ USER: aido
│ │ │ │ HOME: /fake-home/aido
│ │ │ user: 0:0
│ │ │ volumes:
│ │ │ [
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-wd:/challenges:rw,
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-fifos:/fifos:rw,
│ │ │ /tmp/fake-aido-home:/fake-home/aido:rw]
│ │ │ networks: {evaluation: {aliases: [evaluation]} }
│ │ evaluator:
│ │ dict[5]
│ │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:48f0b2f34825d15848c3060740ab95a99254d233959586b75aeedf03f1ed5832
│ │ │ environment:
│ │ │ dict[8]
│ │ │ │ experiment_manager_parameters:
│ │ │ │ |episodes_per_scenario: 1
│ │ │ │ |episode_length_s: 0.5
│ │ │ │ |min_episode_length_s: 0.0
│ │ │ │ |seed: 20200922
│ │ │ │ |physics_dt: 0.05
│ │ │ │ |max_failures: 2
│ │ │ │ |fifo_dir: /fifos
│ │ │ │ |sim_in: /fifos/simulator-in
│ │ │ │ |sim_out: /fifos/simulator-out
│ │ │ │ |sm_in: /fifos/scenario_maker-in
│ │ │ │ |sm_out: /fifos/scenario_maker-out
│ │ │ │ |timeout_initialization: 120
│ │ │ │ |timeout_regular: 120
│ │ │ │ |
│ │ │ │ |port: 10123 # visualization port
│ │ │ │ |
│ │ │ │ challenge_name: aido5-LF-sanity-sim-validation
│ │ │ │ challenge_step_name: sanity-check
│ │ │ │ SUBMISSION_CONTAINER: docker.io/jeromelabonte/aido-submissions:2020_10_16_19_50_06@sha256:c9b20878a7e5970afa90813aaeb54977e8b0d4f2f51b9da96d45c023943cc2e5
│ │ │ │ username: aido
│ │ │ │ uid: 0
│ │ │ │ USER: aido
│ │ │ │ HOME: /fake-home/aido
│ │ │ user: 0:0
│ │ │ volumes:
│ │ │ [
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-wd:/challenges:rw,
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-fifos:/fifos:rw,
│ │ │ /tmp/fake-aido-home:/fake-home/aido:rw]
│ │ │ networks: {evaluation: {aliases: [evaluation]} }
│ │ simulator:
│ │ dict[5]
│ │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:953ba9f1437e3f267db1f4ff2e58340de33f6c207283f26def16fc8612b9506e
│ │ │ environment:
│ │ │ dict[10]
│ │ │ │ AIDONODE_CONFIG:
│ │ │ │ |env_constructor: Simulator
│ │ │ │ |env_parameters:
│ │ │ │ | max_steps: 500001 # we don't want the gym to reset itself
│ │ │ │ | domain_rand: 0
│ │ │ │ | camera_width: 640
│ │ │ │ | camera_height: 480
│ │ │ │ | distortion: true
│ │ │ │ | num_tris_distractors: 0
│ │ │ │ | color_ground: [0, 0.3, 0] # green
│ │ │ │ | enable_leds: true
│ │ │ │ |
│ │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│ │ │ │ challenge_name: aido5-LF-sanity-sim-validation
│ │ │ │ challenge_step_name: sanity-check
│ │ │ │ SUBMISSION_CONTAINER: docker.io/jeromelabonte/aido-submissions:2020_10_16_19_50_06@sha256:c9b20878a7e5970afa90813aaeb54977e8b0d4f2f51b9da96d45c023943cc2e5
│ │ │ │ username: aido
│ │ │ │ uid: 0
│ │ │ │ USER: aido
│ │ │ │ HOME: /fake-home/aido
│ │ │ user: 0:0
│ │ │ volumes:
│ │ │ [
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-wd:/challenges:rw,
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-fifos:/fifos:rw,
│ │ │ /tmp/fake-aido-home:/fake-home/aido:rw]
│ │ │ networks: {evaluation: {aliases: [evaluation]} }
│ │ scenario_maker:
│ │ dict[5]
│ │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:1562e17ba46090cdedbe68b8584827f1b3730f2786f6abd52e8790b4f0f1e63c
│ │ │ environment:
│ │ │ dict[10]
│ │ │ │ AIDONODE_CONFIG:
│ │ │ │ |maps:
│ │ │ │ |- udem1
│ │ │ │ |scenarios_per_map: 1
│ │ │ │ |robots_npcs: []
│ │ │ │ |robots_pcs: [ego]
│ │ │ │ |robots_parked: [parked]
│ │ │ │ |nduckies: 1
│ │ │ │ |
│ │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│ │ │ │ challenge_name: aido5-LF-sanity-sim-validation
│ │ │ │ challenge_step_name: sanity-check
│ │ │ │ SUBMISSION_CONTAINER: docker.io/jeromelabonte/aido-submissions:2020_10_16_19_50_06@sha256:c9b20878a7e5970afa90813aaeb54977e8b0d4f2f51b9da96d45c023943cc2e5
│ │ │ │ username: aido
│ │ │ │ uid: 0
│ │ │ │ USER: aido
│ │ │ │ HOME: /fake-home/aido
│ │ │ user: 0:0
│ │ │ volumes:
│ │ │ [
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-wd:/challenges:rw,
│ │ │ /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sanity-sim-validation/submission10684/sanity-check-mont02-5bd91ed070bc-1-job41105-a-fifos:/fifos:rw,
│ │ │ /tmp/fake-aido-home:/fake-home/aido:rw]
│ │ │ networks: {evaluation: {aliases: [evaluation]} }
│ res: {solution: 71e6ce04bee92f2e1ff83b77900157f83676d57fd95bef6e9e0f38a348ec1a52}
│ names: dict[1]
│ │ 71e6ce04bee92f2e1ff83b77900157f83676d57fd95bef6e9e0f38a348ec1a52: mont02-5bd91ed070bc-1-job41105-426798_solution_1
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
Jerome Labonte 🇨🇦