61890 | LFv-sim | success | yes | | | 0:24:25 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | driven_lanedir_consec_median | 6.032167931235882 | | survival_time_median | 39.79999999999987 | | deviation-center-line_median | 2.255329366308594 | | in-drivable-lane_median | 5.624999999999754 |
other stats| agent_compute-ego0_max | 0.01293986109623396 | | agent_compute-ego0_mean | 0.0122270215641544 | | agent_compute-ego0_median | 0.012038240403414589 | | agent_compute-ego0_min | 0.011891744353554466 | | complete-iteration_max | 0.2044354542556216 | | complete-iteration_mean | 0.17782184446454746 | | complete-iteration_median | 0.17307369443927845 | | complete-iteration_min | 0.1607045347240114 | | deviation-center-line_max | 3.973852910720907 | | deviation-center-line_mean | 2.17264781375469 | | deviation-center-line_min | 0.20607961168066505 | | deviation-heading_max | 11.38378779143122 | | deviation-heading_mean | 6.841208709990047 | | deviation-heading_median | 7.485930252506478 | | deviation-heading_min | 1.0091865435160154 | | driven_any_max | 10.830236175734958 | | driven_any_mean | 7.319188375116533 | | driven_any_median | 7.04207244200637 | | driven_any_min | 4.362372440718435 | | driven_lanedir_consec_max | 10.064976131332113 | | driven_lanedir_consec_mean | 5.704672733049804 | | driven_lanedir_consec_min | 0.6893789383953408 | | driven_lanedir_max | 10.064976131332113 | | driven_lanedir_mean | 5.704672733049804 | | driven_lanedir_median | 6.032167931235882 | | driven_lanedir_min | 0.6893789383953408 | | get_duckie_state_max | 1.2585841327074514e-06 | | get_duckie_state_mean | 1.1900340304100616e-06 | | get_duckie_state_median | 1.1931523755759663e-06 | | get_duckie_state_min | 1.1152472377808626e-06 | | get_robot_state_max | 0.0036375661575228447 | | get_robot_state_mean | 0.0035531264340621493 | | get_robot_state_median | 0.0035488387536921143 | | get_robot_state_min | 0.0034772620713415226 | | get_state_dump_max | 0.004435128315997858 | | get_state_dump_mean | 0.004386010805881423 | | get_state_dump_median | 0.004424735385303069 | | get_state_dump_min | 0.0042594441369216965 | | get_ui_image_max | 0.03538938888833543 | | get_ui_image_mean | 0.03048374786541654 | | get_ui_image_median | 0.030298844076572864 | | get_ui_image_min | 0.025947914420185 | | in-drivable-lane_max | 20.750000000000227 | | in-drivable-lane_mean | 8.387499999999912 | | in-drivable-lane_min | 1.549999999999912 | | per-episodes | details{"LF-norm-loop-000-ego0": {"driven_any": 10.830236175734958, "get_ui_image": 0.027988495179556688, "step_physics": 0.10656146582318383, "survival_time": 59.99999999999873, "driven_lanedir": 10.064976131332113, "get_state_dump": 0.004435128315997858, "get_robot_state": 0.0036375661575228447, "sim_render-ego0": 0.0038298188796349114, "get_duckie_state": 1.2323917893942549e-06, "in-drivable-lane": 2.5999999999999517, "deviation-heading": 11.38378779143122, "agent_compute-ego0": 0.012089926039150215, "complete-iteration": 0.17221823044363208, "set_robot_commands": 0.0023599060052241216, "deviation-center-line": 3.973852910720907, "driven_lanedir_consec": 10.064976131332113, "sim_compute_sim_state": 0.009226016259808822, "sim_compute_performance-ego0": 0.002009691346396415}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.397091381692761, "get_ui_image": 0.03538938888833543, "step_physics": 0.1305672376937446, "survival_time": 36.25000000000008, "driven_lanedir": 6.007806798140856, "get_state_dump": 0.0042594441369216965, "get_robot_state": 0.0034772620713415226, "sim_render-ego0": 0.0035847471436849967, "get_duckie_state": 1.1152472377808626e-06, "in-drivable-lane": 1.549999999999912, "deviation-heading": 7.965619492663192, "agent_compute-ego0": 0.011891744353554466, "complete-iteration": 0.2044354542556216, "set_robot_commands": 0.0020842548901056127, "deviation-center-line": 2.2751533904376204, "driven_lanedir_consec": 6.007806798140856, "sim_compute_sim_state": 0.01127354336835793, "sim_compute_performance-ego0": 0.001832485527374856}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.362372440718435, "get_ui_image": 0.032609192973589045, "step_physics": 0.10164049137161071, "survival_time": 25.05000000000022, "driven_lanedir": 0.6893789383953408, "get_state_dump": 0.004423522379293859, "get_robot_state": 0.0035443125493023024, "sim_render-ego0": 0.003738551975721382, "get_duckie_state": 1.2585841327074514e-06, "in-drivable-lane": 20.750000000000227, "deviation-heading": 1.0091865435160154, "agent_compute-ego0": 0.01293986109623396, "complete-iteration": 0.17392915843492485, "set_robot_commands": 0.0021940460243073116, "deviation-center-line": 0.20607961168066505, "driven_lanedir_consec": 0.6893789383953408, "sim_compute_sim_state": 0.01088413964229751, "sim_compute_performance-ego0": 0.0018775311124277303}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.687053502319979, "get_ui_image": 0.025947914420185, "step_physics": 0.10074975358725692, "survival_time": 43.349999999999675, "driven_lanedir": 6.056529064330907, "get_state_dump": 0.0044259483913122784, "get_robot_state": 0.0035533649580819266, "sim_render-ego0": 0.003701654447388539, "get_duckie_state": 1.1539129617576775e-06, "in-drivable-lane": 8.649999999999556, "deviation-heading": 7.006241012349763, "agent_compute-ego0": 0.01198655476767896, "complete-iteration": 0.1607045347240114, "set_robot_commands": 0.002183514531306957, "deviation-center-line": 2.2355053421795676, "driven_lanedir_consec": 6.056529064330907, "sim_compute_sim_state": 0.00616297798772012, "sim_compute_performance-ego0": 0.0019142916125635947}} | | set_robot_commands_max | 0.0023599060052241216 | | set_robot_commands_mean | 0.0022054303627360005 | | set_robot_commands_median | 0.0021887802778071345 | | set_robot_commands_min | 0.0020842548901056127 | | sim_compute_performance-ego0_max | 0.002009691346396415 | | sim_compute_performance-ego0_mean | 0.001908499899690649 | | sim_compute_performance-ego0_median | 0.0018959113624956623 | | sim_compute_performance-ego0_min | 0.001832485527374856 | | sim_compute_sim_state_max | 0.01127354336835793 | | sim_compute_sim_state_mean | 0.009386669314546096 | | sim_compute_sim_state_median | 0.010055077951053166 | | sim_compute_sim_state_min | 0.00616297798772012 | | sim_render-ego0_max | 0.0038298188796349114 | | sim_render-ego0_mean | 0.0037136931116074578 | | sim_render-ego0_median | 0.00372010321155496 | | sim_render-ego0_min | 0.0035847471436849967 | | simulation-passed | 1 | | step_physics_max | 0.1305672376937446 | | step_physics_mean | 0.10987973711894902 | | step_physics_median | 0.10410097859739728 | | step_physics_min | 0.10074975358725692 | | survival_time_max | 59.99999999999873 | | survival_time_mean | 41.162499999999675 | | survival_time_min | 25.05000000000022 |
| No reset possible |
61889 | LFv-sim | host-error | yes | | | 0:25:01 | Uncaught exception:
[...]Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError:
│ container_ids: [013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936]
│ services: dict[3]
│ │ evaluator:
│ │ dict[7]
│ │ │ image: docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:6d0af9441525e1ed05be582f41e00fc178083c86797d28cd1a255c7025d0fd50
│ │ │ environment:
│ │ │ dict[10]
│ │ │ │ experiment_manager_parameters:
│ │ │ │ |episodes_per_scenario: 1
│ │ │ │ |episode_length_s: 60.0
│ │ │ │ |min_episode_length_s: 0.0
│ │ │ │ |seed: 888
│ │ │ │ |physics_dt: 0.05
│ │ │ │ |max_failures: 2
│ │ │ │ |fifo_dir: /fifos
│ │ │ │ |sim_in: /fifos/simulator-in
│ │ │ │ |sim_out: /fifos/simulator-out
│ │ │ │ |sm_in: /fifos/scenario_maker-in
│ │ │ │ |sm_out: /fifos/scenario_maker-out
│ │ │ │ |timeout_initialization: 120
│ │ │ │ |timeout_regular: 120
│ │ │ │ |port: 10123
│ │ │ │ |scenarios:
│ │ │ │ |- /scenarios
│ │ │ │ |
│ │ │ │ challenge_name: aido5-LF-sim-validation
│ │ │ │ challenge_step_name: LFv-sim
│ │ │ │ submission_id: 13391
│ │ │ │ submitter_name: Fernanda Custodio Pereira do Carmo
│ │ │ │ SUBMISSION_CONTAINER: docker.io/fernanda141/aido-submissions:2020_12_18_14_25_36@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│ │ │ │ username: ubuntu
│ │ │ │ uid: 0
│ │ │ │ USER: ubuntu
│ │ │ │ HOME: /fake-home/ubuntu
│ │ │ ports: [10123]
│ │ │ labels:
│ │ │ dict[2]
│ │ │ │ org.duckietown.created_by_runner: true
│ │ │ │ org.duckietown.runner_name: gpu-production-1-01_616611541d30
│ │ │ user: 0:0
│ │ │ volumes:
│ │ │ [
│ │ │ /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-wd:/challenges:rw,
│ │ │ /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-fifos:/fifos:rw,
│ │ │ /tmp/duckietown/dt-challenges-runner/20_12_18_14_35_25-62631/fake-ubuntu-home:/fake-home/ubuntu:rw]
│ │ │ networks: {evaluation: {aliases: [evaluation]} }
│ │ simulator:
│ │ dict[6]
│ │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:c0096866077db3574e425d40603d8f5fc8ebbd164da7c0578df94ff4ede58d95
│ │ │ environment:
│ │ │ dict[12]
│ │ │ │ AIDONODE_CONFIG:
│ │ │ │ |env_constructor: Simulator
│ │ │ │ |env_parameters:
│ │ │ │ | max_steps: 500001 # we don't want the gym to reset itself
│ │ │ │ | domain_rand: 0
│ │ │ │ | camera_width: 640
│ │ │ │ | camera_height: 480
│ │ │ │ | distortion: true
│ │ │ │ | num_tris_distractors: 0
│ │ │ │ | color_ground: [0, 0.3, 0] # green
│ │ │ │ | enable_leds: true
│ │ │ │ |
│ │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│ │ │ │ challenge_name: aido5-LF-sim-validation
│ │ │ │ challenge_step_name: LFv-sim
│ │ │ │ submission_id: 13391
│ │ │ │ submitter_name: Fernanda Custodio Pereira do Carmo
│ │ │ │ SUBMISSION_CONTAINER: docker.io/fernanda141/aido-submissions:2020_12_18_14_25_36@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│ │ │ │ username: ubuntu
│ │ │ │ uid: 0
│ │ │ │ USER: ubuntu
│ │ │ │ HOME: /fake-home/ubuntu
│ │ │ labels:
│ │ │ dict[2]
│ │ │ │ org.duckietown.created_by_runner: true
│ │ │ │ org.duckietown.runner_name: gpu-production-1-01_616611541d30
│ │ │ user: 0:0
│ │ │ volumes:
│ │ │ [
│ │ │ /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-wd:/challenges:rw,
│ │ │ /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-fifos:/fifos:rw,
│ │ │ /tmp/duckietown/dt-challenges-runner/20_12_18_14_35_25-62631/fake-ubuntu-home:/fake-home/ubuntu:rw]
│ │ │ networks: {evaluation: {aliases: [evaluation]} }
│ │ solution-ego0:
│ │ dict[6]
│ │ │ image: docker.io/fernanda141/aido-submissions@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│ │ │ environment:
│ │ │ dict[13]
│ │ │ │ AIDONODE_NAME: ego0
│ │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│ │ │ │ AIDO_REQUIRE_GPU: 1
│ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│ │ │ │ challenge_name: aido5-LF-sim-validation
│ │ │ │ challenge_step_name: LFv-sim
│ │ │ │ submission_id: 13391
│ │ │ │ submitter_name: Fernanda Custodio Pereira do Carmo
│ │ │ │ SUBMISSION_CONTAINER: docker.io/fernanda141/aido-submissions:2020_12_18_14_25_36@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│ │ │ │ username: ubuntu
│ │ │ │ uid: 0
│ │ │ │ USER: ubuntu
│ │ │ │ HOME: /fake-home/ubuntu
│ │ │ labels:
│ │ │ dict[2]
│ │ │ │ org.duckietown.created_by_runner: true
│ │ │ │ org.duckietown.runner_name: gpu-production-1-01_616611541d30
│ │ │ user: 0:0
│ │ │ volumes:
│ │ │ [
│ │ │ /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-wd:/challenges:rw,
│ │ │ /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-fifos:/fifos:rw,
│ │ │ /tmp/duckietown/dt-challenges-runner/20_12_18_14_35_25-62631/fake-ubuntu-home:/fake-home/ubuntu:rw]
│ │ │ networks: {evaluation: {aliases: [evaluation]} }
│ res: {solution-ego0: 013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936}
│ names: dict[1]
│ │ 013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936: gpu-production-1-01_616611541d30-job61889-547331_solution-ego0_1
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
write_logs(wd, project, services=config["services"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936
│ |
│ names: dict[1]
│ │ 013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936: gpu-production-1-01_616611541d30-job61889-547331_solution-ego0_1
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
Fernanda Custodio Pereira do Carmo 🇨🇦