Duckietown Challenges Home Challenges Submissions

Submission 13391

Submission13391
Competingyes
Challengeaido5-LF-sim-validation
UserFernanda Custodio Pereira do Carmo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 61890
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

61890

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
61890LFv-simsuccessyes0:24:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.032167931235882
survival_time_median39.79999999999987
deviation-center-line_median2.255329366308594
in-drivable-lane_median5.624999999999754


other stats
agent_compute-ego0_max0.01293986109623396
agent_compute-ego0_mean0.0122270215641544
agent_compute-ego0_median0.012038240403414589
agent_compute-ego0_min0.011891744353554466
complete-iteration_max0.2044354542556216
complete-iteration_mean0.17782184446454746
complete-iteration_median0.17307369443927845
complete-iteration_min0.1607045347240114
deviation-center-line_max3.973852910720907
deviation-center-line_mean2.17264781375469
deviation-center-line_min0.20607961168066505
deviation-heading_max11.38378779143122
deviation-heading_mean6.841208709990047
deviation-heading_median7.485930252506478
deviation-heading_min1.0091865435160154
driven_any_max10.830236175734958
driven_any_mean7.319188375116533
driven_any_median7.04207244200637
driven_any_min4.362372440718435
driven_lanedir_consec_max10.064976131332113
driven_lanedir_consec_mean5.704672733049804
driven_lanedir_consec_min0.6893789383953408
driven_lanedir_max10.064976131332113
driven_lanedir_mean5.704672733049804
driven_lanedir_median6.032167931235882
driven_lanedir_min0.6893789383953408
get_duckie_state_max1.2585841327074514e-06
get_duckie_state_mean1.1900340304100616e-06
get_duckie_state_median1.1931523755759663e-06
get_duckie_state_min1.1152472377808626e-06
get_robot_state_max0.0036375661575228447
get_robot_state_mean0.0035531264340621493
get_robot_state_median0.0035488387536921143
get_robot_state_min0.0034772620713415226
get_state_dump_max0.004435128315997858
get_state_dump_mean0.004386010805881423
get_state_dump_median0.004424735385303069
get_state_dump_min0.0042594441369216965
get_ui_image_max0.03538938888833543
get_ui_image_mean0.03048374786541654
get_ui_image_median0.030298844076572864
get_ui_image_min0.025947914420185
in-drivable-lane_max20.750000000000227
in-drivable-lane_mean8.387499999999912
in-drivable-lane_min1.549999999999912
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.830236175734958, "get_ui_image": 0.027988495179556688, "step_physics": 0.10656146582318383, "survival_time": 59.99999999999873, "driven_lanedir": 10.064976131332113, "get_state_dump": 0.004435128315997858, "get_robot_state": 0.0036375661575228447, "sim_render-ego0": 0.0038298188796349114, "get_duckie_state": 1.2323917893942549e-06, "in-drivable-lane": 2.5999999999999517, "deviation-heading": 11.38378779143122, "agent_compute-ego0": 0.012089926039150215, "complete-iteration": 0.17221823044363208, "set_robot_commands": 0.0023599060052241216, "deviation-center-line": 3.973852910720907, "driven_lanedir_consec": 10.064976131332113, "sim_compute_sim_state": 0.009226016259808822, "sim_compute_performance-ego0": 0.002009691346396415}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.397091381692761, "get_ui_image": 0.03538938888833543, "step_physics": 0.1305672376937446, "survival_time": 36.25000000000008, "driven_lanedir": 6.007806798140856, "get_state_dump": 0.0042594441369216965, "get_robot_state": 0.0034772620713415226, "sim_render-ego0": 0.0035847471436849967, "get_duckie_state": 1.1152472377808626e-06, "in-drivable-lane": 1.549999999999912, "deviation-heading": 7.965619492663192, "agent_compute-ego0": 0.011891744353554466, "complete-iteration": 0.2044354542556216, "set_robot_commands": 0.0020842548901056127, "deviation-center-line": 2.2751533904376204, "driven_lanedir_consec": 6.007806798140856, "sim_compute_sim_state": 0.01127354336835793, "sim_compute_performance-ego0": 0.001832485527374856}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.362372440718435, "get_ui_image": 0.032609192973589045, "step_physics": 0.10164049137161071, "survival_time": 25.05000000000022, "driven_lanedir": 0.6893789383953408, "get_state_dump": 0.004423522379293859, "get_robot_state": 0.0035443125493023024, "sim_render-ego0": 0.003738551975721382, "get_duckie_state": 1.2585841327074514e-06, "in-drivable-lane": 20.750000000000227, "deviation-heading": 1.0091865435160154, "agent_compute-ego0": 0.01293986109623396, "complete-iteration": 0.17392915843492485, "set_robot_commands": 0.0021940460243073116, "deviation-center-line": 0.20607961168066505, "driven_lanedir_consec": 0.6893789383953408, "sim_compute_sim_state": 0.01088413964229751, "sim_compute_performance-ego0": 0.0018775311124277303}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.687053502319979, "get_ui_image": 0.025947914420185, "step_physics": 0.10074975358725692, "survival_time": 43.349999999999675, "driven_lanedir": 6.056529064330907, "get_state_dump": 0.0044259483913122784, "get_robot_state": 0.0035533649580819266, "sim_render-ego0": 0.003701654447388539, "get_duckie_state": 1.1539129617576775e-06, "in-drivable-lane": 8.649999999999556, "deviation-heading": 7.006241012349763, "agent_compute-ego0": 0.01198655476767896, "complete-iteration": 0.1607045347240114, "set_robot_commands": 0.002183514531306957, "deviation-center-line": 2.2355053421795676, "driven_lanedir_consec": 6.056529064330907, "sim_compute_sim_state": 0.00616297798772012, "sim_compute_performance-ego0": 0.0019142916125635947}}
set_robot_commands_max0.0023599060052241216
set_robot_commands_mean0.0022054303627360005
set_robot_commands_median0.0021887802778071345
set_robot_commands_min0.0020842548901056127
sim_compute_performance-ego0_max0.002009691346396415
sim_compute_performance-ego0_mean0.001908499899690649
sim_compute_performance-ego0_median0.0018959113624956623
sim_compute_performance-ego0_min0.001832485527374856
sim_compute_sim_state_max0.01127354336835793
sim_compute_sim_state_mean0.009386669314546096
sim_compute_sim_state_median0.010055077951053166
sim_compute_sim_state_min0.00616297798772012
sim_render-ego0_max0.0038298188796349114
sim_render-ego0_mean0.0037136931116074578
sim_render-ego0_median0.00372010321155496
sim_render-ego0_min0.0035847471436849967
simulation-passed1
step_physics_max0.1305672376937446
step_physics_mean0.10987973711894902
step_physics_median0.10410097859739728
step_physics_min0.10074975358725692
survival_time_max59.99999999999873
survival_time_mean41.162499999999675
survival_time_min25.05000000000022
No reset possible
61889LFv-simhost-erroryes0:25:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:6d0af9441525e1ed05be582f41e00fc178083c86797d28cd1a255c7025d0fd50
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 888
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 13391
│                │ │ │ submitter_name: Fernanda Custodio Pereira do Carmo
│                │ │ │ SUBMISSION_CONTAINER: docker.io/fernanda141/aido-submissions:2020_12_18_14_25_36@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: gpu-production-1-01_616611541d30
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_18_14_35_25-62631/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:c0096866077db3574e425d40603d8f5fc8ebbd164da7c0578df94ff4ede58d95
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 13391
│                │ │ │ submitter_name: Fernanda Custodio Pereira do Carmo
│                │ │ │ SUBMISSION_CONTAINER: docker.io/fernanda141/aido-submissions:2020_12_18_14_25_36@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: gpu-production-1-01_616611541d30
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_18_14_35_25-62631/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/fernanda141/aido-submissions@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 13391
│                │ │ │ submitter_name: Fernanda Custodio Pereira do Carmo
│                │ │ │ SUBMISSION_CONTAINER: docker.io/fernanda141/aido-submissions:2020_12_18_14_25_36@sha256:400d00a8fdee498297e93121799e430244b5fa5d112700caadd9d6e91b6c1890
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: gpu-production-1-01_616611541d30
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13391/LFv-sim-gpu-production-1-01_616611541d30-job61889-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_18_14_35_25-62631/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {solution-ego0: 013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936}
│         names: dict[1]
│                │ 013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936: gpu-production-1-01_616611541d30-job61889-547331_solution-ego0_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936
│         |
│  names: dict[1]
│         │ 013f242bc5dcb35d0e72b18fa5cbe91e737850bcfa258999a802971a9a695936: gpu-production-1-01_616611541d30-job61889-547331_solution-ego0_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible