Duckietown Challenges Home Challenges Submissions

Submission 11042

Submission11042
Competingyes
Challengeaido5-LF-sim-validation
UserMelisande Teng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57017
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57017

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57017LFv-simsuccessyes0:23:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4350361101620663
survival_time_median34.850000000000044
deviation-center-line_median1.090993265296563
in-drivable-lane_median23.424999999999844


other stats
agent_compute-ego0_max0.013507952474703572
agent_compute-ego0_mean0.012808886825342392
agent_compute-ego0_median0.012761747835332396
agent_compute-ego0_min0.012204099156001205
complete-iteration_max0.1960386946298819
complete-iteration_mean0.17891742156030732
complete-iteration_median0.1814483989140493
complete-iteration_min0.15673419378324888
deviation-center-line_max2.0744197979314016
deviation-center-line_mean1.1143414156496367
deviation-center-line_min0.20095933407401964
deviation-heading_max11.629600632121525
deviation-heading_mean5.505897407958946
deviation-heading_median4.464902381924224
deviation-heading_min1.4641842358658106
driven_any_max8.888240662435756
driven_any_mean5.846391901144107
driven_any_median5.288732926450557
driven_any_min3.919861089239555
driven_lanedir_consec_max3.715172284311598
driven_lanedir_consec_mean2.3087551929141177
driven_lanedir_consec_min0.6497762670207388
driven_lanedir_max3.832306868881166
driven_lanedir_mean2.3414728461683456
driven_lanedir_median2.4405384966851447
driven_lanedir_min0.6525075224219283
get_duckie_state_max1.2753501770988342e-06
get_duckie_state_mean1.2093530941458893e-06
get_duckie_state_median1.2035788219357172e-06
get_duckie_state_min1.154904555613288e-06
get_robot_state_max0.0037633246117895775
get_robot_state_mean0.0036321772751302865
get_robot_state_median0.003657394377663498
get_robot_state_min0.0034505957334045726
get_state_dump_max0.004752803634811234
get_state_dump_mean0.004530785748181627
get_state_dump_median0.00449815398684012
get_state_dump_min0.004374031384235031
get_ui_image_max0.03445886394364153
get_ui_image_mean0.030055112028589848
get_ui_image_median0.029722987278331742
get_ui_image_min0.026315609614054363
in-drivable-lane_max35.89999999999982
in-drivable-lane_mean22.162499999999895
in-drivable-lane_min5.900000000000066
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.382840090617593, "get_ui_image": 0.02706223261418334, "step_physics": 0.10301298326594784, "survival_time": 28.80000000000027, "driven_lanedir": 2.0142033361862346, "get_state_dump": 0.004374031384235031, "get_robot_state": 0.0034505957334045726, "sim_render-ego0": 0.00368864118949586, "get_duckie_state": 1.154904555613288e-06, "in-drivable-lane": 16.10000000000023, "deviation-heading": 2.142763850689753, "agent_compute-ego0": 0.012204099156001205, "complete-iteration": 0.16767543605956503, "set_robot_commands": 0.0020720702523375303, "deviation-center-line": 0.4247390169718333, "driven_lanedir_consec": 2.0142033361862346, "sim_compute_sim_state": 0.009865888483189629, "sim_compute_performance-ego0": 0.0018675211603967944}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.888240662435756, "get_ui_image": 0.03445886394364153, "step_physics": 0.11991106997322382, "survival_time": 59.99999999999873, "driven_lanedir": 3.832306868881166, "get_state_dump": 0.004430237658117137, "get_robot_state": 0.003568203423442094, "sim_render-ego0": 0.003869592498283799, "get_duckie_state": 1.2079742330000065e-06, "in-drivable-lane": 30.74999999999946, "deviation-heading": 11.629600632121525, "agent_compute-ego0": 0.012677748137767071, "complete-iteration": 0.19522136176853355, "set_robot_commands": 0.002201019576149717, "deviation-center-line": 2.0744197979314016, "driven_lanedir_consec": 3.715172284311598, "sim_compute_sim_state": 0.012044755544988043, "sim_compute_performance-ego0": 0.0019779612281538863}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.919861089239555, "get_ui_image": 0.03238374194248015, "step_physics": 0.1231415737074104, "survival_time": 26.850000000000247, "driven_lanedir": 2.866873657184055, "get_state_dump": 0.004566070315563103, "get_robot_state": 0.0037465853318849017, "sim_render-ego0": 0.003942678408994994, "get_duckie_state": 1.1991834108714278e-06, "in-drivable-lane": 5.900000000000066, "deviation-heading": 6.7870409131586955, "agent_compute-ego0": 0.012845747532897722, "complete-iteration": 0.1960386946298819, "set_robot_commands": 0.002270105603015999, "deviation-center-line": 1.7572475136212928, "driven_lanedir_consec": 2.8558688841378976, "sim_compute_sim_state": 0.01100927347587387, "sim_compute_performance-ego0": 0.0020523864540468806}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.194625762283521, "get_ui_image": 0.026315609614054363, "step_physics": 0.09405308881813208, "survival_time": 40.899999999999814, "driven_lanedir": 0.6525075224219283, "get_state_dump": 0.004752803634811234, "get_robot_state": 0.0037633246117895775, "sim_render-ego0": 0.004029469030098455, "get_duckie_state": 1.2753501770988342e-06, "in-drivable-lane": 35.89999999999982, "deviation-heading": 1.4641842358658106, "agent_compute-ego0": 0.013507952474703572, "complete-iteration": 0.15673419378324888, "set_robot_commands": 0.0022543722602182837, "deviation-center-line": 0.20095933407401964, "driven_lanedir_consec": 0.6497762670207388, "sim_compute_sim_state": 0.005967344556535993, "sim_compute_performance-ego0": 0.0019989115560156666}}
set_robot_commands_max0.002270105603015999
set_robot_commands_mean0.0021993919229303825
set_robot_commands_median0.002227695918184
set_robot_commands_min0.0020720702523375303
sim_compute_performance-ego0_max0.0020523864540468806
sim_compute_performance-ego0_mean0.001974195099653307
sim_compute_performance-ego0_median0.0019884363920847766
sim_compute_performance-ego0_min0.0018675211603967944
sim_compute_sim_state_max0.012044755544988043
sim_compute_sim_state_mean0.009721815515146883
sim_compute_sim_state_median0.01043758097953175
sim_compute_sim_state_min0.005967344556535993
sim_render-ego0_max0.004029469030098455
sim_render-ego0_mean0.003882595281718277
sim_render-ego0_median0.0039061354536393967
sim_render-ego0_min0.00368864118949586
simulation-passed1
step_physics_max0.1231415737074104
step_physics_mean0.11002967894117852
step_physics_median0.11146202661958582
step_physics_min0.09405308881813208
survival_time_max59.99999999999873
survival_time_mean39.13749999999976
survival_time_min26.850000000000247
No reset possible
57013LFv-simsuccessyes0:16:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
57011LFv-simsuccessyes0:17:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
57004LFv-simsuccessyes0:20:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56997LFv-simsuccessyes0:17:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50829LFv-simerrorno0:06:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139979344826272
- M:video_aido:cmdline(in:/;out:/) 139979344340256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50819LFv-simhost-errorno0:04:25
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40400LFv-simsuccessno0:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40399LFv-simsuccessno0:09:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40397LFv-simsuccessno0:09:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40383LFv-simhost-errorno0:11:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 943, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [9b58ab7b47989bd4de1f94442d2a9f093f685441da9cc0827762874cf79cb7e6,
│                 7ec2cabbb28a413e32a9394171e1927504fc20deae7e8292497eb492796c9faf,
│                 381c114c23c92be715612f2ebf9f562737070d08b2ce81da7956b95b7705163f]
│      services: dict[4]
│                │ solution:
│                │ dict[5]
│                │ │ image: docker.io/melisande/aido-submissions@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:48f0b2f34825d15848c3060740ab95a99254d233959586b75aeedf03f1ed5832
│                │ │ environment:
│                │ │ dict[8]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 15.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ ports: [10123]
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:953ba9f1437e3f267db1f4ff2e58340de33f6c207283f26def16fc8612b9506e
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:1562e17ba46090cdedbe68b8584827f1b3730f2786f6abd52e8790b4f0f1e63c
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- ETHZ_autolab_technical_track
│                │ │ │ |scenarios_per_map: 4
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg01-bf67cb02b1e0-1-job40383-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: 9b58ab7b47989bd4de1f94442d2a9f093f685441da9cc0827762874cf79cb7e6
│                │ simulator: 7ec2cabbb28a413e32a9394171e1927504fc20deae7e8292497eb492796c9faf
│                │ solution: 381c114c23c92be715612f2ebf9f562737070d08b2ce81da7956b95b7705163f
│         names: dict[3]
│                │ 9b58ab7b47989bd4de1f94442d2a9f093f685441da9cc0827762874cf79cb7e6: reg01-bf67cb02b1e0-1-job40383-472290_evaluator_1
│                │ 7ec2cabbb28a413e32a9394171e1927504fc20deae7e8292497eb492796c9faf: reg01-bf67cb02b1e0-1-job40383-472290_simulator_1
│                │ 381c114c23c92be715612f2ebf9f562737070d08b2ce81da7956b95b7705163f: reg01-bf67cb02b1e0-1-job40383-472290_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40382LFv-simhost-errorno0:11:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 943, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [fe3c45089dead6b713a2141f35efa74fceba498f5b84971e5ce0dd9ec99b50e7,
│                 3d990462e6b04b87b4fa988a346d99cdb62534767e552b4e0f8cae9c43a2ace0,
│                 8cd8fcce0f9b272701c457b797e855f44eb6aaa2fa506c9a7c1f27ab8853fcf9]
│      services: dict[4]
│                │ solution:
│                │ dict[5]
│                │ │ image: docker.io/melisande/aido-submissions@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:48f0b2f34825d15848c3060740ab95a99254d233959586b75aeedf03f1ed5832
│                │ │ environment:
│                │ │ dict[8]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 15.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ ports: [10123]
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:953ba9f1437e3f267db1f4ff2e58340de33f6c207283f26def16fc8612b9506e
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:1562e17ba46090cdedbe68b8584827f1b3730f2786f6abd52e8790b4f0f1e63c
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- ETHZ_autolab_technical_track
│                │ │ │ |scenarios_per_map: 4
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg04-cb6499190cf5-1-job40382-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: fe3c45089dead6b713a2141f35efa74fceba498f5b84971e5ce0dd9ec99b50e7
│                │ simulator: 3d990462e6b04b87b4fa988a346d99cdb62534767e552b4e0f8cae9c43a2ace0
│                │ solution: 8cd8fcce0f9b272701c457b797e855f44eb6aaa2fa506c9a7c1f27ab8853fcf9
│         names: dict[3]
│                │ fe3c45089dead6b713a2141f35efa74fceba498f5b84971e5ce0dd9ec99b50e7: reg04-cb6499190cf5-1-job40382-583058_evaluator_1
│                │ 3d990462e6b04b87b4fa988a346d99cdb62534767e552b4e0f8cae9c43a2ace0: reg04-cb6499190cf5-1-job40382-583058_simulator_1
│                │ 8cd8fcce0f9b272701c457b797e855f44eb6aaa2fa506c9a7c1f27ab8853fcf9: reg04-cb6499190cf5-1-job40382-583058_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40381LFv-simhost-errorno0:12:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 943, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [f1cb34d9678a9c2a0f617c53181544ff285cc088acda84979faf7e028ee7f5ee,
│                 b1977a64daed31ef89ee326f06c4e3719cc8a42461bccd9f9706a3c86c8d3051,
│                 85e0ac0bb6e49d549cbfacca33f38acbcf2e1dc5581c5f29aa298bec7591dbae]
│      services: dict[4]
│                │ solution:
│                │ dict[5]
│                │ │ image: docker.io/melisande/aido-submissions@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:48f0b2f34825d15848c3060740ab95a99254d233959586b75aeedf03f1ed5832
│                │ │ environment:
│                │ │ dict[8]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 15.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ ports: [10123]
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:953ba9f1437e3f267db1f4ff2e58340de33f6c207283f26def16fc8612b9506e
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:1562e17ba46090cdedbe68b8584827f1b3730f2786f6abd52e8790b4f0f1e63c
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- ETHZ_autolab_technical_track
│                │ │ │ |scenarios_per_map: 4
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_11_04_21_19_12@sha256:6a2b50bc6713c457fde82bd1a74adb1cef7040640672df20efb72f6532a15855
│                │ │ │ username: andrea
│                │ │ │ uid: 0
│                │ │ │ USER: andrea
│                │ │ │ HOME: /fake-home/andrea
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-wd:/challenges:rw,
│                │ │  /media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11042/LFv-sim-reg02-2604b9bb4859-1-job40381-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-andrea-home:/fake-home/andrea:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: f1cb34d9678a9c2a0f617c53181544ff285cc088acda84979faf7e028ee7f5ee
│                │ simulator: b1977a64daed31ef89ee326f06c4e3719cc8a42461bccd9f9706a3c86c8d3051
│                │ solution: 85e0ac0bb6e49d549cbfacca33f38acbcf2e1dc5581c5f29aa298bec7591dbae
│         names: dict[3]
│                │ f1cb34d9678a9c2a0f617c53181544ff285cc088acda84979faf7e028ee7f5ee: reg02-2604b9bb4859-1-job40381-277737_evaluator_1
│                │ b1977a64daed31ef89ee326f06c4e3719cc8a42461bccd9f9706a3c86c8d3051: reg02-2604b9bb4859-1-job40381-277737_simulator_1
│                │ 85e0ac0bb6e49d549cbfacca33f38acbcf2e1dc5581c5f29aa298bec7591dbae: reg02-2604b9bb4859-1-job40381-277737_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40379LFv-simsuccessno0:09:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39738LFv-simsuccessno0:08:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39723LFv-simsuccessno0:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39721LFv-simsuccessno0:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38797LFv-simsuccessno0:10:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38796LFv-simsuccessno0:11:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38795LFv-simsuccessno0:08:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible