Duckietown Challenges Home Challenges Submissions

Submission 14401

Submission14401
Competingyes
Challengemooc-BV1
UserBogdan Gersak
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113662 sim-1of5: 113638 sim-2of5: 113640 sim-3of5: 113637 sim-4of5: 113636
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113662

Click the images to see detailed statistics about the episode.

d45

113640

Click the images to see detailed statistics about the episode.

d40

113638

Click the images to see detailed statistics about the episode.

d50

113637

Click the images to see detailed statistics about the episode.

d30

113636

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113662sim-0of5successyes0:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.4833072031392955


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.4833072031392955
distance-from-start_median4.4833072031392955
distance-from-start_min4.4833072031392955
driven_any_max5.2612804112697305
driven_any_mean5.2612804112697305
driven_any_median5.2612804112697305
driven_any_min5.2612804112697305
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max19.050000000000136
in-drivable-lane_mean19.050000000000136
in-drivable-lane_median19.050000000000136
in-drivable-lane_min19.050000000000136
per-episodes
details{"d45-ego0": {"driven_any": 5.2612804112697305, "survival_time": 19.050000000000136, "driven_lanedir": 0.0, "in-drivable-lane": 19.050000000000136, "deviation-heading": 0.0, "distance-from-start": 4.4833072031392955, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max19.050000000000136
survival_time_mean19.050000000000136
survival_time_median19.050000000000136
survival_time_min19.050000000000136
No reset possible
113652sim-0of5successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113642sim-0of5successyes0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113640sim-2of5successyes0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.740280727329575


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.740280727329575
distance-from-start_median3.740280727329575
distance-from-start_min3.740280727329575
driven_any_max3.936155719709533
driven_any_mean3.936155719709533
driven_any_median3.936155719709533
driven_any_min3.936155719709533
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max15.550000000000086
in-drivable-lane_mean15.550000000000086
in-drivable-lane_median15.550000000000086
in-drivable-lane_min15.550000000000086
per-episodes
details{"d40-ego0": {"driven_any": 3.936155719709533, "survival_time": 15.550000000000086, "driven_lanedir": 0.0, "in-drivable-lane": 15.550000000000086, "deviation-heading": 0.0, "distance-from-start": 3.740280727329575, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max15.550000000000086
survival_time_mean15.550000000000086
survival_time_median15.550000000000086
survival_time_min15.550000000000086
No reset possible
113638sim-1of5successyes0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.724192728024855


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.724192728024855
distance-from-start_median4.724192728024855
distance-from-start_min4.724192728024855
driven_any_max4.836899008529248
driven_any_mean4.836899008529248
driven_any_median4.836899008529248
driven_any_min4.836899008529248
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max18.850000000000133
in-drivable-lane_mean18.850000000000133
in-drivable-lane_median18.850000000000133
in-drivable-lane_min18.850000000000133
per-episodes
details{"d50-ego0": {"driven_any": 4.836899008529248, "survival_time": 18.850000000000133, "driven_lanedir": 0.0, "in-drivable-lane": 18.850000000000133, "deviation-heading": 0.0, "distance-from-start": 4.724192728024855, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max18.850000000000133
survival_time_mean18.850000000000133
survival_time_median18.850000000000133
survival_time_min18.850000000000133
No reset possible
113637sim-3of5successyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.921934144336156


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.921934144336156
distance-from-start_median5.921934144336156
distance-from-start_min5.921934144336156
driven_any_max6.202698180273158
driven_any_mean6.202698180273158
driven_any_median6.202698180273158
driven_any_min6.202698180273158
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.350000000000197
in-drivable-lane_mean23.350000000000197
in-drivable-lane_median23.350000000000197
in-drivable-lane_min23.350000000000197
per-episodes
details{"d30-ego0": {"driven_any": 6.202698180273158, "survival_time": 23.350000000000197, "driven_lanedir": 0.0, "in-drivable-lane": 23.350000000000197, "deviation-heading": 0.0, "distance-from-start": 5.921934144336156, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.350000000000197
survival_time_mean23.350000000000197
survival_time_median23.350000000000197
survival_time_min23.350000000000197
No reset possible
113636sim-4of5successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.683131451576276


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.683131451576276
distance-from-start_median4.683131451576276
distance-from-start_min4.683131451576276
driven_any_max4.816764598603015
driven_any_mean4.816764598603015
driven_any_median4.816764598603015
driven_any_min4.816764598603015
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max18.60000000000013
in-drivable-lane_mean18.60000000000013
in-drivable-lane_median18.60000000000013
in-drivable-lane_min18.60000000000013
per-episodes
details{"d50-ego0": {"driven_any": 4.816764598603015, "survival_time": 18.60000000000013, "driven_lanedir": 0.0, "in-drivable-lane": 18.60000000000013, "deviation-heading": 0.0, "distance-from-start": 4.683131451576276, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max18.60000000000013
survival_time_mean18.60000000000013
survival_time_median18.60000000000013
survival_time_min18.60000000000013
No reset possible
113631sim-2of5successyes0:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113629sim-3of5successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113628sim-4of5successyes0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113627sim-1of5successyes0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113622sim-3of5successyes0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113621sim-2of5successyes0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113619sim-4of5successyes0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113618sim-1of5successyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94017sim-0of5successno0:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94016sim-4of5successno0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94013sim-4of5successno0:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94012sim-0of5successno0:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94010sim-4of5successno0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94003sim-0of5successno0:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94000sim-4of5successno0:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93994sim-4of5successno0:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93993sim-0of5successno0:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93986sim-0of5successno0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93985sim-4of5successno0:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93978sim-4of5successno0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93971sim-0of5successno0:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93966sim-1of5successno0:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93964sim-2of5successno0:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93963sim-3of5successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93957sim-1of5successno0:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93779sim-4of5timeoutno----No reset possible
93778sim-2of5timeoutno----No reset possible
93777sim-3of5timeoutno----No reset possible
93776sim-1of5timeoutno----No reset possible
74322sim-4of5successno0:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74279sim-1of5successno0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74278sim-4of5host-errorno0:02:54
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [f17a0b083289b9bfb8c9da50fc60361403b7b54f5ea733c711491c6a8a66a9fe]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:841534bf59ddb792959a6b025c9143161ae2ba717993f444adf67709f97283ee
│                │ │ environment:
│                │ │ dict[11]
│                │ │ │ replica: {"index": 4, "total": 5}
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 3
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: mooc-BV1
│                │ │ │ challenge_step_name: sim-4of5
│                │ │ │ submission_id: 14401
│                │ │ │ submitter_name: Bogdan Gersak
│                │ │ │ SUBMISSION_CONTAINER: docker.io/gersakbogdan/aido-submissions:2021_04_17_16_33_11@sha256:93df0c240d09f998bc5024c29d0e63901f2971241e737deb9a17807bd8a4c097
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-01_1a71a421eb2f
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/mooc-BV1/submission14401/sim-4of5-nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/mooc-BV1/submission14401/sim-4of5-nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_20_57_14-26682/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:74989d3337d7fc221b8550c34dab1359eb18109113950b27deaa647a983417e0
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 4, "total": 5}
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  #color_ground: [0, 0, 0] # black
│                │ │ │ |  #color_sky: [0, 0, 0.1] # dark blue
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ |terminate_on_ool: false
│                │ │ │ |terminate_on_out_of_tile: true
│                │ │ │ |terminate_on_collision: true
│                │ │ │ |topdown_resolution: 300
│                │ │ │ |max_pixel_mov: 1000
│                │ │ │ |debug_profile: False
│                │ │ │ |debug_profile_summary: True
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: mooc-BV1
│                │ │ │ challenge_step_name: sim-4of5
│                │ │ │ submission_id: 14401
│                │ │ │ submitter_name: Bogdan Gersak
│                │ │ │ SUBMISSION_CONTAINER: docker.io/gersakbogdan/aido-submissions:2021_04_17_16_33_11@sha256:93df0c240d09f998bc5024c29d0e63901f2971241e737deb9a17807bd8a4c097
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-01_1a71a421eb2f
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/mooc-BV1/submission14401/sim-4of5-nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/mooc-BV1/submission14401/sim-4of5-nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_20_57_14-26682/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/gersakbogdan/aido-submissions@sha256:93df0c240d09f998bc5024c29d0e63901f2971241e737deb9a17807bd8a4c097
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 4, "total": 5}
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: mooc-BV1
│                │ │ │ challenge_step_name: sim-4of5
│                │ │ │ submission_id: 14401
│                │ │ │ submitter_name: Bogdan Gersak
│                │ │ │ SUBMISSION_CONTAINER: docker.io/gersakbogdan/aido-submissions:2021_04_17_16_33_11@sha256:93df0c240d09f998bc5024c29d0e63901f2971241e737deb9a17807bd8a4c097
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-01_1a71a421eb2f
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/mooc-BV1/submission14401/sim-4of5-nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/mooc-BV1/submission14401/sim-4of5-nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_20_57_14-26682/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {evaluator: f17a0b083289b9bfb8c9da50fc60361403b7b54f5ea733c711491c6a8a66a9fe}
│         names: dict[1]
│                │ f17a0b083289b9bfb8c9da50fc60361403b7b54f5ea733c711491c6a8a66a9fe: nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-259064_evaluator_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |f17a0b083289b9bfb8c9da50fc60361403b7b54f5ea733c711491c6a8a66a9fe
│         |
│  names: dict[1]
│         │ f17a0b083289b9bfb8c9da50fc60361403b7b54f5ea733c711491c6a8a66a9fe: nogpu-production-b-spot-3-01_1a71a421eb2f-job74278-259064_evaluator_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74277sim-3of5successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74274sim-0of5successno0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74253sim-0of5successno0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74252sim-4of5successno0:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74251sim-3of5successno0:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74250sim-2of5successno0:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74245sim-1of5successno0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70411sim-1of5errorno0:03:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70403sim-0of5errorno0:02:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70402sim-2of5errorno0:03:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70401sim-4of5errorno0:02:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible