Duckietown Challenges Home Challenges Submissions

Submission 14396

Submission14396
Competingyes
Challengemooc-BV1
UserKiyo Kunii
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113693 sim-1of5: 113692 sim-2of5: 113695 sim-3of5: 113694 sim-4of5: 113696
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113696

Click the images to see detailed statistics about the episode.

d50

113695

Click the images to see detailed statistics about the episode.

d40

113694

Click the images to see detailed statistics about the episode.

d30

113693

Click the images to see detailed statistics about the episode.

d45

113692

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113696sim-4of5successyes0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.0262864998271315


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.0262864998271315
distance-from-start_median2.0262864998271315
distance-from-start_min2.0262864998271315
driven_any_max2.8110280164089847
driven_any_mean2.8110280164089847
driven_any_median2.8110280164089847
driven_any_min2.8110280164089847
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max34.25000000000019
in-drivable-lane_mean34.25000000000019
in-drivable-lane_median34.25000000000019
in-drivable-lane_min34.25000000000019
per-episodes
details{"d50-ego0": {"driven_any": 2.8110280164089847, "survival_time": 34.25000000000019, "driven_lanedir": 0.0, "in-drivable-lane": 34.25000000000019, "deviation-heading": 0.0, "distance-from-start": 2.0262864998271315, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max34.25000000000019
survival_time_mean34.25000000000019
survival_time_median34.25000000000019
survival_time_min34.25000000000019
No reset possible
113695sim-2of5successyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8425115901356065


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8425115901356065
distance-from-start_median0.8425115901356065
distance-from-start_min0.8425115901356065
driven_any_max0.8664893977905184
driven_any_mean0.8664893977905184
driven_any_median0.8664893977905184
driven_any_min0.8664893977905184
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max12.750000000000046
in-drivable-lane_mean12.750000000000046
in-drivable-lane_median12.750000000000046
in-drivable-lane_min12.750000000000046
per-episodes
details{"d40-ego0": {"driven_any": 0.8664893977905184, "survival_time": 12.750000000000046, "driven_lanedir": 0.0, "in-drivable-lane": 12.750000000000046, "deviation-heading": 0.0, "distance-from-start": 0.8425115901356065, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max12.750000000000046
survival_time_mean12.750000000000046
survival_time_median12.750000000000046
survival_time_min12.750000000000046
No reset possible
113694sim-3of5successyes0:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.33049554778819


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.33049554778819
distance-from-start_median3.33049554778819
distance-from-start_min3.33049554778819
driven_any_max3.638310564584782
driven_any_mean3.638310564584782
driven_any_median3.638310564584782
driven_any_min3.638310564584782
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max44.749999999999595
in-drivable-lane_mean44.749999999999595
in-drivable-lane_median44.749999999999595
in-drivable-lane_min44.749999999999595
per-episodes
details{"d30-ego0": {"driven_any": 3.638310564584782, "survival_time": 44.749999999999595, "driven_lanedir": 0.0, "in-drivable-lane": 44.749999999999595, "deviation-heading": 0.0, "distance-from-start": 3.33049554778819, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max44.749999999999595
survival_time_mean44.749999999999595
survival_time_median44.749999999999595
survival_time_min44.749999999999595
No reset possible
113693sim-0of5successyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.682879405501932


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.682879405501932
distance-from-start_median1.682879405501932
distance-from-start_min1.682879405501932
driven_any_max1.7063277606533798
driven_any_mean1.7063277606533798
driven_any_median1.7063277606533798
driven_any_min1.7063277606533798
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max19.900000000000148
in-drivable-lane_mean19.900000000000148
in-drivable-lane_median19.900000000000148
in-drivable-lane_min19.900000000000148
per-episodes
details{"d45-ego0": {"driven_any": 1.7063277606533798, "survival_time": 19.900000000000148, "driven_lanedir": 0.0, "in-drivable-lane": 19.900000000000148, "deviation-heading": 0.0, "distance-from-start": 1.682879405501932, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max19.900000000000148
survival_time_mean19.900000000000148
survival_time_median19.900000000000148
survival_time_min19.900000000000148
No reset possible
113692sim-1of5successyes0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.015781254106467


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.015781254106467
distance-from-start_median2.015781254106467
distance-from-start_min2.015781254106467
driven_any_max2.784433817640153
driven_any_mean2.784433817640153
driven_any_median2.784433817640153
driven_any_min2.784433817640153
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max34.40000000000018
in-drivable-lane_mean34.40000000000018
in-drivable-lane_median34.40000000000018
in-drivable-lane_min34.40000000000018
per-episodes
details{"d50-ego0": {"driven_any": 2.784433817640153, "survival_time": 34.40000000000018, "driven_lanedir": 0.0, "in-drivable-lane": 34.40000000000018, "deviation-heading": 0.0, "distance-from-start": 2.015781254106467, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max34.40000000000018
survival_time_mean34.40000000000018
survival_time_median34.40000000000018
survival_time_min34.40000000000018
No reset possible
113689sim-2of5successyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113686sim-0of5successyes0:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113684sim-2of5successyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113683sim-4of5successyes0:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113682sim-3of5successyes0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113679sim-1of5successyes0:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113677sim-0of5successyes0:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113675sim-2of5successyes0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113673sim-4of5successyes0:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113672sim-2of5successyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113671sim-3of5successyes0:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113670sim-1of5successyes0:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113669sim-0of5successyes0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94046sim-0of5successno0:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94045sim-2of5successno0:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94044sim-3of5successno0:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94043sim-1of5successno0:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94042sim-2of5successno0:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94041sim-4of5successno0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74320sim-4of5successno0:05:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74271sim-1of5successno0:05:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74270sim-0of5successno0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74269sim-3of5successno0:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74267sim-4of5host-errorno0:05:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [b4ff129cef473ee3965c2aad6d9b9d7187a405abf618181f3870ae09f7eef1cb]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:841534bf59ddb792959a6b025c9143161ae2ba717993f444adf67709f97283ee
│                │ │ environment:
│                │ │ dict[11]
│                │ │ │ replica: {"index": 4, "total": 5}
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 3
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: mooc-BV1
│                │ │ │ challenge_step_name: sim-4of5
│                │ │ │ submission_id: 14396
│                │ │ │ submitter_name: Kiyo Kunii
│                │ │ │ SUBMISSION_CONTAINER: docker.io/921kiyo/aido-submissions:2021_04_17_11_00_14@sha256:34db441d5bcf7da3b2aec6ede7c62de47aeaf46d8a07ba57c3113e216cd48a32
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-07_a929a5d11afe
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/mooc-BV1/submission14396/sim-4of5-nogpu-production-b-spot-3-07_a929a5d11afe-job74267-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/mooc-BV1/submission14396/sim-4of5-nogpu-production-b-spot-3-07_a929a5d11afe-job74267-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_20_55_08-36841/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:74989d3337d7fc221b8550c34dab1359eb18109113950b27deaa647a983417e0
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 4, "total": 5}
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  #color_ground: [0, 0, 0] # black
│                │ │ │ |  #color_sky: [0, 0, 0.1] # dark blue
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ |terminate_on_ool: false
│                │ │ │ |terminate_on_out_of_tile: true
│                │ │ │ |terminate_on_collision: true
│                │ │ │ |topdown_resolution: 300
│                │ │ │ |max_pixel_mov: 1000
│                │ │ │ |debug_profile: False
│                │ │ │ |debug_profile_summary: True
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: mooc-BV1
│                │ │ │ challenge_step_name: sim-4of5
│                │ │ │ submission_id: 14396
│                │ │ │ submitter_name: Kiyo Kunii
│                │ │ │ SUBMISSION_CONTAINER: docker.io/921kiyo/aido-submissions:2021_04_17_11_00_14@sha256:34db441d5bcf7da3b2aec6ede7c62de47aeaf46d8a07ba57c3113e216cd48a32
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-07_a929a5d11afe
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/mooc-BV1/submission14396/sim-4of5-nogpu-production-b-spot-3-07_a929a5d11afe-job74267-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/mooc-BV1/submission14396/sim-4of5-nogpu-production-b-spot-3-07_a929a5d11afe-job74267-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_20_55_08-36841/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/921kiyo/aido-submissions@sha256:34db441d5bcf7da3b2aec6ede7c62de47aeaf46d8a07ba57c3113e216cd48a32
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 4, "total": 5}
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: mooc-BV1
│                │ │ │ challenge_step_name: sim-4of5
│                │ │ │ submission_id: 14396
│                │ │ │ submitter_name: Kiyo Kunii
│                │ │ │ SUBMISSION_CONTAINER: docker.io/921kiyo/aido-submissions:2021_04_17_11_00_14@sha256:34db441d5bcf7da3b2aec6ede7c62de47aeaf46d8a07ba57c3113e216cd48a32
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-07_a929a5d11afe
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/mooc-BV1/submission14396/sim-4of5-nogpu-production-b-spot-3-07_a929a5d11afe-job74267-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/mooc-BV1/submission14396/sim-4of5-nogpu-production-b-spot-3-07_a929a5d11afe-job74267-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_20_55_08-36841/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {evaluator: b4ff129cef473ee3965c2aad6d9b9d7187a405abf618181f3870ae09f7eef1cb}
│         names: dict[1]
│                │ b4ff129cef473ee3965c2aad6d9b9d7187a405abf618181f3870ae09f7eef1cb: nogpu-production-b-spot-3-07_a929a5d11afe-job74267-29607_evaluator_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |b4ff129cef473ee3965c2aad6d9b9d7187a405abf618181f3870ae09f7eef1cb
│         |
│  names: dict[1]
│         │ b4ff129cef473ee3965c2aad6d9b9d7187a405abf618181f3870ae09f7eef1cb: nogpu-production-b-spot-3-07_a929a5d11afe-job74267-29607_evaluator_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74266sim-2of5successno0:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70425sim-4of5errorno0:04:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70424sim-2of5errorno0:02:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70423sim-1of5errorno0:04:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70422sim-0of5errorno0:03:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70421sim-3of5errorno0:05:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67429sim-0of5successno0:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67428sim-3of5successno0:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67427sim-1of5successno0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67426sim-2of5successno0:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67425sim-4of5successno0:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67424sim-4of5successno0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67423sim-0of5successno0:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67422sim-3of5successno0:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67421sim-2of5successno0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67420sim-1of5successno0:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67419sim-4of5successno0:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible