Duckietown Challenges Home Challenges Submissions

Submission 14836

Submission14836
Competingyes
Challengemooc-BV1
UserJerry Kuch
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 112848 sim-1of5: 112863 sim-2of5: 112879 sim-3of5: 112846 sim-4of5: 112856
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

112879

Click the images to see detailed statistics about the episode.

d40

112863

Click the images to see detailed statistics about the episode.

d50

112856

Click the images to see detailed statistics about the episode.

d50

112848

Click the images to see detailed statistics about the episode.

d45

112846

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
112879sim-2of5successyes0:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1156000000001285


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1156000000001285
distance-from-start_median2.1156000000001285
distance-from-start_min2.1156000000001285
driven_any_max2.1156000000001742
driven_any_mean2.1156000000001742
driven_any_median2.1156000000001742
driven_any_min2.1156000000001742
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max36.300000000000075
in-drivable-lane_mean36.300000000000075
in-drivable-lane_median36.300000000000075
in-drivable-lane_min36.300000000000075
per-episodes
details{"d40-ego0": {"driven_any": 2.1156000000001742, "survival_time": 36.300000000000075, "driven_lanedir": 0.0, "in-drivable-lane": 36.300000000000075, "deviation-heading": 0.0, "distance-from-start": 2.1156000000001285, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max36.300000000000075
survival_time_mean36.300000000000075
survival_time_median36.300000000000075
survival_time_min36.300000000000075
No reset possible
112863sim-1of5successyes0:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6526000000000187


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6526000000000187
distance-from-start_median2.6526000000000187
distance-from-start_min2.6526000000000187
driven_any_max2.6526000000000804
driven_any_mean2.6526000000000804
driven_any_median2.6526000000000804
driven_any_min2.6526000000000804
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max45.24999999999957
in-drivable-lane_mean45.24999999999957
in-drivable-lane_median45.24999999999957
in-drivable-lane_min45.24999999999957
per-episodes
details{"d50-ego0": {"driven_any": 2.6526000000000804, "survival_time": 45.24999999999957, "driven_lanedir": 0.0, "in-drivable-lane": 45.24999999999957, "deviation-heading": 0.0, "distance-from-start": 2.6526000000000187, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max45.24999999999957
survival_time_mean45.24999999999957
survival_time_median45.24999999999957
survival_time_min45.24999999999957
No reset possible
112857sim-2of5successyes0:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
112856sim-4of5successyes0:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6526000000000187


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6526000000000187
distance-from-start_median2.6526000000000187
distance-from-start_min2.6526000000000187
driven_any_max2.6526000000000804
driven_any_mean2.6526000000000804
driven_any_median2.6526000000000804
driven_any_min2.6526000000000804
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max45.24999999999957
in-drivable-lane_mean45.24999999999957
in-drivable-lane_median45.24999999999957
in-drivable-lane_min45.24999999999957
per-episodes
details{"d50-ego0": {"driven_any": 2.6526000000000804, "survival_time": 45.24999999999957, "driven_lanedir": 0.0, "in-drivable-lane": 45.24999999999957, "deviation-heading": 0.0, "distance-from-start": 2.6526000000000187, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max45.24999999999957
survival_time_mean45.24999999999957
survival_time_median45.24999999999957
survival_time_min45.24999999999957
No reset possible
112852sim-4of5successyes0:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
112851sim-2of5successyes0:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
112849sim-1of5successyes0:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
112848sim-0of5successyes0:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.187600000000101


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.187600000000101
distance-from-start_median2.187600000000101
distance-from-start_min2.187600000000101
driven_any_max2.1876000000001468
driven_any_mean2.1876000000001468
driven_any_median2.1876000000001468
driven_any_min2.1876000000001468
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max37.50000000000001
in-drivable-lane_mean37.50000000000001
in-drivable-lane_median37.50000000000001
in-drivable-lane_min37.50000000000001
per-episodes
details{"d45-ego0": {"driven_any": 2.1876000000001468, "survival_time": 37.50000000000001, "driven_lanedir": 0.0, "in-drivable-lane": 37.50000000000001, "deviation-heading": 0.0, "distance-from-start": 2.187600000000101, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max37.50000000000001
survival_time_mean37.50000000000001
survival_time_median37.50000000000001
survival_time_min37.50000000000001
No reset possible
112846sim-3of5successyes0:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.579600000000537


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.579600000000537
distance-from-start_median3.579600000000537
distance-from-start_min3.579600000000537
driven_any_max3.579600000000637
driven_any_mean3.579600000000637
driven_any_median3.579600000000637
driven_any_min3.579600000000637
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 3.579600000000637, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 3.579600000000537, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
93053sim-1of5successno0:08:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93051sim-2of5successno0:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93050sim-4of5successno0:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93049sim-3of5successno0:18:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93048sim-0of5successno0:08:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
71275sim-2of5successno0:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
71272sim-1of5successno0:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
71270sim-3of5successno0:08:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
71269sim-4of5successno0:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
71266sim-0of5successno0:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70760sim-3of5abortedno0:01:51
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70759sim-1of5abortedno0:02:12
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70758sim-4of5host-errorno0:03:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 771, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 265, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 261, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/mooc-BV1/submission14836/sim-4of5-nogpu-production-b-spot-0-04_5c447f332023-job70758-a-wd/challenge-evaluation-output/episodes/d60/ui_image.mp4.palette.tmp.png'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69504sim-4of5errorno0:03:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69501sim-4of5errorno0:03:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69500sim-3of5errorno0:07:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69499sim-1of5errorno0:07:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69498sim-0of5errorno0:06:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69493sim-2of5errorno0:05:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible