Duckietown Challenges Home Challenges Submissions

Submission 14404

Submission14404
Competingyes
Challengemooc-BV1
UserDimitrios Dimopoulos
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113633 sim-1of5: 113630 sim-2of5: 113639 sim-3of5: 113635 sim-4of5: 113632
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113639

Click the images to see detailed statistics about the episode.

d40

113635

Click the images to see detailed statistics about the episode.

d30

113633

Click the images to see detailed statistics about the episode.

d45

113632

Click the images to see detailed statistics about the episode.

d60

113630

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113639sim-2of5successyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.9094939083900624


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.9094939083900624
distance-from-start_median0.9094939083900624
distance-from-start_min0.9094939083900624
driven_any_max0.9611863892600716
driven_any_mean0.9611863892600716
driven_any_median0.9611863892600716
driven_any_min0.9611863892600716
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max11.250000000000025
in-drivable-lane_mean11.250000000000025
in-drivable-lane_median11.250000000000025
in-drivable-lane_min11.250000000000025
per-episodes
details{"d40-ego0": {"driven_any": 0.9611863892600716, "survival_time": 11.250000000000025, "driven_lanedir": 0.0, "in-drivable-lane": 11.250000000000025, "deviation-heading": 0.0, "distance-from-start": 0.9094939083900624, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean11.250000000000025
survival_time_median11.250000000000025
survival_time_min11.250000000000025
No reset possible
113635sim-3of5successyes0:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.818131776833524


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.818131776833524
distance-from-start_median1.818131776833524
distance-from-start_min1.818131776833524
driven_any_max2.281143014389725
driven_any_mean2.281143014389725
driven_any_median2.281143014389725
driven_any_min2.281143014389725
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max27.75000000000026
in-drivable-lane_mean27.75000000000026
in-drivable-lane_median27.75000000000026
in-drivable-lane_min27.75000000000026
per-episodes
details{"d30-ego0": {"driven_any": 2.281143014389725, "survival_time": 27.75000000000026, "driven_lanedir": 0.0, "in-drivable-lane": 27.75000000000026, "deviation-heading": 0.0, "distance-from-start": 1.818131776833524, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max27.75000000000026
survival_time_mean27.75000000000026
survival_time_median27.75000000000026
survival_time_min27.75000000000026
No reset possible
113633sim-0of5successyes0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.0246448335557572


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.0246448335557572
distance-from-start_median1.0246448335557572
distance-from-start_min1.0246448335557572
driven_any_max1.2236237293111918
driven_any_mean1.2236237293111918
driven_any_median1.2236237293111918
driven_any_min1.2236237293111918
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max14.600000000000072
in-drivable-lane_mean14.600000000000072
in-drivable-lane_median14.600000000000072
in-drivable-lane_min14.600000000000072
per-episodes
details{"d45-ego0": {"driven_any": 1.2236237293111918, "survival_time": 14.600000000000072, "driven_lanedir": 0.0, "in-drivable-lane": 14.600000000000072, "deviation-heading": 0.0, "distance-from-start": 1.0246448335557572, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max14.600000000000072
survival_time_mean14.600000000000072
survival_time_median14.600000000000072
survival_time_min14.600000000000072
No reset possible
113632sim-4of5successyes0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1853505954678418


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1853505954678418
distance-from-start_median1.1853505954678418
distance-from-start_min1.1853505954678418
driven_any_max1.69960442834684
driven_any_mean1.69960442834684
driven_any_median1.69960442834684
driven_any_min1.69960442834684
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max21.800000000000175
in-drivable-lane_mean21.800000000000175
in-drivable-lane_median21.800000000000175
in-drivable-lane_min21.800000000000175
per-episodes
details{"d60-ego0": {"driven_any": 1.69960442834684, "survival_time": 21.800000000000175, "driven_lanedir": 0.0, "in-drivable-lane": 21.800000000000175, "deviation-heading": 0.0, "distance-from-start": 1.1853505954678418, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max21.800000000000175
survival_time_mean21.800000000000175
survival_time_median21.800000000000175
survival_time_min21.800000000000175
No reset possible
113630sim-1of5successyes0:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.185713815614978


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.185713815614978
distance-from-start_median2.185713815614978
distance-from-start_min2.185713815614978
driven_any_max2.7949734802065427
driven_any_mean2.7949734802065427
driven_any_median2.7949734802065427
driven_any_min2.7949734802065427
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max35.50000000000012
in-drivable-lane_mean35.50000000000012
in-drivable-lane_median35.50000000000012
in-drivable-lane_min35.50000000000012
per-episodes
details{"d60-ego0": {"driven_any": 2.7949734802065427, "survival_time": 35.50000000000012, "driven_lanedir": 0.0, "in-drivable-lane": 35.50000000000012, "deviation-heading": 0.0, "distance-from-start": 2.185713815614978, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max35.50000000000012
survival_time_mean35.50000000000012
survival_time_median35.50000000000012
survival_time_min35.50000000000012
No reset possible
113626sim-3of5successyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113624sim-0of5successyes0:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113623sim-2of5successyes0:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113617sim-3of5successyes0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113616sim-4of5successyes0:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113615sim-0of5successyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113614sim-1of5successyes0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113613sim-2of5successyes0:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93945sim-1of5successno0:09:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93775sim-3of5successno0:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93774sim-1of5timeoutno----No reset possible
93772sim-0of5successno0:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93771sim-4of5successno0:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93768sim-2of5successno0:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93767sim-0of5successno0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74268sim-2of5successno0:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74249sim-3of5successno0:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74242sim-1of5successno0:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74240sim-2of5successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74238sim-4of5successno0:04:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74236sim-0of5successno0:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70404sim-0of5errorno0:02:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70399sim-2of5errorno0:03:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70398sim-1of5errorno0:03:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70397sim-4of5errorno0:03:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70396sim-0of5errorno0:02:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70390sim-3of5errorno0:03:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67891sim-1of5successno0:11:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67890sim-4of5successno0:12:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67889sim-3of5successno0:09:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67888sim-2of5successno0:06:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67887sim-0of5successno0:10:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible