Duckietown Challenges Home Challenges Submissions

Submission 14228

Submission14228
Competingyes
Challengemooc-BV1
UserBirgit Jaekel
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113775 sim-1of5: 113781 sim-2of5: 113778 sim-3of5: 113765 sim-4of5: 113779
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113781

Click the images to see detailed statistics about the episode.

d60

113779

Click the images to see detailed statistics about the episode.

d60

113778

Click the images to see detailed statistics about the episode.

d40

113775

Click the images to see detailed statistics about the episode.

d45

113765

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113781sim-1of5successyes0:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4563959728712434


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4563959728712434
distance-from-start_median1.4563959728712434
distance-from-start_min1.4563959728712434
driven_any_max1.4693956937583044
driven_any_mean1.4693956937583044
driven_any_median1.4693956937583044
driven_any_min1.4693956937583044
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max21.50000000000017
in-drivable-lane_mean21.50000000000017
in-drivable-lane_median21.50000000000017
in-drivable-lane_min21.50000000000017
per-episodes
details{"d60-ego0": {"driven_any": 1.4693956937583044, "survival_time": 21.50000000000017, "driven_lanedir": 0.0, "in-drivable-lane": 21.50000000000017, "deviation-heading": 0.0, "distance-from-start": 1.4563959728712434, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max21.50000000000017
survival_time_mean21.50000000000017
survival_time_median21.50000000000017
survival_time_min21.50000000000017
No reset possible
113779sim-4of5successyes0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1592190138010414


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1592190138010414
distance-from-start_median1.1592190138010414
distance-from-start_min1.1592190138010414
driven_any_max1.1633970735494483
driven_any_mean1.1633970735494483
driven_any_median1.1633970735494483
driven_any_min1.1633970735494483
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max18.10000000000012
in-drivable-lane_mean18.10000000000012
in-drivable-lane_median18.10000000000012
in-drivable-lane_min18.10000000000012
per-episodes
details{"d60-ego0": {"driven_any": 1.1633970735494483, "survival_time": 18.10000000000012, "driven_lanedir": 0.0, "in-drivable-lane": 18.10000000000012, "deviation-heading": 0.0, "distance-from-start": 1.1592190138010414, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max18.10000000000012
survival_time_mean18.10000000000012
survival_time_median18.10000000000012
survival_time_min18.10000000000012
No reset possible
113778sim-2of5successyes0:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8657264059900301


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8657264059900301
distance-from-start_median0.8657264059900301
distance-from-start_min0.8657264059900301
driven_any_max0.8707471212744766
driven_any_mean0.8707471212744766
driven_any_median0.8707471212744766
driven_any_min0.8707471212744766
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max13.250000000000052
in-drivable-lane_mean13.250000000000052
in-drivable-lane_median13.250000000000052
in-drivable-lane_min13.250000000000052
per-episodes
details{"d40-ego0": {"driven_any": 0.8707471212744766, "survival_time": 13.250000000000052, "driven_lanedir": 0.0, "in-drivable-lane": 13.250000000000052, "deviation-heading": 0.0, "distance-from-start": 0.8657264059900301, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max13.250000000000052
survival_time_mean13.250000000000052
survival_time_median13.250000000000052
survival_time_min13.250000000000052
No reset possible
113775sim-0of5successyes0:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.233387751796674


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.233387751796674
distance-from-start_median2.233387751796674
distance-from-start_min2.233387751796674
driven_any_max2.2372470744055803
driven_any_mean2.2372470744055803
driven_any_median2.2372470744055803
driven_any_min2.2372470744055803
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max36.10000000000009
in-drivable-lane_mean36.10000000000009
in-drivable-lane_median36.10000000000009
in-drivable-lane_min36.10000000000009
per-episodes
details{"d45-ego0": {"driven_any": 2.2372470744055803, "survival_time": 36.10000000000009, "driven_lanedir": 0.0, "in-drivable-lane": 36.10000000000009, "deviation-heading": 0.0, "distance-from-start": 2.233387751796674, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max36.10000000000009
survival_time_mean36.10000000000009
survival_time_median36.10000000000009
survival_time_min36.10000000000009
No reset possible
113769sim-2of5successyes0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113765sim-3of5successyes0:04:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.579600000000537


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.579600000000537
distance-from-start_median3.579600000000537
distance-from-start_min3.579600000000537
driven_any_max3.579600000000637
driven_any_mean3.579600000000637
driven_any_median3.579600000000637
driven_any_min3.579600000000637
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 3.579600000000637, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 3.579600000000537, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113764sim-1of5successyes0:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113763sim-0of5successyes0:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113762sim-2of5successyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113761sim-4of5successyes0:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94179sim-2of5successno0:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94175sim-2of5successno0:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94174sim-1of5successno0:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94171sim-4of5successno0:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94162sim-3of5successno0:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94161sim-0of5successno0:06:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74347sim-2of5successno0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74338sim-1of5successno0:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74337sim-4of5successno0:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74336sim-2of5successno0:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74335sim-3of5successno0:09:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74334sim-0of5successno0:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70469sim-2of5errorno0:02:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70467sim-1of5errorno0:06:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70466sim-3of5errorno0:07:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70465sim-0of5errorno0:05:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70464sim-4of5errorno0:03:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70463sim-2of5errorno0:02:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67500sim-3of5successno0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67499sim-4of5successno0:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67498sim-0of5successno0:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67497sim-3of5successno0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67496sim-2of5successno0:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67494sim-1of5successno0:05:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67046sim-3of5successno0:09:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67045sim-1of5successno0:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67044sim-2of5successno0:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67043sim-4of5successno0:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67042sim-0of5successno0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66998487abortedyes0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66997488abortedyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66996491abortedyes0:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66995488abortedyes0:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66994490abortedyes0:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66993489abortedyes0:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66992487abortedyes0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible