Duckietown Challenges Home Challenges Submissions

Submission 14214

Submission14214
Competingyes
Challengemooc-BV1
UserMustafa Kaan Calik
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113870 sim-1of5: 113862 sim-2of5: 113863 sim-3of5: 113868 sim-4of5: 113866
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113870

Click the images to see detailed statistics about the episode.

d45

113868

Click the images to see detailed statistics about the episode.

d30

113866

Click the images to see detailed statistics about the episode.

d60

113863

Click the images to see detailed statistics about the episode.

d40

113862

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113870sim-0of5successyes0:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.34150127307017


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.34150127307017
distance-from-start_median2.34150127307017
distance-from-start_min2.34150127307017
driven_any_max3.7728920209253127
driven_any_mean3.7728920209253127
driven_any_median3.7728920209253127
driven_any_min3.7728920209253127
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max27.00000000000025
in-drivable-lane_mean27.00000000000025
in-drivable-lane_median27.00000000000025
in-drivable-lane_min27.00000000000025
per-episodes
details{"d45-ego0": {"driven_any": 3.7728920209253127, "survival_time": 27.00000000000025, "driven_lanedir": 0.0, "in-drivable-lane": 27.00000000000025, "deviation-heading": 0.0, "distance-from-start": 2.34150127307017, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max27.00000000000025
survival_time_mean27.00000000000025
survival_time_median27.00000000000025
survival_time_min27.00000000000025
No reset possible
113868sim-3of5successyes0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.8274591206542965


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.8274591206542965
distance-from-start_median1.8274591206542965
distance-from-start_min1.8274591206542965
driven_any_max2.273098385521704
driven_any_mean2.273098385521704
driven_any_median2.273098385521704
driven_any_min2.273098385521704
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max17.15000000000011
in-drivable-lane_mean17.15000000000011
in-drivable-lane_median17.15000000000011
in-drivable-lane_min17.15000000000011
per-episodes
details{"d30-ego0": {"driven_any": 2.273098385521704, "survival_time": 17.15000000000011, "driven_lanedir": 0.0, "in-drivable-lane": 17.15000000000011, "deviation-heading": 0.0, "distance-from-start": 1.8274591206542965, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max17.15000000000011
survival_time_mean17.15000000000011
survival_time_median17.15000000000011
survival_time_min17.15000000000011
No reset possible
113866sim-4of5successyes0:06:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.663608875273661


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.663608875273661
distance-from-start_median3.663608875273661
distance-from-start_min3.663608875273661
driven_any_max8.252025533501211
driven_any_mean8.252025533501211
driven_any_median8.252025533501211
driven_any_min8.252025533501211
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 8.252025533501211, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 3.663608875273661, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113863sim-2of5successyes0:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.809957196452067


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.809957196452067
distance-from-start_median1.809957196452067
distance-from-start_min1.809957196452067
driven_any_max4.154614598912418
driven_any_mean4.154614598912418
driven_any_median4.154614598912418
driven_any_min4.154614598912418
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max30.7000000000003
in-drivable-lane_mean30.7000000000003
in-drivable-lane_median30.7000000000003
in-drivable-lane_min30.7000000000003
per-episodes
details{"d40-ego0": {"driven_any": 4.154614598912418, "survival_time": 30.7000000000003, "driven_lanedir": 0.0, "in-drivable-lane": 30.7000000000003, "deviation-heading": 0.0, "distance-from-start": 1.809957196452067, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max30.7000000000003
survival_time_mean30.7000000000003
survival_time_median30.7000000000003
survival_time_min30.7000000000003
No reset possible
113862sim-1of5successyes0:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.676054088881568


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.676054088881568
distance-from-start_median3.676054088881568
distance-from-start_min3.676054088881568
driven_any_max8.241167814254466
driven_any_mean8.241167814254466
driven_any_median8.241167814254466
driven_any_min8.241167814254466
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 8.241167814254466, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 3.676054088881568, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113860sim-3of5successyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113857sim-3of5successyes0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113856sim-1of5successyes0:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113855sim-0of5successyes0:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113854sim-2of5successyes0:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113852sim-4of5successyes0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94305sim-3of5successno0:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94304sim-4of5successno0:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94303sim-0of5successno0:09:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94302sim-2of5successno0:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94301sim-3of5successno0:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94300sim-1of5successno0:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74399sim-3of5successno0:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74391sim-4of5successno0:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74389sim-0of5successno0:09:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74388sim-3of5successno0:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74387sim-2of5successno0:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74386sim-1of5successno0:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70508sim-3of5errorno0:02:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70506sim-1of5errorno0:03:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70505sim-4of5errorno0:07:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70504sim-3of5errorno0:02:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70503sim-2of5errorno0:04:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70502sim-0of5errorno0:07:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67522sim-1of5successno0:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67521sim-2of5successno0:09:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67520sim-3of5successno0:08:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67519sim-0of5successno0:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67518sim-4of5successno0:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67081sim-1of5successno0:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67080sim-4of5successno0:10:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67079sim-0of5successno0:06:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67078sim-2of5successno0:08:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67077sim-3of5successno0:06:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66941488successyes0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66940490successyes0:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66939490successyes0:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66938491successyes0:06:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66937488successyes0:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66936489successyes0:08:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66935487successyes0:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible