Duckietown Challenges Home Challenges Submissions

Submission 14487

Submission14487
Competingyes
Challengemooc-BV1
UserSampsa Ranta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113075 sim-1of5: 113074 sim-2of5: 113117 sim-3of5: 113109 sim-4of5: 113116
Next
User labelNeed Z to fly! This duck votes yellow.
Admin priority50
Blessingn/a
User priority50

113117

Click the images to see detailed statistics about the episode.

d40

113116

Click the images to see detailed statistics about the episode.

d60

113109

Click the images to see detailed statistics about the episode.

d30

113075

Click the images to see detailed statistics about the episode.

d45

113074

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113117sim-2of5successyes0:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.292188096055347


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.292188096055347
distance-from-start_median6.292188096055347
distance-from-start_min6.292188096055347
driven_any_max6.313199065687806
driven_any_mean6.313199065687806
driven_any_median6.313199065687806
driven_any_min6.313199065687806
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max24.650000000000215
in-drivable-lane_mean24.650000000000215
in-drivable-lane_median24.650000000000215
in-drivable-lane_min24.650000000000215
per-episodes
details{"d40-ego0": {"driven_any": 6.313199065687806, "survival_time": 24.650000000000215, "driven_lanedir": 0.0, "in-drivable-lane": 24.650000000000215, "deviation-heading": 0.0, "distance-from-start": 6.292188096055347, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max24.650000000000215
survival_time_mean24.650000000000215
survival_time_median24.650000000000215
survival_time_min24.650000000000215
No reset possible
113116sim-4of5successyes0:03:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.342186412055622


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.342186412055622
distance-from-start_median5.342186412055622
distance-from-start_min5.342186412055622
driven_any_max5.412937314488762
driven_any_mean5.412937314488762
driven_any_median5.412937314488762
driven_any_min5.412937314488762
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.950000000000205
in-drivable-lane_mean23.950000000000205
in-drivable-lane_median23.950000000000205
in-drivable-lane_min23.950000000000205
per-episodes
details{"d60-ego0": {"driven_any": 5.412937314488762, "survival_time": 23.950000000000205, "driven_lanedir": 0.0, "in-drivable-lane": 23.950000000000205, "deviation-heading": 0.0, "distance-from-start": 5.342186412055622, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.950000000000205
survival_time_mean23.950000000000205
survival_time_median23.950000000000205
survival_time_min23.950000000000205
No reset possible
113109sim-3of5successyes0:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.1695910993517975


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.1695910993517975
distance-from-start_median6.1695910993517975
distance-from-start_min6.1695910993517975
driven_any_max6.178599396666773
driven_any_mean6.178599396666773
driven_any_median6.178599396666773
driven_any_min6.178599396666773
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max38.49999999999995
in-drivable-lane_mean38.49999999999995
in-drivable-lane_median38.49999999999995
in-drivable-lane_min38.49999999999995
per-episodes
details{"d30-ego0": {"driven_any": 6.178599396666773, "survival_time": 38.49999999999995, "driven_lanedir": 0.0, "in-drivable-lane": 38.49999999999995, "deviation-heading": 0.0, "distance-from-start": 6.1695910993517975, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max38.49999999999995
survival_time_mean38.49999999999995
survival_time_median38.49999999999995
survival_time_min38.49999999999995
No reset possible
113104sim-2of5successyes0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113103sim-4of5successyes0:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113093sim-2of5successyes0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113091sim-3of5successyes0:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113090sim-4of5successyes0:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113075sim-0of5successyes0:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.981736557339993


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.981736557339993
distance-from-start_median4.981736557339993
distance-from-start_min4.981736557339993
driven_any_max5.022695328093342
driven_any_mean5.022695328093342
driven_any_median5.022695328093342
driven_any_min5.022695328093342
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max22.300000000000185
in-drivable-lane_mean22.300000000000185
in-drivable-lane_median22.300000000000185
in-drivable-lane_min22.300000000000185
per-episodes
details{"d45-ego0": {"driven_any": 5.022695328093342, "survival_time": 22.300000000000185, "driven_lanedir": 0.0, "in-drivable-lane": 22.300000000000185, "deviation-heading": 0.0, "distance-from-start": 4.981736557339993, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max22.300000000000185
survival_time_mean22.300000000000185
survival_time_median22.300000000000185
survival_time_min22.300000000000185
No reset possible
113074sim-1of5successyes0:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.296404762511305


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.296404762511305
distance-from-start_median5.296404762511305
distance-from-start_min5.296404762511305
driven_any_max5.358595611262016
driven_any_mean5.358595611262016
driven_any_median5.358595611262016
driven_any_min5.358595611262016
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.4000000000002
in-drivable-lane_mean23.4000000000002
in-drivable-lane_median23.4000000000002
in-drivable-lane_min23.4000000000002
per-episodes
details{"d60-ego0": {"driven_any": 5.358595611262016, "survival_time": 23.4000000000002, "driven_lanedir": 0.0, "in-drivable-lane": 23.4000000000002, "deviation-heading": 0.0, "distance-from-start": 5.296404762511305, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.4000000000002
survival_time_mean23.4000000000002
survival_time_median23.4000000000002
survival_time_min23.4000000000002
No reset possible
93469sim-3of5successno0:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93468sim-4of5successno0:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93466sim-0of5successno0:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93461sim-1of5successno0:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93459sim-2of5successno0:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73738sim-4of5successno0:04:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73735sim-3of5successno0:06:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73610sim-0of5successno0:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73607sim-1of5successno0:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73603sim-2of5successno0:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69987sim-1of5errorno0:04:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69985sim-3of5errorno0:05:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69984sim-0of5errorno0:04:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69983sim-4of5errorno0:04:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69981sim-2of5errorno0:03:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68564sim-4of5successno0:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68563sim-1of5successno0:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68562sim-0of5successno0:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68561sim-3of5successno0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68560sim-2of5successno0:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible