Duckietown Challenges Home Challenges Submissions

Submission 14486

Submission14486
Competingyes
Challengemooc-BV1
UserSampsa Ranta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113115 sim-1of5: 113122 sim-2of5: 113146 sim-3of5: 113119 sim-4of5: 113147
Next
User labelNeed Z to fly! This duck votes yellow.
Admin priority50
Blessingn/a
User priority50

113147

Click the images to see detailed statistics about the episode.

d50

113146

Click the images to see detailed statistics about the episode.

d40

113122

Click the images to see detailed statistics about the episode.

d60

113119

Click the images to see detailed statistics about the episode.

d30

113115

Click the images to see detailed statistics about the episode.

d45

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113147sim-4of5successyes0:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.937004122066866


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.937004122066866
distance-from-start_median5.937004122066866
distance-from-start_min5.937004122066866
driven_any_max6.00158486435785
driven_any_mean6.00158486435785
driven_any_median6.00158486435785
driven_any_min6.00158486435785
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.800000000000203
in-drivable-lane_mean23.800000000000203
in-drivable-lane_median23.800000000000203
in-drivable-lane_min23.800000000000203
per-episodes
details{"d50-ego0": {"driven_any": 6.00158486435785, "survival_time": 23.800000000000203, "driven_lanedir": 0.0, "in-drivable-lane": 23.800000000000203, "deviation-heading": 0.0, "distance-from-start": 5.937004122066866, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.800000000000203
survival_time_mean23.800000000000203
survival_time_median23.800000000000203
survival_time_min23.800000000000203
No reset possible
113146sim-2of5successyes0:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.877944108221285


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.877944108221285
distance-from-start_median5.877944108221285
distance-from-start_min5.877944108221285
driven_any_max5.911285259586588
driven_any_mean5.911285259586588
driven_any_median5.911285259586588
driven_any_min5.911285259586588
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.350000000000197
in-drivable-lane_mean23.350000000000197
in-drivable-lane_median23.350000000000197
in-drivable-lane_min23.350000000000197
per-episodes
details{"d40-ego0": {"driven_any": 5.911285259586588, "survival_time": 23.350000000000197, "driven_lanedir": 0.0, "in-drivable-lane": 23.350000000000197, "deviation-heading": 0.0, "distance-from-start": 5.877944108221285, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.350000000000197
survival_time_mean23.350000000000197
survival_time_median23.350000000000197
survival_time_min23.350000000000197
No reset possible
113137sim-2of5successyes0:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113134sim-4of5successyes0:03:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113125sim-2of5successyes0:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113122sim-1of5successyes0:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.498453143162688


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.498453143162688
distance-from-start_median3.498453143162688
distance-from-start_min3.498453143162688
driven_any_max3.545114257001857
driven_any_mean3.545114257001857
driven_any_median3.545114257001857
driven_any_min3.545114257001857
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max15.10000000000008
in-drivable-lane_mean15.10000000000008
in-drivable-lane_median15.10000000000008
in-drivable-lane_min15.10000000000008
per-episodes
details{"d60-ego0": {"driven_any": 3.545114257001857, "survival_time": 15.10000000000008, "driven_lanedir": 0.0, "in-drivable-lane": 15.10000000000008, "deviation-heading": 0.0, "distance-from-start": 3.498453143162688, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max15.10000000000008
survival_time_mean15.10000000000008
survival_time_median15.10000000000008
survival_time_min15.10000000000008
No reset possible
113121sim-4of5successyes0:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113119sim-3of5successyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.532385944944057


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.532385944944057
distance-from-start_median5.532385944944057
distance-from-start_min5.532385944944057
driven_any_max5.544364772565507
driven_any_mean5.544364772565507
driven_any_median5.544364772565507
driven_any_min5.544364772565507
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max21.850000000000176
in-drivable-lane_mean21.850000000000176
in-drivable-lane_median21.850000000000176
in-drivable-lane_min21.850000000000176
per-episodes
details{"d30-ego0": {"driven_any": 5.544364772565507, "survival_time": 21.850000000000176, "driven_lanedir": 0.0, "in-drivable-lane": 21.850000000000176, "deviation-heading": 0.0, "distance-from-start": 5.532385944944057, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max21.850000000000176
survival_time_mean21.850000000000176
survival_time_median21.850000000000176
survival_time_min21.850000000000176
No reset possible
113118sim-2of5successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113115sim-0of5successyes0:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.4798077300826264


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.4798077300826264
distance-from-start_median5.4798077300826264
distance-from-start_min5.4798077300826264
driven_any_max5.553097264707905
driven_any_mean5.553097264707905
driven_any_median5.553097264707905
driven_any_min5.553097264707905
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max22.450000000000184
in-drivable-lane_mean22.450000000000184
in-drivable-lane_median22.450000000000184
in-drivable-lane_min22.450000000000184
per-episodes
details{"d45-ego0": {"driven_any": 5.553097264707905, "survival_time": 22.450000000000184, "driven_lanedir": 0.0, "in-drivable-lane": 22.450000000000184, "deviation-heading": 0.0, "distance-from-start": 5.4798077300826264, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max22.450000000000184
survival_time_mean22.450000000000184
survival_time_median22.450000000000184
survival_time_min22.450000000000184
No reset possible
113108sim-1of5successyes0:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113107sim-3of5successyes0:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113102sim-0of5successyes0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113097sim-1of5successyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113095sim-3of5successyes0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93475sim-1of5successno0:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93474sim-3of5successno0:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93473sim-4of5successno0:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93472sim-1of5successno0:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93471sim-2of5successno0:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93470sim-0of5successno0:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73768sim-3of5successno0:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73762sim-4of5successno0:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73760sim-0of5successno0:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73755sim-2of5successno0:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73745sim-1of5successno0:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70102sim-1of5errorno0:03:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70100sim-2of5errorno0:03:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70094sim-3of5errorno0:03:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69990sim-4of5errorno0:02:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69986sim-0of5errorno0:03:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68559sim-4of5successno0:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68558sim-2of5successno0:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68557sim-3of5successno0:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68556sim-1of5successno0:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68555sim-0of5successno0:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible