Duckietown Challenges Home Challenges Submissions

Submission 14459

Submission14459
Competingyes
Challengemooc-BV1
UserSloane Simmons
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113315 sim-1of5: 113297 sim-2of5: 113286 sim-3of5: 113312 sim-4of5: 113287
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113315

Click the images to see detailed statistics about the episode.

d45

113312

Click the images to see detailed statistics about the episode.

d30

113297

Click the images to see detailed statistics about the episode.

d60

113287

Click the images to see detailed statistics about the episode.

d60

113286

Click the images to see detailed statistics about the episode.

d40

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113315sim-0of5successyes0:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.225303238225887


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.225303238225887
distance-from-start_median4.225303238225887
distance-from-start_min4.225303238225887
driven_any_max4.88764923809254
driven_any_mean4.88764923809254
driven_any_median4.88764923809254
driven_any_min4.88764923809254
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max49.149999999999345
in-drivable-lane_mean49.149999999999345
in-drivable-lane_median49.149999999999345
in-drivable-lane_min49.149999999999345
per-episodes
details{"d45-ego0": {"driven_any": 4.88764923809254, "survival_time": 49.149999999999345, "driven_lanedir": 0.0, "in-drivable-lane": 49.149999999999345, "deviation-heading": 0.0, "distance-from-start": 4.225303238225887, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max49.149999999999345
survival_time_mean49.149999999999345
survival_time_median49.149999999999345
survival_time_min49.149999999999345
No reset possible
113312sim-3of5successyes0:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.458483334787031


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.458483334787031
distance-from-start_median5.458483334787031
distance-from-start_min5.458483334787031
driven_any_max5.566537769149142
driven_any_mean5.566537769149142
driven_any_median5.566537769149142
driven_any_min5.566537769149142
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max55.94999999999896
in-drivable-lane_mean55.94999999999896
in-drivable-lane_median55.94999999999896
in-drivable-lane_min55.94999999999896
per-episodes
details{"d30-ego0": {"driven_any": 5.566537769149142, "survival_time": 55.94999999999896, "driven_lanedir": 0.0, "in-drivable-lane": 55.94999999999896, "deviation-heading": 0.0, "distance-from-start": 5.458483334787031, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max55.94999999999896
survival_time_mean55.94999999999896
survival_time_median55.94999999999896
survival_time_min55.94999999999896
No reset possible
113299sim-0of5successyes0:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113298sim-3of5successyes0:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113297sim-1of5successyes0:06:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.798586299512098


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.798586299512098
distance-from-start_median4.798586299512098
distance-from-start_min4.798586299512098
driven_any_max5.420559553407235
driven_any_mean5.420559553407235
driven_any_median5.420559553407235
driven_any_min5.420559553407235
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 5.420559553407235, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 4.798586299512098, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113287sim-4of5successyes0:06:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.803496485278349


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.803496485278349
distance-from-start_median4.803496485278349
distance-from-start_min4.803496485278349
driven_any_max5.427102899986642
driven_any_mean5.427102899986642
driven_any_median5.427102899986642
driven_any_min5.427102899986642
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 5.427102899986642, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 4.803496485278349, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113286sim-2of5successyes0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.693730353849562


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.693730353849562
distance-from-start_median4.693730353849562
distance-from-start_min4.693730353849562
driven_any_max5.356288794576964
driven_any_mean5.356288794576964
driven_any_median5.356288794576964
driven_any_min5.356288794576964
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max52.69999999999914
in-drivable-lane_mean52.69999999999914
in-drivable-lane_median52.69999999999914
in-drivable-lane_min52.69999999999914
per-episodes
details{"d40-ego0": {"driven_any": 5.356288794576964, "survival_time": 52.69999999999914, "driven_lanedir": 0.0, "in-drivable-lane": 52.69999999999914, "deviation-heading": 0.0, "distance-from-start": 4.693730353849562, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max52.69999999999914
survival_time_mean52.69999999999914
survival_time_median52.69999999999914
survival_time_min52.69999999999914
No reset possible
93599sim-4of5successno0:16:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93598sim-2of5successno0:08:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93597sim-0of5successno0:09:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93596sim-3of5successno0:08:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93594sim-1of5successno0:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74027sim-4of5successno0:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74025sim-2of5successno0:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74015sim-0of5successno0:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74012sim-3of5successno0:07:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74011sim-1of5successno0:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70232sim-0of5errorno0:07:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70230sim-2of5errorno0:07:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70229sim-1of5errorno0:07:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70228sim-3of5errorno0:06:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70226sim-4of5errorno0:09:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68271sim-4of5successno0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68268sim-1of5successno0:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68267sim-4of5successno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68266sim-1of5successno0:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68265sim-2of5successno0:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68264sim-4of5successno0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68263sim-0of5successno0:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68262sim-3of5successno0:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible