Duckietown Challenges Home Challenges Submissions

Submission 14450

Submission14450
Competingyes
Challengemooc-BV1
UserEthan Frank
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113362 sim-1of5: 113368 sim-2of5: 113364 sim-3of5: 113365 sim-4of5: 113361
Next
User labeledf_exercise_braitenberg
Admin priority50
Blessingn/a
User priority50

113368

Click the images to see detailed statistics about the episode.

d50

113365

Click the images to see detailed statistics about the episode.

d30

113364

Click the images to see detailed statistics about the episode.

d40

113362

Click the images to see detailed statistics about the episode.

d45

113361

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113368sim-1of5successyes0:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.846920008386257


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.846920008386257
distance-from-start_median4.846920008386257
distance-from-start_min4.846920008386257
driven_any_max5.151283008488845
driven_any_mean5.151283008488845
driven_any_median5.151283008488845
driven_any_min5.151283008488845
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max27.15000000000025
in-drivable-lane_mean27.15000000000025
in-drivable-lane_median27.15000000000025
in-drivable-lane_min27.15000000000025
per-episodes
details{"d50-ego0": {"driven_any": 5.151283008488845, "survival_time": 27.15000000000025, "driven_lanedir": 0.0, "in-drivable-lane": 27.15000000000025, "deviation-heading": 0.0, "distance-from-start": 4.846920008386257, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max27.15000000000025
survival_time_mean27.15000000000025
survival_time_median27.15000000000025
survival_time_min27.15000000000025
No reset possible
113365sim-3of5successyes0:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.6424486592695295


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.6424486592695295
distance-from-start_median4.6424486592695295
distance-from-start_min4.6424486592695295
driven_any_max5.001400397432368
driven_any_mean5.001400397432368
driven_any_median5.001400397432368
driven_any_min5.001400397432368
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max25.250000000000224
in-drivable-lane_mean25.250000000000224
in-drivable-lane_median25.250000000000224
in-drivable-lane_min25.250000000000224
per-episodes
details{"d30-ego0": {"driven_any": 5.001400397432368, "survival_time": 25.250000000000224, "driven_lanedir": 0.0, "in-drivable-lane": 25.250000000000224, "deviation-heading": 0.0, "distance-from-start": 4.6424486592695295, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max25.250000000000224
survival_time_mean25.250000000000224
survival_time_median25.250000000000224
survival_time_min25.250000000000224
No reset possible
113364sim-2of5successyes0:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.666061354490135


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.666061354490135
distance-from-start_median4.666061354490135
distance-from-start_min4.666061354490135
driven_any_max5.53481852509155
driven_any_mean5.53481852509155
driven_any_median5.53481852509155
driven_any_min5.53481852509155
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max27.500000000000256
in-drivable-lane_mean27.500000000000256
in-drivable-lane_median27.500000000000256
in-drivable-lane_min27.500000000000256
per-episodes
details{"d40-ego0": {"driven_any": 5.53481852509155, "survival_time": 27.500000000000256, "driven_lanedir": 0.0, "in-drivable-lane": 27.500000000000256, "deviation-heading": 0.0, "distance-from-start": 4.666061354490135, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max27.500000000000256
survival_time_mean27.500000000000256
survival_time_median27.500000000000256
survival_time_min27.500000000000256
No reset possible
113362sim-0of5successyes0:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.159270332604235


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.159270332604235
distance-from-start_median4.159270332604235
distance-from-start_min4.159270332604235
driven_any_max4.845614965669503
driven_any_mean4.845614965669503
driven_any_median4.845614965669503
driven_any_min4.845614965669503
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max24.95000000000022
in-drivable-lane_mean24.95000000000022
in-drivable-lane_median24.95000000000022
in-drivable-lane_min24.95000000000022
per-episodes
details{"d45-ego0": {"driven_any": 4.845614965669503, "survival_time": 24.95000000000022, "driven_lanedir": 0.0, "in-drivable-lane": 24.95000000000022, "deviation-heading": 0.0, "distance-from-start": 4.159270332604235, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max24.95000000000022
survival_time_mean24.95000000000022
survival_time_median24.95000000000022
survival_time_min24.95000000000022
No reset possible
113361sim-4of5successyes0:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.794914973494784


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.794914973494784
distance-from-start_median4.794914973494784
distance-from-start_min4.794914973494784
driven_any_max5.0385718318381985
driven_any_mean5.0385718318381985
driven_any_median5.0385718318381985
driven_any_min5.0385718318381985
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max27.70000000000026
in-drivable-lane_mean27.70000000000026
in-drivable-lane_median27.70000000000026
in-drivable-lane_min27.70000000000026
per-episodes
details{"d60-ego0": {"driven_any": 5.0385718318381985, "survival_time": 27.70000000000026, "driven_lanedir": 0.0, "in-drivable-lane": 27.70000000000026, "deviation-heading": 0.0, "distance-from-start": 4.794914973494784, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_median27.70000000000026
survival_time_min27.70000000000026
No reset possible
113358sim-1of5successyes0:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113357sim-3of5successyes0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113356sim-2of5successyes0:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113348sim-2of5successyes0:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93636sim-1of5successno0:12:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93635sim-4of5successno0:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93630sim-0of5successno0:07:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93628sim-3of5successno0:10:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93627sim-3of5successno0:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93626sim-2of5successno0:10:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74075sim-2of5successno0:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74073sim-3of5successno0:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74072sim-4of5successno0:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74068sim-0of5successno0:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74067sim-1of5successno0:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70268sim-1of5errorno0:04:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70267sim-2of5errorno0:03:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70266sim-3of5errorno0:03:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70265sim-0of5errorno0:03:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70263sim-4of5errorno0:04:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68223sim-2of5successno0:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68222sim-4of5successno0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68221sim-4of5successno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68220sim-4of5successno0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68219sim-2of5successno0:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68218sim-1of5successno0:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68212sim-3of5successno0:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68210sim-1of5successno0:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68208sim-3of5successno0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68206sim-0of5successno0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible