Duckietown Challenges Home Challenges Submissions

Submission 14431

Submission14431
Competingyes
Challengemooc-BV1
UserDaniel Beutel
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113459 sim-1of5: 113440 sim-2of5: 113460 sim-3of5: 113463 sim-4of5: 113451
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113463

Click the images to see detailed statistics about the episode.

d30

113460

Click the images to see detailed statistics about the episode.

d40

113459

Click the images to see detailed statistics about the episode.

d45

113451

Click the images to see detailed statistics about the episode.

d60

113440

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113463sim-3of5successyes0:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.0680814297240055


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.0680814297240055
distance-from-start_median3.0680814297240055
distance-from-start_min3.0680814297240055
driven_any_max3.561896411536486
driven_any_mean3.561896411536486
driven_any_median3.561896411536486
driven_any_min3.561896411536486
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max40.699999999999825
in-drivable-lane_mean40.699999999999825
in-drivable-lane_median40.699999999999825
in-drivable-lane_min40.699999999999825
per-episodes
details{"d30-ego0": {"driven_any": 3.561896411536486, "survival_time": 40.699999999999825, "driven_lanedir": 0.0, "in-drivable-lane": 40.699999999999825, "deviation-heading": 0.0, "distance-from-start": 3.0680814297240055, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max40.699999999999825
survival_time_mean40.699999999999825
survival_time_median40.699999999999825
survival_time_min40.699999999999825
No reset possible
113460sim-2of5successyes0:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.6166207855542885


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.6166207855542885
distance-from-start_median4.6166207855542885
distance-from-start_min4.6166207855542885
driven_any_max4.925395975876059
driven_any_mean4.925395975876059
driven_any_median4.925395975876059
driven_any_min4.925395975876059
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max55.79999999999897
in-drivable-lane_mean55.79999999999897
in-drivable-lane_median55.79999999999897
in-drivable-lane_min55.79999999999897
per-episodes
details{"d40-ego0": {"driven_any": 4.925395975876059, "survival_time": 55.79999999999897, "driven_lanedir": 0.0, "in-drivable-lane": 55.79999999999897, "deviation-heading": 0.0, "distance-from-start": 4.6166207855542885, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max55.79999999999897
survival_time_mean55.79999999999897
survival_time_median55.79999999999897
survival_time_min55.79999999999897
No reset possible
113459sim-0of5successyes0:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.50814128585987


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.50814128585987
distance-from-start_median4.50814128585987
distance-from-start_min4.50814128585987
driven_any_max4.731895533264864
driven_any_mean4.731895533264864
driven_any_median4.731895533264864
driven_any_min4.731895533264864
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max53.699999999999086
in-drivable-lane_mean53.699999999999086
in-drivable-lane_median53.699999999999086
in-drivable-lane_min53.699999999999086
per-episodes
details{"d45-ego0": {"driven_any": 4.731895533264864, "survival_time": 53.699999999999086, "driven_lanedir": 0.0, "in-drivable-lane": 53.699999999999086, "deviation-heading": 0.0, "distance-from-start": 4.50814128585987, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max53.699999999999086
survival_time_mean53.699999999999086
survival_time_median53.699999999999086
survival_time_min53.699999999999086
No reset possible
113456sim-2of5successyes0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113453sim-3of5successyes0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113451sim-4of5successyes0:06:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.455854459408703


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.455854459408703
distance-from-start_median4.455854459408703
distance-from-start_min4.455854459408703
driven_any_max5.352896212266274
driven_any_mean5.352896212266274
driven_any_median5.352896212266274
driven_any_min5.352896212266274
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 5.352896212266274, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 4.455854459408703, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113448sim-0of5successyes0:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113440sim-1of5successyes0:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.397569108918431


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.397569108918431
distance-from-start_median2.397569108918431
distance-from-start_min2.397569108918431
driven_any_max2.445896911876362
driven_any_mean2.445896911876362
driven_any_median2.445896911876362
driven_any_min2.445896911876362
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max28.250000000000263
in-drivable-lane_mean28.250000000000263
in-drivable-lane_median28.250000000000263
in-drivable-lane_min28.250000000000263
per-episodes
details{"d60-ego0": {"driven_any": 2.445896911876362, "survival_time": 28.250000000000263, "driven_lanedir": 0.0, "in-drivable-lane": 28.250000000000263, "deviation-heading": 0.0, "distance-from-start": 2.397569108918431, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max28.250000000000263
survival_time_mean28.250000000000263
survival_time_median28.250000000000263
survival_time_min28.250000000000263
No reset possible
113439sim-4of5successyes0:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93680sim-4of5successno0:10:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93678sim-3of5successno0:12:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93677sim-1of5successno0:06:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93676sim-2of5successno0:10:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93675sim-0of5successno0:21:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74135sim-3of5successno0:08:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74134sim-2of5successno0:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74133sim-0of5successno0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74132sim-4of5successno0:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74131sim-1of5successno0:09:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70314sim-0of5errorno0:02:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70313sim-3of5errorno0:06:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70312sim-2of5errorno0:03:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70311sim-1of5errorno0:08:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70309sim-4of5errorno0:08:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68086sim-4of5successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68085sim-4of5successno0:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68084sim-0of5successno0:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68083sim-1of5successno0:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68082sim-2of5successno0:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68081sim-3of5successno0:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible