Duckietown Challenges Home Challenges Submissions

Submission 14465

Submission14465
Competingyes
Challengemooc-BV1
UserRicardo Fernandes
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113257 sim-1of5: 113238 sim-2of5: 113254 sim-3of5: 113255 sim-4of5: 113252
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113257

Click the images to see detailed statistics about the episode.

d45

113255

Click the images to see detailed statistics about the episode.

d30

113254

Click the images to see detailed statistics about the episode.

d40

113252

Click the images to see detailed statistics about the episode.

d50

113238

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113257sim-0of5successyes0:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.020790146241905


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.020790146241905
distance-from-start_median5.020790146241905
distance-from-start_min5.020790146241905
driven_any_max5.887559689707142
driven_any_mean5.887559689707142
driven_any_median5.887559689707142
driven_any_min5.887559689707142
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max30.6000000000003
in-drivable-lane_mean30.6000000000003
in-drivable-lane_median30.6000000000003
in-drivable-lane_min30.6000000000003
per-episodes
details{"d45-ego0": {"driven_any": 5.887559689707142, "survival_time": 30.6000000000003, "driven_lanedir": 0.0, "in-drivable-lane": 30.6000000000003, "deviation-heading": 0.0, "distance-from-start": 5.020790146241905, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max30.6000000000003
survival_time_mean30.6000000000003
survival_time_median30.6000000000003
survival_time_min30.6000000000003
No reset possible
113255sim-3of5successyes0:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.231554061886518


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.231554061886518
distance-from-start_median5.231554061886518
distance-from-start_min5.231554061886518
driven_any_max5.733517305455099
driven_any_mean5.733517305455099
driven_any_median5.733517305455099
driven_any_min5.733517305455099
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max32.100000000000314
in-drivable-lane_mean32.100000000000314
in-drivable-lane_median32.100000000000314
in-drivable-lane_min32.100000000000314
per-episodes
details{"d30-ego0": {"driven_any": 5.733517305455099, "survival_time": 32.100000000000314, "driven_lanedir": 0.0, "in-drivable-lane": 32.100000000000314, "deviation-heading": 0.0, "distance-from-start": 5.231554061886518, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max32.100000000000314
survival_time_mean32.100000000000314
survival_time_median32.100000000000314
survival_time_min32.100000000000314
No reset possible
113254sim-2of5successyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.72675383229375


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.72675383229375
distance-from-start_median2.72675383229375
distance-from-start_min2.72675383229375
driven_any_max2.867278914561891
driven_any_mean2.867278914561891
driven_any_median2.867278914561891
driven_any_min2.867278914561891
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max15.05000000000008
in-drivable-lane_mean15.05000000000008
in-drivable-lane_median15.05000000000008
in-drivable-lane_min15.05000000000008
per-episodes
details{"d40-ego0": {"driven_any": 2.867278914561891, "survival_time": 15.05000000000008, "driven_lanedir": 0.0, "in-drivable-lane": 15.05000000000008, "deviation-heading": 0.0, "distance-from-start": 2.72675383229375, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max15.05000000000008
survival_time_mean15.05000000000008
survival_time_median15.05000000000008
survival_time_min15.05000000000008
No reset possible
113252sim-4of5successyes0:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.825853657402113


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.825853657402113
distance-from-start_median4.825853657402113
distance-from-start_min4.825853657402113
driven_any_max5.647452247516778
driven_any_mean5.647452247516778
driven_any_median5.647452247516778
driven_any_min5.647452247516778
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max30.5500000000003
in-drivable-lane_mean30.5500000000003
in-drivable-lane_median30.5500000000003
in-drivable-lane_min30.5500000000003
per-episodes
details{"d50-ego0": {"driven_any": 5.647452247516778, "survival_time": 30.5500000000003, "driven_lanedir": 0.0, "in-drivable-lane": 30.5500000000003, "deviation-heading": 0.0, "distance-from-start": 4.825853657402113, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max30.5500000000003
survival_time_mean30.5500000000003
survival_time_median30.5500000000003
survival_time_min30.5500000000003
No reset possible
113246sim-0of5successyes0:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113242sim-3of5successyes0:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113241sim-2of5successyes0:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113240sim-4of5successyes0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113238sim-1of5successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.147300540925221


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.147300540925221
distance-from-start_median3.147300540925221
distance-from-start_min3.147300540925221
driven_any_max3.70118644407654
driven_any_mean3.70118644407654
driven_any_median3.70118644407654
driven_any_min3.70118644407654
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max20.35000000000015
in-drivable-lane_mean20.35000000000015
in-drivable-lane_median20.35000000000015
in-drivable-lane_min20.35000000000015
per-episodes
details{"d50-ego0": {"driven_any": 3.70118644407654, "survival_time": 20.35000000000015, "driven_lanedir": 0.0, "in-drivable-lane": 20.35000000000015, "deviation-heading": 0.0, "distance-from-start": 3.147300540925221, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max20.35000000000015
survival_time_mean20.35000000000015
survival_time_median20.35000000000015
survival_time_min20.35000000000015
No reset possible
113229sim-0of5successyes0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113227sim-1of5successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93558sim-1of5successno0:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93557sim-4of5successno0:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93554sim-4of5successno0:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93551sim-1of5successno0:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93550sim-3of5successno0:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93544sim-0of5successno0:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93543sim-2of5successno0:12:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73978sim-2of5successno0:05:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73963sim-4of5successno0:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73957sim-1of5successno0:05:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73955sim-3of5successno0:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73954sim-0of5successno0:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73953sim-2of5successno0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70208sim-4of5errorno0:03:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70205sim-1of5errorno0:03:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70204sim-2of5errorno0:05:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70203sim-3of5errorno0:04:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70202sim-0of5errorno0:03:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68308sim-3of5successno0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68307sim-1of5successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68306sim-3of5successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68305sim-0of5successno0:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68304sim-4of5successno0:07:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68303sim-2of5successno0:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68302sim-1of5successno0:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68301sim-3of5successno0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible