Duckietown Challenges Home Challenges Submissions

Submission 14492

Submission14492
Competingyes
Challengemooc-BV1
UserPatricio Cortes Estay
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113038 sim-1of5: 113036 sim-2of5: 113040 sim-3of5: 113054 sim-4of5: 113044
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113054

Click the images to see detailed statistics about the episode.

d30

113044

Click the images to see detailed statistics about the episode.

d60

113040

Click the images to see detailed statistics about the episode.

d40

113038

Click the images to see detailed statistics about the episode.

d45

113036

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113054sim-3of5successyes0:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.980338570506139


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.980338570506139
distance-from-start_median5.980338570506139
distance-from-start_min5.980338570506139
driven_any_max6.035687590824057
driven_any_mean6.035687590824057
driven_any_median6.035687590824057
driven_any_min6.035687590824057
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max50.94999999999924
in-drivable-lane_mean50.94999999999924
in-drivable-lane_median50.94999999999924
in-drivable-lane_min50.94999999999924
per-episodes
details{"d30-ego0": {"driven_any": 6.035687590824057, "survival_time": 50.94999999999924, "driven_lanedir": 0.0, "in-drivable-lane": 50.94999999999924, "deviation-heading": 0.0, "distance-from-start": 5.980338570506139, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max50.94999999999924
survival_time_mean50.94999999999924
survival_time_median50.94999999999924
survival_time_min50.94999999999924
No reset possible
113044sim-4of5successyes0:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.4361620172476695


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.4361620172476695
distance-from-start_median5.4361620172476695
distance-from-start_min5.4361620172476695
driven_any_max5.776807355918341
driven_any_mean5.776807355918341
driven_any_median5.776807355918341
driven_any_min5.776807355918341
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max47.199999999999456
in-drivable-lane_mean47.199999999999456
in-drivable-lane_median47.199999999999456
in-drivable-lane_min47.199999999999456
per-episodes
details{"d60-ego0": {"driven_any": 5.776807355918341, "survival_time": 47.199999999999456, "driven_lanedir": 0.0, "in-drivable-lane": 47.199999999999456, "deviation-heading": 0.0, "distance-from-start": 5.4361620172476695, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max47.199999999999456
survival_time_mean47.199999999999456
survival_time_median47.199999999999456
survival_time_min47.199999999999456
No reset possible
113040sim-2of5successyes0:04:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.1624943210406595


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.1624943210406595
distance-from-start_median5.1624943210406595
distance-from-start_min5.1624943210406595
driven_any_max5.706349404998708
driven_any_mean5.706349404998708
driven_any_median5.706349404998708
driven_any_min5.706349404998708
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max46.84999999999947
in-drivable-lane_mean46.84999999999947
in-drivable-lane_median46.84999999999947
in-drivable-lane_min46.84999999999947
per-episodes
details{"d40-ego0": {"driven_any": 5.706349404998708, "survival_time": 46.84999999999947, "driven_lanedir": 0.0, "in-drivable-lane": 46.84999999999947, "deviation-heading": 0.0, "distance-from-start": 5.1624943210406595, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max46.84999999999947
survival_time_mean46.84999999999947
survival_time_median46.84999999999947
survival_time_min46.84999999999947
No reset possible
113039sim-3of5successyes0:04:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113038sim-0of5successyes0:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.5780502481609275


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.5780502481609275
distance-from-start_median4.5780502481609275
distance-from-start_min4.5780502481609275
driven_any_max4.928266075986839
driven_any_mean4.928266075986839
driven_any_median4.928266075986839
driven_any_min4.928266075986839
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max40.84999999999982
in-drivable-lane_mean40.84999999999982
in-drivable-lane_median40.84999999999982
in-drivable-lane_min40.84999999999982
per-episodes
details{"d45-ego0": {"driven_any": 4.928266075986839, "survival_time": 40.84999999999982, "driven_lanedir": 0.0, "in-drivable-lane": 40.84999999999982, "deviation-heading": 0.0, "distance-from-start": 4.5780502481609275, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max40.84999999999982
survival_time_mean40.84999999999982
survival_time_median40.84999999999982
survival_time_min40.84999999999982
No reset possible
113036sim-1of5successyes0:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.750979141922525


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.750979141922525
distance-from-start_median3.750979141922525
distance-from-start_min3.750979141922525
driven_any_max4.066159202502956
driven_any_mean4.066159202502956
driven_any_median4.066159202502956
driven_any_min4.066159202502956
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max33.25000000000025
in-drivable-lane_mean33.25000000000025
in-drivable-lane_median33.25000000000025
in-drivable-lane_min33.25000000000025
per-episodes
details{"d60-ego0": {"driven_any": 4.066159202502956, "survival_time": 33.25000000000025, "driven_lanedir": 0.0, "in-drivable-lane": 33.25000000000025, "deviation-heading": 0.0, "distance-from-start": 3.750979141922525, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max33.25000000000025
survival_time_mean33.25000000000025
survival_time_median33.25000000000025
survival_time_min33.25000000000025
No reset possible
113025sim-0of5successyes0:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113023sim-4of5successyes0:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113021sim-2of5successyes0:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113020sim-1of5successyes0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93415sim-0of5successno0:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93414sim-1of5successno0:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93413sim-1of5timeoutno0:00:27
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93412sim-3of5successno0:08:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93411sim-4of5successno0:14:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93410sim-2of5successno0:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73530sim-0of5successno0:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73523sim-3of5successno0:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73520sim-1of5successno0:08:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73515sim-4of5successno0:08:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73511sim-2of5successno0:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69916sim-4of5errorno0:05:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69912sim-0of5errorno0:05:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69911sim-3of5errorno0:06:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69910sim-1of5errorno0:06:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
69909sim-2of5errorno0:06:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68594sim-4of5successno0:10:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68593sim-1of5successno0:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68592sim-0of5successno0:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68591sim-3of5successno0:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68590sim-2of5successno0:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible