Duckietown Challenges Home Challenges Submissions

Submission 14397

Submission14397
Competingyes
Challengemooc-BV1
UserJM Sadoul
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113661 sim-1of5: 113663 sim-2of5: 113700 sim-3of5: 113667 sim-4of5: 113664
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113700

Click the images to see detailed statistics about the episode.

d40

113667

Click the images to see detailed statistics about the episode.

d30

113664

Click the images to see detailed statistics about the episode.

d60

113663

Click the images to see detailed statistics about the episode.

d60

113661

Click the images to see detailed statistics about the episode.

d45

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113700sim-2of5successyes0:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.0783508432661444


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.0783508432661444
distance-from-start_median2.0783508432661444
distance-from-start_min2.0783508432661444
driven_any_max2.1302700136175057
driven_any_mean2.1302700136175057
driven_any_median2.1302700136175057
driven_any_min2.1302700136175057
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max27.350000000000257
in-drivable-lane_mean27.350000000000257
in-drivable-lane_median27.350000000000257
in-drivable-lane_min27.350000000000257
per-episodes
details{"d40-ego0": {"driven_any": 2.1302700136175057, "survival_time": 27.350000000000257, "driven_lanedir": 0.0, "in-drivable-lane": 27.350000000000257, "deviation-heading": 0.0, "distance-from-start": 2.0783508432661444, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max27.350000000000257
survival_time_mean27.350000000000257
survival_time_median27.350000000000257
survival_time_min27.350000000000257
No reset possible
113685sim-2of5successyes0:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113668sim-2of5successyes0:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113667sim-3of5successyes0:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2349318468185644


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2349318468185644
distance-from-start_median1.2349318468185644
distance-from-start_min1.2349318468185644
driven_any_max1.9252697036365232
driven_any_mean1.9252697036365232
driven_any_median1.9252697036365232
driven_any_min1.9252697036365232
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.000000000000192
in-drivable-lane_mean23.000000000000192
in-drivable-lane_median23.000000000000192
in-drivable-lane_min23.000000000000192
per-episodes
details{"d30-ego0": {"driven_any": 1.9252697036365232, "survival_time": 23.000000000000192, "driven_lanedir": 0.0, "in-drivable-lane": 23.000000000000192, "deviation-heading": 0.0, "distance-from-start": 1.2349318468185644, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.000000000000192
survival_time_mean23.000000000000192
survival_time_median23.000000000000192
survival_time_min23.000000000000192
No reset possible
113664sim-4of5successyes0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.3987022520632464


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.3987022520632464
distance-from-start_median2.3987022520632464
distance-from-start_min2.3987022520632464
driven_any_max2.4133029409854148
driven_any_mean2.4133029409854148
driven_any_median2.4133029409854148
driven_any_min2.4133029409854148
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max27.550000000000257
in-drivable-lane_mean27.550000000000257
in-drivable-lane_median27.550000000000257
in-drivable-lane_min27.550000000000257
per-episodes
details{"d60-ego0": {"driven_any": 2.4133029409854148, "survival_time": 27.550000000000257, "driven_lanedir": 0.0, "in-drivable-lane": 27.550000000000257, "deviation-heading": 0.0, "distance-from-start": 2.3987022520632464, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max27.550000000000257
survival_time_mean27.550000000000257
survival_time_median27.550000000000257
survival_time_min27.550000000000257
No reset possible
113663sim-1of5successyes0:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.778438053395754


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.778438053395754
distance-from-start_median4.778438053395754
distance-from-start_min4.778438053395754
driven_any_max5.068411814532296
driven_any_mean5.068411814532296
driven_any_median5.068411814532296
driven_any_min5.068411814532296
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 5.068411814532296, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 4.778438053395754, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113661sim-0of5successyes0:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.7515851116703548


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.7515851116703548
distance-from-start_median0.7515851116703548
distance-from-start_min0.7515851116703548
driven_any_max5.369417355048159
driven_any_mean5.369417355048159
driven_any_median5.369417355048159
driven_any_min5.369417355048159
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 5.369417355048159, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.7515851116703548, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113657sim-3of5successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113650sim-1of5successyes0:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113649sim-0of5successyes0:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113648sim-4of5successyes0:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113647sim-3of5successyes0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94040sim-3of5successno0:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94039sim-0of5successno0:05:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94038sim-2of5successno0:04:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94037sim-1of5successno0:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94034sim-4of5successno0:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94029sim-4of5successno0:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74265sim-3of5successno0:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74264sim-1of5successno0:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74262sim-2of5successno0:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74258sim-0of5successno0:08:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74257sim-4of5successno0:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70420sim-2of5errorno0:05:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70419sim-3of5errorno0:02:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70418sim-1of5errorno0:05:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70417sim-0of5errorno0:03:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70416sim-4of5errorno0:09:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67488sim-4of5successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67487sim-1of5successno0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67484sim-1of5successno0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67483sim-4of5successno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67482sim-3of5successno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67481sim-2of5successno0:09:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67480sim-0of5successno0:09:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible