Duckietown Challenges Home Challenges Submissions

Submission 14463

Submission14463
Competingyes
Challengemooc-BV1
UserSowmiya Narayanan G
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113275 sim-1of5: 113272 sim-2of5: 113271 sim-3of5: 113263 sim-4of5: 113270
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113275

Click the images to see detailed statistics about the episode.

d45

113272

Click the images to see detailed statistics about the episode.

d50

113271

Click the images to see detailed statistics about the episode.

d40

113270

Click the images to see detailed statistics about the episode.

d50

113263

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113275sim-0of5successyes0:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1875211613055483


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1875211613055483
distance-from-start_median2.1875211613055483
distance-from-start_min2.1875211613055483
driven_any_max2.1875211613055727
driven_any_mean2.1875211613055727
driven_any_median2.1875211613055727
driven_any_min2.1875211613055727
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max25.250000000000224
in-drivable-lane_mean25.250000000000224
in-drivable-lane_median25.250000000000224
in-drivable-lane_min25.250000000000224
per-episodes
details{"d45-ego0": {"driven_any": 2.1875211613055727, "survival_time": 25.250000000000224, "driven_lanedir": 0.0, "in-drivable-lane": 25.250000000000224, "deviation-heading": 0.0, "distance-from-start": 2.1875211613055483, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max25.250000000000224
survival_time_mean25.250000000000224
survival_time_median25.250000000000224
survival_time_min25.250000000000224
No reset possible
113272sim-1of5successyes0:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.654844990584467


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.654844990584467
distance-from-start_median2.654844990584467
distance-from-start_min2.654844990584467
driven_any_max2.654844990584486
driven_any_mean2.654844990584486
driven_any_median2.654844990584486
driven_any_min2.654844990584486
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max29.85000000000029
in-drivable-lane_mean29.85000000000029
in-drivable-lane_median29.85000000000029
in-drivable-lane_min29.85000000000029
per-episodes
details{"d50-ego0": {"driven_any": 2.654844990584486, "survival_time": 29.85000000000029, "driven_lanedir": 0.0, "in-drivable-lane": 29.85000000000029, "deviation-heading": 0.0, "distance-from-start": 2.654844990584467, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max29.85000000000029
survival_time_mean29.85000000000029
survival_time_median29.85000000000029
survival_time_min29.85000000000029
No reset possible
113271sim-2of5successyes0:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.116537802613052


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.116537802613052
distance-from-start_median2.116537802613052
distance-from-start_min2.116537802613052
driven_any_max2.116537802613071
driven_any_mean2.116537802613071
driven_any_median2.116537802613071
driven_any_min2.116537802613071
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max28.700000000000273
in-drivable-lane_mean28.700000000000273
in-drivable-lane_median28.700000000000273
in-drivable-lane_min28.700000000000273
per-episodes
details{"d40-ego0": {"driven_any": 2.116537802613071, "survival_time": 28.700000000000273, "driven_lanedir": 0.0, "in-drivable-lane": 28.700000000000273, "deviation-heading": 0.0, "distance-from-start": 2.116537802613052, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max28.700000000000273
survival_time_mean28.700000000000273
survival_time_median28.700000000000273
survival_time_min28.700000000000273
No reset possible
113270sim-4of5successyes0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6529054391827436


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6529054391827436
distance-from-start_median2.6529054391827436
distance-from-start_min2.6529054391827436
driven_any_max2.6529054391827693
driven_any_mean2.6529054391827693
driven_any_median2.6529054391827693
driven_any_min2.6529054391827693
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max29.60000000000029
in-drivable-lane_mean29.60000000000029
in-drivable-lane_median29.60000000000029
in-drivable-lane_min29.60000000000029
per-episodes
details{"d50-ego0": {"driven_any": 2.6529054391827693, "survival_time": 29.60000000000029, "driven_lanedir": 0.0, "in-drivable-lane": 29.60000000000029, "deviation-heading": 0.0, "distance-from-start": 2.6529054391827436, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max29.60000000000029
survival_time_mean29.60000000000029
survival_time_median29.60000000000029
survival_time_min29.60000000000029
No reset possible
113266sim-0of5successyes0:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113263sim-3of5successyes0:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.921261061549142


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.921261061549142
distance-from-start_median4.921261061549142
distance-from-start_min4.921261061549142
driven_any_max4.9212610615492345
driven_any_mean4.9212610615492345
driven_any_median4.9212610615492345
driven_any_min4.9212610615492345
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 4.9212610615492345, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 4.921261061549142, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
113261sim-2of5successyes0:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113260sim-1of5successyes0:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113259sim-4of5successyes0:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113258sim-0of5successyes0:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93582sim-4of5successno0:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93581sim-0of5successno0:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93580sim-2of5successno0:09:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93578sim-1of5successno0:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93577sim-3of5successno0:09:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93571sim-1of5successno0:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93570sim-2of5successno0:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93568sim-2of5successno0:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93567sim-3of5successno0:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73992sim-4of5successno0:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73991sim-0of5successno0:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73990sim-1of5successno0:05:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73986sim-2of5successno0:05:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73985sim-3of5successno0:09:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70216sim-1of5errorno0:04:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70215sim-2of5errorno0:04:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70214sim-4of5errorno0:02:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70213sim-3of5errorno0:07:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70212sim-0of5errorno0:03:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68293sim-4of5successno0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68292sim-3of5successno0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68291sim-2of5successno0:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68290sim-3of5successno0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68289sim-0of5successno0:10:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68288sim-4of5successno0:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68287sim-1of5successno0:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible