Duckietown Challenges Home Challenges Submissions

Submission 14221

Submission14221
Competingyes
Challengeaido-hello-sim-validation
UserVincenzo Polizzi 🇮🇹
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssanity-check: 129019
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

129019

Click the images to see detailed statistics about the episode.

scenarios

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
129019sanity-checksuccessyes0:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.007457570166591001


other stats
deviation-center-line_max0.007457570166591001
deviation-center-line_mean0.007457570166591001
deviation-center-line_min0.007457570166591001
deviation-heading_max0.26874261028062396
deviation-heading_mean0.26874261028062396
deviation-heading_median0.26874261028062396
deviation-heading_min0.26874261028062396
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max5.551115123125784e-16
driven_any_mean5.551115123125784e-16
driven_any_median5.551115123125784e-16
driven_any_min5.551115123125784e-16
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 5.551115123125784e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.26874261028062396, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
129018sanity-checkerroryes0:03:04
InvalidEvaluator: co [...]
InvalidEvaluator:
concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.8/concurrent/futures/process.py", line 239, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 461, in robot_stats
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/dist-packages/aido_analyze/utils_drawing.py", line 415, in read_and_draw
    draw_static(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_world/svg_drawing/misc.py", line 166, in draw_static
    os.makedirs(output_dir)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/challenges/challenge-evaluation-output/episodes/scenarios/ego0'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 392, in main
    stats = future.result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 444, in result
    return self.__get_result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
FileExistsError: [Errno 17] File exists: '/challenges/challenge-evaluation-output/episodes/scenarios/ego0'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94294370successyes0:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94287370successyes0:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94277370timeoutyes----No reset possible
94271370successyes0:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66968370successno0:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible