Duckietown Challenges Home Challenges Submissions

Submission 13861

Submission13861
Competingyes
Challengeaido-hello-sim-validation
UserScott Vang
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssanity-check: 129489
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

129489

Click the images to see detailed statistics about the episode.

scenarios

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
129489sanity-checksuccessyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.058817380809317754
deviation-center-line_median0.006975964128268102


other stats
deviation-center-line_max0.006975964128268102
deviation-center-line_mean0.006975964128268102
deviation-center-line_min0.006975964128268102
deviation-heading_max0.2650181877737848
deviation-heading_mean0.2650181877737848
deviation-heading_median0.2650181877737848
deviation-heading_min0.2650181877737848
distance-from-start_max0.06765951470550984
distance-from-start_mean0.06765951470550984
distance-from-start_median0.06765951470550984
distance-from-start_min0.06765951470550984
driven_any_max0.0676644346818848
driven_any_mean0.0676644346818848
driven_any_median0.0676644346818848
driven_any_min0.0676644346818848
driven_lanedir_consec_max0.058817380809317754
driven_lanedir_consec_mean0.058817380809317754
driven_lanedir_consec_min0.058817380809317754
driven_lanedir_max0.058817380809317754
driven_lanedir_mean0.058817380809317754
driven_lanedir_median0.058817380809317754
driven_lanedir_min0.058817380809317754
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.0676644346818848, "survival_time": 0.49999999999999994, "driven_lanedir": 0.058817380809317754, "in-drivable-lane": 0.0, "deviation-heading": 0.2650181877737848, "distance-from-start": 0.06765951470550984, "deviation-center-line": 0.006975964128268102, "driven_lanedir_consec": 0.058817380809317754}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
129488sanity-checkhost-erroryes0:01:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 392, in main
    stats = future.result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 444, in result
    return self.__get_result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 426, in main
    raise dc.InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: broken process pool
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129487sanity-checksuccessyes0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95308370successyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95300370successyes0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95293370successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95282370successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62644370successno0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62643370successno0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62642370successno0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62641370successno0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62640370successno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62639370successno0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62638370successno0:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible