Duckietown Challenges Home Challenges Submissions

Submission 13753

Submission13753
Competingyes
Challengeaido-LF-sim-validation
Usersunhwi kim
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 116114 sim-1of4: 116062 sim-2of4: 116101 sim-3of4: 116089
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

116114

Click the images to see detailed statistics about the episode.

loop2-000

116101

Click the images to see detailed statistics about the episode.

loop-000

116089

Click the images to see detailed statistics about the episode.

zigzag-000

116062

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
116114sim-0of4successyes0:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3335933267243314
survival_time_median16.750000000000103
deviation-center-line_median0.6104967370300892
in-drivable-lane_median9.65000000000012


other stats
deviation-center-line_max0.6104967370300892
deviation-center-line_mean0.6104967370300892
deviation-center-line_min0.6104967370300892
deviation-heading_max2.928115037748982
deviation-heading_mean2.928115037748982
deviation-heading_median2.928115037748982
deviation-heading_min2.928115037748982
distance-from-start_max0.5801911047239985
distance-from-start_mean0.5801911047239985
distance-from-start_median0.5801911047239985
distance-from-start_min0.5801911047239985
driven_any_max2.0723784922230593
driven_any_mean2.0723784922230593
driven_any_median2.0723784922230593
driven_any_min2.0723784922230593
driven_lanedir_consec_max0.3335933267243314
driven_lanedir_consec_mean0.3335933267243314
driven_lanedir_consec_min0.3335933267243314
driven_lanedir_max0.783726091814489
driven_lanedir_mean0.783726091814489
driven_lanedir_median0.783726091814489
driven_lanedir_min0.783726091814489
in-drivable-lane_max9.65000000000012
in-drivable-lane_mean9.65000000000012
in-drivable-lane_min9.65000000000012
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.0723784922230593, "survival_time": 16.750000000000103, "driven_lanedir": 0.783726091814489, "in-drivable-lane": 9.65000000000012, "deviation-heading": 2.928115037748982, "distance-from-start": 0.5801911047239985, "deviation-center-line": 0.6104967370300892, "driven_lanedir_consec": 0.3335933267243314}}
simulation-passed1
survival_time_max16.750000000000103
survival_time_mean16.750000000000103
survival_time_min16.750000000000103
No reset possible
116106sim-0of4successyes0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116101sim-2of4successyes0:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.191694978990178
survival_time_median59.99999999999873
deviation-center-line_median2.675683515772115
in-drivable-lane_median2.0499999999998835


other stats
deviation-center-line_max2.675683515772115
deviation-center-line_mean2.675683515772115
deviation-center-line_min2.675683515772115
deviation-heading_max10.94789345266647
deviation-heading_mean10.94789345266647
deviation-heading_median10.94789345266647
deviation-heading_min10.94789345266647
distance-from-start_max2.6764777628979344
distance-from-start_mean2.6764777628979344
distance-from-start_median2.6764777628979344
distance-from-start_min2.6764777628979344
driven_any_max7.907750215186225
driven_any_mean7.907750215186225
driven_any_median7.907750215186225
driven_any_min7.907750215186225
driven_lanedir_consec_max5.191694978990178
driven_lanedir_consec_mean5.191694978990178
driven_lanedir_consec_min5.191694978990178
driven_lanedir_max7.269846211520448
driven_lanedir_mean7.269846211520448
driven_lanedir_median7.269846211520448
driven_lanedir_min7.269846211520448
in-drivable-lane_max2.0499999999998835
in-drivable-lane_mean2.0499999999998835
in-drivable-lane_min2.0499999999998835
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907750215186225, "survival_time": 59.99999999999873, "driven_lanedir": 7.269846211520448, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 10.94789345266647, "distance-from-start": 2.6764777628979344, "deviation-center-line": 2.675683515772115, "driven_lanedir_consec": 5.191694978990178}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
116090sim-0of4successyes0:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116089sim-3of4successyes0:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.3311570756375595
survival_time_median59.99999999999873
deviation-center-line_median4.457185199323683
in-drivable-lane_median9.699999999999822


other stats
deviation-center-line_max4.457185199323683
deviation-center-line_mean4.457185199323683
deviation-center-line_min4.457185199323683
deviation-heading_max10.785771590910564
deviation-heading_mean10.785771590910564
deviation-heading_median10.785771590910564
deviation-heading_min10.785771590910564
distance-from-start_max4.356098877386798
distance-from-start_mean4.356098877386798
distance-from-start_median4.356098877386798
distance-from-start_min4.356098877386798
driven_any_max7.907821888041098
driven_any_mean7.907821888041098
driven_any_median7.907821888041098
driven_any_min7.907821888041098
driven_lanedir_consec_max6.3311570756375595
driven_lanedir_consec_mean6.3311570756375595
driven_lanedir_consec_min6.3311570756375595
driven_lanedir_max6.3311570756375595
driven_lanedir_mean6.3311570756375595
driven_lanedir_median6.3311570756375595
driven_lanedir_min6.3311570756375595
in-drivable-lane_max9.699999999999822
in-drivable-lane_mean9.699999999999822
in-drivable-lane_min9.699999999999822
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907821888041098, "survival_time": 59.99999999999873, "driven_lanedir": 6.3311570756375595, "in-drivable-lane": 9.699999999999822, "deviation-heading": 10.785771590910564, "distance-from-start": 4.356098877386798, "deviation-center-line": 4.457185199323683, "driven_lanedir_consec": 6.3311570756375595}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
116088sim-2of4successyes0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116062sim-1of4successyes0:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.107763645796703
survival_time_median59.99999999999873
deviation-center-line_median4.237791979934381
in-drivable-lane_median7.599999999999759


other stats
deviation-center-line_max4.237791979934381
deviation-center-line_mean4.237791979934381
deviation-center-line_min4.237791979934381
deviation-heading_max12.822574983766774
deviation-heading_mean12.822574983766774
deviation-heading_median12.822574983766774
deviation-heading_min12.822574983766774
distance-from-start_max2.4871947401296444
distance-from-start_mean2.4871947401296444
distance-from-start_median2.4871947401296444
distance-from-start_min2.4871947401296444
driven_any_max7.907735862992705
driven_any_mean7.907735862992705
driven_any_median7.907735862992705
driven_any_min7.907735862992705
driven_lanedir_consec_max4.107763645796703
driven_lanedir_consec_mean4.107763645796703
driven_lanedir_consec_min4.107763645796703
driven_lanedir_max6.484092335289078
driven_lanedir_mean6.484092335289078
driven_lanedir_median6.484092335289078
driven_lanedir_min6.484092335289078
in-drivable-lane_max7.599999999999759
in-drivable-lane_mean7.599999999999759
in-drivable-lane_min7.599999999999759
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907735862992705, "survival_time": 59.99999999999873, "driven_lanedir": 6.484092335289078, "in-drivable-lane": 7.599999999999759, "deviation-heading": 12.822574983766774, "distance-from-start": 2.4871947401296444, "deviation-center-line": 4.237791979934381, "driven_lanedir_consec": 4.107763645796703}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
62315347successyes0:47:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62314347failedyes0:03:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible