Duckietown Challenges Home Challenges Submissions

Submission 13961

Submission13961
Competingyes
Challengeaido-LF-sim-validation
UserAshley Reid
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 114980 sim-1of4: 114983 sim-2of4: 114984 sim-3of4: 114992
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

114992

Click the images to see detailed statistics about the episode.

loop-000

114984

Click the images to see detailed statistics about the episode.

autolab-000

114983

Click the images to see detailed statistics about the episode.

zigzag-000

114980

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
114992sim-3of4successyes0:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.9093047973568655
survival_time_median59.99999999999873
deviation-center-line_median2.314638462840208
in-drivable-lane_median12.849999999999277


other stats
deviation-center-line_max2.314638462840208
deviation-center-line_mean2.314638462840208
deviation-center-line_min2.314638462840208
deviation-heading_max6.936272791145407
deviation-heading_mean6.936272791145407
deviation-heading_median6.936272791145407
deviation-heading_min6.936272791145407
distance-from-start_max2.6481194753399744
distance-from-start_mean2.6481194753399744
distance-from-start_median2.6481194753399744
distance-from-start_min2.6481194753399744
driven_any_max7.914369435538413
driven_any_mean7.914369435538413
driven_any_median7.914369435538413
driven_any_min7.914369435538413
driven_lanedir_consec_max4.9093047973568655
driven_lanedir_consec_mean4.9093047973568655
driven_lanedir_consec_min4.9093047973568655
driven_lanedir_max6.014605539317481
driven_lanedir_mean6.014605539317481
driven_lanedir_median6.014605539317481
driven_lanedir_min6.014605539317481
in-drivable-lane_max12.849999999999277
in-drivable-lane_mean12.849999999999277
in-drivable-lane_min12.849999999999277
per-episodes
details{"loop-000-ego0": {"driven_any": 7.914369435538413, "survival_time": 59.99999999999873, "driven_lanedir": 6.014605539317481, "in-drivable-lane": 12.849999999999277, "deviation-heading": 6.936272791145407, "distance-from-start": 2.6481194753399744, "deviation-center-line": 2.314638462840208, "driven_lanedir_consec": 4.9093047973568655}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
114984sim-2of4successyes0:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.6269245156593137
survival_time_median59.99999999999873
deviation-center-line_median2.156705310533381
in-drivable-lane_median11.849999999999469


other stats
deviation-center-line_max2.156705310533381
deviation-center-line_mean2.156705310533381
deviation-center-line_min2.156705310533381
deviation-heading_max14.05126581900184
deviation-heading_mean14.05126581900184
deviation-heading_median14.05126581900184
deviation-heading_min14.05126581900184
distance-from-start_max1.940069192409733
distance-from-start_mean1.940069192409733
distance-from-start_median1.940069192409733
distance-from-start_min1.940069192409733
driven_any_max7.91432999235466
driven_any_mean7.91432999235466
driven_any_median7.91432999235466
driven_any_min7.91432999235466
driven_lanedir_consec_max3.6269245156593137
driven_lanedir_consec_mean3.6269245156593137
driven_lanedir_consec_min3.6269245156593137
driven_lanedir_max5.770696480838428
driven_lanedir_mean5.770696480838428
driven_lanedir_median5.770696480838428
driven_lanedir_min5.770696480838428
in-drivable-lane_max11.849999999999469
in-drivable-lane_mean11.849999999999469
in-drivable-lane_min11.849999999999469
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.91432999235466, "survival_time": 59.99999999999873, "driven_lanedir": 5.770696480838428, "in-drivable-lane": 11.849999999999469, "deviation-heading": 14.05126581900184, "distance-from-start": 1.940069192409733, "deviation-center-line": 2.156705310533381, "driven_lanedir_consec": 3.6269245156593137}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
114983sim-1of4successyes0:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.667444856716349
survival_time_median59.99999999999873
deviation-center-line_median3.9141907113126497
in-drivable-lane_median12.14999999999973


other stats
deviation-center-line_max3.9141907113126497
deviation-center-line_mean3.9141907113126497
deviation-center-line_min3.9141907113126497
deviation-heading_max11.025713422359493
deviation-heading_mean11.025713422359493
deviation-heading_median11.025713422359493
deviation-heading_min11.025713422359493
distance-from-start_max4.3579063471550565
distance-from-start_mean4.3579063471550565
distance-from-start_median4.3579063471550565
distance-from-start_min4.3579063471550565
driven_any_max7.9077548144638765
driven_any_mean7.9077548144638765
driven_any_median7.9077548144638765
driven_any_min7.9077548144638765
driven_lanedir_consec_max5.667444856716349
driven_lanedir_consec_mean5.667444856716349
driven_lanedir_consec_min5.667444856716349
driven_lanedir_max5.955172555318816
driven_lanedir_mean5.955172555318816
driven_lanedir_median5.955172555318816
driven_lanedir_min5.955172555318816
in-drivable-lane_max12.14999999999973
in-drivable-lane_mean12.14999999999973
in-drivable-lane_min12.14999999999973
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.9077548144638765, "survival_time": 59.99999999999873, "driven_lanedir": 5.955172555318816, "in-drivable-lane": 12.14999999999973, "deviation-heading": 11.025713422359493, "distance-from-start": 4.3579063471550565, "deviation-center-line": 3.9141907113126497, "driven_lanedir_consec": 5.667444856716349}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
114982sim-3of4successyes0:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114980sim-0of4successyes0:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.086106627118861
survival_time_median58.89999999999879
deviation-center-line_median2.307911331240142
in-drivable-lane_median26.249999999998636


other stats
deviation-center-line_max2.307911331240142
deviation-center-line_mean2.307911331240142
deviation-center-line_min2.307911331240142
deviation-heading_max6.789460066931564
deviation-heading_mean6.789460066931564
deviation-heading_median6.789460066931564
deviation-heading_min6.789460066931564
distance-from-start_max1.1258008861559206
distance-from-start_mean1.1258008861559206
distance-from-start_median1.1258008861559206
distance-from-start_min1.1258008861559206
driven_any_max7.675183504569143
driven_any_mean7.675183504569143
driven_any_median7.675183504569143
driven_any_min7.675183504569143
driven_lanedir_consec_max4.086106627118861
driven_lanedir_consec_mean4.086106627118861
driven_lanedir_consec_min4.086106627118861
driven_lanedir_max4.086106627118861
driven_lanedir_mean4.086106627118861
driven_lanedir_median4.086106627118861
driven_lanedir_min4.086106627118861
in-drivable-lane_max26.249999999998636
in-drivable-lane_mean26.249999999998636
in-drivable-lane_min26.249999999998636
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.675183504569143, "survival_time": 58.89999999999879, "driven_lanedir": 4.086106627118861, "in-drivable-lane": 26.249999999998636, "deviation-heading": 6.789460066931564, "distance-from-start": 1.1258008861559206, "deviation-center-line": 2.307911331240142, "driven_lanedir_consec": 4.086106627118861}}
simulation-passed1
survival_time_max58.89999999999879
survival_time_mean58.89999999999879
survival_time_min58.89999999999879
No reset possible
94951sim-1of4successno0:08:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94950sim-3of4successno0:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94948sim-0of4successno0:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94947sim-2of4successno0:09:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74901sim-3of4successno0:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74890sim-3of4successno0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74882sim-1of4successno0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74867sim-2of4successno0:06:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74862sim-0of4successno0:08:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74805sim-0of4timeoutno----No reset possible
74804sim-3of4timeoutno----No reset possible
74802sim-1of4timeoutno----No reset possible
74801sim-2of4timeoutno----No reset possible
63390sim-3of4successno0:07:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63384sim-0of4successno0:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63377sim-1of4successno0:07:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63373sim-2of4successno0:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62933347failedyes0:04:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible