Duckietown Challenges Home Challenges Submissions

Submission 13734

Submission13734
Competingyes
Challengeaido-LF-sim-validation
UserAndrea Daniele 🇮🇹
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 116120 sim-1of4: 116121 sim-2of4: 116125 sim-3of4: 116118
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

116125

Click the images to see detailed statistics about the episode.

loop-000

116121

Click the images to see detailed statistics about the episode.

zigzag-000

116120

Click the images to see detailed statistics about the episode.

loop2-000

116118

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
116125sim-2of4successyes0:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.882986314164948
survival_time_median59.99999999999873
deviation-center-line_median3.320310812296579
in-drivable-lane_median4.349999999999902


other stats
deviation-center-line_max3.320310812296579
deviation-center-line_mean3.320310812296579
deviation-center-line_min3.320310812296579
deviation-heading_max12.427794982172577
deviation-heading_mean12.427794982172577
deviation-heading_median12.427794982172577
deviation-heading_min12.427794982172577
distance-from-start_max2.658315967625372
distance-from-start_mean2.658315967625372
distance-from-start_median2.658315967625372
distance-from-start_min2.658315967625372
driven_any_max7.907657132541238
driven_any_mean7.907657132541238
driven_any_median7.907657132541238
driven_any_min7.907657132541238
driven_lanedir_consec_max4.882986314164948
driven_lanedir_consec_mean4.882986314164948
driven_lanedir_consec_min4.882986314164948
driven_lanedir_max6.85058912100264
driven_lanedir_mean6.85058912100264
driven_lanedir_median6.85058912100264
driven_lanedir_min6.85058912100264
in-drivable-lane_max4.349999999999902
in-drivable-lane_mean4.349999999999902
in-drivable-lane_min4.349999999999902
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907657132541238, "survival_time": 59.99999999999873, "driven_lanedir": 6.85058912100264, "in-drivable-lane": 4.349999999999902, "deviation-heading": 12.427794982172577, "distance-from-start": 2.658315967625372, "deviation-center-line": 3.320310812296579, "driven_lanedir_consec": 4.882986314164948}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
116121sim-1of4successyes0:05:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.100467076732252
survival_time_median59.99999999999873
deviation-center-line_median2.9225841437369477
in-drivable-lane_median18.749999999999535


other stats
deviation-center-line_max2.9225841437369477
deviation-center-line_mean2.9225841437369477
deviation-center-line_min2.9225841437369477
deviation-heading_max9.573091224151984
deviation-heading_mean9.573091224151984
deviation-heading_median9.573091224151984
deviation-heading_min9.573091224151984
distance-from-start_max4.348001057499988
distance-from-start_mean4.348001057499988
distance-from-start_median4.348001057499988
distance-from-start_min4.348001057499988
driven_any_max7.907780708797558
driven_any_mean7.907780708797558
driven_any_median7.907780708797558
driven_any_min7.907780708797558
driven_lanedir_consec_max5.100467076732252
driven_lanedir_consec_mean5.100467076732252
driven_lanedir_consec_min5.100467076732252
driven_lanedir_max5.100467076732252
driven_lanedir_mean5.100467076732252
driven_lanedir_median5.100467076732252
driven_lanedir_min5.100467076732252
in-drivable-lane_max18.749999999999535
in-drivable-lane_mean18.749999999999535
in-drivable-lane_min18.749999999999535
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907780708797558, "survival_time": 59.99999999999873, "driven_lanedir": 5.100467076732252, "in-drivable-lane": 18.749999999999535, "deviation-heading": 9.573091224151984, "distance-from-start": 4.348001057499988, "deviation-center-line": 2.9225841437369477, "driven_lanedir_consec": 5.100467076732252}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
116120sim-0of4successyes0:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.340488256563922
survival_time_median59.99999999999873
deviation-center-line_median3.985619710229976
in-drivable-lane_median17.149999999999757


other stats
deviation-center-line_max3.985619710229976
deviation-center-line_mean3.985619710229976
deviation-center-line_min3.985619710229976
deviation-heading_max13.178863018392924
deviation-heading_mean13.178863018392924
deviation-heading_median13.178863018392924
deviation-heading_min13.178863018392924
distance-from-start_max1.193714464936519
distance-from-start_mean1.193714464936519
distance-from-start_median1.193714464936519
distance-from-start_min1.193714464936519
driven_any_max7.9140407762440015
driven_any_mean7.9140407762440015
driven_any_median7.9140407762440015
driven_any_min7.9140407762440015
driven_lanedir_consec_max4.340488256563922
driven_lanedir_consec_mean4.340488256563922
driven_lanedir_consec_min4.340488256563922
driven_lanedir_max5.09827984189809
driven_lanedir_mean5.09827984189809
driven_lanedir_median5.09827984189809
driven_lanedir_min5.09827984189809
in-drivable-lane_max17.149999999999757
in-drivable-lane_mean17.149999999999757
in-drivable-lane_min17.149999999999757
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.9140407762440015, "survival_time": 59.99999999999873, "driven_lanedir": 5.09827984189809, "in-drivable-lane": 17.149999999999757, "deviation-heading": 13.178863018392924, "distance-from-start": 1.193714464936519, "deviation-center-line": 3.985619710229976, "driven_lanedir_consec": 4.340488256563922}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
116118sim-3of4successyes0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.176129796125308
survival_time_median59.99999999999873
deviation-center-line_median3.4467511733165335
in-drivable-lane_median10.899999999999627


other stats
deviation-center-line_max3.4467511733165335
deviation-center-line_mean3.4467511733165335
deviation-center-line_min3.4467511733165335
deviation-heading_max9.177981488987104
deviation-heading_mean9.177981488987104
deviation-heading_median9.177981488987104
deviation-heading_min9.177981488987104
distance-from-start_max2.403225954059294
distance-from-start_mean2.403225954059294
distance-from-start_median2.403225954059294
distance-from-start_min2.403225954059294
driven_any_max7.914475966638629
driven_any_mean7.914475966638629
driven_any_median7.914475966638629
driven_any_min7.914475966638629
driven_lanedir_consec_max6.176129796125308
driven_lanedir_consec_mean6.176129796125308
driven_lanedir_consec_min6.176129796125308
driven_lanedir_max6.176129796125308
driven_lanedir_mean6.176129796125308
driven_lanedir_median6.176129796125308
driven_lanedir_min6.176129796125308
in-drivable-lane_max10.899999999999627
in-drivable-lane_mean10.899999999999627
in-drivable-lane_min10.899999999999627
per-episodes
details{"loop-000-ego0": {"driven_any": 7.914475966638629, "survival_time": 59.99999999999873, "driven_lanedir": 6.176129796125308, "in-drivable-lane": 10.899999999999627, "deviation-heading": 9.177981488987104, "distance-from-start": 2.403225954059294, "deviation-center-line": 3.4467511733165335, "driven_lanedir_consec": 6.176129796125308}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
62274347failedyes0:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62273347failedyes0:03:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible