Duckietown Challenges Home Challenges Submissions

Submission 17798

Submission17798
Competingyes
Challengeaido-LF-sim-validation
UserDailin Hu
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 116297 sim-1of4: 116296 sim-2of4: 116299 sim-3of4: 116301
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

116301

Click the images to see detailed statistics about the episode.

zigzag-000

116299

Click the images to see detailed statistics about the episode.

loop-000

116297

Click the images to see detailed statistics about the episode.

loop2-000

116296

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
116301sim-3of4successyes0:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8943854682798507
survival_time_median59.99999999999873
deviation-center-line_median1.829083031254375
in-drivable-lane_median30.59999999999935


other stats
deviation-center-line_max1.829083031254375
deviation-center-line_mean1.829083031254375
deviation-center-line_min1.829083031254375
deviation-heading_max23.362262044442502
deviation-heading_mean23.362262044442502
deviation-heading_median23.362262044442502
deviation-heading_min23.362262044442502
distance-from-start_max0.14007621596787315
distance-from-start_mean0.14007621596787315
distance-from-start_median0.14007621596787315
distance-from-start_min0.14007621596787315
driven_any_max3.098717526963185
driven_any_mean3.098717526963185
driven_any_median3.098717526963185
driven_any_min3.098717526963185
driven_lanedir_consec_max0.8943854682798507
driven_lanedir_consec_mean0.8943854682798507
driven_lanedir_consec_min0.8943854682798507
driven_lanedir_max0.8943854682798507
driven_lanedir_mean0.8943854682798507
driven_lanedir_median0.8943854682798507
driven_lanedir_min0.8943854682798507
in-drivable-lane_max30.59999999999935
in-drivable-lane_mean30.59999999999935
in-drivable-lane_min30.59999999999935
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.098717526963185, "survival_time": 59.99999999999873, "driven_lanedir": 0.8943854682798507, "in-drivable-lane": 30.59999999999935, "deviation-heading": 23.362262044442502, "distance-from-start": 0.14007621596787315, "deviation-center-line": 1.829083031254375, "driven_lanedir_consec": 0.8943854682798507}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
116300sim-3of4successyes0:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116299sim-2of4successyes0:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.035403776521903074
survival_time_median2.6499999999999986
deviation-center-line_median0.02379974825375925
in-drivable-lane_median1.7499999999999984


other stats
deviation-center-line_max0.02379974825375925
deviation-center-line_mean0.02379974825375925
deviation-center-line_min0.02379974825375925
deviation-heading_max0.7847259670216955
deviation-heading_mean0.7847259670216955
deviation-heading_median0.7847259670216955
deviation-heading_min0.7847259670216955
distance-from-start_max0.1346846441065475
distance-from-start_mean0.1346846441065475
distance-from-start_median0.1346846441065475
distance-from-start_min0.1346846441065475
driven_any_max0.20740415550618851
driven_any_mean0.20740415550618851
driven_any_median0.20740415550618851
driven_any_min0.20740415550618851
driven_lanedir_consec_max0.035403776521903074
driven_lanedir_consec_mean0.035403776521903074
driven_lanedir_consec_min0.035403776521903074
driven_lanedir_max0.035403776521903074
driven_lanedir_mean0.035403776521903074
driven_lanedir_median0.035403776521903074
driven_lanedir_min0.035403776521903074
in-drivable-lane_max1.7499999999999984
in-drivable-lane_mean1.7499999999999984
in-drivable-lane_min1.7499999999999984
per-episodes
details{"loop-000-ego0": {"driven_any": 0.20740415550618851, "survival_time": 2.6499999999999986, "driven_lanedir": 0.035403776521903074, "in-drivable-lane": 1.7499999999999984, "deviation-heading": 0.7847259670216955, "distance-from-start": 0.1346846441065475, "deviation-center-line": 0.02379974825375925, "driven_lanedir_consec": 0.035403776521903074}}
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.6499999999999986
survival_time_min2.6499999999999986
No reset possible
116298sim-3of4host-erroryes0:02:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 856, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1058, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 123, in docker_pull
    docker_caching.mark_tag_pushed(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/caching.py", line 214, in mark_tag_pushed
    self._check_inited()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/caching.py", line 36, in _check_inited
    os.makedirs(dn)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/fake-home/ubuntu/.dt-caches'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116297sim-0of4successyes0:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3491724421482791
survival_time_median59.74999999999874
deviation-center-line_median2.02302144340845
in-drivable-lane_median33.499999999999154


other stats
deviation-center-line_max2.02302144340845
deviation-center-line_mean2.02302144340845
deviation-center-line_min2.02302144340845
deviation-heading_max20.16517860779971
deviation-heading_mean20.16517860779971
deviation-heading_median20.16517860779971
deviation-heading_min20.16517860779971
distance-from-start_max0.21348962359818216
distance-from-start_mean0.21348962359818216
distance-from-start_median0.21348962359818216
distance-from-start_min0.21348962359818216
driven_any_max4.776705292456995
driven_any_mean4.776705292456995
driven_any_median4.776705292456995
driven_any_min4.776705292456995
driven_lanedir_consec_max1.3491724421482791
driven_lanedir_consec_mean1.3491724421482791
driven_lanedir_consec_min1.3491724421482791
driven_lanedir_max1.3491724421482791
driven_lanedir_mean1.3491724421482791
driven_lanedir_median1.3491724421482791
driven_lanedir_min1.3491724421482791
in-drivable-lane_max33.499999999999154
in-drivable-lane_mean33.499999999999154
in-drivable-lane_min33.499999999999154
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.776705292456995, "survival_time": 59.74999999999874, "driven_lanedir": 1.3491724421482791, "in-drivable-lane": 33.499999999999154, "deviation-heading": 20.16517860779971, "distance-from-start": 0.21348962359818216, "deviation-center-line": 2.02302144340845, "driven_lanedir_consec": 1.3491724421482791}}
simulation-passed1
survival_time_max59.74999999999874
survival_time_mean59.74999999999874
survival_time_min59.74999999999874
No reset possible
116296sim-1of4successyes0:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12260720580338225
survival_time_median2.5999999999999988
deviation-center-line_median0.07563545509762834
in-drivable-lane_median1.3999999999999984


other stats
deviation-center-line_max0.07563545509762834
deviation-center-line_mean0.07563545509762834
deviation-center-line_min0.07563545509762834
deviation-heading_max0.8679381614483607
deviation-heading_mean0.8679381614483607
deviation-heading_median0.8679381614483607
deviation-heading_min0.8679381614483607
distance-from-start_max0.2422099723731867
distance-from-start_mean0.2422099723731867
distance-from-start_median0.2422099723731867
distance-from-start_min0.2422099723731867
driven_any_max0.2857493967082554
driven_any_mean0.2857493967082554
driven_any_median0.2857493967082554
driven_any_min0.2857493967082554
driven_lanedir_consec_max0.12260720580338225
driven_lanedir_consec_mean0.12260720580338225
driven_lanedir_consec_min0.12260720580338225
driven_lanedir_max0.12260720580338225
driven_lanedir_mean0.12260720580338225
driven_lanedir_median0.12260720580338225
driven_lanedir_min0.12260720580338225
in-drivable-lane_max1.3999999999999984
in-drivable-lane_mean1.3999999999999984
in-drivable-lane_min1.3999999999999984
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.2857493967082554, "survival_time": 2.5999999999999988, "driven_lanedir": 0.12260720580338225, "in-drivable-lane": 1.3999999999999984, "deviation-heading": 0.8679381614483607, "distance-from-start": 0.2422099723731867, "deviation-center-line": 0.07563545509762834, "driven_lanedir_consec": 0.12260720580338225}}
simulation-passed1
survival_time_max2.5999999999999988
survival_time_mean2.5999999999999988
survival_time_min2.5999999999999988
No reset possible