Duckietown Challenges Home Challenges Submissions

Submission 18077

Submission18077
Competingyes
Challengeaido-LF-sim-validation
UserPierre-Luc Parent
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 118784 sim-1of4: 118779 sim-2of4: 118777 sim-3of4: 118780
Next
User labelbaseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

118784

Click the images to see detailed statistics about the episode.

zigzag-000

118780

Click the images to see detailed statistics about the episode.

autolab-000

118779

Click the images to see detailed statistics about the episode.

loop2-000

118777

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
118784sim-0of4successyes0:10:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.4716257975561255
survival_time_median25.70000000000023
deviation-center-line_median1.3865842423112158
in-drivable-lane_median5.150000000000054


other stats
deviation-center-line_max1.3865842423112158
deviation-center-line_mean1.3865842423112158
deviation-center-line_min1.3865842423112158
deviation-heading_max6.353533506421609
deviation-heading_mean6.353533506421609
deviation-heading_median6.353533506421609
deviation-heading_min6.353533506421609
distance-from-start_max2.8328821478168233
distance-from-start_mean2.8328821478168233
distance-from-start_median2.8328821478168233
distance-from-start_min2.8328821478168233
driven_any_max5.898813701629424
driven_any_mean5.898813701629424
driven_any_median5.898813701629424
driven_any_min5.898813701629424
driven_lanedir_consec_max4.4716257975561255
driven_lanedir_consec_mean4.4716257975561255
driven_lanedir_consec_min4.4716257975561255
driven_lanedir_max4.4716257975561255
driven_lanedir_mean4.4716257975561255
driven_lanedir_median4.4716257975561255
driven_lanedir_min4.4716257975561255
in-drivable-lane_max5.150000000000054
in-drivable-lane_mean5.150000000000054
in-drivable-lane_min5.150000000000054
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.898813701629424, "survival_time": 25.70000000000023, "driven_lanedir": 4.4716257975561255, "in-drivable-lane": 5.150000000000054, "deviation-heading": 6.353533506421609, "distance-from-start": 2.8328821478168233, "deviation-center-line": 1.3865842423112158, "driven_lanedir_consec": 4.4716257975561255}}
simulation-passed1
survival_time_max25.70000000000023
survival_time_mean25.70000000000023
survival_time_min25.70000000000023
No reset possible
118781sim-0of4abortedyes0:02:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 274, in main
    raise InvalidEvaluator(msg)
duckietown_challenges.exceptions.InvalidEvaluator: Timeout during connection: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
118780sim-3of4successyes0:08:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.700842703814097
survival_time_median43.94999999999964
deviation-center-line_median1.768622369774303
in-drivable-lane_median1.4499999999999955


other stats
deviation-center-line_max1.768622369774303
deviation-center-line_mean1.768622369774303
deviation-center-line_min1.768622369774303
deviation-heading_max7.011162940192932
deviation-heading_mean7.011162940192932
deviation-heading_median7.011162940192932
deviation-heading_min7.011162940192932
distance-from-start_max3.2100851482168573
distance-from-start_mean3.2100851482168573
distance-from-start_median3.2100851482168573
distance-from-start_min3.2100851482168573
driven_any_max10.311454813288782
driven_any_mean10.311454813288782
driven_any_median10.311454813288782
driven_any_min10.311454813288782
driven_lanedir_consec_max9.700842703814097
driven_lanedir_consec_mean9.700842703814097
driven_lanedir_consec_min9.700842703814097
driven_lanedir_max9.700842703814097
driven_lanedir_mean9.700842703814097
driven_lanedir_median9.700842703814097
driven_lanedir_min9.700842703814097
in-drivable-lane_max1.4499999999999955
in-drivable-lane_mean1.4499999999999955
in-drivable-lane_min1.4499999999999955
per-episodes
details{"autolab-000-ego0": {"driven_any": 10.311454813288782, "survival_time": 43.94999999999964, "driven_lanedir": 9.700842703814097, "in-drivable-lane": 1.4499999999999955, "deviation-heading": 7.011162940192932, "distance-from-start": 3.2100851482168573, "deviation-center-line": 1.768622369774303, "driven_lanedir_consec": 9.700842703814097}}
simulation-passed1
survival_time_max43.94999999999964
survival_time_mean43.94999999999964
survival_time_min43.94999999999964
No reset possible
118779sim-1of4successyes0:09:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.388510448426285
survival_time_median59.99999999999873
deviation-center-line_median3.387389858186066
in-drivable-lane_median8.749999999999812


other stats
deviation-center-line_max3.387389858186066
deviation-center-line_mean3.387389858186066
deviation-center-line_min3.387389858186066
deviation-heading_max17.282411481585708
deviation-heading_mean17.282411481585708
deviation-heading_median17.282411481585708
deviation-heading_min17.282411481585708
distance-from-start_max1.142251426864623
distance-from-start_mean1.142251426864623
distance-from-start_median1.142251426864623
distance-from-start_min1.142251426864623
driven_any_max14.308769653920685
driven_any_mean14.308769653920685
driven_any_median14.308769653920685
driven_any_min14.308769653920685
driven_lanedir_consec_max11.388510448426285
driven_lanedir_consec_mean11.388510448426285
driven_lanedir_consec_min11.388510448426285
driven_lanedir_max11.388510448426285
driven_lanedir_mean11.388510448426285
driven_lanedir_median11.388510448426285
driven_lanedir_min11.388510448426285
in-drivable-lane_max8.749999999999812
in-drivable-lane_mean8.749999999999812
in-drivable-lane_min8.749999999999812
per-episodes
details{"loop2-000-ego0": {"driven_any": 14.308769653920685, "survival_time": 59.99999999999873, "driven_lanedir": 11.388510448426285, "in-drivable-lane": 8.749999999999812, "deviation-heading": 17.282411481585708, "distance-from-start": 1.142251426864623, "deviation-center-line": 3.387389858186066, "driven_lanedir_consec": 11.388510448426285}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118777sim-2of4successyes0:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.6385695808769265
survival_time_median47.59999999999943
deviation-center-line_median0.9533599809340724
in-drivable-lane_median26.89999999999927


other stats
deviation-center-line_max0.9533599809340724
deviation-center-line_mean0.9533599809340724
deviation-center-line_min0.9533599809340724
deviation-heading_max4.64048784862574
deviation-heading_mean4.64048784862574
deviation-heading_median4.64048784862574
deviation-heading_min4.64048784862574
distance-from-start_max2.510167174929238
distance-from-start_mean2.510167174929238
distance-from-start_median2.510167174929238
distance-from-start_min2.510167174929238
driven_any_max11.193191152420177
driven_any_mean11.193191152420177
driven_any_median11.193191152420177
driven_any_min11.193191152420177
driven_lanedir_consec_max4.6385695808769265
driven_lanedir_consec_mean4.6385695808769265
driven_lanedir_consec_min4.6385695808769265
driven_lanedir_max4.6385695808769265
driven_lanedir_mean4.6385695808769265
driven_lanedir_median4.6385695808769265
driven_lanedir_min4.6385695808769265
in-drivable-lane_max26.89999999999927
in-drivable-lane_mean26.89999999999927
in-drivable-lane_min26.89999999999927
per-episodes
details{"loop-000-ego0": {"driven_any": 11.193191152420177, "survival_time": 47.59999999999943, "driven_lanedir": 4.6385695808769265, "in-drivable-lane": 26.89999999999927, "deviation-heading": 4.64048784862574, "distance-from-start": 2.510167174929238, "deviation-center-line": 0.9533599809340724, "driven_lanedir_consec": 4.6385695808769265}}
simulation-passed1
survival_time_max47.59999999999943
survival_time_mean47.59999999999943
survival_time_min47.59999999999943
No reset possible