Duckietown Challenges Home Challenges Submissions

Submission 17200

Submission17200
Competingyes
Challengemooc-BV1
UserSacha Morin
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 107280 sim-1of5: 107275 sim-2of5: 107263 sim-3of5: 107278 sim-4of5: 107259
Next
User labelfinal_submission_real
Admin priority50
Blessingn/a
User priority50

107280

Click the images to see detailed statistics about the episode.

d45

107278

Click the images to see detailed statistics about the episode.

d30

107275

Click the images to see detailed statistics about the episode.

d50

107263

Click the images to see detailed statistics about the episode.

d40

107259

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
107280sim-0of5successyes0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.9614092271441456


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.9614092271441456
distance-from-start_median0.9614092271441456
distance-from-start_min0.9614092271441456
driven_any_max1.0569527171458366
driven_any_mean1.0569527171458366
driven_any_median1.0569527171458366
driven_any_min1.0569527171458366
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.649999999999995
in-drivable-lane_mean3.649999999999995
in-drivable-lane_median3.649999999999995
in-drivable-lane_min3.649999999999995
per-episodes
details{"d45-ego0": {"driven_any": 1.0569527171458366, "survival_time": 3.649999999999995, "driven_lanedir": 0.0, "in-drivable-lane": 3.649999999999995, "deviation-heading": 0.0, "distance-from-start": 0.9614092271441456, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean3.649999999999995
survival_time_median3.649999999999995
survival_time_min3.649999999999995
No reset possible
107278sim-3of5successyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.6643759340099984


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.6643759340099984
distance-from-start_median0.6643759340099984
distance-from-start_min0.6643759340099984
driven_any_max0.7937089793448907
driven_any_mean0.7937089793448907
driven_any_median0.7937089793448907
driven_any_min0.7937089793448907
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.9999999999999973
in-drivable-lane_mean2.9999999999999973
in-drivable-lane_median2.9999999999999973
in-drivable-lane_min2.9999999999999973
per-episodes
details{"d30-ego0": {"driven_any": 0.7937089793448907, "survival_time": 2.9999999999999973, "driven_lanedir": 0.0, "in-drivable-lane": 2.9999999999999973, "deviation-heading": 0.0, "distance-from-start": 0.6643759340099984, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.9999999999999973
survival_time_mean2.9999999999999973
survival_time_median2.9999999999999973
survival_time_min2.9999999999999973
No reset possible
107276sim-0of5successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107275sim-1of5successyes0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.619421927406531


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.619421927406531
distance-from-start_median1.619421927406531
distance-from-start_min1.619421927406531
driven_any_max1.988349823872315
driven_any_mean1.988349823872315
driven_any_median1.988349823872315
driven_any_min1.988349823872315
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.949999999999987
in-drivable-lane_mean5.949999999999987
in-drivable-lane_median5.949999999999987
in-drivable-lane_min5.949999999999987
per-episodes
details{"d50-ego0": {"driven_any": 1.988349823872315, "survival_time": 5.949999999999987, "driven_lanedir": 0.0, "in-drivable-lane": 5.949999999999987, "deviation-heading": 0.0, "distance-from-start": 1.619421927406531, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.949999999999987
survival_time_mean5.949999999999987
survival_time_median5.949999999999987
survival_time_min5.949999999999987
No reset possible
107272sim-3of5successyes0:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107270sim-1of5successyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107269sim-0of5successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107266sim-1of5successyes0:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107265sim-3of5successyes0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107264sim-0of5successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107263sim-2of5successyes0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.6546192501721158


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.6546192501721158
distance-from-start_median0.6546192501721158
distance-from-start_min0.6546192501721158
driven_any_max0.7937048249910503
driven_any_mean0.7937048249910503
driven_any_median0.7937048249910503
driven_any_min0.7937048249910503
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.9999999999999973
in-drivable-lane_mean2.9999999999999973
in-drivable-lane_median2.9999999999999973
in-drivable-lane_min2.9999999999999973
per-episodes
details{"d40-ego0": {"driven_any": 0.7937048249910503, "survival_time": 2.9999999999999973, "driven_lanedir": 0.0, "in-drivable-lane": 2.9999999999999973, "deviation-heading": 0.0, "distance-from-start": 0.6546192501721158, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.9999999999999973
survival_time_mean2.9999999999999973
survival_time_median2.9999999999999973
survival_time_min2.9999999999999973
No reset possible
107261sim-3of5successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107259sim-4of5successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.5691161190990144


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.5691161190990144
distance-from-start_median1.5691161190990144
distance-from-start_min1.5691161190990144
driven_any_max2.3730082312794294
driven_any_mean2.3730082312794294
driven_any_median2.3730082312794294
driven_any_min2.3730082312794294
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.8999999999999835
in-drivable-lane_mean6.8999999999999835
in-drivable-lane_median6.8999999999999835
in-drivable-lane_min6.8999999999999835
per-episodes
details{"d60-ego0": {"driven_any": 2.3730082312794294, "survival_time": 6.8999999999999835, "driven_lanedir": 0.0, "in-drivable-lane": 6.8999999999999835, "deviation-heading": 0.0, "distance-from-start": 1.5691161190990144, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.8999999999999835
survival_time_mean6.8999999999999835
survival_time_median6.8999999999999835
survival_time_min6.8999999999999835
No reset possible
107256sim-2of5successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107252sim-4of5successyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107248sim-2of5successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107242sim-4of5successyes0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107241sim-2of5successyes0:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107235sim-4of5successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107234sim-2of5successyes0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87168sim-2of5successno0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87167sim-4of5successno0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87166sim-1of5successno0:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87165sim-0of5successno0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87164sim-3of5successno0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87163sim-4of5successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87162sim-2of5successno0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87161sim-0of5successno0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87160sim-1of5successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87159sim-3of5successno0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87158sim-3of5errorno0:00:45
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal05_802404650a97-job87158-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87157sim-4of5successno0:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87156sim-2of5successno0:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87155sim-3of5errorno0:00:45
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17200/sim-3of5-montreal01_d2e00e7885ab-job87155-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87154sim-0of5successno0:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87153sim-1of5successno0:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible