Duckietown Challenges Home Challenges Submissions

Submission 17209

Submission17209
Competingyes
Challengemooc-BV1
UserAlihusein Kuwajerwala
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 107076 sim-1of5: 107077 sim-2of5: 107097 sim-3of5: 107078 sim-4of5: 107094
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

107097

Click the images to see detailed statistics about the episode.

d40

107094

Click the images to see detailed statistics about the episode.

d60

107078

Click the images to see detailed statistics about the episode.

d30

107077

Click the images to see detailed statistics about the episode.

d50

107076

Click the images to see detailed statistics about the episode.

d45

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
107097sim-2of5successyes0:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.343558987537626


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.343558987537626
distance-from-start_median5.343558987537626
distance-from-start_min5.343558987537626
driven_any_max5.866784551309166
driven_any_mean5.866784551309166
driven_any_median5.866784551309166
driven_any_min5.866784551309166
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max21.55000000000017
in-drivable-lane_mean21.55000000000017
in-drivable-lane_median21.55000000000017
in-drivable-lane_min21.55000000000017
per-episodes
details{"d40-ego0": {"driven_any": 5.866784551309166, "survival_time": 21.55000000000017, "driven_lanedir": 0.0, "in-drivable-lane": 21.55000000000017, "deviation-heading": 0.0, "distance-from-start": 5.343558987537626, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max21.55000000000017
survival_time_mean21.55000000000017
survival_time_median21.55000000000017
survival_time_min21.55000000000017
No reset possible
107094sim-4of5successyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1847778739889105


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1847778739889105
distance-from-start_median2.1847778739889105
distance-from-start_min2.1847778739889105
driven_any_max2.767601122032526
driven_any_mean2.767601122032526
driven_any_median2.767601122032526
driven_any_min2.767601122032526
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max10.500000000000014
in-drivable-lane_mean10.500000000000014
in-drivable-lane_median10.500000000000014
in-drivable-lane_min10.500000000000014
per-episodes
details{"d60-ego0": {"driven_any": 2.767601122032526, "survival_time": 10.500000000000014, "driven_lanedir": 0.0, "in-drivable-lane": 10.500000000000014, "deviation-heading": 0.0, "distance-from-start": 2.1847778739889105, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max10.500000000000014
survival_time_mean10.500000000000014
survival_time_median10.500000000000014
survival_time_min10.500000000000014
No reset possible
107091sim-2of5successyes0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107089sim-4of5successyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107082sim-2of5successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107081sim-4of5successyes0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107078sim-3of5successyes0:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.347318677186423


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.347318677186423
distance-from-start_median5.347318677186423
distance-from-start_min5.347318677186423
driven_any_max5.664600482991105
driven_any_mean5.664600482991105
driven_any_median5.664600482991105
driven_any_min5.664600482991105
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max21.600000000000172
in-drivable-lane_mean21.600000000000172
in-drivable-lane_median21.600000000000172
in-drivable-lane_min21.600000000000172
per-episodes
details{"d30-ego0": {"driven_any": 5.664600482991105, "survival_time": 21.600000000000172, "driven_lanedir": 0.0, "in-drivable-lane": 21.600000000000172, "deviation-heading": 0.0, "distance-from-start": 5.347318677186423, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max21.600000000000172
survival_time_mean21.600000000000172
survival_time_median21.600000000000172
survival_time_min21.600000000000172
No reset possible
107077sim-1of5successyes0:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.189457299108818


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.189457299108818
distance-from-start_median5.189457299108818
distance-from-start_min5.189457299108818
driven_any_max6.606177022261665
driven_any_mean6.606177022261665
driven_any_median6.606177022261665
driven_any_min6.606177022261665
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max24.30000000000021
in-drivable-lane_mean24.30000000000021
in-drivable-lane_median24.30000000000021
in-drivable-lane_min24.30000000000021
per-episodes
details{"d50-ego0": {"driven_any": 6.606177022261665, "survival_time": 24.30000000000021, "driven_lanedir": 0.0, "in-drivable-lane": 24.30000000000021, "deviation-heading": 0.0, "distance-from-start": 5.189457299108818, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max24.30000000000021
survival_time_mean24.30000000000021
survival_time_median24.30000000000021
survival_time_min24.30000000000021
No reset possible
107076sim-0of5successyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.7743081178423328


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.7743081178423328
distance-from-start_median2.7743081178423328
distance-from-start_min2.7743081178423328
driven_any_max3.194615485969693
driven_any_mean3.194615485969693
driven_any_median3.194615485969693
driven_any_min3.194615485969693
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max11.750000000000032
in-drivable-lane_mean11.750000000000032
in-drivable-lane_median11.750000000000032
in-drivable-lane_min11.750000000000032
per-episodes
details{"d45-ego0": {"driven_any": 3.194615485969693, "survival_time": 11.750000000000032, "driven_lanedir": 0.0, "in-drivable-lane": 11.750000000000032, "deviation-heading": 0.0, "distance-from-start": 2.7743081178423328, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max11.750000000000032
survival_time_mean11.750000000000032
survival_time_median11.750000000000032
survival_time_min11.750000000000032
No reset possible
107075sim-2of5successyes0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107073sim-1of5successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107072sim-0of5successyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107070sim-3of5successyes0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87265sim-4of5errorno0:00:42
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal05_802404650a97-job87265-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87264sim-3of5successno0:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87263sim-4of5errorno0:00:42
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87263-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87262sim-2of5successno0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87261sim-0of5successno0:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87260sim-1of5successno0:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87259sim-2of5errorno0:00:44
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87259-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87258sim-0of5errorno0:00:43
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal02_b87fca61d0e7-job87258-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87257sim-1of5errorno0:00:44
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal01_d2e00e7885ab-job87257-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87256sim-2of5errorno0:00:45
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal05_802404650a97-job87256-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87255sim-4of5successno0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87254sim-0of5errorno0:00:42
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal03_a39f3a5a13b9-job87254-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87253sim-3of5successno0:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87252sim-0of5errorno0:00:49
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-0of5-montreal04_6419ffa178db-job87252-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87251sim-1of5errorno0:00:49
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-1of5-montreal02_b87fca61d0e7-job87251-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87250sim-3of5errorno0:00:48
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-3of5-montreal05_802404650a97-job87250-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87249sim-4of5errorno0:00:51
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-4of5-montreal03_a39f3a5a13b9-job87249-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87248sim-2of5errorno0:00:48
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17209/sim-2of5-montreal01_d2e00e7885ab-job87248-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible