Submission 17203

Submission

17203

Competing

yes

Challenge

mooc-BV1

User

Thanh Pham

Date submitted

2021-10-13 18:28:42+00:00

Last status update

2021-12-04 20:49:00+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of5: 107192 sim-1of5: 107195 sim-2of5: 107200 sim-3of5: 107177 sim-4of5: 107193

User label

exercises_braitenberg

Admin priority

Blessing

n/a

User priority

107200

Click the images to see detailed statistics about the episode.

d40

107195

Click the images to see detailed statistics about the episode.

d50

107193

Click the images to see detailed statistics about the episode.

d60

107192

Click the images to see detailed statistics about the episode.

d45

107177

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107200

sim-2of5

success

yes

2021-11-03 10:09:47+00:00

2021-11-03 10:13:22+00:00

0:03:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.1156000000001285

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.1156000000001285
distance-from-start_median	2.1156000000001285
distance-from-start_min	2.1156000000001285
driven_any_max	2.1156000000001742
driven_any_mean	2.1156000000001742
driven_any_median	2.1156000000001742
driven_any_min	2.1156000000001742
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	36.300000000000075
in-drivable-lane_mean	36.300000000000075
in-drivable-lane_median	36.300000000000075
in-drivable-lane_min	36.300000000000075
per-episodes	details {"d40-ego0": {"driven_any": 2.1156000000001742, "survival_time": 36.300000000000075, "driven_lanedir": 0.0, "in-drivable-lane": 36.300000000000075, "deviation-heading": 0.0, "distance-from-start": 2.1156000000001285, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	36.300000000000075
survival_time_mean	36.300000000000075
survival_time_median	36.300000000000075
survival_time_min	36.300000000000075

No reset possible

107195

sim-1of5

success

yes

2021-11-03 10:08:11+00:00

2021-11-03 10:14:19+00:00

0:06:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.844581014870298

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.844581014870298
distance-from-start_median	2.844581014870298
distance-from-start_min	2.844581014870298
driven_any_max	4.073415471225687
driven_any_mean	4.073415471225687
driven_any_median	4.073415471225687
driven_any_min	4.073415471225687
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d50-ego0": {"driven_any": 4.073415471225687, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 2.844581014870298, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107193

sim-4of5

success

yes

2021-11-03 10:08:08+00:00

2021-11-03 10:10:48+00:00

0:02:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

1.077599999999977

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	1.077599999999977
distance-from-start_median	1.077599999999977
distance-from-start_min	1.077599999999977
driven_any_max	1.0775999999999872
driven_any_mean	1.0775999999999872
driven_any_median	1.0775999999999872
driven_any_min	1.0775999999999872
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	19.000000000000135
in-drivable-lane_mean	19.000000000000135
in-drivable-lane_median	19.000000000000135
in-drivable-lane_min	19.000000000000135
per-episodes	details {"d60-ego0": {"driven_any": 1.0775999999999872, "survival_time": 19.000000000000135, "driven_lanedir": 0.0, "in-drivable-lane": 19.000000000000135, "deviation-heading": 0.0, "distance-from-start": 1.077599999999977, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	19.000000000000135
survival_time_mean	19.000000000000135
survival_time_median	19.000000000000135
survival_time_min	19.000000000000135

No reset possible

107192

sim-0of5

success

yes

2021-11-03 10:07:37+00:00

2021-11-03 10:12:43+00:00

0:05:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.0522905361905877

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.0522905361905877
distance-from-start_median	3.0522905361905877
distance-from-start_min	3.0522905361905877
driven_any_max	3.1380252606231576
driven_any_mean	3.1380252606231576
driven_any_median	3.1380252606231576
driven_any_min	3.1380252606231576
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	51.34999999999922
in-drivable-lane_mean	51.34999999999922
in-drivable-lane_median	51.34999999999922
in-drivable-lane_min	51.34999999999922
per-episodes	details {"d45-ego0": {"driven_any": 3.1380252606231576, "survival_time": 51.34999999999922, "driven_lanedir": 0.0, "in-drivable-lane": 51.34999999999922, "deviation-heading": 0.0, "distance-from-start": 3.0522905361905877, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	51.34999999999922
survival_time_mean	51.34999999999922
survival_time_median	51.34999999999922
survival_time_min	51.34999999999922

No reset possible

107187

sim-2of5

success

yes

2021-11-03 10:05:53+00:00

2021-11-03 10:09:34+00:00

0:03:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107178

sim-1of5

success

yes

2021-11-03 10:02:47+00:00

2021-11-03 10:07:42+00:00

0:04:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107177

sim-3of5

success

yes

2021-11-03 10:02:10+00:00

2021-11-03 10:07:16+00:00

0:05:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.579600000000537

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.579600000000537
distance-from-start_median	3.579600000000537
distance-from-start_min	3.579600000000537
driven_any_max	3.579600000000637
driven_any_mean	3.579600000000637
driven_any_median	3.579600000000637
driven_any_min	3.579600000000637
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d30-ego0": {"driven_any": 3.579600000000637, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 3.579600000000537, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

87189

sim-2of5

success

2021-10-13 18:35:28+00:00

2021-10-13 18:41:30+00:00

0:06:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87188

sim-2of5

error

2021-10-13 18:34:20+00:00

2021-10-13 18:35:01+00:00

0:00:41

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal03_a39f3a5a13b9-job87188-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87187

sim-4of5

success

2021-10-13 18:34:20+00:00

2021-10-13 18:38:31+00:00

0:04:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87186

sim-1of5

success

2021-10-13 18:34:18+00:00

2021-10-13 18:44:06+00:00

0:09:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87185

sim-0of5

success

2021-10-13 18:33:18+00:00

2021-10-13 18:39:51+00:00

0:06:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87184

sim-3of5

success

2021-10-13 18:33:17+00:00

2021-10-13 18:41:46+00:00

0:08:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87183

sim-2of5

error

2021-10-13 18:33:16+00:00

2021-10-13 18:34:03+00:00

0:00:47

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-2of5-montreal01_d2e00e7885ab-job87183-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87182

sim-4of5

error

2021-10-13 18:33:15+00:00

2021-10-13 18:34:03+00:00

0:00:48

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-4of5-montreal05_802404650a97-job87182-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87181

sim-1of5

error

2021-10-13 18:33:14+00:00

2021-10-13 18:34:00+00:00

0:00:46

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17203/sim-1of5-montreal03_a39f3a5a13b9-job87181-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible