Submission 17159

Submission

17159

Competing

yes

Challenge

mooc-BV1

User

Marco Pascolo

Date submitted

2021-10-12 08:24:38+00:00

Last status update

2021-12-04 20:48:58+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of5: 107579 sim-1of5: 107583 sim-2of5: 107590 sim-3of5: 107575 sim-4of5: 107578

User label

exercises_braitenberg

Admin priority

Blessing

n/a

User priority

107590

Click the images to see detailed statistics about the episode.

d40

107583

Click the images to see detailed statistics about the episode.

d50

107579

Click the images to see detailed statistics about the episode.

d45

107578

Click the images to see detailed statistics about the episode.

d60

107575

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107590

sim-2of5

success

yes

2021-11-03 12:27:00+00:00

2021-11-03 12:30:10+00:00

0:03:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.726013030997555

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.726013030997555
distance-from-start_median	3.726013030997555
distance-from-start_min	3.726013030997555
driven_any_max	3.9306358484276696
driven_any_mean	3.9306358484276696
driven_any_median	3.9306358484276696
driven_any_min	3.9306358484276696
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	30.750000000000306
in-drivable-lane_mean	30.750000000000306
in-drivable-lane_median	30.750000000000306
in-drivable-lane_min	30.750000000000306
per-episodes	details {"d40-ego0": {"driven_any": 3.9306358484276696, "survival_time": 30.750000000000306, "driven_lanedir": 0.0, "in-drivable-lane": 30.750000000000306, "deviation-heading": 0.0, "distance-from-start": 3.726013030997555, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	30.750000000000306
survival_time_mean	30.750000000000306
survival_time_median	30.750000000000306
survival_time_min	30.750000000000306

No reset possible

107584

sim-2of5

success

yes

2021-11-03 12:23:15+00:00

2021-11-03 12:26:34+00:00

0:03:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107583

sim-1of5

success

yes

2021-11-03 12:22:00+00:00

2021-11-03 12:25:42+00:00

0:03:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

4.4826698306472

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	4.4826698306472
distance-from-start_median	4.4826698306472
distance-from-start_min	4.4826698306472
driven_any_max	4.688460132013628
driven_any_mean	4.688460132013628
driven_any_median	4.688460132013628
driven_any_min	4.688460132013628
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	35.250000000000135
in-drivable-lane_mean	35.250000000000135
in-drivable-lane_median	35.250000000000135
in-drivable-lane_min	35.250000000000135
per-episodes	details {"d50-ego0": {"driven_any": 4.688460132013628, "survival_time": 35.250000000000135, "driven_lanedir": 0.0, "in-drivable-lane": 35.250000000000135, "deviation-heading": 0.0, "distance-from-start": 4.4826698306472, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	35.250000000000135
survival_time_mean	35.250000000000135
survival_time_median	35.250000000000135
survival_time_min	35.250000000000135

No reset possible

107579

sim-0of5

success

yes

2021-11-03 12:21:53+00:00

2021-11-03 12:26:10+00:00

0:04:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

4.496717667496226

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	4.496717667496226
distance-from-start_median	4.496717667496226
distance-from-start_min	4.496717667496226
driven_any_max	4.641790799950225
driven_any_mean	4.641790799950225
driven_any_median	4.641790799950225
driven_any_min	4.641790799950225
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	43.09999999999969
in-drivable-lane_mean	43.09999999999969
in-drivable-lane_median	43.09999999999969
in-drivable-lane_min	43.09999999999969
per-episodes	details {"d45-ego0": {"driven_any": 4.641790799950225, "survival_time": 43.09999999999969, "driven_lanedir": 0.0, "in-drivable-lane": 43.09999999999969, "deviation-heading": 0.0, "distance-from-start": 4.496717667496226, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	43.09999999999969
survival_time_mean	43.09999999999969
survival_time_median	43.09999999999969
survival_time_min	43.09999999999969

No reset possible

107578

sim-4of5

success

yes

2021-11-03 12:21:14+00:00

2021-11-03 12:23:15+00:00

0:02:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

1.049456953129568

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	1.049456953129568
distance-from-start_median	1.049456953129568
distance-from-start_min	1.049456953129568
driven_any_max	1.0717544992414654
driven_any_mean	1.0717544992414654
driven_any_median	1.0717544992414654
driven_any_min	1.0717544992414654
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	11.950000000000037
in-drivable-lane_mean	11.950000000000037
in-drivable-lane_median	11.950000000000037
in-drivable-lane_min	11.950000000000037
per-episodes	details {"d60-ego0": {"driven_any": 1.0717544992414654, "survival_time": 11.950000000000037, "driven_lanedir": 0.0, "in-drivable-lane": 11.950000000000037, "deviation-heading": 0.0, "distance-from-start": 1.049456953129568, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	11.950000000000037
survival_time_mean	11.950000000000037
survival_time_median	11.950000000000037
survival_time_min	11.950000000000037

No reset possible

107575

sim-3of5

success

yes

2021-11-03 12:20:21+00:00

2021-11-03 12:22:49+00:00

0:02:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.100462445409891

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.100462445409891
distance-from-start_median	2.100462445409891
distance-from-start_min	2.100462445409891
driven_any_max	2.876223566254999
driven_any_mean	2.876223566254999
driven_any_median	2.876223566254999
driven_any_min	2.876223566254999
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	26.50000000000024
in-drivable-lane_mean	26.50000000000024
in-drivable-lane_median	26.50000000000024
in-drivable-lane_min	26.50000000000024
per-episodes	details {"d30-ego0": {"driven_any": 2.876223566254999, "survival_time": 26.50000000000024, "driven_lanedir": 0.0, "in-drivable-lane": 26.50000000000024, "deviation-heading": 0.0, "distance-from-start": 2.100462445409891, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	26.50000000000024
survival_time_mean	26.50000000000024
survival_time_median	26.50000000000024
survival_time_min	26.50000000000024

No reset possible

107572

sim-1of5

success

yes

2021-11-03 12:19:44+00:00

2021-11-03 12:21:21+00:00

0:01:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107569

sim-3of5

success

yes

2021-11-03 12:18:08+00:00

2021-11-03 12:19:48+00:00

0:01:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107568

sim-0of5

success

yes

2021-11-03 12:18:03+00:00

2021-11-03 12:21:33+00:00

0:03:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107567

sim-4of5

success

yes

2021-11-03 12:18:03+00:00

2021-11-03 12:20:49+00:00

0:02:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86633

sim-0of5

error

2021-10-12 08:28:54+00:00

2021-10-12 08:29:36+00:00

0:00:42

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-0of5-montreal05_802404650a97-job86633-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86632

sim-2of5

success

2021-10-12 08:27:28+00:00

2021-10-12 08:31:56+00:00

0:04:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86631

sim-4of5

success

2021-10-12 08:27:26+00:00

2021-10-12 08:32:15+00:00

0:04:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86630

sim-3of5

success

2021-10-12 08:26:08+00:00

2021-10-12 08:31:27+00:00

0:05:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86629

sim-1of5

success

2021-10-12 08:26:08+00:00

2021-10-12 08:31:08+00:00

0:05:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86628

sim-4of5

error

2021-10-12 08:26:07+00:00

2021-10-12 08:26:52+00:00

0:00:45

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-4of5-montreal01_d2e00e7885ab-job86628-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86627

sim-2of5

error

2021-10-12 08:26:04+00:00

2021-10-12 08:26:48+00:00

0:00:44

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17159/sim-2of5-montreal03_a39f3a5a13b9-job86627-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86626

sim-0of5

success

2021-10-12 08:26:03+00:00

2021-10-12 08:28:21+00:00

0:02:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible