Submission 17157

Submission

17157

Competing

yes

Challenge

mooc-BV1

User

Marco Pascolo

Date submitted

2021-10-12 07:52:56+00:00

Last status update

2021-12-04 20:48:58+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of5: 107601 sim-1of5: 107599 sim-2of5: 107610 sim-3of5: 107600 sim-4of5: 107609

User label

exercises_braitenberg

Admin priority

Blessing

n/a

User priority

107610

Click the images to see detailed statistics about the episode.

d40

107609

Click the images to see detailed statistics about the episode.

d60

107601

Click the images to see detailed statistics about the episode.

d45

107600

Click the images to see detailed statistics about the episode.

d30

107599

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107610

sim-2of5

success

yes

2021-11-03 12:36:22+00:00

2021-11-03 12:40:56+00:00

0:04:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.025679336285489

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.025679336285489
distance-from-start_median	5.025679336285489
distance-from-start_min	5.025679336285489
driven_any_max	7.1783009459651375
driven_any_mean	7.1783009459651375
driven_any_median	7.1783009459651375
driven_any_min	7.1783009459651375
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	50.749999999999254
in-drivable-lane_mean	50.749999999999254
in-drivable-lane_median	50.749999999999254
in-drivable-lane_min	50.749999999999254
per-episodes	details {"d40-ego0": {"driven_any": 7.1783009459651375, "survival_time": 50.749999999999254, "driven_lanedir": 0.0, "in-drivable-lane": 50.749999999999254, "deviation-heading": 0.0, "distance-from-start": 5.025679336285489, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	50.749999999999254
survival_time_mean	50.749999999999254
survival_time_median	50.749999999999254
survival_time_min	50.749999999999254

No reset possible

107609

sim-4of5

success

yes

2021-11-03 12:35:29+00:00

2021-11-03 12:39:15+00:00

0:03:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.744844610640535

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.744844610640535
distance-from-start_median	3.744844610640535
distance-from-start_min	3.744844610640535
driven_any_max	4.113147037245724
driven_any_mean	4.113147037245724
driven_any_median	4.113147037245724
driven_any_min	4.113147037245724
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	31.40000000000031
in-drivable-lane_mean	31.40000000000031
in-drivable-lane_median	31.40000000000031
in-drivable-lane_min	31.40000000000031
per-episodes	details {"d60-ego0": {"driven_any": 4.113147037245724, "survival_time": 31.40000000000031, "driven_lanedir": 0.0, "in-drivable-lane": 31.40000000000031, "deviation-heading": 0.0, "distance-from-start": 3.744844610640535, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	31.40000000000031
survival_time_mean	31.40000000000031
survival_time_median	31.40000000000031
survival_time_min	31.40000000000031

No reset possible

107605

sim-4of5

success

yes

2021-11-03 12:33:08+00:00

2021-11-03 12:35:02+00:00

0:01:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107604

sim-2of5

success

yes

2021-11-03 12:33:08+00:00

2021-11-03 12:35:51+00:00

0:02:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107601

sim-0of5

success

yes

2021-11-03 12:30:29+00:00

2021-11-03 12:32:35+00:00

0:02:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

1.9424213877587115

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	1.9424213877587115
distance-from-start_median	1.9424213877587115
distance-from-start_min	1.9424213877587115
driven_any_max	2.1684708315307497
driven_any_mean	2.1684708315307497
driven_any_median	2.1684708315307497
driven_any_min	2.1684708315307497
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	16.5500000000001
in-drivable-lane_mean	16.5500000000001
in-drivable-lane_median	16.5500000000001
in-drivable-lane_min	16.5500000000001
per-episodes	details {"d45-ego0": {"driven_any": 2.1684708315307497, "survival_time": 16.5500000000001, "driven_lanedir": 0.0, "in-drivable-lane": 16.5500000000001, "deviation-heading": 0.0, "distance-from-start": 1.9424213877587115, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	16.5500000000001
survival_time_mean	16.5500000000001
survival_time_median	16.5500000000001
survival_time_min	16.5500000000001

No reset possible

107600

sim-3of5

success

yes

2021-11-03 12:30:00+00:00

2021-11-03 12:33:14+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.837986328036661

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.837986328036661
distance-from-start_median	3.837986328036661
distance-from-start_min	3.837986328036661
driven_any_max	4.693589861648122
driven_any_mean	4.693589861648122
driven_any_median	4.693589861648122
driven_any_min	4.693589861648122
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	34.550000000000175
in-drivable-lane_mean	34.550000000000175
in-drivable-lane_median	34.550000000000175
in-drivable-lane_min	34.550000000000175
per-episodes	details {"d30-ego0": {"driven_any": 4.693589861648122, "survival_time": 34.550000000000175, "driven_lanedir": 0.0, "in-drivable-lane": 34.550000000000175, "deviation-heading": 0.0, "distance-from-start": 3.837986328036661, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	34.550000000000175
survival_time_mean	34.550000000000175
survival_time_median	34.550000000000175
survival_time_min	34.550000000000175

No reset possible

107599

sim-1of5

success

yes

2021-11-03 12:29:26+00:00

2021-11-03 12:32:47+00:00

0:03:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.9924339037188767

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.9924339037188767
distance-from-start_median	2.9924339037188767
distance-from-start_min	2.9924339037188767
driven_any_max	3.532949531743375
driven_any_mean	3.532949531743375
driven_any_median	3.532949531743375
driven_any_min	3.532949531743375
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	30.150000000000293
in-drivable-lane_mean	30.150000000000293
in-drivable-lane_median	30.150000000000293
in-drivable-lane_min	30.150000000000293
per-episodes	details {"d50-ego0": {"driven_any": 3.532949531743375, "survival_time": 30.150000000000293, "driven_lanedir": 0.0, "in-drivable-lane": 30.150000000000293, "deviation-heading": 0.0, "distance-from-start": 2.9924339037188767, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	30.150000000000293
survival_time_mean	30.150000000000293
survival_time_median	30.150000000000293
survival_time_min	30.150000000000293

No reset possible

86614

sim-1of5

success

2021-10-12 08:03:59+00:00

2021-10-12 08:10:44+00:00

0:06:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86613

sim-1of5

host-error

2021-10-12 07:59:53+00:00

2021-10-12 08:00:07+00:00

0:00:14

Error while running [...]

Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86612

sim-2of5

success

2021-10-12 07:58:09+00:00

2021-10-12 08:01:57+00:00

0:03:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86611

sim-4of5

success

2021-10-12 07:58:08+00:00

2021-10-12 08:04:56+00:00

0:06:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86610

sim-4of5

error

2021-10-12 07:57:04+00:00

2021-10-12 07:57:47+00:00

0:00:43

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal05_802404650a97-job86610-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86609

sim-0of5

success

2021-10-12 07:57:04+00:00

2021-10-12 08:00:23+00:00

0:03:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86608

sim-4of5

error

2021-10-12 07:56:07+00:00

2021-10-12 07:56:52+00:00

0:00:45

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-4of5-montreal01_d2e00e7885ab-job86608-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86607

sim-0of5

error

2021-10-12 07:56:01+00:00

2021-10-12 07:56:46+00:00

0:00:45

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17157/sim-0of5-montreal05_802404650a97-job86607-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86606

sim-1of5

success

2021-10-12 07:55:59+00:00

2021-10-12 07:59:25+00:00

0:03:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86605

sim-2of5

success

2021-10-12 07:55:58+00:00

2021-10-12 07:57:55+00:00

0:01:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86604

sim-3of5

success

2021-10-12 07:55:58+00:00

2021-10-12 08:00:02+00:00

0:04:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible