Submission 17184

Submission

17184

Competing

yes

Challenge

mooc-BV1

User

Baptiste BANCEL

Date submitted

2021-10-12 22:15:46+00:00

Last status update

2021-12-04 20:48:59+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of5: 107451 sim-1of5: 107468 sim-2of5: 107494 sim-3of5: 107470 sim-4of5: 107456

User label

exercises_braitenberg

Admin priority

Blessing

n/a

User priority

107494

Click the images to see detailed statistics about the episode.

d40

107470

Click the images to see detailed statistics about the episode.

d30

107468

Click the images to see detailed statistics about the episode.

d50

107456

Click the images to see detailed statistics about the episode.

d60

107451

Click the images to see detailed statistics about the episode.

d45

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107494

sim-2of5

success

yes

2021-11-03 11:46:46+00:00

2021-11-03 11:50:31+00:00

0:03:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.535058369669978

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.535058369669978
distance-from-start_median	5.535058369669978
distance-from-start_min	5.535058369669978
driven_any_max	5.9724640551095955
driven_any_mean	5.9724640551095955
driven_any_median	5.9724640551095955
driven_any_min	5.9724640551095955
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	38.599999999999945
in-drivable-lane_mean	38.599999999999945
in-drivable-lane_median	38.599999999999945
in-drivable-lane_min	38.599999999999945
per-episodes	details {"d40-ego0": {"driven_any": 5.9724640551095955, "survival_time": 38.599999999999945, "driven_lanedir": 0.0, "in-drivable-lane": 38.599999999999945, "deviation-heading": 0.0, "distance-from-start": 5.535058369669978, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	38.599999999999945
survival_time_mean	38.599999999999945
survival_time_median	38.599999999999945
survival_time_min	38.599999999999945

No reset possible

107476

sim-2of5

success

yes

2021-11-03 11:42:39+00:00

2021-11-03 11:46:19+00:00

0:03:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107470

sim-3of5

success

yes

2021-11-03 11:42:07+00:00

2021-11-03 11:45:38+00:00

0:03:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.921049227856437

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.921049227856437
distance-from-start_median	5.921049227856437
distance-from-start_min	5.921049227856437
driven_any_max	5.998517581700986
driven_any_mean	5.998517581700986
driven_any_median	5.998517581700986
driven_any_min	5.998517581700986
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	40.79999999999982
in-drivable-lane_mean	40.79999999999982
in-drivable-lane_median	40.79999999999982
in-drivable-lane_min	40.79999999999982
per-episodes	details {"d30-ego0": {"driven_any": 5.998517581700986, "survival_time": 40.79999999999982, "driven_lanedir": 0.0, "in-drivable-lane": 40.79999999999982, "deviation-heading": 0.0, "distance-from-start": 5.921049227856437, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	40.79999999999982
survival_time_mean	40.79999999999982
survival_time_median	40.79999999999982
survival_time_min	40.79999999999982

No reset possible

107468

sim-1of5

success

yes

2021-11-03 11:41:35+00:00

2021-11-03 11:44:26+00:00

0:02:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.0762238621798588

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.0762238621798588
distance-from-start_median	3.0762238621798588
distance-from-start_min	3.0762238621798588
driven_any_max	3.4368635122271063
driven_any_mean	3.4368635122271063
driven_any_median	3.4368635122271063
driven_any_min	3.4368635122271063
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	22.80000000000019
in-drivable-lane_mean	22.80000000000019
in-drivable-lane_median	22.80000000000019
in-drivable-lane_min	22.80000000000019
per-episodes	details {"d50-ego0": {"driven_any": 3.4368635122271063, "survival_time": 22.80000000000019, "driven_lanedir": 0.0, "in-drivable-lane": 22.80000000000019, "deviation-heading": 0.0, "distance-from-start": 3.0762238621798588, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	22.80000000000019
survival_time_mean	22.80000000000019
survival_time_median	22.80000000000019
survival_time_min	22.80000000000019

No reset possible

107456

sim-4of5

success

yes

2021-11-03 11:38:29+00:00

2021-11-03 11:42:33+00:00

0:04:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

4.835096774880592

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	4.835096774880592
distance-from-start_median	4.835096774880592
distance-from-start_min	4.835096774880592
driven_any_max	5.271861221959979
driven_any_mean	5.271861221959979
driven_any_median	5.271861221959979
driven_any_min	5.271861221959979
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	34.40000000000018
in-drivable-lane_mean	34.40000000000018
in-drivable-lane_median	34.40000000000018
in-drivable-lane_min	34.40000000000018
per-episodes	details {"d60-ego0": {"driven_any": 5.271861221959979, "survival_time": 34.40000000000018, "driven_lanedir": 0.0, "in-drivable-lane": 34.40000000000018, "deviation-heading": 0.0, "distance-from-start": 4.835096774880592, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	34.40000000000018
survival_time_mean	34.40000000000018
survival_time_median	34.40000000000018
survival_time_min	34.40000000000018

No reset possible

107455

sim-3of5

success

yes

2021-11-03 11:37:59+00:00

2021-11-03 11:41:27+00:00

0:03:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107452

sim-1of5

success

yes

2021-11-03 11:37:56+00:00

2021-11-03 11:41:03+00:00

0:03:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107451

sim-0of5

success

yes

2021-11-03 11:37:55+00:00

2021-11-03 11:42:02+00:00

0:04:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

4.8744457396352106

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	4.8744457396352106
distance-from-start_median	4.8744457396352106
distance-from-start_min	4.8744457396352106
driven_any_max	6.363839858158521
driven_any_mean	6.363839858158521
driven_any_median	6.363839858158521
driven_any_min	6.363839858158521
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	40.899999999999814
in-drivable-lane_mean	40.899999999999814
in-drivable-lane_median	40.899999999999814
in-drivable-lane_min	40.899999999999814
per-episodes	details {"d45-ego0": {"driven_any": 6.363839858158521, "survival_time": 40.899999999999814, "driven_lanedir": 0.0, "in-drivable-lane": 40.899999999999814, "deviation-heading": 0.0, "distance-from-start": 4.8744457396352106, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	40.899999999999814
survival_time_mean	40.899999999999814
survival_time_median	40.899999999999814
survival_time_min	40.899999999999814

No reset possible

86873

sim-0of5

success

2021-10-12 22:37:03+00:00

2021-10-12 22:41:47+00:00

0:04:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86872

sim-4of5

success

2021-10-12 22:35:31+00:00

2021-10-12 22:42:43+00:00

0:07:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86871

sim-2of5

success

2021-10-12 22:35:04+00:00

2021-10-12 22:41:26+00:00

0:06:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86870

sim-1of5

success

2021-10-12 22:33:16+00:00

2021-10-12 22:39:48+00:00

0:06:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86869

sim-3of5

success

2021-10-12 22:31:42+00:00

2021-10-12 22:37:38+00:00

0:05:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86868

sim-0of5

success

2021-10-12 22:31:05+00:00

2021-10-12 22:36:38+00:00

0:05:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86867

sim-4of5

success

2021-10-12 22:31:04+00:00

2021-10-12 22:34:59+00:00

0:03:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86866

sim-0of5

error

2021-10-12 22:30:01+00:00

2021-10-12 22:30:43+00:00

0:00:42

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-0of5-montreal05_802404650a97-job86866-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86865

sim-2of5

success

2021-10-12 22:28:24+00:00

2021-10-12 22:34:32+00:00

0:06:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86864

sim-4of5

success

2021-10-12 22:26:39+00:00

2021-10-12 22:30:45+00:00

0:04:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86863

sim-1of5

success

2021-10-12 22:26:38+00:00

2021-10-12 22:33:09+00:00

0:06:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86862

sim-0of5

success

2021-10-12 22:25:32+00:00

2021-10-12 22:29:36+00:00

0:04:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86861

sim-1of5

error

2021-10-12 22:25:30+00:00

2021-10-12 22:26:14+00:00

0:00:44

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-1of5-montreal03_a39f3a5a13b9-job86861-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86860

sim-4of5

error

2021-10-12 22:25:28+00:00

2021-10-12 22:26:12+00:00

0:00:44

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17184/sim-4of5-montreal05_802404650a97-job86860-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86859

sim-2of5

success

2021-10-12 22:25:28+00:00

2021-10-12 22:27:57+00:00

0:02:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86858

sim-3of5

success

2021-10-12 22:25:28+00:00

2021-10-12 22:31:23+00:00

0:05:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible