Submission 17189

Submission

17189

Competing

yes

Challenge

mooc-BV1

User

Maxime Fournier

Date submitted

2021-10-12 23:34:41+00:00

Last status update

2021-12-04 20:48:59+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of5: 107388 sim-1of5: 107402 sim-2of5: 107382 sim-3of5: 107383 sim-4of5: 107415

User label

exercises_braitenberg

Admin priority

Blessing

n/a

User priority

107415

Click the images to see detailed statistics about the episode.

d60

107402

Click the images to see detailed statistics about the episode.

d50

107388

Click the images to see detailed statistics about the episode.

d45

107383

Click the images to see detailed statistics about the episode.

d30

107382

Click the images to see detailed statistics about the episode.

d40

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107415

sim-4of5

success

yes

2021-11-03 11:29:35+00:00

2021-11-03 11:31:51+00:00

0:02:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.079607588538647

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.079607588538647
distance-from-start_median	2.079607588538647
distance-from-start_min	2.079607588538647
driven_any_max	2.70174682699021
driven_any_mean	2.70174682699021
driven_any_median	2.70174682699021
driven_any_min	2.70174682699021
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	15.400000000000084
in-drivable-lane_mean	15.400000000000084
in-drivable-lane_median	15.400000000000084
in-drivable-lane_min	15.400000000000084
per-episodes	details {"d60-ego0": {"driven_any": 2.70174682699021, "survival_time": 15.400000000000084, "driven_lanedir": 0.0, "in-drivable-lane": 15.400000000000084, "deviation-heading": 0.0, "distance-from-start": 2.079607588538647, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	15.400000000000084
survival_time_mean	15.400000000000084
survival_time_median	15.400000000000084
survival_time_min	15.400000000000084

No reset possible

107406

sim-4of5

success

yes

2021-11-03 11:26:51+00:00

2021-11-03 11:29:10+00:00

0:02:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107402

sim-1of5

success

yes

2021-11-03 11:25:11+00:00

2021-11-03 11:27:37+00:00

0:02:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.0674575615813655

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.0674575615813655
distance-from-start_median	3.0674575615813655
distance-from-start_min	3.0674575615813655
driven_any_max	3.5417578587289675
driven_any_mean	3.5417578587289675
driven_any_median	3.5417578587289675
driven_any_min	3.5417578587289675
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	19.000000000000135
in-drivable-lane_mean	19.000000000000135
in-drivable-lane_median	19.000000000000135
in-drivable-lane_min	19.000000000000135
per-episodes	details {"d50-ego0": {"driven_any": 3.5417578587289675, "survival_time": 19.000000000000135, "driven_lanedir": 0.0, "in-drivable-lane": 19.000000000000135, "deviation-heading": 0.0, "distance-from-start": 3.0674575615813655, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	19.000000000000135
survival_time_mean	19.000000000000135
survival_time_median	19.000000000000135
survival_time_min	19.000000000000135

No reset possible

107398

sim-4of5

success

yes

2021-11-03 11:24:19+00:00

2021-11-03 11:26:37+00:00

0:02:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107393

sim-1of5

success

yes

2021-11-03 11:22:38+00:00

2021-11-03 11:24:59+00:00

0:02:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107388

sim-0of5

success

yes

2021-11-03 11:19:04+00:00

2021-11-03 11:23:38+00:00

0:04:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

4.634017305440403

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	4.634017305440403
distance-from-start_median	4.634017305440403
distance-from-start_min	4.634017305440403
driven_any_max	5.1077250058388355
driven_any_mean	5.1077250058388355
driven_any_median	5.1077250058388355
driven_any_min	5.1077250058388355
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	25.550000000000228
in-drivable-lane_mean	25.550000000000228
in-drivable-lane_median	25.550000000000228
in-drivable-lane_min	25.550000000000228
per-episodes	details {"d45-ego0": {"driven_any": 5.1077250058388355, "survival_time": 25.550000000000228, "driven_lanedir": 0.0, "in-drivable-lane": 25.550000000000228, "deviation-heading": 0.0, "distance-from-start": 4.634017305440403, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	25.550000000000228
survival_time_mean	25.550000000000228
survival_time_median	25.550000000000228
survival_time_min	25.550000000000228

No reset possible

107383

sim-3of5

success

yes

2021-11-03 11:19:00+00:00

2021-11-03 11:24:00+00:00

0:05:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.122509615975699

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.122509615975699
distance-from-start_median	5.122509615975699
distance-from-start_min	5.122509615975699
driven_any_max	5.821757022882492
driven_any_mean	5.821757022882492
driven_any_median	5.821757022882492
driven_any_min	5.821757022882492
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	36.80000000000005
in-drivable-lane_mean	36.80000000000005
in-drivable-lane_median	36.80000000000005
in-drivable-lane_min	36.80000000000005
per-episodes	details {"d30-ego0": {"driven_any": 5.821757022882492, "survival_time": 36.80000000000005, "driven_lanedir": 0.0, "in-drivable-lane": 36.80000000000005, "deviation-heading": 0.0, "distance-from-start": 5.122509615975699, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	36.80000000000005
survival_time_mean	36.80000000000005
survival_time_median	36.80000000000005
survival_time_min	36.80000000000005

No reset possible

107382

sim-2of5

success

yes

2021-11-03 11:18:59+00:00

2021-11-03 11:23:55+00:00

0:04:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.681322788826752

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.681322788826752
distance-from-start_median	5.681322788826752
distance-from-start_min	5.681322788826752
driven_any_max	6.463716886500819
driven_any_mean	6.463716886500819
driven_any_median	6.463716886500819
driven_any_min	6.463716886500819
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	29.700000000000287
in-drivable-lane_mean	29.700000000000287
in-drivable-lane_median	29.700000000000287
in-drivable-lane_min	29.700000000000287
per-episodes	details {"d40-ego0": {"driven_any": 6.463716886500819, "survival_time": 29.700000000000287, "driven_lanedir": 0.0, "in-drivable-lane": 29.700000000000287, "deviation-heading": 0.0, "distance-from-start": 5.681322788826752, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	29.700000000000287
survival_time_mean	29.700000000000287
survival_time_median	29.700000000000287
survival_time_min	29.700000000000287

No reset possible

107358

sim-2of5

timeout

yes

2021-11-03 11:02:18+00:00

No reset possible

86951

sim-4of5

success

2021-10-12 23:40:10+00:00

2021-10-12 23:43:35+00:00

0:03:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86950

sim-1of5

success

2021-10-12 23:38:34+00:00

2021-10-12 23:42:22+00:00

0:03:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86949

sim-3of5

success

2021-10-12 23:37:25+00:00

2021-10-12 23:43:08+00:00

0:05:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86948

sim-1of5

error

2021-10-12 23:37:24+00:00

2021-10-12 23:38:06+00:00

0:00:42

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal05_802404650a97-job86948-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86947

sim-0of5

success

2021-10-12 23:37:23+00:00

2021-10-12 23:42:01+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86946

sim-2of5

success

2021-10-12 23:36:27+00:00

2021-10-12 23:41:27+00:00

0:05:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86945

sim-1of5

error

2021-10-12 23:36:25+00:00

2021-10-12 23:37:13+00:00

0:00:48

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-1of5-montreal02_b87fca61d0e7-job86945-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86944

sim-3of5

error

2021-10-12 23:36:25+00:00

2021-10-12 23:37:11+00:00

0:00:46

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-3of5-montreal05_802404650a97-job86944-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86943

sim-0of5

error

2021-10-12 23:36:24+00:00

2021-10-12 23:37:09+00:00

0:00:45

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17189/sim-0of5-montreal04_6419ffa178db-job86943-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86942

sim-4of5

success

2021-10-12 23:36:22+00:00

2021-10-12 23:39:50+00:00

0:03:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible