Submission 17202

Submission

17202

Competing

yes

Challenge

mooc-BV1

User

Julia Hindel

Date submitted

2021-10-13 17:56:41+00:00

Last status update

2021-12-04 20:48:55+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of5: 107221 sim-1of5: 107258 sim-2of5: 107217 sim-3of5: 107260 sim-4of5: 107216

User label

exercises_braitenberg

Admin priority

Blessing

n/a

User priority

107260

Click the images to see detailed statistics about the episode.

d30

107258

Click the images to see detailed statistics about the episode.

d50

107221

Click the images to see detailed statistics about the episode.

d45

107217

Click the images to see detailed statistics about the episode.

d40

107216

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107260

sim-3of5

success

yes

2021-11-03 10:22:02+00:00

2021-11-03 10:24:03+00:00

0:02:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

4.62310163804509

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	4.62310163804509
distance-from-start_median	4.62310163804509
distance-from-start_min	4.62310163804509
driven_any_max	5.086814660344213
driven_any_mean	5.086814660344213
driven_any_median	5.086814660344213
driven_any_min	5.086814660344213
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	19.750000000000146
in-drivable-lane_mean	19.750000000000146
in-drivable-lane_median	19.750000000000146
in-drivable-lane_min	19.750000000000146
per-episodes	details {"d30-ego0": {"driven_any": 5.086814660344213, "survival_time": 19.750000000000146, "driven_lanedir": 0.0, "in-drivable-lane": 19.750000000000146, "deviation-heading": 0.0, "distance-from-start": 4.62310163804509, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	19.750000000000146
survival_time_mean	19.750000000000146
survival_time_median	19.750000000000146
survival_time_min	19.750000000000146

No reset possible

107258

sim-1of5

success

yes

2021-11-03 10:21:37+00:00

2021-11-03 10:23:25+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.355088477985282

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.355088477985282
distance-from-start_median	3.355088477985282
distance-from-start_min	3.355088477985282
driven_any_max	3.885141257874369
driven_any_mean	3.885141257874369
driven_any_median	3.885141257874369
driven_any_min	3.885141257874369
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	12.200000000000038
in-drivable-lane_mean	12.200000000000038
in-drivable-lane_median	12.200000000000038
in-drivable-lane_min	12.200000000000038
per-episodes	details {"d50-ego0": {"driven_any": 3.885141257874369, "survival_time": 12.200000000000038, "driven_lanedir": 0.0, "in-drivable-lane": 12.200000000000038, "deviation-heading": 0.0, "distance-from-start": 3.355088477985282, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	12.200000000000038
survival_time_mean	12.200000000000038
survival_time_median	12.200000000000038
survival_time_min	12.200000000000038

No reset possible

107247

sim-3of5

success

yes

2021-11-03 10:19:25+00:00

2021-11-03 10:21:29+00:00

0:02:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107245

sim-1of5

success

yes

2021-11-03 10:18:49+00:00

2021-11-03 10:21:18+00:00

0:02:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107237

sim-3of5

success

yes

2021-11-03 10:17:07+00:00

2021-11-03 10:19:05+00:00

0:01:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107229

sim-1of5

success

yes

2021-11-03 10:16:02+00:00

2021-11-03 10:18:25+00:00

0:02:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107223

sim-3of5

success

yes

2021-11-03 10:14:32+00:00

2021-11-03 10:16:36+00:00

0:02:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107221

sim-0of5

success

yes

2021-11-03 10:14:08+00:00

2021-11-03 10:15:56+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.21740740356082

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.21740740356082
distance-from-start_median	2.21740740356082
distance-from-start_min	2.21740740356082
driven_any_max	3.4728282665847003
driven_any_mean	3.4728282665847003
driven_any_median	3.4728282665847003
driven_any_min	3.4728282665847003
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	12.900000000000048
in-drivable-lane_mean	12.900000000000048
in-drivable-lane_median	12.900000000000048
in-drivable-lane_min	12.900000000000048
per-episodes	details {"d45-ego0": {"driven_any": 3.4728282665847003, "survival_time": 12.900000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.900000000000048, "deviation-heading": 0.0, "distance-from-start": 2.21740740356082, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	12.900000000000048
survival_time_mean	12.900000000000048
survival_time_median	12.900000000000048
survival_time_min	12.900000000000048

No reset possible

107220

sim-1of5

success

yes

2021-11-03 10:14:06+00:00

2021-11-03 10:15:48+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107217

sim-2of5

success

yes

2021-11-03 10:13:24+00:00

2021-11-03 10:16:07+00:00

0:02:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.2281373530547794

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.2281373530547794
distance-from-start_median	5.2281373530547794
distance-from-start_min	5.2281373530547794
driven_any_max	5.678696809785465
driven_any_mean	5.678696809785465
driven_any_median	5.678696809785465
driven_any_min	5.678696809785465
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	26.600000000000243
in-drivable-lane_mean	26.600000000000243
in-drivable-lane_median	26.600000000000243
in-drivable-lane_min	26.600000000000243
per-episodes	details {"d40-ego0": {"driven_any": 5.678696809785465, "survival_time": 26.600000000000243, "driven_lanedir": 0.0, "in-drivable-lane": 26.600000000000243, "deviation-heading": 0.0, "distance-from-start": 5.2281373530547794, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	26.600000000000243
survival_time_mean	26.600000000000243
survival_time_median	26.600000000000243
survival_time_min	26.600000000000243

No reset possible

107216

sim-4of5

success

yes

2021-11-03 10:13:24+00:00

2021-11-03 10:15:29+00:00

0:02:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.5909264274775117

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.5909264274775117
distance-from-start_median	2.5909264274775117
distance-from-start_min	2.5909264274775117
driven_any_max	3.9550560986821206
driven_any_mean	3.9550560986821206
driven_any_median	3.9550560986821206
driven_any_min	3.9550560986821206
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	14.200000000000069
in-drivable-lane_mean	14.200000000000069
in-drivable-lane_median	14.200000000000069
in-drivable-lane_min	14.200000000000069
per-episodes	details {"d60-ego0": {"driven_any": 3.9550560986821206, "survival_time": 14.200000000000069, "driven_lanedir": 0.0, "in-drivable-lane": 14.200000000000069, "deviation-heading": 0.0, "distance-from-start": 2.5909264274775117, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	14.200000000000069
survival_time_mean	14.200000000000069
survival_time_median	14.200000000000069
survival_time_min	14.200000000000069

No reset possible

107207

sim-0of5

success

yes

2021-11-03 10:11:15+00:00

2021-11-03 10:13:37+00:00

0:02:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107202

sim-2of5

success

yes

2021-11-03 10:09:54+00:00

2021-11-03 10:12:45+00:00

0:02:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87180

sim-3of5

success

2021-10-13 18:03:09+00:00

2021-10-13 18:05:22+00:00

0:02:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87179

sim-4of5

success

2021-10-13 18:00:21+00:00

2021-10-13 18:03:38+00:00

0:03:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87178

sim-2of5

success

2021-10-13 18:00:21+00:00

2021-10-13 18:04:52+00:00

0:04:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87177

sim-0of5

success

2021-10-13 18:00:21+00:00

2021-10-13 18:03:07+00:00

0:02:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87176

sim-3of5

success

2021-10-13 17:59:13+00:00

2021-10-13 18:02:35+00:00

0:03:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87175

sim-4of5

error

2021-10-13 17:59:13+00:00

2021-10-13 17:59:59+00:00

0:00:46

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-4of5-montreal01_d2e00e7885ab-job87175-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87174

sim-2of5

error

2021-10-13 17:59:13+00:00

2021-10-13 18:00:00+00:00

0:00:47

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-2of5-montreal05_802404650a97-job87174-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87173

sim-1of5

success

2021-10-13 17:59:11+00:00

2021-10-13 18:03:37+00:00

0:04:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87172

sim-0of5

error

2021-10-13 17:59:09+00:00

2021-10-13 17:59:54+00:00

0:00:45

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17202/sim-0of5-montreal02_b87fca61d0e7-job87172-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible