Submission 17656

Submission

17656

Competing

yes

Challenge

aido-LFP-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:01:55+00:00

Last status update

2021-12-04 20:47:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 105382 sim-1of4: 105381 sim-2of4: 105385 sim-3of4: 105386

User label

template-random

Admin priority

Blessing

n/a

User priority

105386

Click the images to see detailed statistics about the episode.

loop-000

105385

Click the images to see detailed statistics about the episode.

autolab-000

105382

Click the images to see detailed statistics about the episode.

loop2-000

105381

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

105386

sim-3of4

success

yes

2021-11-03 02:28:03+00:00

2021-11-03 02:31:40+00:00

0:03:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	32.600000000000286
in-drivable-lane_median	24.050000000000264
driven_lanedir_consec_median	0.2676461536739756
deviation-center-line_median	0.7555294413118671

other stats

deviation-center-line_max	0.7555294413118671
deviation-center-line_mean	0.7555294413118671
deviation-center-line_min	0.7555294413118671
deviation-heading_max	5.523299093945129
deviation-heading_mean	5.523299093945129
deviation-heading_median	5.523299093945129
deviation-heading_min	5.523299093945129
distance-from-start_max	0.9340577697896372
distance-from-start_mean	0.9340577697896372
distance-from-start_median	0.9340577697896372
distance-from-start_min	0.9340577697896372
driven_any_max	8.050205698618822
driven_any_mean	8.050205698618822
driven_any_median	8.050205698618822
driven_any_min	8.050205698618822
driven_lanedir_consec_max	0.2676461536739756
driven_lanedir_consec_mean	0.2676461536739756
driven_lanedir_consec_min	0.2676461536739756
driven_lanedir_max	0.2496366697298575
driven_lanedir_mean	0.2496366697298575
driven_lanedir_median	0.2496366697298575
driven_lanedir_min	0.2496366697298575
in-drivable-lane_max	24.050000000000264
in-drivable-lane_mean	24.050000000000264
in-drivable-lane_min	24.050000000000264
per-episodes	details {"loop-000-ego0": {"driven_any": 8.050205698618822, "survival_time": 32.600000000000286, "driven_lanedir": 0.2496366697298575, "in-drivable-lane": 24.050000000000264, "deviation-heading": 5.523299093945129, "distance-from-start": 0.9340577697896372, "deviation-center-line": 0.7555294413118671, "driven_lanedir_consec": 0.2676461536739756}}
simulation-passed	1
survival_time_max	32.600000000000286
survival_time_mean	32.600000000000286
survival_time_min	32.600000000000286

No reset possible

105385

sim-2of4

success

yes

2021-11-03 02:27:40+00:00

2021-11-03 02:30:01+00:00

0:02:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	16.4500000000001
in-drivable-lane_median	8.850000000000088
driven_lanedir_consec_median	0.27376192919933695
deviation-center-line_median	0.6226667356941823

other stats

deviation-center-line_max	0.6226667356941823
deviation-center-line_mean	0.6226667356941823
deviation-center-line_min	0.6226667356941823
deviation-heading_max	4.977695202648224
deviation-heading_mean	4.977695202648224
deviation-heading_median	4.977695202648224
deviation-heading_min	4.977695202648224
distance-from-start_max	0.6736010379605029
distance-from-start_mean	0.6736010379605029
distance-from-start_median	0.6736010379605029
distance-from-start_min	0.6736010379605029
driven_any_max	3.8273590406355353
driven_any_mean	3.8273590406355353
driven_any_median	3.8273590406355353
driven_any_min	3.8273590406355353
driven_lanedir_consec_max	0.27376192919933695
driven_lanedir_consec_mean	0.27376192919933695
driven_lanedir_consec_min	0.27376192919933695
driven_lanedir_max	0.26276154130140084
driven_lanedir_mean	0.26276154130140084
driven_lanedir_median	0.26276154130140084
driven_lanedir_min	0.26276154130140084
in-drivable-lane_max	8.850000000000088
in-drivable-lane_mean	8.850000000000088
in-drivable-lane_min	8.850000000000088
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.8273590406355353, "survival_time": 16.4500000000001, "driven_lanedir": 0.26276154130140084, "in-drivable-lane": 8.850000000000088, "deviation-heading": 4.977695202648224, "distance-from-start": 0.6736010379605029, "deviation-center-line": 0.6226667356941823, "driven_lanedir_consec": 0.27376192919933695}}
simulation-passed	1
survival_time_max	16.4500000000001
survival_time_mean	16.4500000000001
survival_time_min	16.4500000000001

No reset possible

105382

sim-0of4

success

yes

2021-11-03 02:27:01+00:00

2021-11-03 02:30:54+00:00

0:03:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	45.099999999999575
in-drivable-lane_median	36.54999999999956
driven_lanedir_consec_median	0.26764947507969805
deviation-center-line_median	0.7555292890833561

other stats

deviation-center-line_max	0.7555292890833561
deviation-center-line_mean	0.7555292890833561
deviation-center-line_min	0.7555292890833561
deviation-heading_max	5.523299123594233
deviation-heading_mean	5.523299123594233
deviation-heading_median	5.523299123594233
deviation-heading_min	5.523299123594233
distance-from-start_max	1.0442247976691843
distance-from-start_mean	1.0442247976691843
distance-from-start_median	1.0442247976691843
distance-from-start_min	1.0442247976691843
driven_any_max	11.376062002465083
driven_any_mean	11.376062002465083
driven_any_median	11.376062002465083
driven_any_min	11.376062002465083
driven_lanedir_consec_max	0.26764947507969805
driven_lanedir_consec_mean	0.26764947507969805
driven_lanedir_consec_min	0.26764947507969805
driven_lanedir_max	0.2496387990426845
driven_lanedir_mean	0.2496387990426845
driven_lanedir_median	0.2496387990426845
driven_lanedir_min	0.2496387990426845
in-drivable-lane_max	36.54999999999956
in-drivable-lane_mean	36.54999999999956
in-drivable-lane_min	36.54999999999956
per-episodes	details {"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}}
simulation-passed	1
survival_time_max	45.099999999999575
survival_time_mean	45.099999999999575
survival_time_min	45.099999999999575

No reset possible

105381

sim-1of4

success

yes

2021-11-03 02:26:56+00:00

2021-11-03 02:28:38+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.7499999999999805
in-drivable-lane_median	3.74999999999999
driven_lanedir_consec_median	0.3176161276974132
deviation-center-line_median	0.27533253301389016

other stats

deviation-center-line_max	0.27533253301389016
deviation-center-line_mean	0.27533253301389016
deviation-center-line_min	0.27533253301389016
deviation-heading_max	3.128947285557921
deviation-heading_mean	3.128947285557921
deviation-heading_median	3.128947285557921
deviation-heading_min	3.128947285557921
distance-from-start_max	0.5223892996766406
distance-from-start_mean	0.5223892996766406
distance-from-start_median	0.5223892996766406
distance-from-start_min	0.5223892996766406
driven_any_max	1.4596542667951202
driven_any_mean	1.4596542667951202
driven_any_median	1.4596542667951202
driven_any_min	1.4596542667951202
driven_lanedir_consec_max	0.3176161276974132
driven_lanedir_consec_mean	0.3176161276974132
driven_lanedir_consec_min	0.3176161276974132
driven_lanedir_max	0.3176161276974132
driven_lanedir_mean	0.3176161276974132
driven_lanedir_median	0.3176161276974132
driven_lanedir_min	0.3176161276974132
in-drivable-lane_max	3.74999999999999
in-drivable-lane_mean	3.74999999999999
in-drivable-lane_min	3.74999999999999
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.4596542667951202, "survival_time": 7.7499999999999805, "driven_lanedir": 0.3176161276974132, "in-drivable-lane": 3.74999999999999, "deviation-heading": 3.128947285557921, "distance-from-start": 0.5223892996766406, "deviation-center-line": 0.27533253301389016, "driven_lanedir_consec": 0.3176161276974132}}
simulation-passed	1
survival_time_max	7.7499999999999805
survival_time_mean	7.7499999999999805
survival_time_min	7.7499999999999805

No reset possible

105379

sim-2of4

success

yes

2021-11-03 02:24:52+00:00

2021-11-03 02:27:14+00:00

0:02:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105378

sim-1of4

success

yes

2021-11-03 02:24:51+00:00

2021-11-03 02:26:29+00:00

0:01:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105376

sim-3of4

success

yes

2021-11-03 02:24:13+00:00

2021-11-03 02:27:50+00:00

0:03:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105373

sim-0of4

success

yes

2021-11-03 02:22:39+00:00

2021-11-03 02:26:30+00:00

0:03:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105372

sim-1of4

success

yes

2021-11-03 02:22:36+00:00

2021-11-03 02:24:12+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105371

sim-2of4

success

yes

2021-11-03 02:22:08+00:00

2021-11-03 02:24:31+00:00

0:02:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible