Submission 18548

Submission

18548

Competing

yes

Challenge

aido-LF-sim-validation

User

Sampsa Ranta

Date submitted

2021-12-08 22:33:00+00:00

Last status update

2021-12-08 22:59:40+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 122540 sim-1of4: 122542 sim-2of4: 122543 sim-3of4: 122539

User label

Quack² - To Quack Or Not

Admin priority

Blessing

n/a

User priority

122543

Click the images to see detailed statistics about the episode.

loop2-000

122542

Click the images to see detailed statistics about the episode.

loop-000

122540

Click the images to see detailed statistics about the episode.

autolab-000

122539

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

122543

sim-2of4

success

yes

2021-12-08 22:49:14+00:00

2021-12-08 22:55:54+00:00

0:06:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.315896477803744
survival_time_median	59.99999999999873
deviation-center-line_median	2.24685542030629
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.24685542030629
deviation-center-line_mean	2.24685542030629
deviation-center-line_min	2.24685542030629
deviation-heading_max	6.219872965195946
deviation-heading_mean	6.219872965195946
deviation-heading_median	6.219872965195946
deviation-heading_min	6.219872965195946
distance-from-start_max	1.0617634976883124
distance-from-start_mean	1.0617634976883124
distance-from-start_median	1.0617634976883124
distance-from-start_min	1.0617634976883124
driven_any_max	10.396266231843065
driven_any_mean	10.396266231843065
driven_any_median	10.396266231843065
driven_any_min	10.396266231843065
driven_lanedir_consec_max	10.315896477803744
driven_lanedir_consec_mean	10.315896477803744
driven_lanedir_consec_min	10.315896477803744
driven_lanedir_max	10.315896477803744
driven_lanedir_mean	10.315896477803744
driven_lanedir_median	10.315896477803744
driven_lanedir_min	10.315896477803744
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 10.396266231843065, "survival_time": 59.99999999999873, "driven_lanedir": 10.315896477803744, "in-drivable-lane": 0.0, "deviation-heading": 6.219872965195946, "distance-from-start": 1.0617634976883124, "deviation-center-line": 2.24685542030629, "driven_lanedir_consec": 10.315896477803744}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

122542

sim-1of4

success

yes

2021-12-08 22:48:38+00:00

2021-12-08 22:54:48+00:00

0:06:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.34941271945414
survival_time_median	59.99999999999873
deviation-center-line_median	1.6438314963324838
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	1.6438314963324838
deviation-center-line_mean	1.6438314963324838
deviation-center-line_min	1.6438314963324838
deviation-heading_max	4.269818542937844
deviation-heading_mean	4.269818542937844
deviation-heading_median	4.269818542937844
deviation-heading_min	4.269818542937844
distance-from-start_max	2.530343496109225
distance-from-start_mean	2.530343496109225
distance-from-start_median	2.530343496109225
distance-from-start_min	2.530343496109225
driven_any_max	10.396398075282129
driven_any_mean	10.396398075282129
driven_any_median	10.396398075282129
driven_any_min	10.396398075282129
driven_lanedir_consec_max	10.34941271945414
driven_lanedir_consec_mean	10.34941271945414
driven_lanedir_consec_min	10.34941271945414
driven_lanedir_max	10.34941271945414
driven_lanedir_mean	10.34941271945414
driven_lanedir_median	10.34941271945414
driven_lanedir_min	10.34941271945414
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 10.396398075282129, "survival_time": 59.99999999999873, "driven_lanedir": 10.34941271945414, "in-drivable-lane": 0.0, "deviation-heading": 4.269818542937844, "distance-from-start": 2.530343496109225, "deviation-center-line": 1.6438314963324838, "driven_lanedir_consec": 10.34941271945414}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

122540

sim-0of4

success

yes

2021-12-08 22:46:44+00:00

2021-12-08 22:53:00+00:00

0:06:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.342739170585238
survival_time_median	59.99999999999873
deviation-center-line_median	1.4925322312052702
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	1.4925322312052702
deviation-center-line_mean	1.4925322312052702
deviation-center-line_min	1.4925322312052702
deviation-heading_max	4.567345733157781
deviation-heading_mean	4.567345733157781
deviation-heading_median	4.567345733157781
deviation-heading_min	4.567345733157781
distance-from-start_max	3.2501780000016582
distance-from-start_mean	3.2501780000016582
distance-from-start_median	3.2501780000016582
distance-from-start_min	3.2501780000016582
driven_any_max	10.396426903162538
driven_any_mean	10.396426903162538
driven_any_median	10.396426903162538
driven_any_min	10.396426903162538
driven_lanedir_consec_max	10.342739170585238
driven_lanedir_consec_mean	10.342739170585238
driven_lanedir_consec_min	10.342739170585238
driven_lanedir_max	10.342739170585238
driven_lanedir_mean	10.342739170585238
driven_lanedir_median	10.342739170585238
driven_lanedir_min	10.342739170585238
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 10.396426903162538, "survival_time": 59.99999999999873, "driven_lanedir": 10.342739170585238, "in-drivable-lane": 0.0, "deviation-heading": 4.567345733157781, "distance-from-start": 3.2501780000016582, "deviation-center-line": 1.4925322312052702, "driven_lanedir_consec": 10.342739170585238}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

122539

sim-3of4

success

yes

2021-12-08 22:46:19+00:00

2021-12-08 22:53:08+00:00

0:06:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.32350954105663
survival_time_median	59.99999999999873
deviation-center-line_median	1.7079439950523856
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	1.7079439950523856
deviation-center-line_mean	1.7079439950523856
deviation-center-line_min	1.7079439950523856
deviation-heading_max	5.4489876996134425
deviation-heading_mean	5.4489876996134425
deviation-heading_median	5.4489876996134425
deviation-heading_min	5.4489876996134425
distance-from-start_max	4.452093301896062
distance-from-start_mean	4.452093301896062
distance-from-start_median	4.452093301896062
distance-from-start_min	4.452093301896062
driven_any_max	10.396326548095477
driven_any_mean	10.396326548095477
driven_any_median	10.396326548095477
driven_any_min	10.396326548095477
driven_lanedir_consec_max	10.32350954105663
driven_lanedir_consec_mean	10.32350954105663
driven_lanedir_consec_min	10.32350954105663
driven_lanedir_max	10.32350954105663
driven_lanedir_mean	10.32350954105663
driven_lanedir_median	10.32350954105663
driven_lanedir_min	10.32350954105663
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 10.396326548095477, "survival_time": 59.99999999999873, "driven_lanedir": 10.32350954105663, "in-drivable-lane": 0.0, "deviation-heading": 5.4489876996134425, "distance-from-start": 4.452093301896062, "deviation-center-line": 1.7079439950523856, "driven_lanedir_consec": 10.32350954105663}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

122536

sim-1of4

success

yes

2021-12-08 22:41:58+00:00

2021-12-08 22:48:08+00:00

0:06:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122535

sim-2of4

success

yes

2021-12-08 22:41:57+00:00

2021-12-08 22:48:34+00:00

0:06:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122534

sim-0of4

success

yes

2021-12-08 22:40:26+00:00

2021-12-08 22:46:37+00:00

0:06:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122533

sim-3of4

success

yes

2021-12-08 22:39:12+00:00

2021-12-08 22:45:39+00:00

0:06:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible