Submission 17710

Submission

17710

Competing

yes

Challenge

aido-LF-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:07:50+00:00

Last status update

2021-12-04 20:47:43+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104471 sim-1of4: 104474 sim-2of4: 104475 sim-3of4: 104473

User label

baseline-simple-yield

Admin priority

Blessing

n/a

User priority

104475

Click the images to see detailed statistics about the episode.

autolab-000

104474

Click the images to see detailed statistics about the episode.

zigzag-000

104473

Click the images to see detailed statistics about the episode.

zigzag-000

104471

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104475

sim-2of4

success

yes

2021-11-02 18:12:34+00:00

2021-11-02 18:16:11+00:00

0:03:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8948975282353634

other stats

deviation-center-line_max	0.8948975282353634
deviation-center-line_mean	0.8948975282353634
deviation-center-line_min	0.8948975282353634
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	6.280369834735102e-16
distance-from-start_mean	6.280369834735102e-16
distance-from-start_median	6.280369834735102e-16
distance-from-start_min	6.280369834735102e-16
driven_any_max	7.536443801682175e-13
driven_any_mean	7.536443801682175e-13
driven_any_median	7.536443801682175e-13
driven_any_min	7.536443801682175e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8948975282353634, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104474

sim-1of4

success

yes

2021-11-02 18:12:03+00:00

2021-11-02 18:15:51+00:00

0:03:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.379280605881083
deviation-center-line_median	0.4086426394863958

other stats

deviation-center-line_max	0.4086426394863958
deviation-center-line_mean	0.4086426394863958
deviation-center-line_min	0.4086426394863958
deviation-heading_max	3.257710113460004
deviation-heading_mean	3.257710113460004
deviation-heading_median	3.257710113460004
deviation-heading_min	3.257710113460004
distance-from-start_max	2.710848600829782
distance-from-start_mean	2.710848600829782
distance-from-start_median	2.710848600829782
distance-from-start_min	2.710848600829782
driven_any_max	5.395555302886635
driven_any_mean	5.395555302886635
driven_any_median	5.395555302886635
driven_any_min	5.395555302886635
driven_lanedir_consec_max	5.379280605881083
driven_lanedir_consec_mean	5.379280605881083
driven_lanedir_consec_min	5.379280605881083
driven_lanedir_max	5.379280605881083
driven_lanedir_mean	5.379280605881083
driven_lanedir_median	5.379280605881083
driven_lanedir_min	5.379280605881083
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 5.395555302886635, "survival_time": 59.99999999999873, "driven_lanedir": 5.379280605881083, "in-drivable-lane": 0.0, "deviation-heading": 3.257710113460004, "distance-from-start": 2.710848600829782, "deviation-center-line": 0.4086426394863958, "driven_lanedir_consec": 5.379280605881083}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104473

sim-3of4

success

yes

2021-11-02 18:12:02+00:00

2021-11-02 18:16:16+00:00

0:04:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.379280605881083
deviation-center-line_median	0.4086426394863958

other stats

deviation-center-line_max	0.4086426394863958
deviation-center-line_mean	0.4086426394863958
deviation-center-line_min	0.4086426394863958
deviation-heading_max	3.257710113460004
deviation-heading_mean	3.257710113460004
deviation-heading_median	3.257710113460004
deviation-heading_min	3.257710113460004
distance-from-start_max	2.710848600829782
distance-from-start_mean	2.710848600829782
distance-from-start_median	2.710848600829782
distance-from-start_min	2.710848600829782
driven_any_max	5.395555302886635
driven_any_mean	5.395555302886635
driven_any_median	5.395555302886635
driven_any_min	5.395555302886635
driven_lanedir_consec_max	5.379280605881083
driven_lanedir_consec_mean	5.379280605881083
driven_lanedir_consec_min	5.379280605881083
driven_lanedir_max	5.379280605881083
driven_lanedir_mean	5.379280605881083
driven_lanedir_median	5.379280605881083
driven_lanedir_min	5.379280605881083
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 5.395555302886635, "survival_time": 59.99999999999873, "driven_lanedir": 5.379280605881083, "in-drivable-lane": 0.0, "deviation-heading": 3.257710113460004, "distance-from-start": 2.710848600829782, "deviation-center-line": 0.4086426394863958, "driven_lanedir_consec": 5.379280605881083}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104471

sim-0of4

success

yes

2021-11-02 18:10:22+00:00

2021-11-02 18:13:43+00:00

0:03:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.5342392748923
deviation-center-line_median	0.219904045457012

other stats

deviation-center-line_max	0.219904045457012
deviation-center-line_mean	0.219904045457012
deviation-center-line_min	0.219904045457012
deviation-heading_max	2.302069906172969
deviation-heading_mean	2.302069906172969
deviation-heading_median	2.302069906172969
deviation-heading_min	2.302069906172969
distance-from-start_max	1.5178953029412718
distance-from-start_mean	1.5178953029412718
distance-from-start_median	1.5178953029412718
distance-from-start_min	1.5178953029412718
driven_any_max	5.543896156524706
driven_any_mean	5.543896156524706
driven_any_median	5.543896156524706
driven_any_min	5.543896156524706
driven_lanedir_consec_max	5.5342392748923
driven_lanedir_consec_mean	5.5342392748923
driven_lanedir_consec_min	5.5342392748923
driven_lanedir_max	5.5342392748923
driven_lanedir_mean	5.5342392748923
driven_lanedir_median	5.5342392748923
driven_lanedir_min	5.5342392748923
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 5.543896156524706, "survival_time": 59.99999999999873, "driven_lanedir": 5.5342392748923, "in-drivable-lane": 0.0, "deviation-heading": 2.302069906172969, "distance-from-start": 1.5178953029412718, "deviation-center-line": 0.219904045457012, "driven_lanedir_consec": 5.5342392748923}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104467

sim-3of4

success

yes

2021-11-02 18:08:20+00:00

2021-11-02 18:11:44+00:00

0:03:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104465

sim-2of4

success

yes

2021-11-02 18:08:16+00:00

2021-11-02 18:11:53+00:00

0:03:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104464

sim-1of4

success

yes

2021-11-02 18:07:47+00:00

2021-11-02 18:11:34+00:00

0:03:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104463

sim-0of4

success

yes

2021-11-02 18:06:47+00:00

2021-11-02 18:10:03+00:00

0:03:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible