Submission 17637

Submission

17637

Competing

yes

Challenge

aido-LFP-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:00:13+00:00

Last status update

2021-12-04 20:47:45+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104543 sim-1of4: 104541 sim-2of4: 104548 sim-3of4: 104540

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

104548

Click the images to see detailed statistics about the episode.

autolab-000

104543

Click the images to see detailed statistics about the episode.

loop2-000

104541

Click the images to see detailed statistics about the episode.

autolab-000

104540

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

104548

sim-2of4

success

yes

2021-11-02 18:44:01+00:00

2021-11-02 18:47:42+00:00

0:03:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	54.99999999999901
in-drivable-lane_median	3.1499999999999666
driven_lanedir_consec_median	1.420452979729076
deviation-center-line_median	4.299642636408967

other stats

deviation-center-line_max	4.299642636408967
deviation-center-line_mean	4.299642636408967
deviation-center-line_min	4.299642636408967
deviation-heading_max	7.737882401817608
deviation-heading_mean	7.737882401817608
deviation-heading_median	7.737882401817608
deviation-heading_min	7.737882401817608
distance-from-start_max	1.206000789659136
distance-from-start_mean	1.206000789659136
distance-from-start_median	1.206000789659136
distance-from-start_min	1.206000789659136
driven_any_max	3.1430848844498547
driven_any_mean	3.1430848844498547
driven_any_median	3.1430848844498547
driven_any_min	3.1430848844498547
driven_lanedir_consec_max	1.420452979729076
driven_lanedir_consec_mean	1.420452979729076
driven_lanedir_consec_min	1.420452979729076
driven_lanedir_max	2.9486964161761877
driven_lanedir_mean	2.9486964161761877
driven_lanedir_median	2.9486964161761877
driven_lanedir_min	2.9486964161761877
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1499999999999666
in-drivable-lane_min	3.1499999999999666
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.1430848844498547, "survival_time": 54.99999999999901, "driven_lanedir": 2.9486964161761877, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.737882401817608, "distance-from-start": 1.206000789659136, "deviation-center-line": 4.299642636408967, "driven_lanedir_consec": 1.420452979729076}}
simulation-passed	1
survival_time_max	54.99999999999901
survival_time_mean	54.99999999999901
survival_time_min	54.99999999999901

No reset possible

104543

sim-0of4

success

yes

2021-11-02 18:41:47+00:00

2021-11-02 18:45:17+00:00

0:03:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.1499999999999666
driven_lanedir_consec_median	1.4204197100811673
deviation-center-line_median	4.903600870629327

other stats

deviation-center-line_max	4.903600870629327
deviation-center-line_mean	4.903600870629327
deviation-center-line_min	4.903600870629327
deviation-heading_max	7.744574576193987
deviation-heading_mean	7.744574576193987
deviation-heading_median	7.744574576193987
deviation-heading_min	7.744574576193987
distance-from-start_max	1.2060007985322774
distance-from-start_mean	1.2060007985322774
distance-from-start_median	1.2060007985322774
distance-from-start_min	1.2060007985322774
driven_any_max	3.4850840176967317
driven_any_mean	3.4850840176967317
driven_any_median	3.4850840176967317
driven_any_min	3.4850840176967317
driven_lanedir_consec_max	1.4204197100811673
driven_lanedir_consec_mean	1.4204197100811673
driven_lanedir_consec_min	1.4204197100811673
driven_lanedir_max	3.2905075260443173
driven_lanedir_mean	3.2905075260443173
driven_lanedir_median	3.2905075260443173
driven_lanedir_min	3.2905075260443173
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1499999999999666
in-drivable-lane_min	3.1499999999999666
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4850840176967317, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905075260443173, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574576193987, "distance-from-start": 1.2060007985322774, "deviation-center-line": 4.903600870629327, "driven_lanedir_consec": 1.4204197100811673}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104541

sim-1of4

success

yes

2021-11-02 18:41:07+00:00

2021-11-02 18:45:12+00:00

0:04:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	54.99999999999901
in-drivable-lane_median	3.1499999999999666
driven_lanedir_consec_median	1.420452979729076
deviation-center-line_median	4.299642636408967

other stats

deviation-center-line_max	4.299642636408967
deviation-center-line_mean	4.299642636408967
deviation-center-line_min	4.299642636408967
deviation-heading_max	7.737882401817608
deviation-heading_mean	7.737882401817608
deviation-heading_median	7.737882401817608
deviation-heading_min	7.737882401817608
distance-from-start_max	1.206000789659136
distance-from-start_mean	1.206000789659136
distance-from-start_median	1.206000789659136
distance-from-start_min	1.206000789659136
driven_any_max	3.1430848844498547
driven_any_mean	3.1430848844498547
driven_any_median	3.1430848844498547
driven_any_min	3.1430848844498547
driven_lanedir_consec_max	1.420452979729076
driven_lanedir_consec_mean	1.420452979729076
driven_lanedir_consec_min	1.420452979729076
driven_lanedir_max	2.9486964161761877
driven_lanedir_mean	2.9486964161761877
driven_lanedir_median	2.9486964161761877
driven_lanedir_min	2.9486964161761877
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1499999999999666
in-drivable-lane_min	3.1499999999999666
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.1430848844498547, "survival_time": 54.99999999999901, "driven_lanedir": 2.9486964161761877, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.737882401817608, "distance-from-start": 1.206000789659136, "deviation-center-line": 4.299642636408967, "driven_lanedir_consec": 1.420452979729076}}
simulation-passed	1
survival_time_max	54.99999999999901
survival_time_mean	54.99999999999901
survival_time_min	54.99999999999901

No reset possible

104540

sim-3of4

success

yes

2021-11-02 18:40:36+00:00

2021-11-02 18:45:07+00:00

0:04:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	58.999999999998785
in-drivable-lane_median	5.099999999999877
driven_lanedir_consec_median	2.8920792929900845
deviation-center-line_median	5.6806740116942835

other stats

deviation-center-line_max	5.6806740116942835
deviation-center-line_mean	5.6806740116942835
deviation-center-line_min	5.6806740116942835
deviation-heading_max	11.30344108488696
deviation-heading_mean	11.30344108488696
deviation-heading_median	11.30344108488696
deviation-heading_min	11.30344108488696
distance-from-start_max	2.5229792435928395
distance-from-start_mean	2.5229792435928395
distance-from-start_median	2.5229792435928395
distance-from-start_min	2.5229792435928395
driven_any_max	3.3245754522163784
driven_any_mean	3.3245754522163784
driven_any_median	3.3245754522163784
driven_any_min	3.3245754522163784
driven_lanedir_consec_max	2.8920792929900845
driven_lanedir_consec_mean	2.8920792929900845
driven_lanedir_consec_min	2.8920792929900845
driven_lanedir_max	2.9981420562404173
driven_lanedir_mean	2.9981420562404173
driven_lanedir_median	2.9981420562404173
driven_lanedir_min	2.9981420562404173
in-drivable-lane_max	5.099999999999877
in-drivable-lane_mean	5.099999999999877
in-drivable-lane_min	5.099999999999877
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.3245754522163784, "survival_time": 58.999999999998785, "driven_lanedir": 2.9981420562404173, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.30344108488696, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.6806740116942835, "driven_lanedir_consec": 2.8920792929900845}}
simulation-passed	1
survival_time_max	58.999999999998785
survival_time_mean	58.999999999998785
survival_time_min	58.999999999998785

No reset possible

104539

sim-2of4

success

yes

2021-11-02 18:39:39+00:00

2021-11-02 18:43:30+00:00

0:03:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102421

sim-3of4

success

2021-11-02 11:11:04+00:00

2021-11-02 11:12:17+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102419

sim-0of4

success

2021-11-02 11:10:35+00:00

2021-11-02 11:13:38+00:00

0:03:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102417

sim-1of4

success

2021-11-02 11:10:33+00:00

2021-11-02 11:14:43+00:00

0:04:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102398

sim-0of4

success

2021-11-02 11:06:35+00:00

2021-11-02 11:10:06+00:00

0:03:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102394

sim-3of4

success

2021-11-02 11:05:50+00:00

2021-11-02 11:10:36+00:00

0:04:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102393

sim-1of4

success

2021-11-02 11:05:50+00:00

2021-11-02 11:10:01+00:00

0:04:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102371

sim-2of4

success

2021-11-02 11:02:49+00:00

2021-11-02 11:06:31+00:00

0:03:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible