Submission 17641

Submission

17641

Competing

yes

Challenge

aido-LF-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:00:14+00:00

Last status update

2021-12-04 20:47:42+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104534 sim-1of4: 104529 sim-2of4: 104538 sim-3of4: 104536

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

104538

Click the images to see detailed statistics about the episode.

autolab-000

104536

Click the images to see detailed statistics about the episode.

loop-000

104534

Click the images to see detailed statistics about the episode.

loop2-000

104529

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104538

sim-2of4

success

yes

2021-11-02 18:39:08+00:00

2021-11-02 18:42:37+00:00

0:03:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.449999999999882
driven_lanedir_consec_median	3.273341764774173
deviation-center-line_median	5.928861955930986

other stats

deviation-center-line_max	5.928861955930986
deviation-center-line_mean	5.928861955930986
deviation-center-line_min	5.928861955930986
deviation-heading_max	8.56664395768181
deviation-heading_mean	8.56664395768181
deviation-heading_median	8.56664395768181
deviation-heading_min	8.56664395768181
distance-from-start_max	2.0613975353473006
distance-from-start_mean	2.0613975353473006
distance-from-start_median	2.0613975353473006
distance-from-start_min	2.0613975353473006
driven_any_max	3.476087222739718
driven_any_mean	3.476087222739718
driven_any_median	3.476087222739718
driven_any_min	3.476087222739718
driven_lanedir_consec_max	3.273341764774173
driven_lanedir_consec_mean	3.273341764774173
driven_lanedir_consec_min	3.273341764774173
driven_lanedir_max	3.273341764774173
driven_lanedir_mean	3.273341764774173
driven_lanedir_median	3.273341764774173
driven_lanedir_min	3.273341764774173
in-drivable-lane_max	3.449999999999882
in-drivable-lane_mean	3.449999999999882
in-drivable-lane_min	3.449999999999882
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.476087222739718, "survival_time": 59.99999999999873, "driven_lanedir": 3.273341764774173, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.56664395768181, "distance-from-start": 2.0613975353473006, "deviation-center-line": 5.928861955930986, "driven_lanedir_consec": 3.273341764774173}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104536

sim-3of4

success

yes

2021-11-02 18:39:04+00:00

2021-11-02 18:42:19+00:00

0:03:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.0499999999998835
driven_lanedir_consec_median	2.5903446787225497
deviation-center-line_median	4.845050204100621

other stats

deviation-center-line_max	4.845050204100621
deviation-center-line_mean	4.845050204100621
deviation-center-line_min	4.845050204100621
deviation-heading_max	5.268596966876985
deviation-heading_mean	5.268596966876985
deviation-heading_median	5.268596966876985
deviation-heading_min	5.268596966876985
distance-from-start_max	2.0328181009471
distance-from-start_mean	2.0328181009471
distance-from-start_median	2.0328181009471
distance-from-start_min	2.0328181009471
driven_any_max	3.5180872153630816
driven_any_mean	3.5180872153630816
driven_any_median	3.5180872153630816
driven_any_min	3.5180872153630816
driven_lanedir_consec_max	2.5903446787225497
driven_lanedir_consec_mean	2.5903446787225497
driven_lanedir_consec_min	2.5903446787225497
driven_lanedir_max	3.3813728794222344
driven_lanedir_mean	3.3813728794222344
driven_lanedir_median	3.3813728794222344
driven_lanedir_min	3.3813728794222344
in-drivable-lane_max	2.0499999999998835
in-drivable-lane_mean	2.0499999999998835
in-drivable-lane_min	2.0499999999998835
per-episodes	details {"loop-000-ego0": {"driven_any": 3.5180872153630816, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813728794222344, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.268596966876985, "distance-from-start": 2.0328181009471, "deviation-center-line": 4.845050204100621, "driven_lanedir_consec": 2.5903446787225497}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104534

sim-0of4

success

yes

2021-11-02 18:37:54+00:00

2021-11-02 18:41:12+00:00

0:03:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.099999999999845
driven_lanedir_consec_median	3.2655349065782646
deviation-center-line_median	7.1145113238609285

other stats

deviation-center-line_max	7.1145113238609285
deviation-center-line_mean	7.1145113238609285
deviation-center-line_min	7.1145113238609285
deviation-heading_max	5.702635608894818
deviation-heading_mean	5.702635608894818
deviation-heading_median	5.702635608894818
deviation-heading_min	5.702635608894818
distance-from-start_max	1.6303678384799305
distance-from-start_mean	1.6303678384799305
distance-from-start_median	1.6303678384799305
distance-from-start_min	1.6303678384799305
driven_any_max	3.4663369172896528
driven_any_mean	3.4663369172896528
driven_any_median	3.4663369172896528
driven_any_min	3.4663369172896528
driven_lanedir_consec_max	3.2655349065782646
driven_lanedir_consec_mean	3.2655349065782646
driven_lanedir_consec_min	3.2655349065782646
driven_lanedir_max	3.2655349065782646
driven_lanedir_mean	3.2655349065782646
driven_lanedir_median	3.2655349065782646
driven_lanedir_min	3.2655349065782646
in-drivable-lane_max	4.099999999999845
in-drivable-lane_mean	4.099999999999845
in-drivable-lane_min	4.099999999999845
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4663369172896528, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655349065782646, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635608894818, "distance-from-start": 1.6303678384799305, "deviation-center-line": 7.1145113238609285, "driven_lanedir_consec": 3.2655349065782646}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104530

sim-3of4

success

yes

2021-11-02 18:35:53+00:00

2021-11-02 18:38:55+00:00

0:03:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104529

sim-1of4

success

yes

2021-11-02 18:35:16+00:00

2021-11-02 18:38:58+00:00

0:03:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	5.099999999999877
driven_lanedir_consec_median	2.8920792929900845
deviation-center-line_median	5.680288946152966

other stats

deviation-center-line_max	5.680288946152966
deviation-center-line_mean	5.680288946152966
deviation-center-line_min	5.680288946152966
deviation-heading_max	11.490175070254152
deviation-heading_mean	11.490175070254152
deviation-heading_median	11.490175070254152
deviation-heading_min	11.490175070254152
distance-from-start_max	2.5229792435928395
distance-from-start_mean	2.5229792435928395
distance-from-start_median	2.5229792435928395
distance-from-start_min	2.5229792435928395
driven_any_max	3.4265750684858305
driven_any_mean	3.4265750684858305
driven_any_median	3.4265750684858305
driven_any_min	3.4265750684858305
driven_lanedir_consec_max	2.8920792929900845
driven_lanedir_consec_mean	2.8920792929900845
driven_lanedir_consec_min	2.8920792929900845
driven_lanedir_max	3.0978303472366893
driven_lanedir_mean	3.0978303472366893
driven_lanedir_median	3.0978303472366893
driven_lanedir_min	3.0978303472366893
in-drivable-lane_max	5.099999999999877
in-drivable-lane_mean	5.099999999999877
in-drivable-lane_min	5.099999999999877
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.4265750684858305, "survival_time": 59.99999999999873, "driven_lanedir": 3.0978303472366893, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.490175070254152, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.680288946152966, "driven_lanedir_consec": 2.8920792929900845}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104525

sim-2of4

success

yes

2021-11-02 18:34:55+00:00

2021-11-02 18:38:25+00:00

0:03:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104524

sim-0of4

success

yes

2021-11-02 18:34:17+00:00

2021-11-02 18:37:33+00:00

0:03:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104517

sim-3of4

success

yes

2021-11-02 18:31:05+00:00

2021-11-02 18:35:07+00:00

0:04:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104516

sim-2of4

success

yes

2021-11-02 18:31:04+00:00

2021-11-02 18:34:29+00:00

0:03:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104515

sim-1of4

success

yes

2021-11-02 18:31:03+00:00

2021-11-02 18:34:43+00:00

0:03:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104514

sim-0of4

success

yes

2021-11-02 18:30:28+00:00

2021-11-02 18:33:51+00:00

0:03:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible