Submission 17639

Submission

17639

Competing

yes

Challenge

aido-LFVI-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:00:14+00:00

Last status update

2021-12-04 20:47:44+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104552 sim-1of4: 104527 sim-2of4: 104535 sim-3of4: 104522

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

104552

Click the images to see detailed statistics about the episode.

4way-000

104535

Click the images to see detailed statistics about the episode.

4way-000

104527

Click the images to see detailed statistics about the episode.

4way-001

104522

Click the images to see detailed statistics about the episode.

4way-001

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104552

sim-0of4

success

yes

2021-11-02 18:45:14+00:00

2021-11-02 18:52:56+00:00

0:07:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.4352327805345304
deviation-center-line_median	3.4976585818458954

other stats

deviation-center-line_max	3.4976585818458954
deviation-center-line_mean	3.4976585818458954
deviation-center-line_min	3.4976585818458954
deviation-heading_max	4.543459809816395
deviation-heading_mean	4.543459809816395
deviation-heading_median	4.543459809816395
deviation-heading_min	4.543459809816395
distance-from-start_max	2.277929298279453
distance-from-start_mean	2.277929298279453
distance-from-start_median	2.277929298279453
distance-from-start_min	2.277929298279453
driven_any_max	3.579588783619006
driven_any_mean	3.579588783619006
driven_any_median	3.579588783619006
driven_any_min	3.579588783619006
driven_lanedir_consec_max	3.4352327805345304
driven_lanedir_consec_mean	3.4352327805345304
driven_lanedir_consec_min	3.4352327805345304
driven_lanedir_max	3.5560705587675905
driven_lanedir_mean	3.5560705587675905
driven_lanedir_median	3.5560705587675905
driven_lanedir_min	3.5560705587675905
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.579588783619006, "survival_time": 59.99999999999873, "driven_lanedir": 3.5560705587675905, "in-drivable-lane": 0.0, "deviation-heading": 4.543459809816395, "distance-from-start": 2.277929298279453, "deviation-center-line": 3.4976585818458954, "driven_lanedir_consec": 3.4352327805345304}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104535

sim-2of4

success

yes

2021-11-02 18:38:31+00:00

2021-11-02 18:46:45+00:00

0:08:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.4352327805345304
deviation-center-line_median	3.4976585818458954

other stats

deviation-center-line_max	3.4976585818458954
deviation-center-line_mean	3.4976585818458954
deviation-center-line_min	3.4976585818458954
deviation-heading_max	4.543459809816395
deviation-heading_mean	4.543459809816395
deviation-heading_median	4.543459809816395
deviation-heading_min	4.543459809816395
distance-from-start_max	2.277929298279453
distance-from-start_mean	2.277929298279453
distance-from-start_median	2.277929298279453
distance-from-start_min	2.277929298279453
driven_any_max	3.579588783619006
driven_any_mean	3.579588783619006
driven_any_median	3.579588783619006
driven_any_min	3.579588783619006
driven_lanedir_consec_max	3.4352327805345304
driven_lanedir_consec_mean	3.4352327805345304
driven_lanedir_consec_min	3.4352327805345304
driven_lanedir_max	3.5560705587675905
driven_lanedir_mean	3.5560705587675905
driven_lanedir_median	3.5560705587675905
driven_lanedir_min	3.5560705587675905
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.579588783619006, "survival_time": 59.99999999999873, "driven_lanedir": 3.5560705587675905, "in-drivable-lane": 0.0, "deviation-heading": 4.543459809816395, "distance-from-start": 2.277929298279453, "deviation-center-line": 3.4976585818458954, "driven_lanedir_consec": 3.4352327805345304}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104532

sim-0of4

success

yes

2021-11-02 18:37:23+00:00

2021-11-02 18:44:55+00:00

0:07:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104527

sim-1of4

success

yes

2021-11-02 18:35:15+00:00

2021-11-02 18:42:43+00:00

0:07:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.2000000000000313
driven_lanedir_consec_median	3.0719634979059167
deviation-center-line_median	2.5127522585495656

other stats

deviation-center-line_max	2.5127522585495656
deviation-center-line_mean	2.5127522585495656
deviation-center-line_min	2.5127522585495656
deviation-heading_max	5.80643510594152
deviation-heading_mean	5.80643510594152
deviation-heading_median	5.80643510594152
deviation-heading_min	5.80643510594152
distance-from-start_max	2.558018844429722
distance-from-start_mean	2.558018844429722
distance-from-start_median	2.558018844429722
distance-from-start_min	2.558018844429722
driven_any_max	3.5135741911352505
driven_any_mean	3.5135741911352505
driven_any_median	3.5135741911352505
driven_any_min	3.5135741911352505
driven_lanedir_consec_max	3.0719634979059167
driven_lanedir_consec_mean	3.0719634979059167
driven_lanedir_consec_min	3.0719634979059167
driven_lanedir_max	3.3771987735835296
driven_lanedir_mean	3.3771987735835296
driven_lanedir_median	3.3771987735835296
driven_lanedir_min	3.3771987735835296
in-drivable-lane_max	2.2000000000000313
in-drivable-lane_mean	2.2000000000000313
in-drivable-lane_min	2.2000000000000313
per-episodes	details {"4way-001-ego0": {"driven_any": 3.5135741911352505, "survival_time": 59.99999999999873, "driven_lanedir": 3.3771987735835296, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.80643510594152, "distance-from-start": 2.558018844429722, "deviation-center-line": 2.5127522585495656, "driven_lanedir_consec": 3.0719634979059167}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104522

sim-3of4

success

yes

2021-11-02 18:33:03+00:00

2021-11-02 18:41:05+00:00

0:08:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.2000000000000313
driven_lanedir_consec_median	3.0719634979059167
deviation-center-line_median	2.5127522585495656

other stats

deviation-center-line_max	2.5127522585495656
deviation-center-line_mean	2.5127522585495656
deviation-center-line_min	2.5127522585495656
deviation-heading_max	5.80643510594152
deviation-heading_mean	5.80643510594152
deviation-heading_median	5.80643510594152
deviation-heading_min	5.80643510594152
distance-from-start_max	2.558018844429722
distance-from-start_mean	2.558018844429722
distance-from-start_median	2.558018844429722
distance-from-start_min	2.558018844429722
driven_any_max	3.5135741911352505
driven_any_mean	3.5135741911352505
driven_any_median	3.5135741911352505
driven_any_min	3.5135741911352505
driven_lanedir_consec_max	3.0719634979059167
driven_lanedir_consec_mean	3.0719634979059167
driven_lanedir_consec_min	3.0719634979059167
driven_lanedir_max	3.3771987735835296
driven_lanedir_mean	3.3771987735835296
driven_lanedir_median	3.3771987735835296
driven_lanedir_min	3.3771987735835296
in-drivable-lane_max	2.2000000000000313
in-drivable-lane_mean	2.2000000000000313
in-drivable-lane_min	2.2000000000000313
per-episodes	details {"4way-001-ego0": {"driven_any": 3.5135741911352505, "survival_time": 59.99999999999873, "driven_lanedir": 3.3771987735835296, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.80643510594152, "distance-from-start": 2.558018844429722, "deviation-center-line": 2.5127522585495656, "driven_lanedir_consec": 3.0719634979059167}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible