Submission 17673

Submission

17673

Competing

yes

Challenge

aido-LFV-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:06:06+00:00

Last status update

2021-12-04 20:47:22+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104314 sim-1of4: 104319 sim-2of4: 104318 sim-3of4: 104313

User label

minimal-agent

Admin priority

Blessing

n/a

User priority

104319

Click the images to see detailed statistics about the episode.

autolab-000

104318

Click the images to see detailed statistics about the episode.

autolab-000

104314

Click the images to see detailed statistics about the episode.

loop2-000

104313

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104319

sim-1of4

success

yes

2021-11-02 17:25:56+00:00

2021-11-02 17:27:50+00:00

0:01:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	3.8499999999999943
in-drivable-lane_median	2.0999999999999934
driven_lanedir_consec_median	0.19955565328420843
deviation-center-line_median	0.12567516126913225

other stats

deviation-center-line_max	0.12567516126913225
deviation-center-line_mean	0.12567516126913225
deviation-center-line_min	0.12567516126913225
deviation-heading_max	0.9488219555580464
deviation-heading_mean	0.9488219555580464
deviation-heading_median	0.9488219555580464
deviation-heading_min	0.9488219555580464
distance-from-start_max	0.46487640009490927
distance-from-start_mean	0.46487640009490927
distance-from-start_median	0.46487640009490927
distance-from-start_min	0.46487640009490927
driven_any_max	0.46488519376666826
driven_any_mean	0.46488519376666826
driven_any_median	0.46488519376666826
driven_any_min	0.46488519376666826
driven_lanedir_consec_max	0.19955565328420843
driven_lanedir_consec_mean	0.19955565328420843
driven_lanedir_consec_min	0.19955565328420843
driven_lanedir_max	0.19955565328420843
driven_lanedir_mean	0.19955565328420843
driven_lanedir_median	0.19955565328420843
driven_lanedir_min	0.19955565328420843
in-drivable-lane_max	2.0999999999999934
in-drivable-lane_mean	2.0999999999999934
in-drivable-lane_min	2.0999999999999934
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed	1
survival_time_max	3.8499999999999943
survival_time_mean	3.8499999999999943
survival_time_min	3.8499999999999943

No reset possible

104318

sim-2of4

success

yes

2021-11-02 17:25:26+00:00

2021-11-02 17:27:09+00:00

0:01:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	3.8499999999999943
in-drivable-lane_median	2.0999999999999934
driven_lanedir_consec_median	0.19955565328420843
deviation-center-line_median	0.12567516126913225

other stats

deviation-center-line_max	0.12567516126913225
deviation-center-line_mean	0.12567516126913225
deviation-center-line_min	0.12567516126913225
deviation-heading_max	0.9488219555580464
deviation-heading_mean	0.9488219555580464
deviation-heading_median	0.9488219555580464
deviation-heading_min	0.9488219555580464
distance-from-start_max	0.46487640009490927
distance-from-start_mean	0.46487640009490927
distance-from-start_median	0.46487640009490927
distance-from-start_min	0.46487640009490927
driven_any_max	0.46488519376666826
driven_any_mean	0.46488519376666826
driven_any_median	0.46488519376666826
driven_any_min	0.46488519376666826
driven_lanedir_consec_max	0.19955565328420843
driven_lanedir_consec_mean	0.19955565328420843
driven_lanedir_consec_min	0.19955565328420843
driven_lanedir_max	0.19955565328420843
driven_lanedir_mean	0.19955565328420843
driven_lanedir_median	0.19955565328420843
driven_lanedir_min	0.19955565328420843
in-drivable-lane_max	2.0999999999999934
in-drivable-lane_mean	2.0999999999999934
in-drivable-lane_min	2.0999999999999934
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed	1
survival_time_max	3.8499999999999943
survival_time_mean	3.8499999999999943
survival_time_min	3.8499999999999943

No reset possible

104314

sim-0of4

success

yes

2021-11-02 17:25:21+00:00

2021-11-02 17:27:32+00:00

0:02:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.900000000000006
in-drivable-lane_median	6.60000000000001
driven_lanedir_consec_median	0.33122941999330235
deviation-center-line_median	0.2697354465605155

other stats

deviation-center-line_max	0.2697354465605155
deviation-center-line_mean	0.2697354465605155
deviation-center-line_min	0.2697354465605155
deviation-heading_max	2.53835057480462
deviation-heading_mean	2.53835057480462
deviation-heading_median	2.53835057480462
deviation-heading_min	2.53835057480462
distance-from-start_max	1.4631057991302543
distance-from-start_mean	1.4631057991302543
distance-from-start_median	1.4631057991302543
distance-from-start_min	1.4631057991302543
driven_any_max	1.4632129547419284
driven_any_mean	1.4632129547419284
driven_any_median	1.4632129547419284
driven_any_min	1.4632129547419284
driven_lanedir_consec_max	0.33122941999330235
driven_lanedir_consec_mean	0.33122941999330235
driven_lanedir_consec_min	0.33122941999330235
driven_lanedir_max	0.33122941999330235
driven_lanedir_mean	0.33122941999330235
driven_lanedir_median	0.33122941999330235
driven_lanedir_min	0.33122941999330235
in-drivable-lane_max	6.60000000000001
in-drivable-lane_mean	6.60000000000001
in-drivable-lane_min	6.60000000000001
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed	1
survival_time_max	9.900000000000006
survival_time_mean	9.900000000000006
survival_time_min	9.900000000000006

No reset possible

104313

sim-3of4

success

yes

2021-11-02 17:24:54+00:00

2021-11-02 17:27:43+00:00

0:02:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.499999999999986
in-drivable-lane_median	6.749999999999985
driven_lanedir_consec_median	0.19955231542410212
deviation-center-line_median	0.1256753337219296

other stats

deviation-center-line_max	0.1256753337219296
deviation-center-line_mean	0.1256753337219296
deviation-center-line_min	0.1256753337219296
deviation-heading_max	0.9488219555580464
deviation-heading_mean	0.9488219555580464
deviation-heading_median	0.9488219555580464
deviation-heading_min	0.9488219555580464
distance-from-start_max	1.233057068821899
distance-from-start_mean	1.233057068821899
distance-from-start_median	1.233057068821899
distance-from-start_min	1.233057068821899
driven_any_max	1.2331286149593297
driven_any_mean	1.2331286149593297
driven_any_median	1.2331286149593297
driven_any_min	1.2331286149593297
driven_lanedir_consec_max	0.19955231542410212
driven_lanedir_consec_mean	0.19955231542410212
driven_lanedir_consec_min	0.19955231542410212
driven_lanedir_max	0.19955231542410212
driven_lanedir_mean	0.19955231542410212
driven_lanedir_median	0.19955231542410212
driven_lanedir_min	0.19955231542410212
in-drivable-lane_max	6.749999999999985
in-drivable-lane_mean	6.749999999999985
in-drivable-lane_min	6.749999999999985
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed	1
survival_time_max	8.499999999999986
survival_time_mean	8.499999999999986
survival_time_min	8.499999999999986

No reset possible

104310

sim-1of4

success

yes

2021-11-02 17:23:46+00:00

2021-11-02 17:25:37+00:00

0:01:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104309

sim-0of4

success

yes

2021-11-02 17:23:10+00:00

2021-11-02 17:25:09+00:00

0:01:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104308

sim-2of4

success

yes

2021-11-02 17:22:42+00:00

2021-11-02 17:24:47+00:00

0:02:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104304

sim-1of4

success

yes

2021-11-02 17:21:42+00:00

2021-11-02 17:23:34+00:00

0:01:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104303

sim-3of4

success

yes

2021-11-02 17:21:22+00:00

2021-11-02 17:24:27+00:00

0:03:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible