Submission 17674

Submission

17674

Competing

yes

Challenge

aido-LFP-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:06:06+00:00

Last status update

2021-12-04 20:47:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104195 sim-1of4: 104212 sim-2of4: 104222 sim-3of4: 104218

User label

minimal-agent

Admin priority

Blessing

n/a

User priority

104222

Click the images to see detailed statistics about the episode.

autolab-000

104218

Click the images to see detailed statistics about the episode.

zigzag-000

104212

Click the images to see detailed statistics about the episode.

zigzag-000

104195

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104222

sim-2of4

success

yes

2021-11-02 16:52:11+00:00

2021-11-02 16:53:24+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.449999999999985
in-drivable-lane_median	4.699999999999984
driven_lanedir_consec_median	0.19954528207596137
deviation-center-line_median	0.1256753841612151

other stats

deviation-center-line_max	0.1256753841612151
deviation-center-line_mean	0.1256753841612151
deviation-center-line_min	0.1256753841612151
deviation-heading_max	0.9488219555580464
deviation-heading_mean	0.9488219555580464
deviation-heading_median	0.9488219555580464
deviation-heading_min	0.9488219555580464
distance-from-start_max	0.8933842387456826
distance-from-start_mean	0.8933842387456826
distance-from-start_median	0.8933842387456826
distance-from-start_min	0.8933842387456826
driven_any_max	0.8934060045503991
driven_any_mean	0.8934060045503991
driven_any_median	0.8934060045503991
driven_any_min	0.8934060045503991
driven_lanedir_consec_max	0.19954528207596137
driven_lanedir_consec_mean	0.19954528207596137
driven_lanedir_consec_min	0.19954528207596137
driven_lanedir_max	0.19954528207596137
driven_lanedir_mean	0.19954528207596137
driven_lanedir_median	0.19954528207596137
driven_lanedir_min	0.19954528207596137
in-drivable-lane_max	4.699999999999984
in-drivable-lane_mean	4.699999999999984
in-drivable-lane_min	4.699999999999984
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.8934060045503991, "survival_time": 6.449999999999985, "driven_lanedir": 0.19954528207596137, "in-drivable-lane": 4.699999999999984, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.8933842387456826, "deviation-center-line": 0.1256753841612151, "driven_lanedir_consec": 0.19954528207596137}}
simulation-passed	1
survival_time_max	6.449999999999985
survival_time_mean	6.449999999999985
survival_time_min	6.449999999999985

No reset possible

104218

sim-3of4

success

yes

2021-11-02 16:51:02+00:00

2021-11-02 16:54:56+00:00

0:03:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	18.65000000000013
in-drivable-lane_median	17.20000000000013
driven_lanedir_consec_median	0.139799708254134
deviation-center-line_median	0.09390672675333604

other stats

deviation-center-line_max	0.09390672675333604
deviation-center-line_mean	0.09390672675333604
deviation-center-line_min	0.09390672675333604
deviation-heading_max	0.9654180772015548
deviation-heading_mean	0.9654180772015548
deviation-heading_median	0.9654180772015548
deviation-heading_min	0.9654180772015548
distance-from-start_max	2.912547675729676
distance-from-start_mean	2.912547675729676
distance-from-start_median	2.912547675729676
distance-from-start_min	2.912547675729676
driven_any_max	2.9132594175988893
driven_any_mean	2.9132594175988893
driven_any_median	2.9132594175988893
driven_any_min	2.9132594175988893
driven_lanedir_consec_max	0.139799708254134
driven_lanedir_consec_mean	0.139799708254134
driven_lanedir_consec_min	0.139799708254134
driven_lanedir_max	0.139799708254134
driven_lanedir_mean	0.139799708254134
driven_lanedir_median	0.139799708254134
driven_lanedir_min	0.139799708254134
in-drivable-lane_max	17.20000000000013
in-drivable-lane_mean	17.20000000000013
in-drivable-lane_min	17.20000000000013
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.9132594175988893, "survival_time": 18.65000000000013, "driven_lanedir": 0.139799708254134, "in-drivable-lane": 17.20000000000013, "deviation-heading": 0.9654180772015548, "distance-from-start": 2.912547675729676, "deviation-center-line": 0.09390672675333604, "driven_lanedir_consec": 0.139799708254134}}
simulation-passed	1
survival_time_max	18.65000000000013
survival_time_mean	18.65000000000013
survival_time_min	18.65000000000013

No reset possible

104213

sim-2of4

success

yes

2021-11-02 16:50:38+00:00

2021-11-02 16:51:47+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104212

sim-1of4

success

yes

2021-11-02 16:50:35+00:00

2021-11-02 16:52:26+00:00

0:01:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	18.65000000000013
in-drivable-lane_median	17.20000000000013
driven_lanedir_consec_median	0.139799708254134
deviation-center-line_median	0.09390672675333604

other stats

deviation-center-line_max	0.09390672675333604
deviation-center-line_mean	0.09390672675333604
deviation-center-line_min	0.09390672675333604
deviation-heading_max	0.9654180772015548
deviation-heading_mean	0.9654180772015548
deviation-heading_median	0.9654180772015548
deviation-heading_min	0.9654180772015548
distance-from-start_max	2.912547675729676
distance-from-start_mean	2.912547675729676
distance-from-start_median	2.912547675729676
distance-from-start_min	2.912547675729676
driven_any_max	2.9132594175988893
driven_any_mean	2.9132594175988893
driven_any_median	2.9132594175988893
driven_any_min	2.9132594175988893
driven_lanedir_consec_max	0.139799708254134
driven_lanedir_consec_mean	0.139799708254134
driven_lanedir_consec_min	0.139799708254134
driven_lanedir_max	0.139799708254134
driven_lanedir_mean	0.139799708254134
driven_lanedir_median	0.139799708254134
driven_lanedir_min	0.139799708254134
in-drivable-lane_max	17.20000000000013
in-drivable-lane_mean	17.20000000000013
in-drivable-lane_min	17.20000000000013
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.9132594175988893, "survival_time": 18.65000000000013, "driven_lanedir": 0.139799708254134, "in-drivable-lane": 17.20000000000013, "deviation-heading": 0.9654180772015548, "distance-from-start": 2.912547675729676, "deviation-center-line": 0.09390672675333604, "driven_lanedir_consec": 0.139799708254134}}
simulation-passed	1
survival_time_max	18.65000000000013
survival_time_mean	18.65000000000013
survival_time_min	18.65000000000013

No reset possible

104210

sim-3of4

success

yes

2021-11-02 16:49:29+00:00

2021-11-02 16:50:36+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104208

sim-2of4

success

yes

2021-11-02 16:48:47+00:00

2021-11-02 16:50:00+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104206

sim-1of4

success

yes

2021-11-02 16:48:15+00:00

2021-11-02 16:50:20+00:00

0:02:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104205

sim-3of4

success

yes

2021-11-02 16:47:53+00:00

2021-11-02 16:48:54+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104200

sim-3of4

success

yes

2021-11-02 16:46:48+00:00

2021-11-02 16:47:46+00:00

0:00:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104195

sim-0of4

success

yes

2021-11-02 16:44:47+00:00

2021-11-02 16:46:13+00:00

0:01:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.700000000000044
in-drivable-lane_median	9.40000000000005
driven_lanedir_consec_median	0.33122977762117056
deviation-center-line_median	0.2697354450181819

other stats

deviation-center-line_max	0.2697354450181819
deviation-center-line_mean	0.2697354450181819
deviation-center-line_min	0.2697354450181819
deviation-heading_max	2.5383505748046193
deviation-heading_mean	2.5383505748046193
deviation-heading_median	2.5383505748046193
deviation-heading_min	2.5383505748046193
distance-from-start_max	1.9240493840830373
distance-from-start_mean	1.9240493840830373
distance-from-start_median	1.9240493840830373
distance-from-start_min	1.9240493840830373
driven_any_max	1.9241954407136783
driven_any_mean	1.9241954407136783
driven_any_median	1.9241954407136783
driven_any_min	1.9241954407136783
driven_lanedir_consec_max	0.33122977762117056
driven_lanedir_consec_mean	0.33122977762117056
driven_lanedir_consec_min	0.33122977762117056
driven_lanedir_max	0.33122977762117056
driven_lanedir_mean	0.33122977762117056
driven_lanedir_median	0.33122977762117056
driven_lanedir_min	0.33122977762117056
in-drivable-lane_max	9.40000000000005
in-drivable-lane_mean	9.40000000000005
in-drivable-lane_min	9.40000000000005
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.9241954407136783, "survival_time": 12.700000000000044, "driven_lanedir": 0.33122977762117056, "in-drivable-lane": 9.40000000000005, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9240493840830373, "deviation-center-line": 0.2697354450181819, "driven_lanedir_consec": 0.33122977762117056}}
simulation-passed	1
survival_time_max	12.700000000000044
survival_time_mean	12.700000000000044
survival_time_min	12.700000000000044

No reset possible

104187

sim-0of4

success

yes

2021-11-02 16:42:12+00:00

2021-11-02 16:43:41+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible