Submission 17672

Submission

17672

Competing

yes

Challenge

aido-LFV_multi-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:06:06+00:00

Last status update

2021-12-04 20:47:22+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104336 sim-1of4: 104325 sim-2of4: 104328 sim-3of4: 104330

User label

minimal-agent

Admin priority

Blessing

n/a

User priority

104336

Click the images to see detailed statistics about the episode.

loop2-000

104330

Click the images to see detailed statistics about the episode.

loop-000

104328

Click the images to see detailed statistics about the episode.

loop-000

104325

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104336

sim-0of4

success

yes

2021-11-02 17:30:44+00:00

2021-11-02 17:32:26+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	5.949999999999987
in-drivable-lane_median	4.349999999999986
driven_lanedir_consec_median	0.1796243236291546
deviation-center-line_median	0.13064995214824765

other stats

deviation-center-line_max	0.1356245705745657
deviation-center-line_mean	0.13064995214824765
deviation-center-line_min	0.1256753337219296
deviation-heading_max	0.9488219555580464
deviation-heading_mean	0.848315713252692
deviation-heading_median	0.848315713252692
deviation-heading_min	0.7478094709473374
distance-from-start_max	0.8124268507162298
distance-from-start_mean	0.8002552992142686
distance-from-start_median	0.8002552992142686
distance-from-start_min	0.7880837477123075
driven_any_max	0.8124423795236627
driven_any_mean	0.8002702946322935
driven_any_median	0.8002702946322935
driven_any_min	0.7880982097409241
driven_lanedir_consec_max	0.19955231542410212
driven_lanedir_consec_mean	0.1796243236291546
driven_lanedir_consec_min	0.15969633183420706
driven_lanedir_max	0.19955231542410212
driven_lanedir_mean	0.1796243236291546
driven_lanedir_median	0.1796243236291546
driven_lanedir_min	0.15969633183420706
in-drivable-lane_max	4.499999999999987
in-drivable-lane_mean	4.349999999999986
in-drivable-lane_min	4.199999999999986
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.8124423795236627, "survival_time": 5.949999999999987, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 4.199999999999986, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.8124268507162298, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}, "loop2-000-ego1": {"driven_any": 0.7880982097409241, "survival_time": 5.949999999999987, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 4.499999999999987, "deviation-heading": 0.7478094709473374, "distance-from-start": 0.7880837477123075, "deviation-center-line": 0.1356245705745657, "driven_lanedir_consec": 0.15969633183420706}}
simulation-passed	1
survival_time_max	5.949999999999987
survival_time_mean	5.949999999999987
survival_time_min	5.949999999999987

No reset possible

104330

sim-3of4

success

yes

2021-11-02 17:29:09+00:00

2021-11-02 17:31:39+00:00

0:02:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.699999999999989
in-drivable-lane_median	5.124999999999994
driven_lanedir_consec_median	0.3534980472911704
deviation-center-line_median	0.31473998602704023

other stats

deviation-center-line_max	1.1167880744707592
deviation-center-line_mean	0.4679858397779584
deviation-center-line_min	0.1256753125869936
deviation-heading_max	2.483401077481458
deviation-heading_mean	1.59686418028581
deviation-heading_median	1.5781230863572229
deviation-heading_min	0.7478094709473372
distance-from-start_max	1.2661028531770575
distance-from-start_mean	0.9500582944506836
distance-from-start_median	1.0055183306038733
distance-from-start_min	0.5230936634179303
driven_any_max	1.2661876874339428
driven_any_mean	0.9501035001353118
driven_any_median	1.0055609346511667
driven_any_min	0.5231044438049705
driven_lanedir_consec_max	0.7375228777305465
driven_lanedir_consec_mean	0.4010538260367736
driven_lanedir_consec_min	0.15969633183420706
driven_lanedir_max	0.7375228777305465
driven_lanedir_mean	0.4010538260367736
driven_lanedir_median	0.3534980472911704
driven_lanedir_min	0.15969633183420706
in-drivable-lane_max	7.2499999999999885
in-drivable-lane_mean	4.374999999999994
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 0.9347451682894408, "survival_time": 8.699999999999989, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 6.949999999999988, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566112, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955005044754337}, "loop-000-ego1": {"driven_any": 1.2661876874339428, "survival_time": 8.699999999999989, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 7.2499999999999885, "deviation-heading": 0.7478094709473372, "distance-from-start": 1.2661028531770575, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969633183420706}, "loop-000-ego2": {"driven_any": 0.5231044438049705, "survival_time": 8.699999999999989, "driven_lanedir": 0.5074460441347974, "in-drivable-lane": 0.0, "deviation-heading": 2.483401077481458, "distance-from-start": 0.5230936634179303, "deviation-center-line": 1.1167880744707592, "driven_lanedir_consec": 0.5074460441347974}, "loop-000-ego3": {"driven_any": 1.0763767010128928, "survival_time": 8.699999999999989, "driven_lanedir": 0.7375228777305465, "in-drivable-lane": 3.3, "deviation-heading": 2.207424217156399, "distance-from-start": 1.0763222871511355, "deviation-center-line": 0.4938550612758114, "driven_lanedir_consec": 0.7375228777305465}}
simulation-passed	1
survival_time_max	8.699999999999989
survival_time_mean	8.699999999999989
survival_time_min	8.699999999999989

No reset possible

104328

sim-2of4

success

yes

2021-11-02 17:28:38+00:00

2021-11-02 17:31:22+00:00

0:02:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.699999999999989
in-drivable-lane_median	5.124999999999994
driven_lanedir_consec_median	0.3534980472911704
deviation-center-line_median	0.31473998602704023

other stats

deviation-center-line_max	1.1167880744707592
deviation-center-line_mean	0.4679858397779584
deviation-center-line_min	0.1256753125869936
deviation-heading_max	2.483401077481458
deviation-heading_mean	1.59686418028581
deviation-heading_median	1.5781230863572229
deviation-heading_min	0.7478094709473372
distance-from-start_max	1.2661028531770575
distance-from-start_mean	0.9500582944506836
distance-from-start_median	1.0055183306038733
distance-from-start_min	0.5230936634179303
driven_any_max	1.2661876874339428
driven_any_mean	0.9501035001353118
driven_any_median	1.0055609346511667
driven_any_min	0.5231044438049705
driven_lanedir_consec_max	0.7375228777305465
driven_lanedir_consec_mean	0.4010538260367736
driven_lanedir_consec_min	0.15969633183420706
driven_lanedir_max	0.7375228777305465
driven_lanedir_mean	0.4010538260367736
driven_lanedir_median	0.3534980472911704
driven_lanedir_min	0.15969633183420706
in-drivable-lane_max	7.2499999999999885
in-drivable-lane_mean	4.374999999999994
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 0.9347451682894408, "survival_time": 8.699999999999989, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 6.949999999999988, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566112, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955005044754337}, "loop-000-ego1": {"driven_any": 1.2661876874339428, "survival_time": 8.699999999999989, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 7.2499999999999885, "deviation-heading": 0.7478094709473372, "distance-from-start": 1.2661028531770575, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969633183420706}, "loop-000-ego2": {"driven_any": 0.5231044438049705, "survival_time": 8.699999999999989, "driven_lanedir": 0.5074460441347974, "in-drivable-lane": 0.0, "deviation-heading": 2.483401077481458, "distance-from-start": 0.5230936634179303, "deviation-center-line": 1.1167880744707592, "driven_lanedir_consec": 0.5074460441347974}, "loop-000-ego3": {"driven_any": 1.0763767010128928, "survival_time": 8.699999999999989, "driven_lanedir": 0.7375228777305465, "in-drivable-lane": 3.3, "deviation-heading": 2.207424217156399, "distance-from-start": 1.0763222871511355, "deviation-center-line": 0.4938550612758114, "driven_lanedir_consec": 0.7375228777305465}}
simulation-passed	1
survival_time_max	8.699999999999989
survival_time_mean	8.699999999999989
survival_time_min	8.699999999999989

No reset possible

104325

sim-1of4

success

yes

2021-11-02 17:28:11+00:00

2021-11-02 17:31:43+00:00

0:03:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.850000000000048
in-drivable-lane_median	9.600000000000051
driven_lanedir_consec_median	0.395970381094496
deviation-center-line_median	0.2727382860816283

other stats

deviation-center-line_max	0.3711793675074804
deviation-center-line_mean	0.26307006175696934
deviation-center-line_min	0.13562430735714032
deviation-heading_max	2.5383505748046193
deviation-heading_mean	1.5839275146723817
deviation-heading_median	1.5305477977075064
deviation-heading_min	0.7362638884698938
distance-from-start_max	1.9486947141078033
distance-from-start_mean	1.6104892935754336
distance-from-start_median	1.6878960391209077
distance-from-start_min	1.117470381952116
driven_any_max	1.9488515657780785
driven_any_mean	1.6105973523255763
driven_any_median	1.6880059043797089
driven_any_min	1.1175260347648104
driven_lanedir_consec_max	0.6388965134503066
driven_lanedir_consec_mean	0.3976334018683764
driven_lanedir_consec_min	0.15969633183420706
driven_lanedir_max	0.6388965134503066
driven_lanedir_mean	0.3976334018683764
driven_lanedir_median	0.395970381094496
driven_lanedir_min	0.15969633183420706
in-drivable-lane_max	11.400000000000048
in-drivable-lane_mean	9.612500000000054
in-drivable-lane_min	7.850000000000057
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.9488515657780785, "survival_time": 12.850000000000048, "driven_lanedir": 0.3312247708304017, "in-drivable-lane": 9.550000000000052, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9486947141078033, "deviation-center-line": 0.26973515872126547, "driven_lanedir_consec": 0.3312247708304017}, "autolab-000-ego1": {"driven_any": 1.1175260347648104, "survival_time": 12.850000000000048, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 11.400000000000048, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.117470381952116, "deviation-center-line": 0.13562430735714032, "driven_lanedir_consec": 0.15969633183420706}, "autolab-000-ego2": {"driven_any": 1.6921542763568478, "survival_time": 12.850000000000048, "driven_lanedir": 0.6388965134503066, "in-drivable-lane": 7.850000000000057, "deviation-heading": 2.313286124467676, "distance-from-start": 1.6920444051025798, "deviation-center-line": 0.3711793675074804, "driven_lanedir_consec": 0.6388965134503066}, "autolab-000-ego3": {"driven_any": 1.68385753240257, "survival_time": 12.850000000000048, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 9.650000000000052, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}
simulation-passed	1
survival_time_max	12.850000000000048
survival_time_mean	12.850000000000048
survival_time_min	12.850000000000048

No reset possible

104324

sim-0of4

success

yes

2021-11-02 17:28:11+00:00

2021-11-02 17:30:06+00:00

0:01:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104316

sim-3of4

success

yes

2021-11-02 17:25:25+00:00

2021-11-02 17:28:28+00:00

0:03:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104315

sim-2of4

success

yes

2021-11-02 17:25:25+00:00

2021-11-02 17:28:19+00:00

0:02:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104312

sim-1of4

success

yes

2021-11-02 17:24:51+00:00

2021-11-02 17:27:41+00:00

0:02:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104311

sim-0of4

success

yes

2021-11-02 17:24:50+00:00

2021-11-02 17:26:26+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible