Submission 17520

Submission

17520

Competing

yes

Challenge

aido-LFV_multi-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-01 16:47:26+00:00

Last status update

2021-12-04 20:47:23+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 107341 sim-1of4: 107332 sim-2of4: 107326 sim-3of4: 107309

User label

baseline-RL-sim-pytorch

Admin priority

Blessing

n/a

User priority

107341

Click the images to see detailed statistics about the episode.

loop2-000

107332

Click the images to see detailed statistics about the episode.

autolab-000

107326

Click the images to see detailed statistics about the episode.

loop-000

107309

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

107341

sim-0of4

success

yes

2021-11-03 10:56:50+00:00

2021-11-03 11:04:31+00:00

0:07:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	22.949999999999456
driven_lanedir_consec_median	-2.8471294012330346
deviation-center-line_median	3.010722951287721

other stats

deviation-center-line_max	3.068028455634104
deviation-center-line_mean	3.010722951287721
deviation-center-line_min	2.9534174469413377
deviation-heading_max	28.468855522882933
deviation-heading_mean	28.103151949237777
deviation-heading_median	28.103151949237777
deviation-heading_min	27.737448375592624
distance-from-start_max	0.2273201117357503
distance-from-start_mean	0.22418424891281868
distance-from-start_median	0.22418424891281868
distance-from-start_min	0.22104838608988703
driven_any_max	10.952566261793065
driven_any_mean	10.879845757511688
driven_any_median	10.879845757511688
driven_any_min	10.807125253230312
driven_lanedir_consec_max	-2.8144971017781537
driven_lanedir_consec_mean	-2.8471294012330346
driven_lanedir_consec_min	-2.8797617006879155
driven_lanedir_max	-2.8144971017781537
driven_lanedir_mean	-2.8471294012330346
driven_lanedir_median	-2.8471294012330346
driven_lanedir_min	-2.8797617006879155
in-drivable-lane_max	22.99999999999944
in-drivable-lane_mean	22.949999999999456
in-drivable-lane_min	22.899999999999473
per-episodes	details {"loop2-000-ego0": {"driven_any": 10.952566261793065, "survival_time": 59.99999999999873, "driven_lanedir": -2.8797617006879155, "in-drivable-lane": 22.99999999999944, "deviation-heading": 28.468855522882933, "distance-from-start": 0.2273201117357503, "deviation-center-line": 3.068028455634104, "driven_lanedir_consec": -2.8797617006879155}, "loop2-000-ego1": {"driven_any": 10.807125253230312, "survival_time": 59.99999999999873, "driven_lanedir": -2.8144971017781537, "in-drivable-lane": 22.899999999999473, "deviation-heading": 27.737448375592624, "distance-from-start": 0.22104838608988703, "deviation-center-line": 2.9534174469413377, "driven_lanedir_consec": -2.8144971017781537}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107332

sim-1of4

success

yes

2021-11-03 10:52:29+00:00

2021-11-03 11:11:50+00:00

0:19:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	20.624999999999545
driven_lanedir_consec_median	-4.058886638956979
deviation-center-line_median	3.959403529829016

other stats

deviation-center-line_max	6.066217521431305
deviation-center-line_mean	4.100941244858433
deviation-center-line_min	2.418740398344395
deviation-heading_max	33.94214029273566
deviation-heading_mean	29.194612362246502
deviation-heading_median	28.75621989628552
deviation-heading_min	25.32386936367932
distance-from-start_max	0.23574247673456325
distance-from-start_mean	0.19501721484685175
distance-from-start_median	0.1892772617855129
distance-from-start_min	0.1657718590818179
driven_any_max	14.847704977014002
driven_any_mean	13.699800408554346
driven_any_median	13.537858757490364
driven_any_min	12.875779142222653
driven_lanedir_consec_max	-3.546999733191043
driven_lanedir_consec_mean	-4.095273893306464
driven_lanedir_consec_min	-4.716322562120856
driven_lanedir_max	-3.546999733191043
driven_lanedir_mean	-6.149192873645797
driven_lanedir_median	-6.378680443999717
driven_lanedir_min	-8.292410873392711
in-drivable-lane_max	29.24999999999932
in-drivable-lane_mean	19.49999999999956
in-drivable-lane_min	7.499999999999833
per-episodes	details {"autolab-000-ego0": {"driven_any": 13.15259050713234, "survival_time": 59.99999999999873, "driven_lanedir": -4.599246010886873, "in-drivable-lane": 29.24999999999932, "deviation-heading": 25.32386936367932, "distance-from-start": 0.1657718590818179, "deviation-center-line": 2.418740398344395, "driven_lanedir_consec": -4.083967172577786}, "autolab-000-ego1": {"driven_any": 12.875779142222653, "survival_time": 59.99999999999873, "driven_lanedir": -3.546999733191043, "in-drivable-lane": 27.299999999999343, "deviation-heading": 27.43533335068736, "distance-from-start": 0.17783752769554842, "deviation-center-line": 3.2277618230000513, "driven_lanedir_consec": -3.546999733191043}, "autolab-000-ego2": {"driven_any": 13.92312700784839, "survival_time": 59.99999999999873, "driven_lanedir": -8.292410873392711, "in-drivable-lane": 7.499999999999833, "deviation-heading": 33.94214029273566, "distance-from-start": 0.23574247673456325, "deviation-center-line": 6.066217521431305, "driven_lanedir_consec": -4.033806105336172}, "autolab-000-ego3": {"driven_any": 14.847704977014002, "survival_time": 59.99999999999873, "driven_lanedir": -8.158114877112562, "in-drivable-lane": 13.949999999999743, "deviation-heading": 30.07710644188369, "distance-from-start": 0.20071699587547745, "deviation-center-line": 4.691045236657981, "driven_lanedir_consec": -4.716322562120856}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107326

sim-2of4

success

yes

2021-11-03 10:49:14+00:00

2021-11-03 11:06:02+00:00

0:16:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	28.174999999999372
driven_lanedir_consec_median	-2.8231036338530457
deviation-center-line_median	2.7138872019310822

other stats

deviation-center-line_max	5.133887225122188
deviation-center-line_mean	3.1950507418526746
deviation-center-line_min	2.2185413384263453
deviation-heading_max	28.571736719374403
deviation-heading_mean	25.511274033812327
deviation-heading_median	25.930489441805573
deviation-heading_min	21.612380532263764
distance-from-start_max	0.28110733524402925
distance-from-start_mean	0.20337783771001008
distance-from-start_median	0.1872003787737065
distance-from-start_min	0.15800325804859802
driven_any_max	12.3798000955292
driven_any_mean	11.430649610690148
driven_any_median	11.658527041676706
driven_any_min	10.02574426387798
driven_lanedir_consec_max	-0.8632171757706784
driven_lanedir_consec_mean	-2.546111993637883
driven_lanedir_consec_min	-3.675023531074763
driven_lanedir_max	-0.8632171757706784
driven_lanedir_mean	-3.502629405418631
driven_lanedir_median	-3.490510803260629
driven_lanedir_min	-6.166278839382587
in-drivable-lane_max	33.84999999999883
in-drivable-lane_mean	25.862499999999272
in-drivable-lane_min	13.249999999999517
per-episodes	details {"loop-000-ego0": {"driven_any": 12.215212775672091, "survival_time": 59.99999999999873, "driven_lanedir": -3.888948601519728, "in-drivable-lane": 30.14999999999937, "deviation-heading": 24.77549134387294, "distance-from-start": 0.16331935292090627, "deviation-center-line": 2.3364057667350755, "driven_lanedir_consec": -3.675023531074763}, "loop-000-ego1": {"driven_any": 11.10184130768132, "survival_time": 59.99999999999873, "driven_lanedir": -3.092073005001531, "in-drivable-lane": 26.199999999999378, "deviation-heading": 27.085487539738207, "distance-from-start": 0.15800325804859802, "deviation-center-line": 2.2185413384263453, "driven_lanedir_consec": -3.092073005001531}, "loop-000-ego2": {"driven_any": 12.3798000955292, "survival_time": 59.99999999999873, "driven_lanedir": -6.166278839382587, "in-drivable-lane": 13.249999999999517, "deviation-heading": 28.571736719374403, "distance-from-start": 0.28110733524402925, "deviation-center-line": 5.133887225122188, "driven_lanedir_consec": -2.5541342627045607}, "loop-000-ego3": {"driven_any": 10.02574426387798, "survival_time": 59.99999999999873, "driven_lanedir": -0.8632171757706784, "in-drivable-lane": 33.84999999999883, "deviation-heading": 21.612380532263764, "distance-from-start": 0.21108140462650668, "deviation-center-line": 3.091368637127089, "driven_lanedir_consec": -0.8632171757706784}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107322

sim-0of4

success

yes

2021-11-03 10:48:47+00:00

2021-11-03 10:56:24+00:00

0:07:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107309

sim-3of4

success

yes

2021-11-03 10:42:49+00:00

2021-11-03 11:03:18+00:00

0:20:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	24.049999999999308
driven_lanedir_consec_median	-2.880909578811297
deviation-center-line_median	3.211557850993752

other stats

deviation-center-line_max	5.191452302725507
deviation-center-line_mean	3.323090518769052
deviation-center-line_min	1.6777940703631973
deviation-heading_max	31.44411517056935
deviation-heading_mean	25.69294785903412
deviation-heading_median	27.96200707256086
deviation-heading_min	15.40366212044541
distance-from-start_max	0.228698945442988
distance-from-start_mean	0.19995843474700647
distance-from-start_median	0.2029737151732743
distance-from-start_min	0.16518736319848928
driven_any_max	14.769951616314849
driven_any_mean	12.730843898819318
driven_any_median	12.57798447505523
driven_any_min	10.997455028851965
driven_lanedir_consec_max	-2.358071623852501
driven_lanedir_consec_mean	-2.906677853148341
driven_lanedir_consec_min	-3.5068206311182677
driven_lanedir_max	-2.3655043519940864
driven_lanedir_mean	-4.472986330853653
driven_lanedir_median	-3.5212720983329953
driven_lanedir_min	-8.483896774754536
in-drivable-lane_max	43.149999999999054
in-drivable-lane_mean	25.287499999999383
in-drivable-lane_min	9.899999999999856
per-episodes	details {"zigzag-000-ego0": {"driven_any": 10.997455028851965, "survival_time": 59.99999999999873, "driven_lanedir": -2.3655043519940864, "in-drivable-lane": 29.799999999999265, "deviation-heading": 25.235267245224232, "distance-from-start": 0.21778596640417044, "deviation-center-line": 3.051693495262791, "driven_lanedir_consec": -2.3655043519940864}, "zigzag-000-ego1": {"driven_any": 12.88888625902239, "survival_time": 59.99999999999873, "driven_lanedir": -2.371923907536531, "in-drivable-lane": 43.149999999999054, "deviation-heading": 15.40366212044541, "distance-from-start": 0.16518736319848928, "deviation-center-line": 1.6777940703631973, "driven_lanedir_consec": -2.358071623852501}, "zigzag-000-ego2": {"driven_any": 12.267082691088069, "survival_time": 59.99999999999873, "driven_lanedir": -4.6706202891294595, "in-drivable-lane": 18.29999999999935, "deviation-heading": 30.688746899897485, "distance-from-start": 0.18816146394237815, "deviation-center-line": 3.371422206724713, "driven_lanedir_consec": -3.3963148056285077}, "zigzag-000-ego3": {"driven_any": 14.769951616314849, "survival_time": 59.99999999999873, "driven_lanedir": -8.483896774754536, "in-drivable-lane": 9.899999999999856, "deviation-heading": 31.44411517056935, "distance-from-start": 0.228698945442988, "deviation-center-line": 5.191452302725507, "driven_lanedir_consec": -3.5068206311182677}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible