Submission 18338

Submission

18338

Competing

yes

Challenge

aido-LFV_multi-sim-validation

User

Bence Haromi

Date submitted

2021-12-07 12:02:58+00:00

Last status update

2021-12-07 12:36:31+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 120756 sim-1of4: 120755 sim-2of4: 120758 sim-3of4: 120754

User label

007-0.5

Admin priority

Blessing

n/a

User priority

120758

Click the images to see detailed statistics about the episode.

loop2-000

120756

Click the images to see detailed statistics about the episode.

autolab-000

120755

Click the images to see detailed statistics about the episode.

loop-000

120754

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

120758

sim-2of4

success

yes

2021-12-07 12:17:51+00:00

2021-12-07 12:25:59+00:00

0:08:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	15.909344684836771
deviation-center-line_median	1.025325317433364

other stats

deviation-center-line_max	1.08181015660505
deviation-center-line_mean	1.025325317433364
deviation-center-line_min	0.9688404782616784
deviation-heading_max	3.617763190807753
deviation-heading_mean	3.471128550355993
deviation-heading_median	3.471128550355993
deviation-heading_min	3.3244939099042328
distance-from-start_max	1.545003339830572
distance-from-start_mean	1.532794028171817
distance-from-start_median	1.532794028171817
distance-from-start_min	1.5205847165130624
driven_any_max	15.969326418396198
driven_any_mean	15.954282973654308
driven_any_median	15.954282973654308
driven_any_min	15.939239528912417
driven_lanedir_consec_max	15.920550272719217
driven_lanedir_consec_mean	15.909344684836771
driven_lanedir_consec_min	15.898139096954324
driven_lanedir_max	15.920550272719217
driven_lanedir_mean	15.909344684836771
driven_lanedir_median	15.909344684836771
driven_lanedir_min	15.898139096954324
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 15.939239528912417, "survival_time": 59.99999999999873, "driven_lanedir": 15.898139096954324, "in-drivable-lane": 0.0, "deviation-heading": 3.3244939099042328, "distance-from-start": 1.5205847165130624, "deviation-center-line": 0.9688404782616784, "driven_lanedir_consec": 15.898139096954324}, "loop2-000-ego1": {"driven_any": 15.969326418396198, "survival_time": 59.99999999999873, "driven_lanedir": 15.920550272719217, "in-drivable-lane": 0.0, "deviation-heading": 3.617763190807753, "distance-from-start": 1.545003339830572, "deviation-center-line": 1.08181015660505, "driven_lanedir_consec": 15.920550272719217}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

120757

sim-2of4

success

yes

2021-12-07 12:09:23+00:00

2021-12-07 12:17:21+00:00

0:07:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120756

sim-0of4

success

yes

2021-12-07 12:08:50+00:00

2021-12-07 12:29:59+00:00

0:21:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	15.187954529137487
deviation-center-line_median	1.6753408399156573

other stats

deviation-center-line_max	1.7781498092654862
deviation-center-line_mean	1.3167223803527164
deviation-center-line_min	0.1380580323140649
deviation-heading_max	5.8866075720124025
deviation-heading_mean	4.369938921018569
deviation-heading_median	5.527012078723999
deviation-heading_min	0.5391239546138774
distance-from-start_max	3.978187741889751
distance-from-start_mean	2.746056798484984
distance-from-start_median	3.2212466225076586
distance-from-start_min	0.5635462070348688
driven_any_max	15.72675866895467
driven_any_mean	11.915028722469328
driven_any_median	15.303304771547872
driven_any_min	1.3267466778268973
driven_lanedir_consec_max	15.62459525645761
driven_lanedir_consec_mean	11.562285908896998
driven_lanedir_consec_min	0.2486393208554043
driven_lanedir_max	15.62459525645761
driven_lanedir_mean	11.562285908896998
driven_lanedir_median	15.187954529137487
driven_lanedir_min	0.2486393208554043
in-drivable-lane_max	58.59999999999873
in-drivable-lane_mean	14.649999999999682
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 15.28878990720692, "survival_time": 59.99999999999873, "driven_lanedir": 15.175738379772843, "in-drivable-lane": 0.0, "deviation-heading": 5.787762301004628, "distance-from-start": 3.978187741889751, "deviation-center-line": 1.6536444685764382, "driven_lanedir_consec": 15.175738379772843}, "autolab-000-ego1": {"driven_any": 1.3267466778268973, "survival_time": 59.99999999999873, "driven_lanedir": 0.2486393208554043, "in-drivable-lane": 58.59999999999873, "deviation-heading": 0.5391239546138774, "distance-from-start": 0.5635462070348688, "deviation-center-line": 0.1380580323140649, "driven_lanedir_consec": 0.2486393208554043}, "autolab-000-ego2": {"driven_any": 15.72675866895467, "survival_time": 59.99999999999873, "driven_lanedir": 15.62459525645761, "in-drivable-lane": 0.0, "deviation-heading": 5.2662618564433705, "distance-from-start": 2.767332486727504, "deviation-center-line": 1.7781498092654862, "driven_lanedir_consec": 15.62459525645761}, "autolab-000-ego3": {"driven_any": 15.317819635888826, "survival_time": 59.99999999999873, "driven_lanedir": 15.20017067850213, "in-drivable-lane": 0.0, "deviation-heading": 5.8866075720124025, "distance-from-start": 3.675160758287814, "deviation-center-line": 1.6970372112548766, "driven_lanedir_consec": 15.20017067850213}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

120755

sim-1of4

success

yes

2021-12-07 12:08:48+00:00

2021-12-07 12:26:18+00:00

0:17:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	16.203515715344956
deviation-center-line_median	1.2153011731140753

other stats

deviation-center-line_max	1.884306464209488
deviation-center-line_mean	1.374205334690119
deviation-center-line_min	1.181912528322837
deviation-heading_max	4.747968241606541
deviation-heading_mean	3.443223241978504
deviation-heading_median	3.2666210335109716
deviation-heading_min	2.4916826592855323
distance-from-start_max	3.242283016763647
distance-from-start_mean	2.762995695448721
distance-from-start_median	2.893151859134758
distance-from-start_min	2.023396046761719
driven_any_max	16.51251383714238
driven_any_mean	16.265243008955014
driven_any_median	16.24886108330339
driven_any_min	16.05073603207091
driven_lanedir_consec_max	16.483614505409218
driven_lanedir_consec_mean	16.21451993527371
driven_lanedir_consec_min	15.967433804995707
driven_lanedir_max	16.483614505409218
driven_lanedir_mean	16.21451993527371
driven_lanedir_median	16.203515715344956
driven_lanedir_min	15.967433804995707
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 16.05073603207091, "survival_time": 59.99999999999873, "driven_lanedir": 15.967433804995707, "in-drivable-lane": 0.0, "deviation-heading": 4.747968241606541, "distance-from-start": 2.023396046761719, "deviation-center-line": 1.884306464209488, "driven_lanedir_consec": 15.967433804995707}, "loop-000-ego1": {"driven_any": 16.185559591061285, "survival_time": 59.99999999999873, "driven_lanedir": 16.13827952692362, "in-drivable-lane": 0.0, "deviation-heading": 3.3391469873300768, "distance-from-start": 3.239666500036515, "deviation-center-line": 1.2031036641205173, "driven_lanedir_consec": 16.13827952692362}, "loop-000-ego2": {"driven_any": 16.51251383714238, "survival_time": 59.99999999999873, "driven_lanedir": 16.483614505409218, "in-drivable-lane": 0.0, "deviation-heading": 2.4916826592855323, "distance-from-start": 3.242283016763647, "deviation-center-line": 1.181912528322837, "driven_lanedir_consec": 16.483614505409218}, "loop-000-ego3": {"driven_any": 16.31216257554549, "survival_time": 59.99999999999873, "driven_lanedir": 16.268751903766297, "in-drivable-lane": 0.0, "deviation-heading": 3.194095079691867, "distance-from-start": 2.546637218233001, "deviation-center-line": 1.2274986821076332, "driven_lanedir_consec": 16.268751903766297}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

120754

sim-3of4

success

yes

2021-12-07 12:08:21+00:00

2021-12-07 12:31:42+00:00

0:23:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	15.35268036670497
deviation-center-line_median	1.446050190528413

other stats

deviation-center-line_max	1.6406418062027173
deviation-center-line_mean	1.455455012508193
deviation-center-line_min	1.2890778627732289
deviation-heading_max	5.9970001278690015
deviation-heading_mean	5.4104221947694136
deviation-heading_median	5.434438010026479
deviation-heading_min	4.7758126311556905
distance-from-start_max	4.464159071100733
distance-from-start_mean	3.8156273684196225
distance-from-start_median	3.7680187221893218
distance-from-start_min	3.2623129581991153
driven_any_max	15.523834252005642
driven_any_mean	15.427502247370237
driven_any_median	15.451655736860893
driven_any_min	15.282863263753514
driven_lanedir_consec_max	15.444569232174258
driven_lanedir_consec_mean	15.330262434498476
driven_lanedir_consec_min	15.1711197724097
driven_lanedir_max	15.444569232174258
driven_lanedir_mean	15.330262434498476
driven_lanedir_median	15.35268036670497
driven_lanedir_min	15.1711197724097
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 15.47750954887352, "survival_time": 59.99999999999873, "driven_lanedir": 15.395767355196618, "in-drivable-lane": 0.0, "deviation-heading": 4.940501774373231, "distance-from-start": 3.7784170040742624, "deviation-center-line": 1.2890778627732289, "driven_lanedir_consec": 15.395767355196618}, "zigzag-000-ego1": {"driven_any": 15.425801924848267, "survival_time": 59.99999999999873, "driven_lanedir": 15.30959337821332, "in-drivable-lane": 0.0, "deviation-heading": 5.9970001278690015, "distance-from-start": 3.2623129581991153, "deviation-center-line": 1.5980658492922024, "driven_lanedir_consec": 15.30959337821332}, "zigzag-000-ego2": {"driven_any": 15.523834252005642, "survival_time": 59.99999999999873, "driven_lanedir": 15.444569232174258, "in-drivable-lane": 0.0, "deviation-heading": 4.7758126311556905, "distance-from-start": 3.75762044030438, "deviation-center-line": 1.2940345317646242, "driven_lanedir_consec": 15.444569232174258}, "zigzag-000-ego3": {"driven_any": 15.282863263753514, "survival_time": 59.99999999999873, "driven_lanedir": 15.1711197724097, "in-drivable-lane": 0.0, "deviation-heading": 5.928374245679729, "distance-from-start": 4.464159071100733, "deviation-center-line": 1.6406418062027173, "driven_lanedir_consec": 15.1711197724097}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible