Submission 17602

Submission

17602

Competing

yes

Challenge

aido-LFV_multi-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 08:53:29+00:00

Last status update

2021-12-04 20:47:22+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 105580 sim-1of4: 105577 sim-2of4: 105576 sim-3of4: 105578

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

105580

Click the images to see detailed statistics about the episode.

loop2-000

105578

Click the images to see detailed statistics about the episode.

loop-000

105577

Click the images to see detailed statistics about the episode.

zigzag-000

105576

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

105580

sim-0of4

success

yes

2021-11-03 03:39:07+00:00

2021-11-03 03:45:44+00:00

0:06:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	14.67499999999957
driven_lanedir_consec_median	5.766947748559593
deviation-center-line_median	5.18123781991612

other stats

deviation-center-line_max	5.536793667614606
deviation-center-line_mean	5.18123781991612
deviation-center-line_min	4.825681972217636
deviation-heading_max	9.946884999067857
deviation-heading_mean	8.11789711116863
deviation-heading_median	8.11789711116863
deviation-heading_min	6.288909223269409
distance-from-start_max	1.5294256851691497
distance-from-start_mean	1.4809930952661303
distance-from-start_median	1.4809930952661303
distance-from-start_min	1.4325605053631114
driven_any_max	7.91448020240191
driven_any_mean	7.914455633626082
driven_any_median	7.914455633626082
driven_any_min	7.914431064850254
driven_lanedir_consec_max	6.529996692866063
driven_lanedir_consec_mean	5.766947748559593
driven_lanedir_consec_min	5.003898804253124
driven_lanedir_max	6.529996692866063
driven_lanedir_mean	5.766947748559593
driven_lanedir_median	5.766947748559593
driven_lanedir_min	5.003898804253124
in-drivable-lane_max	20.849999999999383
in-drivable-lane_mean	14.67499999999957
in-drivable-lane_min	8.49999999999976
per-episodes	details {"loop2-000-ego0": {"driven_any": 7.91448020240191, "survival_time": 59.99999999999873, "driven_lanedir": 5.003898804253124, "in-drivable-lane": 20.849999999999383, "deviation-heading": 6.288909223269409, "distance-from-start": 1.4325605053631114, "deviation-center-line": 4.825681972217636, "driven_lanedir_consec": 5.003898804253124}, "loop2-000-ego1": {"driven_any": 7.914431064850254, "survival_time": 59.99999999999873, "driven_lanedir": 6.529996692866063, "in-drivable-lane": 8.49999999999976, "deviation-heading": 9.946884999067857, "distance-from-start": 1.5294256851691497, "deviation-center-line": 5.536793667614606, "driven_lanedir_consec": 6.529996692866063}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105578

sim-3of4

success

yes

2021-11-03 03:35:23+00:00

2021-11-03 03:53:13+00:00

0:17:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.74999999999874
in-drivable-lane_median	16.774999999999363
driven_lanedir_consec_median	4.297112652351611
deviation-center-line_median	2.6476672327902993

other stats

deviation-center-line_max	3.708773811926773
deviation-center-line_mean	2.312798850933812
deviation-center-line_min	0.24708712622787515
deviation-heading_max	15.728868437645758
deviation-heading_mean	9.430097021582412
deviation-heading_median	10.421486705011976
deviation-heading_min	1.1485462386599372
distance-from-start_max	3.0153608760024713
distance-from-start_mean	2.190718677391931
distance-from-start_median	2.1942770595414576
distance-from-start_min	1.3589597144823369
driven_any_max	7.787733247298913
driven_any_mean	6.816608575558116
driven_any_median	7.518679350276708
driven_any_min	4.441342354380138
driven_lanedir_consec_max	4.828787629619661
driven_lanedir_consec_mean	3.54916951919267
driven_lanedir_consec_min	0.7736651424477967
driven_lanedir_max	6.599729085143225
driven_lanedir_mean	4.455661615374826
driven_lanedir_median	5.224626116954141
driven_lanedir_min	0.7736651424477967
in-drivable-lane_max	53.149999999998755
in-drivable-lane_mean	22.92499999999933
in-drivable-lane_min	4.999999999999829
per-episodes	details {"loop-000-ego0": {"driven_any": 7.24983783097297, "survival_time": 59.74999999999874, "driven_lanedir": 4.0311955863027435, "in-drivable-lane": 27.499999999998757, "deviation-heading": 6.507113817125193, "distance-from-start": 1.8747648781705688, "deviation-center-line": 2.3793059100171186, "driven_lanedir_consec": 4.0311955863027435}, "loop-000-ego1": {"driven_any": 7.7875208695804465, "survival_time": 59.74999999999874, "driven_lanedir": 6.418056647605538, "in-drivable-lane": 6.049999999999969, "deviation-heading": 14.33585959289876, "distance-from-start": 3.0153608760024713, "deviation-center-line": 3.708773811926773, "driven_lanedir_consec": 4.828787629619661}, "loop-000-ego2": {"driven_any": 4.441342354380138, "survival_time": 59.74999999999874, "driven_lanedir": 0.7736651424477967, "in-drivable-lane": 53.149999999998755, "deviation-heading": 1.1485462386599372, "distance-from-start": 1.3589597144823369, "deviation-center-line": 0.24708712622787515, "driven_lanedir_consec": 0.7736651424477967}, "loop-000-ego3": {"driven_any": 7.787733247298913, "survival_time": 59.74999999999874, "driven_lanedir": 6.599729085143225, "in-drivable-lane": 4.999999999999829, "deviation-heading": 15.728868437645758, "distance-from-start": 2.5137892409123466, "deviation-center-line": 2.91602855556348, "driven_lanedir_consec": 4.563029718400478}}
simulation-passed	1
survival_time_max	59.74999999999874
survival_time_mean	59.74999999999874
survival_time_min	59.74999999999874

No reset possible

105577

sim-1of4

success

yes

2021-11-03 03:35:20+00:00

2021-11-03 03:54:26+00:00

0:19:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	7.049999999999844
driven_lanedir_consec_median	3.3114207120437986
deviation-center-line_median	4.706626531059749

other stats

deviation-center-line_max	6.321925510620288
deviation-center-line_mean	4.740507116029702
deviation-center-line_min	3.226849891379021
deviation-heading_max	31.395730388585623
deviation-heading_mean	23.31024957400331
deviation-heading_median	22.931145551250314
deviation-heading_min	15.982976804927
distance-from-start_max	3.252628884356754
distance-from-start_mean	2.112509670585775
distance-from-start_median	1.8834723999240328
distance-from-start_min	1.4304649981382815
driven_any_max	7.91372694755043
driven_any_mean	5.95381884113071
driven_any_median	7.037427382407016
driven_any_min	1.8266936521583748
driven_lanedir_consec_max	4.469006573062526
driven_lanedir_consec_mean	3.1319724130129716
driven_lanedir_consec_min	1.4360416549017632
driven_lanedir_max	5.46357612500217
driven_lanedir_mean	4.156483177912806
driven_lanedir_median	4.8631574658736465
driven_lanedir_min	1.4360416549017632
in-drivable-lane_max	19.149999999999206
in-drivable-lane_mean	8.599999999999724
in-drivable-lane_min	1.1500000000000057
per-episodes	details {"zigzag-000-ego0": {"driven_any": 7.037344979978523, "survival_time": 59.99999999999873, "driven_lanedir": 5.46357612500217, "in-drivable-lane": 6.5999999999999455, "deviation-heading": 18.060900628796407, "distance-from-start": 1.4730664625915848, "deviation-center-line": 4.012741155813447, "driven_lanedir_consec": 3.317184339204809}, "zigzag-000-ego1": {"driven_any": 7.91372694755043, "survival_time": 59.99999999999873, "driven_lanedir": 4.606623953539222, "in-drivable-lane": 19.149999999999206, "deviation-heading": 15.982976804927, "distance-from-start": 3.252628884356754, "deviation-center-line": 3.226849891379021, "driven_lanedir_consec": 4.469006573062526}, "zigzag-000-ego2": {"driven_any": 1.8266936521583748, "survival_time": 59.99999999999873, "driven_lanedir": 1.4360416549017632, "in-drivable-lane": 1.1500000000000057, "deviation-heading": 31.395730388585623, "distance-from-start": 1.4304649981382815, "deviation-center-line": 6.321925510620288, "driven_lanedir_consec": 1.4360416549017632}, "zigzag-000-ego3": {"driven_any": 7.0375097848355095, "survival_time": 59.99999999999873, "driven_lanedir": 5.119690978208071, "in-drivable-lane": 7.499999999999744, "deviation-heading": 27.80139047370422, "distance-from-start": 2.2938783372564804, "deviation-center-line": 5.400511906306052, "driven_lanedir_consec": 3.3056570848827884}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105576

sim-2of4

success

yes

2021-11-03 03:35:03+00:00

2021-11-03 03:55:20+00:00

0:20:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	35.949999999998575
driven_lanedir_consec_median	2.363468618720462
deviation-center-line_median	1.955755186170988

other stats

deviation-center-line_max	4.980344439272086
deviation-center-line_mean	2.3168489175730405
deviation-center-line_min	0.3755408586781005
deviation-heading_max	24.070272154141524
deviation-heading_mean	11.035478910638265
deviation-heading_median	8.994751469643791
deviation-heading_min	2.082140549123942
distance-from-start_max	3.4897376375524884
distance-from-start_mean	2.28172844902677
distance-from-start_median	2.4071947177111666
distance-from-start_min	0.8227867231322605
driven_any_max	7.913683175172379
driven_any_mean	5.878733301956614
driven_any_median	5.709222659304173
driven_any_min	4.182804714045733
driven_lanedir_consec_max	4.744748273838719
driven_lanedir_consec_mean	2.5393590713072185
driven_lanedir_consec_min	0.6857507739492299
driven_lanedir_max	5.965842343841413
driven_lanedir_mean	3.0225303128193683
driven_lanedir_median	2.719264066743415
driven_lanedir_min	0.6857507739492299
in-drivable-lane_max	53.59999999999874
in-drivable-lane_mean	32.99999999999894
in-drivable-lane_min	6.499999999999888
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.913683175172379, "survival_time": 59.99999999999873, "driven_lanedir": 5.965842343841413, "in-drivable-lane": 6.499999999999888, "deviation-heading": 24.070272154141524, "distance-from-start": 3.4897376375524884, "deviation-center-line": 4.980344439272086, "driven_lanedir_consec": 4.744748273838719}, "autolab-000-ego1": {"driven_any": 4.182804714045733, "survival_time": 59.99999999999873, "driven_lanedir": 2.061970927835565, "in-drivable-lane": 40.94999999999855, "deviation-heading": 8.506982109605977, "distance-from-start": 0.8227867231322605, "deviation-center-line": 1.893961693290635, "driven_lanedir_consec": 1.3503800317896593}, "autolab-000-ego2": {"driven_any": 5.8621813568731245, "survival_time": 59.99999999999873, "driven_lanedir": 3.376557205651265, "in-drivable-lane": 30.949999999998596, "deviation-heading": 9.482520829681608, "distance-from-start": 2.732412465340509, "deviation-center-line": 2.017548679051341, "driven_lanedir_consec": 3.376557205651265}, "autolab-000-ego3": {"driven_any": 5.556263961735222, "survival_time": 59.99999999999873, "driven_lanedir": 0.6857507739492299, "in-drivable-lane": 53.59999999999874, "deviation-heading": 2.082140549123942, "distance-from-start": 2.0819769700818243, "deviation-center-line": 0.3755408586781005, "driven_lanedir_consec": 0.6857507739492299}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible