Submission 13691

Submission

13691

Competing

yes

Challenge

aido-LF-sim-validation

User

Caleb BG 🇺🇸

Date submitted

2021-02-25 02:08:25+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 116163 sim-1of4: 116155 sim-2of4: 116159 sim-3of4: 116171

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

116171

Click the images to see detailed statistics about the episode.

loop-000

116163

Click the images to see detailed statistics about the episode.

loop2-000

116159

Click the images to see detailed statistics about the episode.

autolab-000

116155

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

116171

sim-3of4

success

yes

2021-11-06 15:44:52+00:00

2021-11-06 15:47:39+00:00

0:02:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.864535797615141
survival_time_median	34.30000000000019
deviation-center-line_median	1.3606070875353249
in-drivable-lane_median	9.40000000000007

other stats

deviation-center-line_max	1.3606070875353249
deviation-center-line_mean	1.3606070875353249
deviation-center-line_min	1.3606070875353249
deviation-heading_max	6.513387760280761
deviation-heading_mean	6.513387760280761
deviation-heading_median	6.513387760280761
deviation-heading_min	6.513387760280761
distance-from-start_max	2.4113039026541925
distance-from-start_mean	2.4113039026541925
distance-from-start_median	2.4113039026541925
distance-from-start_min	2.4113039026541925
driven_any_max	4.409259000633439
driven_any_mean	4.409259000633439
driven_any_median	4.409259000633439
driven_any_min	4.409259000633439
driven_lanedir_consec_max	2.864535797615141
driven_lanedir_consec_mean	2.864535797615141
driven_lanedir_consec_min	2.864535797615141
driven_lanedir_max	2.9018992099914875
driven_lanedir_mean	2.9018992099914875
driven_lanedir_median	2.9018992099914875
driven_lanedir_min	2.9018992099914875
in-drivable-lane_max	9.40000000000007
in-drivable-lane_mean	9.40000000000007
in-drivable-lane_min	9.40000000000007
per-episodes	details {"loop-000-ego0": {"driven_any": 4.409259000633439, "survival_time": 34.30000000000019, "driven_lanedir": 2.9018992099914875, "in-drivable-lane": 9.40000000000007, "deviation-heading": 6.513387760280761, "distance-from-start": 2.4113039026541925, "deviation-center-line": 1.3606070875353249, "driven_lanedir_consec": 2.864535797615141}}
simulation-passed	1
survival_time_max	34.30000000000019
survival_time_mean	34.30000000000019
survival_time_min	34.30000000000019

No reset possible

116163

sim-0of4

success

yes

2021-11-06 15:42:02+00:00

2021-11-06 15:45:58+00:00

0:03:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.225690514434439
survival_time_median	50.899999999999245
deviation-center-line_median	3.5126542903510862
in-drivable-lane_median	9.14999999999968

other stats

deviation-center-line_max	3.5126542903510862
deviation-center-line_mean	3.5126542903510862
deviation-center-line_min	3.5126542903510862
deviation-heading_max	8.907285148098161
deviation-heading_mean	8.907285148098161
deviation-heading_median	8.907285148098161
deviation-heading_min	8.907285148098161
distance-from-start_max	0.9985819900023648
distance-from-start_mean	0.9985819900023648
distance-from-start_median	0.9985819900023648
distance-from-start_min	0.9985819900023648
driven_any_max	6.613081132631151
driven_any_mean	6.613081132631151
driven_any_median	6.613081132631151
driven_any_min	6.613081132631151
driven_lanedir_consec_max	4.225690514434439
driven_lanedir_consec_mean	4.225690514434439
driven_lanedir_consec_min	4.225690514434439
driven_lanedir_max	5.245801270199082
driven_lanedir_mean	5.245801270199082
driven_lanedir_median	5.245801270199082
driven_lanedir_min	5.245801270199082
in-drivable-lane_max	9.14999999999968
in-drivable-lane_mean	9.14999999999968
in-drivable-lane_min	9.14999999999968
per-episodes	details {"loop2-000-ego0": {"driven_any": 6.613081132631151, "survival_time": 50.899999999999245, "driven_lanedir": 5.245801270199082, "in-drivable-lane": 9.14999999999968, "deviation-heading": 8.907285148098161, "distance-from-start": 0.9985819900023648, "deviation-center-line": 3.5126542903510862, "driven_lanedir_consec": 4.225690514434439}}
simulation-passed	1
survival_time_max	50.899999999999245
survival_time_mean	50.899999999999245
survival_time_min	50.899999999999245

No reset possible

116160

sim-0of4

success

yes

2021-11-06 15:40:30+00:00

2021-11-06 15:41:44+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

116159

sim-2of4

success

yes

2021-11-06 15:40:29+00:00

2021-11-06 15:45:08+00:00

0:04:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	7.054417039616953
survival_time_median	59.99999999999873
deviation-center-line_median	4.458149944358229
in-drivable-lane_median	5.149999999999869

other stats

deviation-center-line_max	4.458149944358229
deviation-center-line_mean	4.458149944358229
deviation-center-line_min	4.458149944358229
deviation-heading_max	7.879836103922473
deviation-heading_mean	7.879836103922473
deviation-heading_median	7.879836103922473
deviation-heading_min	7.879836103922473
distance-from-start_max	3.1540676478884033
distance-from-start_mean	3.1540676478884033
distance-from-start_median	3.1540676478884033
distance-from-start_min	3.1540676478884033
driven_any_max	7.91453678413064
driven_any_mean	7.91453678413064
driven_any_median	7.91453678413064
driven_any_min	7.91453678413064
driven_lanedir_consec_max	7.054417039616953
driven_lanedir_consec_mean	7.054417039616953
driven_lanedir_consec_min	7.054417039616953
driven_lanedir_max	7.054417039616953
driven_lanedir_mean	7.054417039616953
driven_lanedir_median	7.054417039616953
driven_lanedir_min	7.054417039616953
in-drivable-lane_max	5.149999999999869
in-drivable-lane_mean	5.149999999999869
in-drivable-lane_min	5.149999999999869
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.91453678413064, "survival_time": 59.99999999999873, "driven_lanedir": 7.054417039616953, "in-drivable-lane": 5.149999999999869, "deviation-heading": 7.879836103922473, "distance-from-start": 3.1540676478884033, "deviation-center-line": 4.458149944358229, "driven_lanedir_consec": 7.054417039616953}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

116157

sim-3of4

success

yes

2021-11-06 15:39:52+00:00

2021-11-06 15:44:20+00:00

0:04:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

116155

sim-1of4

success

yes

2021-11-06 15:39:48+00:00

2021-11-06 15:45:19+00:00

0:05:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.5111106221715818
survival_time_median	59.99999999999873
deviation-center-line_median	3.979742970388912
in-drivable-lane_median	9.050000000000008

other stats

deviation-center-line_max	3.979742970388912
deviation-center-line_mean	3.979742970388912
deviation-center-line_min	3.979742970388912
deviation-heading_max	12.658061389468894
deviation-heading_mean	12.658061389468894
deviation-heading_median	12.658061389468894
deviation-heading_min	12.658061389468894
distance-from-start_max	2.4580826254845753
distance-from-start_mean	2.4580826254845753
distance-from-start_median	2.4580826254845753
distance-from-start_min	2.4580826254845753
driven_any_max	7.914348779068797
driven_any_mean	7.914348779068797
driven_any_median	7.914348779068797
driven_any_min	7.914348779068797
driven_lanedir_consec_max	3.5111106221715818
driven_lanedir_consec_mean	3.5111106221715818
driven_lanedir_consec_min	3.5111106221715818
driven_lanedir_max	6.319631460121448
driven_lanedir_mean	6.319631460121448
driven_lanedir_median	6.319631460121448
driven_lanedir_min	6.319631460121448
in-drivable-lane_max	9.050000000000008
in-drivable-lane_mean	9.050000000000008
in-drivable-lane_min	9.050000000000008
per-episodes	details {"zigzag-000-ego0": {"driven_any": 7.914348779068797, "survival_time": 59.99999999999873, "driven_lanedir": 6.319631460121448, "in-drivable-lane": 9.050000000000008, "deviation-heading": 12.658061389468894, "distance-from-start": 2.4580826254845753, "deviation-center-line": 3.979742970388912, "driven_lanedir_consec": 3.5111106221715818}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

62302

347

success

yes

2021-03-20 23:16:13+00:00

2021-03-21 00:03:50+00:00

0:47:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible