Submission 15598

Submission

15598

Competing

yes

Challenge

aido-LF-sim-validation

User

Liam Paull 🇨🇦

Date submitted

2021-05-25 11:39:52+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 110954 sim-1of4: 110973 sim-2of4: 110971 sim-3of4: 110970

User label

baseline-duckietown-ml

Admin priority

Blessing

n/a

User priority

110973

Click the images to see detailed statistics about the episode.

autolab-000

110971

Click the images to see detailed statistics about the episode.

loop-000

110970

Click the images to see detailed statistics about the episode.

zigzag-000

110954

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

110973

sim-1of4

success

yes

2021-11-05 09:58:46+00:00

2021-11-05 10:03:49+00:00

0:05:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.7593910208313055
survival_time_median	59.99999999999873
deviation-center-line_median	3.642496088815948
in-drivable-lane_median	14.699999999999807

other stats

deviation-center-line_max	3.642496088815948
deviation-center-line_mean	3.642496088815948
deviation-center-line_min	3.642496088815948
deviation-heading_max	7.370919871305579
deviation-heading_mean	7.370919871305579
deviation-heading_median	7.370919871305579
deviation-heading_min	7.370919871305579
distance-from-start_max	3.1266573608498405
distance-from-start_mean	3.1266573608498405
distance-from-start_median	3.1266573608498405
distance-from-start_min	3.1266573608498405
driven_any_max	7.907872090082186
driven_any_mean	7.907872090082186
driven_any_median	7.907872090082186
driven_any_min	7.907872090082186
driven_lanedir_consec_max	5.7593910208313055
driven_lanedir_consec_mean	5.7593910208313055
driven_lanedir_consec_min	5.7593910208313055
driven_lanedir_max	5.7593910208313055
driven_lanedir_mean	5.7593910208313055
driven_lanedir_median	5.7593910208313055
driven_lanedir_min	5.7593910208313055
in-drivable-lane_max	14.699999999999807
in-drivable-lane_mean	14.699999999999807
in-drivable-lane_min	14.699999999999807
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.907872090082186, "survival_time": 59.99999999999873, "driven_lanedir": 5.7593910208313055, "in-drivable-lane": 14.699999999999807, "deviation-heading": 7.370919871305579, "distance-from-start": 3.1266573608498405, "deviation-center-line": 3.642496088815948, "driven_lanedir_consec": 5.7593910208313055}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

110971

sim-2of4

success

yes

2021-11-05 09:57:19+00:00

2021-11-05 10:02:04+00:00

0:04:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	7.403402138632572
survival_time_median	59.99999999999873
deviation-center-line_median	2.3485962501948805
in-drivable-lane_median	2.6999999999998465

other stats

deviation-center-line_max	2.3485962501948805
deviation-center-line_mean	2.3485962501948805
deviation-center-line_min	2.3485962501948805
deviation-heading_max	7.516323718729814
deviation-heading_mean	7.516323718729814
deviation-heading_median	7.516323718729814
deviation-heading_min	7.516323718729814
distance-from-start_max	2.470431681281696
distance-from-start_mean	2.470431681281696
distance-from-start_median	2.470431681281696
distance-from-start_min	2.470431681281696
driven_any_max	7.90788953614484
driven_any_mean	7.90788953614484
driven_any_median	7.90788953614484
driven_any_min	7.90788953614484
driven_lanedir_consec_max	7.403402138632572
driven_lanedir_consec_mean	7.403402138632572
driven_lanedir_consec_min	7.403402138632572
driven_lanedir_max	7.403402138632572
driven_lanedir_mean	7.403402138632572
driven_lanedir_median	7.403402138632572
driven_lanedir_min	7.403402138632572
in-drivable-lane_max	2.6999999999998465
in-drivable-lane_mean	2.6999999999998465
in-drivable-lane_min	2.6999999999998465
per-episodes	details {"loop-000-ego0": {"driven_any": 7.90788953614484, "survival_time": 59.99999999999873, "driven_lanedir": 7.403402138632572, "in-drivable-lane": 2.6999999999998465, "deviation-heading": 7.516323718729814, "distance-from-start": 2.470431681281696, "deviation-center-line": 2.3485962501948805, "driven_lanedir_consec": 7.403402138632572}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

110970

sim-3of4

success

yes

2021-11-05 09:57:18+00:00

2021-11-05 10:02:01+00:00

0:04:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.6017417553703126e-06
survival_time_median	59.99999999999873
deviation-center-line_median	0.8949077950231444
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.8949077950231444
deviation-center-line_mean	0.8949077950231444
deviation-center-line_min	0.8949077950231444
deviation-heading_max	32.24912799874442
deviation-heading_mean	32.24912799874442
deviation-heading_median	32.24912799874442
deviation-heading_min	32.24912799874442
distance-from-start_max	4.440892098500626e-16
distance-from-start_mean	4.440892098500626e-16
distance-from-start_median	4.440892098500626e-16
distance-from-start_min	4.440892098500626e-16
driven_any_max	5.329070518200751e-13
driven_any_mean	5.329070518200751e-13
driven_any_median	5.329070518200751e-13
driven_any_min	5.329070518200751e-13
driven_lanedir_consec_max	2.6017417553703126e-06
driven_lanedir_consec_mean	2.6017417553703126e-06
driven_lanedir_consec_min	2.6017417553703126e-06
driven_lanedir_max	2.6017417553703126e-06
driven_lanedir_mean	2.6017417553703126e-06
driven_lanedir_median	2.6017417553703126e-06
driven_lanedir_min	2.6017417553703126e-06
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

110958

sim-1of4

success

yes

2021-11-05 09:53:03+00:00

2021-11-05 09:58:29+00:00

0:05:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110957

sim-3of4

success

yes

2021-11-05 09:52:34+00:00

2021-11-05 09:56:43+00:00

0:04:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110956

sim-2of4

success

yes

2021-11-05 09:52:04+00:00

2021-11-05 09:56:44+00:00

0:04:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110954

sim-0of4

success

yes

2021-11-05 09:51:58+00:00

2021-11-05 09:56:44+00:00

0:04:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.640900945896023
survival_time_median	59.99999999999873
deviation-center-line_median	3.373060907074549
in-drivable-lane_median	29.49999999999889

other stats

deviation-center-line_max	3.373060907074549
deviation-center-line_mean	3.373060907074549
deviation-center-line_min	3.373060907074549
deviation-heading_max	7.328185769798751
deviation-heading_mean	7.328185769798751
deviation-heading_median	7.328185769798751
deviation-heading_min	7.328185769798751
distance-from-start_max	1.011699671416734
distance-from-start_mean	1.011699671416734
distance-from-start_median	1.011699671416734
distance-from-start_min	1.011699671416734
driven_any_max	7.907487192810827
driven_any_mean	7.907487192810827
driven_any_median	7.907487192810827
driven_any_min	7.907487192810827
driven_lanedir_consec_max	3.640900945896023
driven_lanedir_consec_mean	3.640900945896023
driven_lanedir_consec_min	3.640900945896023
driven_lanedir_max	3.77487559706098
driven_lanedir_mean	3.77487559706098
driven_lanedir_median	3.77487559706098
driven_lanedir_min	3.77487559706098
in-drivable-lane_max	29.49999999999889
in-drivable-lane_mean	29.49999999999889
in-drivable-lane_min	29.49999999999889
per-episodes	details {"loop2-000-ego0": {"driven_any": 7.907487192810827, "survival_time": 59.99999999999873, "driven_lanedir": 3.77487559706098, "in-drivable-lane": 29.49999999999889, "deviation-heading": 7.328185769798751, "distance-from-start": 1.011699671416734, "deviation-center-line": 3.373060907074549, "driven_lanedir_consec": 3.640900945896023}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

91310

sim-0of4

success

2021-10-22 12:42:53+00:00

2021-10-22 12:47:42+00:00

0:04:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

91307

sim-2of4

success

2021-10-22 12:40:58+00:00

2021-10-22 12:46:55+00:00

0:05:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

91306

sim-0of4

success

2021-10-22 12:39:20+00:00

2021-10-22 12:42:26+00:00

0:03:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

91305

sim-3of4

success

2021-10-22 12:38:30+00:00

2021-10-22 12:41:25+00:00

0:02:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

91303

sim-1of4

success

2021-10-22 12:36:26+00:00

2021-10-22 12:40:11+00:00

0:03:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77398

sim-1of4

success

2021-05-25 11:41:54+00:00

2021-05-25 11:47:07+00:00

0:05:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77397

sim-0of4

success

2021-05-25 11:41:51+00:00

2021-05-25 11:51:05+00:00

0:09:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77396

sim-2of4

success

2021-05-25 11:41:50+00:00

2021-05-25 11:51:25+00:00

0:09:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77395

sim-3of4

success

2021-05-25 11:41:49+00:00

2021-05-25 11:49:54+00:00

0:08:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible