Submission 15666

Submission

15666

Competing

yes

Challenge

aido-LF-sim-validation

User

Keyan Pishdadian

Date submitted

2021-05-28 17:36:20+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 110816 sim-1of4: 110813 sim-2of4: 110819 sim-3of4: 110818

User label

modelv0-behavior-cloning-200epochs

Admin priority

Blessing

n/a

User priority

110819

Click the images to see detailed statistics about the episode.

loop-000

110818

Click the images to see detailed statistics about the episode.

zigzag-000

110816

Click the images to see detailed statistics about the episode.

loop2-000

110813

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

110819

sim-2of4

success

yes

2021-11-05 08:45:49+00:00

2021-11-05 08:48:08+00:00

0:02:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.55016438233433
survival_time_median	27.550000000000257
deviation-center-line_median	0.7493761589000253
in-drivable-lane_median	14.200000000000202

other stats

deviation-center-line_max	0.7493761589000253
deviation-center-line_mean	0.7493761589000253
deviation-center-line_min	0.7493761589000253
deviation-heading_max	3.2580315827469435
deviation-heading_mean	3.2580315827469435
deviation-heading_median	3.2580315827469435
deviation-heading_min	3.2580315827469435
distance-from-start_max	2.7354016923252207
distance-from-start_mean	2.7354016923252207
distance-from-start_median	2.7354016923252207
distance-from-start_min	2.7354016923252207
driven_any_max	6.936180666166259
driven_any_mean	6.936180666166259
driven_any_median	6.936180666166259
driven_any_min	6.936180666166259
driven_lanedir_consec_max	3.55016438233433
driven_lanedir_consec_mean	3.55016438233433
driven_lanedir_consec_min	3.55016438233433
driven_lanedir_max	3.55016438233433
driven_lanedir_mean	3.55016438233433
driven_lanedir_median	3.55016438233433
driven_lanedir_min	3.55016438233433
in-drivable-lane_max	14.200000000000202
in-drivable-lane_mean	14.200000000000202
in-drivable-lane_min	14.200000000000202
per-episodes	details {"loop-000-ego0": {"driven_any": 6.936180666166259, "survival_time": 27.550000000000257, "driven_lanedir": 3.55016438233433, "in-drivable-lane": 14.200000000000202, "deviation-heading": 3.2580315827469435, "distance-from-start": 2.7354016923252207, "deviation-center-line": 0.7493761589000253, "driven_lanedir_consec": 3.55016438233433}}
simulation-passed	1
survival_time_max	27.550000000000257
survival_time_mean	27.550000000000257
survival_time_min	27.550000000000257

No reset possible

110818

sim-3of4

success

yes

2021-11-05 08:45:47+00:00

2021-11-05 08:47:12+00:00

0:01:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5365970426704472
survival_time_median	6.299999999999986
deviation-center-line_median	0.24389386753570963
in-drivable-lane_median	3.749999999999991

other stats

deviation-center-line_max	0.24389386753570963
deviation-center-line_mean	0.24389386753570963
deviation-center-line_min	0.24389386753570963
deviation-heading_max	1.4013102130064
deviation-heading_mean	1.4013102130064
deviation-heading_median	1.4013102130064
deviation-heading_min	1.4013102130064
distance-from-start_max	1.256962323587913
distance-from-start_mean	1.256962323587913
distance-from-start_median	1.256962323587913
distance-from-start_min	1.256962323587913
driven_any_max	1.5010698110551148
driven_any_mean	1.5010698110551148
driven_any_median	1.5010698110551148
driven_any_min	1.5010698110551148
driven_lanedir_consec_max	0.5365970426704472
driven_lanedir_consec_mean	0.5365970426704472
driven_lanedir_consec_min	0.5365970426704472
driven_lanedir_max	0.5365970426704472
driven_lanedir_mean	0.5365970426704472
driven_lanedir_median	0.5365970426704472
driven_lanedir_min	0.5365970426704472
in-drivable-lane_max	3.749999999999991
in-drivable-lane_mean	3.749999999999991
in-drivable-lane_min	3.749999999999991
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.5010698110551148, "survival_time": 6.299999999999986, "driven_lanedir": 0.5365970426704472, "in-drivable-lane": 3.749999999999991, "deviation-heading": 1.4013102130064, "distance-from-start": 1.256962323587913, "deviation-center-line": 0.24389386753570963, "driven_lanedir_consec": 0.5365970426704472}}
simulation-passed	1
survival_time_max	6.299999999999986
survival_time_mean	6.299999999999986
survival_time_min	6.299999999999986

No reset possible

110816

sim-0of4

success

yes

2021-11-05 08:45:05+00:00

2021-11-05 08:46:36+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6291979173629605
survival_time_median	11.950000000000037
deviation-center-line_median	0.2566971522939572
in-drivable-lane_median	9.050000000000036

other stats

deviation-center-line_max	0.2566971522939572
deviation-center-line_mean	0.2566971522939572
deviation-center-line_min	0.2566971522939572
deviation-heading_max	1.364139425752563
deviation-heading_mean	1.364139425752563
deviation-heading_median	1.364139425752563
deviation-heading_min	1.364139425752563
distance-from-start_max	1.9186573763270571
distance-from-start_mean	1.9186573763270571
distance-from-start_median	1.9186573763270571
distance-from-start_min	1.9186573763270571
driven_any_max	2.547276063503585
driven_any_mean	2.547276063503585
driven_any_median	2.547276063503585
driven_any_min	2.547276063503585
driven_lanedir_consec_max	0.6291979173629605
driven_lanedir_consec_mean	0.6291979173629605
driven_lanedir_consec_min	0.6291979173629605
driven_lanedir_max	0.6291979173629605
driven_lanedir_mean	0.6291979173629605
driven_lanedir_median	0.6291979173629605
driven_lanedir_min	0.6291979173629605
in-drivable-lane_max	9.050000000000036
in-drivable-lane_mean	9.050000000000036
in-drivable-lane_min	9.050000000000036
per-episodes	details {"loop2-000-ego0": {"driven_any": 2.547276063503585, "survival_time": 11.950000000000037, "driven_lanedir": 0.6291979173629605, "in-drivable-lane": 9.050000000000036, "deviation-heading": 1.364139425752563, "distance-from-start": 1.9186573763270571, "deviation-center-line": 0.2566971522939572, "driven_lanedir_consec": 0.6291979173629605}}
simulation-passed	1
survival_time_max	11.950000000000037
survival_time_mean	11.950000000000037
survival_time_min	11.950000000000037

No reset possible

110814

sim-3of4

success

yes

2021-11-05 08:43:14+00:00

2021-11-05 08:45:02+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110813

sim-1of4

success

yes

2021-11-05 08:43:13+00:00

2021-11-05 08:46:20+00:00

0:03:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	9.360016475845516
survival_time_median	37.65
deviation-center-line_median	2.1282539612433635
in-drivable-lane_median	2.9999999999999787

other stats

deviation-center-line_max	2.1282539612433635
deviation-center-line_mean	2.1282539612433635
deviation-center-line_min	2.1282539612433635
deviation-heading_max	6.448160295315574
deviation-heading_mean	6.448160295315574
deviation-heading_median	6.448160295315574
deviation-heading_min	6.448160295315574
distance-from-start_max	3.237761952123862
distance-from-start_mean	3.237761952123862
distance-from-start_median	3.237761952123862
distance-from-start_min	3.237761952123862
driven_any_max	10.272977969946842
driven_any_mean	10.272977969946842
driven_any_median	10.272977969946842
driven_any_min	10.272977969946842
driven_lanedir_consec_max	9.360016475845516
driven_lanedir_consec_mean	9.360016475845516
driven_lanedir_consec_min	9.360016475845516
driven_lanedir_max	9.360016475845516
driven_lanedir_mean	9.360016475845516
driven_lanedir_median	9.360016475845516
driven_lanedir_min	9.360016475845516
in-drivable-lane_max	2.9999999999999787
in-drivable-lane_mean	2.9999999999999787
in-drivable-lane_min	2.9999999999999787
per-episodes	details {"autolab-000-ego0": {"driven_any": 10.272977969946842, "survival_time": 37.65, "driven_lanedir": 9.360016475845516, "in-drivable-lane": 2.9999999999999787, "deviation-heading": 6.448160295315574, "distance-from-start": 3.237761952123862, "deviation-center-line": 2.1282539612433635, "driven_lanedir_consec": 9.360016475845516}}
simulation-passed	1
survival_time_max	37.65
survival_time_mean	37.65
survival_time_min	37.65

No reset possible

110810

sim-2of4

success

yes

2021-11-05 08:42:51+00:00

2021-11-05 08:45:17+00:00

0:02:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110809

sim-0of4

success

yes

2021-11-05 08:42:48+00:00

2021-11-05 08:44:11+00:00

0:01:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110805

sim-3of4

success

yes

2021-11-05 08:41:15+00:00

2021-11-05 08:42:41+00:00

0:01:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110804

sim-0of4

success

yes

2021-11-05 08:40:20+00:00

2021-11-05 08:41:58+00:00

0:01:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110803

sim-1of4

success

yes

2021-11-05 08:39:19+00:00

2021-11-05 08:42:30+00:00

0:03:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110799

sim-2of4

success

yes

2021-11-05 08:38:51+00:00

2021-11-05 08:42:20+00:00

0:03:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110790

sim-2of4

success

yes

2021-11-05 08:36:07+00:00

2021-11-05 08:38:18+00:00

0:02:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible