Submission 15654

Submission

15654

Competing

yes

Challenge

aido-LF-sim-validation

User

Keyan Pishdadian

Date submitted

2021-05-26 23:34:09+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 110887 sim-1of4: 110886 sim-2of4: 110877 sim-3of4: 110875

User label

baseline-behavior-cloning

Admin priority

Blessing

n/a

User priority

110887

Click the images to see detailed statistics about the episode.

loop2-000

110886

Click the images to see detailed statistics about the episode.

autolab-000

110877

Click the images to see detailed statistics about the episode.

loop-000

110875

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

110887

sim-0of4

success

yes

2021-11-05 09:12:52+00:00

2021-11-05 09:17:34+00:00

0:04:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	11.618786823996064
survival_time_median	59.99999999999873
deviation-center-line_median	4.012084512086429
in-drivable-lane_median	9.0999999999998

other stats

deviation-center-line_max	4.012084512086429
deviation-center-line_mean	4.012084512086429
deviation-center-line_min	4.012084512086429
deviation-heading_max	15.540405039912896
deviation-heading_mean	15.540405039912896
deviation-heading_median	15.540405039912896
deviation-heading_min	15.540405039912896
distance-from-start_max	0.9509943532782232
distance-from-start_mean	0.9509943532782232
distance-from-start_median	0.9509943532782232
distance-from-start_min	0.9509943532782232
driven_any_max	14.589800947399985
driven_any_mean	14.589800947399985
driven_any_median	14.589800947399985
driven_any_min	14.589800947399985
driven_lanedir_consec_max	11.618786823996064
driven_lanedir_consec_mean	11.618786823996064
driven_lanedir_consec_min	11.618786823996064
driven_lanedir_max	11.618786823996064
driven_lanedir_mean	11.618786823996064
driven_lanedir_median	11.618786823996064
driven_lanedir_min	11.618786823996064
in-drivable-lane_max	9.0999999999998
in-drivable-lane_mean	9.0999999999998
in-drivable-lane_min	9.0999999999998
per-episodes	details {"loop2-000-ego0": {"driven_any": 14.589800947399985, "survival_time": 59.99999999999873, "driven_lanedir": 11.618786823996064, "in-drivable-lane": 9.0999999999998, "deviation-heading": 15.540405039912896, "distance-from-start": 0.9509943532782232, "deviation-center-line": 4.012084512086429, "driven_lanedir_consec": 11.618786823996064}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

110886

sim-1of4

success

yes

2021-11-05 09:12:50+00:00

2021-11-05 09:17:07+00:00

0:04:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.961494208918667
survival_time_median	49.299999999999336
deviation-center-line_median	2.4309749829899814
in-drivable-lane_median	1.7000000000000242

other stats

deviation-center-line_max	2.4309749829899814
deviation-center-line_mean	2.4309749829899814
deviation-center-line_min	2.4309749829899814
deviation-heading_max	9.600659305291924
deviation-heading_mean	9.600659305291924
deviation-heading_median	9.600659305291924
deviation-heading_min	9.600659305291924
distance-from-start_max	3.2215245855151333
distance-from-start_mean	3.2215245855151333
distance-from-start_median	3.2215245855151333
distance-from-start_min	3.2215245855151333
driven_any_max	11.80224077656182
driven_any_mean	11.80224077656182
driven_any_median	11.80224077656182
driven_any_min	11.80224077656182
driven_lanedir_consec_max	10.961494208918667
driven_lanedir_consec_mean	10.961494208918667
driven_lanedir_consec_min	10.961494208918667
driven_lanedir_max	10.961494208918667
driven_lanedir_mean	10.961494208918667
driven_lanedir_median	10.961494208918667
driven_lanedir_min	10.961494208918667
in-drivable-lane_max	1.7000000000000242
in-drivable-lane_mean	1.7000000000000242
in-drivable-lane_min	1.7000000000000242
per-episodes	details {"autolab-000-ego0": {"driven_any": 11.80224077656182, "survival_time": 49.299999999999336, "driven_lanedir": 10.961494208918667, "in-drivable-lane": 1.7000000000000242, "deviation-heading": 9.600659305291924, "distance-from-start": 3.2215245855151333, "deviation-center-line": 2.4309749829899814, "driven_lanedir_consec": 10.961494208918667}}
simulation-passed	1
survival_time_max	49.299999999999336
survival_time_mean	49.299999999999336
survival_time_min	49.299999999999336

No reset possible

110877

sim-2of4

success

yes

2021-11-05 09:07:46+00:00

2021-11-05 09:12:41+00:00

0:04:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	12.014761746511194
survival_time_median	59.99999999999873
deviation-center-line_median	2.4763495845193932
in-drivable-lane_median	7.799999999999844

other stats

deviation-center-line_max	2.4763495845193932
deviation-center-line_mean	2.4763495845193932
deviation-center-line_min	2.4763495845193932
deviation-heading_max	12.58662872441593
deviation-heading_mean	12.58662872441593
deviation-heading_median	12.58662872441593
deviation-heading_min	12.58662872441593
distance-from-start_max	2.5456325445146417
distance-from-start_mean	2.5456325445146417
distance-from-start_median	2.5456325445146417
distance-from-start_min	2.5456325445146417
driven_any_max	14.590058127260388
driven_any_mean	14.590058127260388
driven_any_median	14.590058127260388
driven_any_min	14.590058127260388
driven_lanedir_consec_max	12.014761746511194
driven_lanedir_consec_mean	12.014761746511194
driven_lanedir_consec_min	12.014761746511194
driven_lanedir_max	12.014761746511194
driven_lanedir_mean	12.014761746511194
driven_lanedir_median	12.014761746511194
driven_lanedir_min	12.014761746511194
in-drivable-lane_max	7.799999999999844
in-drivable-lane_mean	7.799999999999844
in-drivable-lane_min	7.799999999999844
per-episodes	details {"loop-000-ego0": {"driven_any": 14.590058127260388, "survival_time": 59.99999999999873, "driven_lanedir": 12.014761746511194, "in-drivable-lane": 7.799999999999844, "deviation-heading": 12.58662872441593, "distance-from-start": 2.5456325445146417, "deviation-center-line": 2.4763495845193932, "driven_lanedir_consec": 12.014761746511194}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

110875

sim-3of4

success

yes

2021-11-05 09:06:43+00:00

2021-11-05 09:12:20+00:00

0:05:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	13.024441740353598
survival_time_median	59.99999999999873
deviation-center-line_median	3.127731943075662
in-drivable-lane_median	3.949999999999922

other stats

deviation-center-line_max	3.127731943075662
deviation-center-line_mean	3.127731943075662
deviation-center-line_min	3.127731943075662
deviation-heading_max	12.792625623218973
deviation-heading_mean	12.792625623218973
deviation-heading_median	12.792625623218973
deviation-heading_min	12.792625623218973
distance-from-start_max	4.433131128872442
distance-from-start_mean	4.433131128872442
distance-from-start_median	4.433131128872442
distance-from-start_min	4.433131128872442
driven_any_max	14.590104264814348
driven_any_mean	14.590104264814348
driven_any_median	14.590104264814348
driven_any_min	14.590104264814348
driven_lanedir_consec_max	13.024441740353598
driven_lanedir_consec_mean	13.024441740353598
driven_lanedir_consec_min	13.024441740353598
driven_lanedir_max	13.024441740353598
driven_lanedir_mean	13.024441740353598
driven_lanedir_median	13.024441740353598
driven_lanedir_min	13.024441740353598
in-drivable-lane_max	3.949999999999922
in-drivable-lane_mean	3.949999999999922
in-drivable-lane_min	3.949999999999922
per-episodes	details {"zigzag-000-ego0": {"driven_any": 14.590104264814348, "survival_time": 59.99999999999873, "driven_lanedir": 13.024441740353598, "in-drivable-lane": 3.949999999999922, "deviation-heading": 12.792625623218973, "distance-from-start": 4.433131128872442, "deviation-center-line": 3.127731943075662, "driven_lanedir_consec": 13.024441740353598}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible