Submission 15655

Submission

15655

Competing

yes

Challenge

aido-LF-sim-validation

User

Keyan Pishdadian

Date submitted

2021-05-26 23:34:18+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 110882 sim-1of4: 110880 sim-2of4: 110865 sim-3of4: 110881

User label

modelv1-behavior-cloning

Admin priority

Blessing

n/a

User priority

110882

Click the images to see detailed statistics about the episode.

loop2-000

110881

Click the images to see detailed statistics about the episode.

zigzag-000

110880

Click the images to see detailed statistics about the episode.

autolab-000

110865

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

110882

sim-0of4

success

yes

2021-11-05 09:10:11+00:00

2021-11-05 09:14:23+00:00

0:04:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	13.479015054608594
survival_time_median	59.99999999999873
deviation-center-line_median	3.4806254584764
in-drivable-lane_median	5.849999999999883

other stats

deviation-center-line_max	3.4806254584764
deviation-center-line_mean	3.4806254584764
deviation-center-line_min	3.4806254584764
deviation-heading_max	12.806682900699236
deviation-heading_mean	12.806682900699236
deviation-heading_median	12.806682900699236
deviation-heading_min	12.806682900699236
distance-from-start_max	1.1561994794647428
distance-from-start_mean	1.1561994794647428
distance-from-start_median	1.1561994794647428
distance-from-start_min	1.1561994794647428
driven_any_max	15.477720539208004
driven_any_mean	15.477720539208004
driven_any_median	15.477720539208004
driven_any_min	15.477720539208004
driven_lanedir_consec_max	13.479015054608594
driven_lanedir_consec_mean	13.479015054608594
driven_lanedir_consec_min	13.479015054608594
driven_lanedir_max	13.479015054608594
driven_lanedir_mean	13.479015054608594
driven_lanedir_median	13.479015054608594
driven_lanedir_min	13.479015054608594
in-drivable-lane_max	5.849999999999883
in-drivable-lane_mean	5.849999999999883
in-drivable-lane_min	5.849999999999883
per-episodes	details {"loop2-000-ego0": {"driven_any": 15.477720539208004, "survival_time": 59.99999999999873, "driven_lanedir": 13.479015054608594, "in-drivable-lane": 5.849999999999883, "deviation-heading": 12.806682900699236, "distance-from-start": 1.1561994794647428, "deviation-center-line": 3.4806254584764, "driven_lanedir_consec": 13.479015054608594}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

110881

sim-3of4

success

yes

2021-11-05 09:09:38+00:00

2021-11-05 09:13:04+00:00

0:03:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.9911592606263167
survival_time_median	34.25000000000019
deviation-center-line_median	1.4864023975340754
in-drivable-lane_median	16.00000000000007

other stats

deviation-center-line_max	1.4864023975340754
deviation-center-line_mean	1.4864023975340754
deviation-center-line_min	1.4864023975340754
deviation-heading_max	8.011292551386497
deviation-heading_mean	8.011292551386497
deviation-heading_median	8.011292551386497
deviation-heading_min	8.011292551386497
distance-from-start_max	1.7894034126161305
distance-from-start_mean	1.7894034126161305
distance-from-start_median	1.7894034126161305
distance-from-start_min	1.7894034126161305
driven_any_max	8.94207825502342
driven_any_mean	8.94207825502342
driven_any_median	8.94207825502342
driven_any_min	8.94207825502342
driven_lanedir_consec_max	3.9911592606263167
driven_lanedir_consec_mean	3.9911592606263167
driven_lanedir_consec_min	3.9911592606263167
driven_lanedir_max	4.07356744158462
driven_lanedir_mean	4.07356744158462
driven_lanedir_median	4.07356744158462
driven_lanedir_min	4.07356744158462
in-drivable-lane_max	16.00000000000007
in-drivable-lane_mean	16.00000000000007
in-drivable-lane_min	16.00000000000007
per-episodes	details {"zigzag-000-ego0": {"driven_any": 8.94207825502342, "survival_time": 34.25000000000019, "driven_lanedir": 4.07356744158462, "in-drivable-lane": 16.00000000000007, "deviation-heading": 8.011292551386497, "distance-from-start": 1.7894034126161305, "deviation-center-line": 1.4864023975340754, "driven_lanedir_consec": 3.9911592606263167}}
simulation-passed	1
survival_time_max	34.25000000000019
survival_time_mean	34.25000000000019
survival_time_min	34.25000000000019

No reset possible

110880

sim-1of4

success

yes

2021-11-05 09:09:11+00:00

2021-11-05 09:12:22+00:00

0:03:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	9.51061224254414
survival_time_median	38.19999999999997
deviation-center-line_median	2.2724247602015635
in-drivable-lane_median	1.050000000000015

other stats

deviation-center-line_max	2.2724247602015635
deviation-center-line_mean	2.2724247602015635
deviation-center-line_min	2.2724247602015635
deviation-heading_max	7.007602324840958
deviation-heading_mean	7.007602324840958
deviation-heading_median	7.007602324840958
deviation-heading_min	7.007602324840958
distance-from-start_max	3.2088662939645993
distance-from-start_mean	3.2088662939645993
distance-from-start_median	3.2088662939645993
distance-from-start_min	3.2088662939645993
driven_any_max	10.083538333285048
driven_any_mean	10.083538333285048
driven_any_median	10.083538333285048
driven_any_min	10.083538333285048
driven_lanedir_consec_max	9.51061224254414
driven_lanedir_consec_mean	9.51061224254414
driven_lanedir_consec_min	9.51061224254414
driven_lanedir_max	9.51061224254414
driven_lanedir_mean	9.51061224254414
driven_lanedir_median	9.51061224254414
driven_lanedir_min	9.51061224254414
in-drivable-lane_max	1.050000000000015
in-drivable-lane_mean	1.050000000000015
in-drivable-lane_min	1.050000000000015
per-episodes	details {"autolab-000-ego0": {"driven_any": 10.083538333285048, "survival_time": 38.19999999999997, "driven_lanedir": 9.51061224254414, "in-drivable-lane": 1.050000000000015, "deviation-heading": 7.007602324840958, "distance-from-start": 3.2088662939645993, "deviation-center-line": 2.2724247602015635, "driven_lanedir_consec": 9.51061224254414}}
simulation-passed	1
survival_time_max	38.19999999999997
survival_time_mean	38.19999999999997
survival_time_min	38.19999999999997

No reset possible

110876

sim-3of4

success

yes

2021-11-05 09:07:17+00:00

2021-11-05 09:09:20+00:00

0:02:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110874

sim-0of4

success

yes

2021-11-05 09:05:29+00:00

2021-11-05 09:09:29+00:00

0:04:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110873

sim-3of4

success

yes

2021-11-05 09:05:28+00:00

2021-11-05 09:06:58+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110870

sim-1of4

success

yes

2021-11-05 09:05:02+00:00

2021-11-05 09:08:42+00:00

0:03:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110865

sim-2of4

success

yes

2021-11-05 09:02:52+00:00

2021-11-05 09:07:00+00:00

0:04:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	14.846271665909155
survival_time_median	59.99999999999873
deviation-center-line_median	2.768034347345291
in-drivable-lane_median	1.1999999999999922

other stats

deviation-center-line_max	2.768034347345291
deviation-center-line_mean	2.768034347345291
deviation-center-line_min	2.768034347345291
deviation-heading_max	11.436380660935628
deviation-heading_mean	11.436380660935628
deviation-heading_median	11.436380660935628
deviation-heading_min	11.436380660935628
distance-from-start_max	2.5057508061599014
distance-from-start_mean	2.5057508061599014
distance-from-start_median	2.5057508061599014
distance-from-start_min	2.5057508061599014
driven_any_max	15.623536753207388
driven_any_mean	15.623536753207388
driven_any_median	15.623536753207388
driven_any_min	15.623536753207388
driven_lanedir_consec_max	14.846271665909155
driven_lanedir_consec_mean	14.846271665909155
driven_lanedir_consec_min	14.846271665909155
driven_lanedir_max	14.846271665909155
driven_lanedir_mean	14.846271665909155
driven_lanedir_median	14.846271665909155
driven_lanedir_min	14.846271665909155
in-drivable-lane_max	1.1999999999999922
in-drivable-lane_mean	1.1999999999999922
in-drivable-lane_min	1.1999999999999922
per-episodes	details {"loop-000-ego0": {"driven_any": 15.623536753207388, "survival_time": 59.99999999999873, "driven_lanedir": 14.846271665909155, "in-drivable-lane": 1.1999999999999922, "deviation-heading": 11.436380660935628, "distance-from-start": 2.5057508061599014, "deviation-center-line": 2.768034347345291, "driven_lanedir_consec": 14.846271665909155}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

110859

sim-1of4

success

yes

2021-11-05 09:00:42+00:00

2021-11-05 09:04:16+00:00

0:03:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110853

sim-2of4

success

yes

2021-11-05 08:58:09+00:00

2021-11-05 09:02:17+00:00

0:04:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible