Submission 15656

Submission

15656

Competing

yes

Challenge

aido-LF-sim-validation

User

Keyan Pishdadian

Date submitted

2021-05-26 23:59:44+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 110843 sim-1of4: 110866 sim-2of4: 110868 sim-3of4: 110869

User label

nvidia-behavior-cloning

Admin priority

Blessing

n/a

User priority

110869

Click the images to see detailed statistics about the episode.

zigzag-000

110868

Click the images to see detailed statistics about the episode.

loop-000

110866

Click the images to see detailed statistics about the episode.

autolab-000

110843

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

110869

sim-3of4

success

yes

2021-11-05 09:03:28+00:00

2021-11-05 09:04:54+00:00

0:01:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1817918932585965
survival_time_median	5.349999999999989
deviation-center-line_median	0.07251237935152882
in-drivable-lane_median	4.299999999999989

other stats

deviation-center-line_max	0.07251237935152882
deviation-center-line_mean	0.07251237935152882
deviation-center-line_min	0.07251237935152882
deviation-heading_max	0.6086922007103504
deviation-heading_mean	0.6086922007103504
deviation-heading_median	0.6086922007103504
deviation-heading_min	0.6086922007103504
distance-from-start_max	1.11683330940046
distance-from-start_mean	1.11683330940046
distance-from-start_median	1.11683330940046
distance-from-start_min	1.11683330940046
driven_any_max	1.3046561688969562
driven_any_mean	1.3046561688969562
driven_any_median	1.3046561688969562
driven_any_min	1.3046561688969562
driven_lanedir_consec_max	0.1817918932585965
driven_lanedir_consec_mean	0.1817918932585965
driven_lanedir_consec_min	0.1817918932585965
driven_lanedir_max	0.1817918932585965
driven_lanedir_mean	0.1817918932585965
driven_lanedir_median	0.1817918932585965
driven_lanedir_min	0.1817918932585965
in-drivable-lane_max	4.299999999999989
in-drivable-lane_mean	4.299999999999989
in-drivable-lane_min	4.299999999999989
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.3046561688969562, "survival_time": 5.349999999999989, "driven_lanedir": 0.1817918932585965, "in-drivable-lane": 4.299999999999989, "deviation-heading": 0.6086922007103504, "distance-from-start": 1.11683330940046, "deviation-center-line": 0.07251237935152882, "driven_lanedir_consec": 0.1817918932585965}}
simulation-passed	1
survival_time_max	5.349999999999989
survival_time_mean	5.349999999999989
survival_time_min	5.349999999999989

No reset possible

110868

sim-2of4

success

yes

2021-11-05 09:03:28+00:00

2021-11-05 09:05:57+00:00

0:02:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.29847722781555
survival_time_median	28.40000000000027
deviation-center-line_median	1.277341818719162
in-drivable-lane_median	10.800000000000152

other stats

deviation-center-line_max	1.277341818719162
deviation-center-line_mean	1.277341818719162
deviation-center-line_min	1.277341818719162
deviation-heading_max	5.943841859544821
deviation-heading_mean	5.943841859544821
deviation-heading_median	5.943841859544821
deviation-heading_min	5.943841859544821
distance-from-start_max	2.581487075384769
distance-from-start_mean	2.581487075384769
distance-from-start_median	2.581487075384769
distance-from-start_min	2.581487075384769
driven_any_max	7.698093676017036
driven_any_mean	7.698093676017036
driven_any_median	7.698093676017036
driven_any_min	7.698093676017036
driven_lanedir_consec_max	4.29847722781555
driven_lanedir_consec_mean	4.29847722781555
driven_lanedir_consec_min	4.29847722781555
driven_lanedir_max	4.29847722781555
driven_lanedir_mean	4.29847722781555
driven_lanedir_median	4.29847722781555
driven_lanedir_min	4.29847722781555
in-drivable-lane_max	10.800000000000152
in-drivable-lane_mean	10.800000000000152
in-drivable-lane_min	10.800000000000152
per-episodes	details {"loop-000-ego0": {"driven_any": 7.698093676017036, "survival_time": 28.40000000000027, "driven_lanedir": 4.29847722781555, "in-drivable-lane": 10.800000000000152, "deviation-heading": 5.943841859544821, "distance-from-start": 2.581487075384769, "deviation-center-line": 1.277341818719162, "driven_lanedir_consec": 4.29847722781555}}
simulation-passed	1
survival_time_max	28.40000000000027
survival_time_mean	28.40000000000027
survival_time_min	28.40000000000027

No reset possible

110866

sim-1of4

success

yes

2021-11-05 09:03:24+00:00

2021-11-05 09:05:04+00:00

0:01:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.274716169243069
survival_time_median	11.850000000000032
deviation-center-line_median	0.724010605644298
in-drivable-lane_median	2.2000000000000313

other stats

deviation-center-line_max	0.724010605644298
deviation-center-line_mean	0.724010605644298
deviation-center-line_min	0.724010605644298
deviation-heading_max	2.0503273926612446
deviation-heading_mean	2.0503273926612446
deviation-heading_median	2.0503273926612446
deviation-heading_min	2.0503273926612446
distance-from-start_max	1.78156677876655
distance-from-start_mean	1.78156677876655
distance-from-start_median	1.78156677876655
distance-from-start_min	1.78156677876655
driven_any_max	2.8390262911460025
driven_any_mean	2.8390262911460025
driven_any_median	2.8390262911460025
driven_any_min	2.8390262911460025
driven_lanedir_consec_max	2.274716169243069
driven_lanedir_consec_mean	2.274716169243069
driven_lanedir_consec_min	2.274716169243069
driven_lanedir_max	2.274716169243069
driven_lanedir_mean	2.274716169243069
driven_lanedir_median	2.274716169243069
driven_lanedir_min	2.274716169243069
in-drivable-lane_max	2.2000000000000313
in-drivable-lane_mean	2.2000000000000313
in-drivable-lane_min	2.2000000000000313
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.8390262911460025, "survival_time": 11.850000000000032, "driven_lanedir": 2.274716169243069, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 2.0503273926612446, "distance-from-start": 1.78156677876655, "deviation-center-line": 0.724010605644298, "driven_lanedir_consec": 2.274716169243069}}
simulation-passed	1
survival_time_max	11.850000000000032
survival_time_mean	11.850000000000032
survival_time_min	11.850000000000032

No reset possible

110862

sim-3of4

success

yes

2021-11-05 09:01:16+00:00

2021-11-05 09:02:41+00:00

0:01:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110861

sim-1of4

success

yes

2021-11-05 09:01:12+00:00

2021-11-05 09:03:01+00:00

0:01:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110860

sim-2of4

success

yes

2021-11-05 09:00:42+00:00

2021-11-05 09:03:06+00:00

0:02:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110857

sim-3of4

success

yes

2021-11-05 08:59:31+00:00

2021-11-05 09:00:51+00:00

0:01:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110855

sim-1of4

success

yes

2021-11-05 08:59:08+00:00

2021-11-05 09:00:28+00:00

0:01:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110851

sim-2of4

success

yes

2021-11-05 08:57:50+00:00

2021-11-05 09:00:09+00:00

0:02:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110850

sim-3of4

success

yes

2021-11-05 08:57:23+00:00

2021-11-05 08:58:47+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110849

sim-1of4

success

yes

2021-11-05 08:56:30+00:00

2021-11-05 08:58:12+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110843

sim-0of4

success

yes

2021-11-05 08:54:40+00:00

2021-11-05 08:56:10+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6801102597205758
survival_time_median	8.199999999999982
deviation-center-line_median	0.22571767253854327
in-drivable-lane_median	4.899999999999985

other stats

deviation-center-line_max	0.22571767253854327
deviation-center-line_mean	0.22571767253854327
deviation-center-line_min	0.22571767253854327
deviation-heading_max	1.1871572733304308
deviation-heading_mean	1.1871572733304308
deviation-heading_median	1.1871572733304308
deviation-heading_min	1.1871572733304308
distance-from-start_max	1.7274210796915703
distance-from-start_mean	1.7274210796915703
distance-from-start_median	1.7274210796915703
distance-from-start_min	1.7274210796915703
driven_any_max	1.7766932509179076
driven_any_mean	1.7766932509179076
driven_any_median	1.7766932509179076
driven_any_min	1.7766932509179076
driven_lanedir_consec_max	0.6801102597205758
driven_lanedir_consec_mean	0.6801102597205758
driven_lanedir_consec_min	0.6801102597205758
driven_lanedir_max	0.6801102597205758
driven_lanedir_mean	0.6801102597205758
driven_lanedir_median	0.6801102597205758
driven_lanedir_min	0.6801102597205758
in-drivable-lane_max	4.899999999999985
in-drivable-lane_mean	4.899999999999985
in-drivable-lane_min	4.899999999999985
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.7766932509179076, "survival_time": 8.199999999999982, "driven_lanedir": 0.6801102597205758, "in-drivable-lane": 4.899999999999985, "deviation-heading": 1.1871572733304308, "distance-from-start": 1.7274210796915703, "deviation-center-line": 0.22571767253854327, "driven_lanedir_consec": 0.6801102597205758}}
simulation-passed	1
survival_time_max	8.199999999999982
survival_time_mean	8.199999999999982
survival_time_min	8.199999999999982

No reset possible

110837

sim-0of4

success

yes

2021-11-05 08:52:45+00:00

2021-11-05 08:54:12+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110832

sim-0of4

success

yes

2021-11-05 08:50:42+00:00

2021-11-05 08:52:11+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110828

sim-0of4

success

yes

2021-11-05 08:48:48+00:00

2021-11-05 08:50:15+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible