Submission 13996

Submission

13996

Competing

yes

Challenge

aido-LFP-sim-validation

User

Frank (Chude) Qian 🇨🇦

Date submitted

2021-04-05 04:51:52+00:00

Last status update

2021-12-04 20:47:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 114826 sim-1of4: 114846 sim-2of4: 114841 sim-3of4: 114834

User label

baseline-behavior-cloning

Admin priority

Blessing

n/a

User priority

114846

Click the images to see detailed statistics about the episode.

autolab-000

114841

Click the images to see detailed statistics about the episode.

loop-000

114834

Click the images to see detailed statistics about the episode.

zigzag-000

114826

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

114846

sim-1of4

success

yes

2021-11-06 12:33:09+00:00

2021-11-06 12:34:50+00:00

0:01:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	10.000000000000009
in-drivable-lane_median	2.500000000000001
driven_lanedir_consec_median	1.4153370790121602
deviation-center-line_median	0.4172130724120995

other stats

deviation-center-line_max	0.4172130724120995
deviation-center-line_mean	0.4172130724120995
deviation-center-line_min	0.4172130724120995
deviation-heading_max	2.723690866192821
deviation-heading_mean	2.723690866192821
deviation-heading_median	2.723690866192821
deviation-heading_min	2.723690866192821
distance-from-start_max	1.896919240772128
distance-from-start_mean	1.896919240772128
distance-from-start_median	1.896919240772128
distance-from-start_min	1.896919240772128
driven_any_max	2.191213975548439
driven_any_mean	2.191213975548439
driven_any_median	2.191213975548439
driven_any_min	2.191213975548439
driven_lanedir_consec_max	1.4153370790121602
driven_lanedir_consec_mean	1.4153370790121602
driven_lanedir_consec_min	1.4153370790121602
driven_lanedir_max	1.4153370790121602
driven_lanedir_mean	1.4153370790121602
driven_lanedir_median	1.4153370790121602
driven_lanedir_min	1.4153370790121602
in-drivable-lane_max	2.500000000000001
in-drivable-lane_mean	2.500000000000001
in-drivable-lane_min	2.500000000000001
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.191213975548439, "survival_time": 10.000000000000009, "driven_lanedir": 1.4153370790121602, "in-drivable-lane": 2.500000000000001, "deviation-heading": 2.723690866192821, "distance-from-start": 1.896919240772128, "deviation-center-line": 0.4172130724120995, "driven_lanedir_consec": 1.4153370790121602}}
simulation-passed	1
survival_time_max	10.000000000000009
survival_time_mean	10.000000000000009
survival_time_min	10.000000000000009

No reset possible

114841

sim-2of4

success

yes

2021-11-06 12:32:32+00:00

2021-11-06 12:34:00+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.049999999999983
in-drivable-lane_median	1.149999999999996
driven_lanedir_consec_median	1.123299737100433
deviation-center-line_median	0.2754587195555242

other stats

deviation-center-line_max	0.2754587195555242
deviation-center-line_mean	0.2754587195555242
deviation-center-line_min	0.2754587195555242
deviation-heading_max	1.740040015299238
deviation-heading_mean	1.740040015299238
deviation-heading_median	1.740040015299238
deviation-heading_min	1.740040015299238
distance-from-start_max	0.9701818377798548
distance-from-start_mean	0.9701818377798548
distance-from-start_median	0.9701818377798548
distance-from-start_min	0.9701818377798548
driven_any_max	1.469737015734488
driven_any_mean	1.469737015734488
driven_any_median	1.469737015734488
driven_any_min	1.469737015734488
driven_lanedir_consec_max	1.123299737100433
driven_lanedir_consec_mean	1.123299737100433
driven_lanedir_consec_min	1.123299737100433
driven_lanedir_max	1.123299737100433
driven_lanedir_mean	1.123299737100433
driven_lanedir_median	1.123299737100433
driven_lanedir_min	1.123299737100433
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	1.149999999999996
in-drivable-lane_min	1.149999999999996
per-episodes	details {"loop-000-ego0": {"driven_any": 1.469737015734488, "survival_time": 7.049999999999983, "driven_lanedir": 1.123299737100433, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.740040015299238, "distance-from-start": 0.9701818377798548, "deviation-center-line": 0.2754587195555242, "driven_lanedir_consec": 1.123299737100433}}
simulation-passed	1
survival_time_max	7.049999999999983
survival_time_mean	7.049999999999983
survival_time_min	7.049999999999983

No reset possible

114834

sim-3of4

success

yes

2021-11-06 12:31:22+00:00

2021-11-06 12:33:58+00:00

0:02:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	19.95000000000015
in-drivable-lane_median	4.000000000000016
driven_lanedir_consec_median	3.3630195425400213
deviation-center-line_median	1.328440389244722

other stats

deviation-center-line_max	1.328440389244722
deviation-center-line_mean	1.328440389244722
deviation-center-line_min	1.328440389244722
deviation-heading_max	5.120358171197475
deviation-heading_mean	5.120358171197475
deviation-heading_median	5.120358171197475
deviation-heading_min	5.120358171197475
distance-from-start_max	3.1627292613343783
distance-from-start_mean	3.1627292613343783
distance-from-start_median	3.1627292613343783
distance-from-start_min	3.1627292613343783
driven_any_max	4.624425287121839
driven_any_mean	4.624425287121839
driven_any_median	4.624425287121839
driven_any_min	4.624425287121839
driven_lanedir_consec_max	3.3630195425400213
driven_lanedir_consec_mean	3.3630195425400213
driven_lanedir_consec_min	3.3630195425400213
driven_lanedir_max	3.3630195425400213
driven_lanedir_mean	3.3630195425400213
driven_lanedir_median	3.3630195425400213
driven_lanedir_min	3.3630195425400213
in-drivable-lane_max	4.000000000000016
in-drivable-lane_mean	4.000000000000016
in-drivable-lane_min	4.000000000000016
per-episodes	details {"zigzag-000-ego0": {"driven_any": 4.624425287121839, "survival_time": 19.95000000000015, "driven_lanedir": 3.3630195425400213, "in-drivable-lane": 4.000000000000016, "deviation-heading": 5.120358171197475, "distance-from-start": 3.1627292613343783, "deviation-center-line": 1.328440389244722, "driven_lanedir_consec": 3.3630195425400213}}
simulation-passed	1
survival_time_max	19.95000000000015
survival_time_mean	19.95000000000015
survival_time_min	19.95000000000015

No reset possible

114832

sim-2of4

success

yes

2021-11-06 12:30:50+00:00

2021-11-06 12:32:19+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114831

sim-1of4

success

yes

2021-11-06 12:30:49+00:00

2021-11-06 12:32:37+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114826

sim-0of4

success

yes

2021-11-06 12:30:24+00:00

2021-11-06 12:32:58+00:00

0:02:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	25.60000000000023
in-drivable-lane_median	5.050000000000052
driven_lanedir_consec_median	4.354432115656716
deviation-center-line_median	1.509246093375994

other stats

deviation-center-line_max	1.509246093375994
deviation-center-line_mean	1.509246093375994
deviation-center-line_min	1.509246093375994
deviation-heading_max	7.7831036008009375
deviation-heading_mean	7.7831036008009375
deviation-heading_median	7.7831036008009375
deviation-heading_min	7.7831036008009375
distance-from-start_max	1.0682187936582697
distance-from-start_mean	1.0682187936582697
distance-from-start_median	1.0682187936582697
distance-from-start_min	1.0682187936582697
driven_any_max	6.006149211912279
driven_any_mean	6.006149211912279
driven_any_median	6.006149211912279
driven_any_min	6.006149211912279
driven_lanedir_consec_max	4.354432115656716
driven_lanedir_consec_mean	4.354432115656716
driven_lanedir_consec_min	4.354432115656716
driven_lanedir_max	4.354432115656716
driven_lanedir_mean	4.354432115656716
driven_lanedir_median	4.354432115656716
driven_lanedir_min	4.354432115656716
in-drivable-lane_max	5.050000000000052
in-drivable-lane_mean	5.050000000000052
in-drivable-lane_min	5.050000000000052
per-episodes	details {"loop2-000-ego0": {"driven_any": 6.006149211912279, "survival_time": 25.60000000000023, "driven_lanedir": 4.354432115656716, "in-drivable-lane": 5.050000000000052, "deviation-heading": 7.7831036008009375, "distance-from-start": 1.0682187936582697, "deviation-center-line": 1.509246093375994, "driven_lanedir_consec": 4.354432115656716}}
simulation-passed	1
survival_time_max	25.60000000000023
survival_time_mean	25.60000000000023
survival_time_min	25.60000000000023

No reset possible

114819

sim-2of4

success

yes

2021-11-06 12:28:54+00:00

2021-11-06 12:30:24+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114818

sim-1of4

success

yes

2021-11-06 12:28:54+00:00

2021-11-06 12:30:24+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114817

sim-3of4

success

yes

2021-11-06 12:28:53+00:00

2021-11-06 12:30:50+00:00

0:01:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114815

sim-0of4

success

yes

2021-11-06 12:28:16+00:00

2021-11-06 12:29:47+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62996

350

success

yes

2021-04-05 06:01:50+00:00

2021-04-05 06:25:02+00:00

0:23:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible