Submission 13998

Submission

13998

Competing

yes

Challenge

aido-LFP-sim-validation

User

Frank (Chude) Qian 🇨🇦

Date submitted

2021-04-05 04:53:15+00:00

Last status update

2021-12-04 20:47:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 114786 sim-1of4: 114810 sim-2of4: 114787 sim-3of4: 114788

User label

baseline-behavior-cloning New Dataset

Admin priority

Blessing

n/a

User priority

114810

Click the images to see detailed statistics about the episode.

autolab-000

114788

Click the images to see detailed statistics about the episode.

zigzag-000

114787

Click the images to see detailed statistics about the episode.

loop-000

114786

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

114810

sim-1of4

success

yes

2021-11-06 12:26:44+00:00

2021-11-06 12:27:55+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.799999999999998
in-drivable-lane_median	1.999999999999998
driven_lanedir_consec_median	0.2078785427220975
deviation-center-line_median	0.0470190037651682

other stats

deviation-center-line_max	0.0470190037651682
deviation-center-line_mean	0.0470190037651682
deviation-center-line_min	0.0470190037651682
deviation-heading_max	0.43289757086256464
deviation-heading_mean	0.43289757086256464
deviation-heading_median	0.43289757086256464
deviation-heading_min	0.43289757086256464
distance-from-start_max	0.9151533066882376
distance-from-start_mean	0.9151533066882376
distance-from-start_median	0.9151533066882376
distance-from-start_min	0.9151533066882376
driven_any_max	0.9152496873907142
driven_any_mean	0.9152496873907142
driven_any_median	0.9152496873907142
driven_any_min	0.9152496873907142
driven_lanedir_consec_max	0.2078785427220975
driven_lanedir_consec_mean	0.2078785427220975
driven_lanedir_consec_min	0.2078785427220975
driven_lanedir_max	0.2078785427220975
driven_lanedir_mean	0.2078785427220975
driven_lanedir_median	0.2078785427220975
driven_lanedir_min	0.2078785427220975
in-drivable-lane_max	1.999999999999998
in-drivable-lane_mean	1.999999999999998
in-drivable-lane_min	1.999999999999998
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.9152496873907142, "survival_time": 2.799999999999998, "driven_lanedir": 0.2078785427220975, "in-drivable-lane": 1.999999999999998, "deviation-heading": 0.43289757086256464, "distance-from-start": 0.9151533066882376, "deviation-center-line": 0.0470190037651682, "driven_lanedir_consec": 0.2078785427220975}}
simulation-passed	1
survival_time_max	2.799999999999998
survival_time_mean	2.799999999999998
survival_time_min	2.799999999999998

No reset possible

114803

sim-1of4

success

yes

2021-11-06 12:25:07+00:00

2021-11-06 12:26:19+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114795

sim-1of4

success

yes

2021-11-06 12:23:29+00:00

2021-11-06 12:24:41+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114788

sim-3of4

success

yes

2021-11-06 12:22:04+00:00

2021-11-06 12:23:32+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.799999999999984
in-drivable-lane_median	6.099999999999984
driven_lanedir_consec_median	0.14748700021886352
deviation-center-line_median	0.03698727418671105

other stats

deviation-center-line_max	0.03698727418671105
deviation-center-line_mean	0.03698727418671105
deviation-center-line_min	0.03698727418671105
deviation-heading_max	0.44660208647383703
deviation-heading_mean	0.44660208647383703
deviation-heading_median	0.44660208647383703
deviation-heading_min	0.44660208647383703
distance-from-start_max	2.9918505661589525
distance-from-start_mean	2.9918505661589525
distance-from-start_median	2.9918505661589525
distance-from-start_min	2.9918505661589525
driven_any_max	2.995345925698947
driven_any_mean	2.995345925698947
driven_any_median	2.995345925698947
driven_any_min	2.995345925698947
driven_lanedir_consec_max	0.14748700021886352
driven_lanedir_consec_mean	0.14748700021886352
driven_lanedir_consec_min	0.14748700021886352
driven_lanedir_max	0.14748700021886352
driven_lanedir_mean	0.14748700021886352
driven_lanedir_median	0.14748700021886352
driven_lanedir_min	0.14748700021886352
in-drivable-lane_max	6.099999999999984
in-drivable-lane_mean	6.099999999999984
in-drivable-lane_min	6.099999999999984
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.995345925698947, "survival_time": 6.799999999999984, "driven_lanedir": 0.14748700021886352, "in-drivable-lane": 6.099999999999984, "deviation-heading": 0.44660208647383703, "distance-from-start": 2.9918505661589525, "deviation-center-line": 0.03698727418671105, "driven_lanedir_consec": 0.14748700021886352}}
simulation-passed	1
survival_time_max	6.799999999999984
survival_time_mean	6.799999999999984
survival_time_min	6.799999999999984

No reset possible

114787

sim-2of4

success

yes

2021-11-06 12:22:03+00:00

2021-11-06 12:23:12+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	1.5000000000000009
in-drivable-lane_median	0.7000000000000005
driven_lanedir_consec_median	0.20788140374503672
deviation-center-line_median	0.04701898869691133

other stats

deviation-center-line_max	0.04701898869691133
deviation-center-line_mean	0.04701898869691133
deviation-center-line_min	0.04701898869691133
deviation-heading_max	0.43289757086256464
deviation-heading_mean	0.43289757086256464
deviation-heading_median	0.43289757086256464
deviation-heading_min	0.43289757086256464
distance-from-start_max	0.24288853169233215
distance-from-start_mean	0.24288853169233215
distance-from-start_median	0.24288853169233215
distance-from-start_min	0.24288853169233215
driven_any_max	0.2428901026658155
driven_any_mean	0.2428901026658155
driven_any_median	0.2428901026658155
driven_any_min	0.2428901026658155
driven_lanedir_consec_max	0.20788140374503672
driven_lanedir_consec_mean	0.20788140374503672
driven_lanedir_consec_min	0.20788140374503672
driven_lanedir_max	0.20788140374503672
driven_lanedir_mean	0.20788140374503672
driven_lanedir_median	0.20788140374503672
driven_lanedir_min	0.20788140374503672
in-drivable-lane_max	0.7000000000000005
in-drivable-lane_mean	0.7000000000000005
in-drivable-lane_min	0.7000000000000005
per-episodes	details {"loop-000-ego0": {"driven_any": 0.2428901026658155, "survival_time": 1.5000000000000009, "driven_lanedir": 0.20788140374503672, "in-drivable-lane": 0.7000000000000005, "deviation-heading": 0.43289757086256464, "distance-from-start": 0.24288853169233215, "deviation-center-line": 0.04701898869691133, "driven_lanedir_consec": 0.20788140374503672}}
simulation-passed	1
survival_time_max	1.5000000000000009
survival_time_mean	1.5000000000000009
survival_time_min	1.5000000000000009

No reset possible

114786

sim-0of4

success

yes

2021-11-06 12:22:02+00:00

2021-11-06 12:23:22+00:00

0:01:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	4.849999999999991
in-drivable-lane_median	3.5499999999999905
driven_lanedir_consec_median	0.35002041974603304
deviation-center-line_median	0.0935432645469072

other stats

deviation-center-line_max	0.0935432645469072
deviation-center-line_mean	0.0935432645469072
deviation-center-line_min	0.0935432645469072
deviation-heading_max	0.9293754889603804
deviation-heading_mean	0.9293754889603804
deviation-heading_median	0.9293754889603804
deviation-heading_min	0.9293754889603804
distance-from-start_max	1.980290376623938
distance-from-start_mean	1.980290376623938
distance-from-start_median	1.980290376623938
distance-from-start_min	1.980290376623938
driven_any_max	1.9812965274760672
driven_any_mean	1.9812965274760672
driven_any_median	1.9812965274760672
driven_any_min	1.9812965274760672
driven_lanedir_consec_max	0.35002041974603304
driven_lanedir_consec_mean	0.35002041974603304
driven_lanedir_consec_min	0.35002041974603304
driven_lanedir_max	0.35002041974603304
driven_lanedir_mean	0.35002041974603304
driven_lanedir_median	0.35002041974603304
driven_lanedir_min	0.35002041974603304
in-drivable-lane_max	3.5499999999999905
in-drivable-lane_mean	3.5499999999999905
in-drivable-lane_min	3.5499999999999905
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.9812965274760672, "survival_time": 4.849999999999991, "driven_lanedir": 0.35002041974603304, "in-drivable-lane": 3.5499999999999905, "deviation-heading": 0.9293754889603804, "distance-from-start": 1.980290376623938, "deviation-center-line": 0.0935432645469072, "driven_lanedir_consec": 0.35002041974603304}}
simulation-passed	1
survival_time_max	4.849999999999991
survival_time_mean	4.849999999999991
survival_time_min	4.849999999999991

No reset possible

114778

sim-3of4

success

yes

2021-11-06 12:20:23+00:00

2021-11-06 12:21:51+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114777

sim-0of4

success

yes

2021-11-06 12:20:04+00:00

2021-11-06 12:21:29+00:00

0:01:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114776

sim-2of4

success

yes

2021-11-06 12:20:04+00:00

2021-11-06 12:21:18+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible