Submission 17587

Submission

17587

Competing

yes

Challenge

aido-LF-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 08:51:07+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 106996 sim-1of4: 106988 sim-2of4: 106993 sim-3of4: 107009

User label

template-pytorch

Admin priority

Blessing

n/a

User priority

107009

Click the images to see detailed statistics about the episode.

zigzag-000

106996

Click the images to see detailed statistics about the episode.

loop2-000

106993

Click the images to see detailed statistics about the episode.

loop-000

106988

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

107009

sim-3of4

success

yes

2021-11-03 09:05:05+00:00

2021-11-03 09:11:30+00:00

0:06:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.7679702264311512
survival_time_median	59.99999999999873
deviation-center-line_median	1.3713332743622555
in-drivable-lane_median	31.09999999999936

other stats

deviation-center-line_max	1.3713332743622555
deviation-center-line_mean	1.3713332743622555
deviation-center-line_min	1.3713332743622555
deviation-heading_max	23.022401458322467
deviation-heading_mean	23.022401458322467
deviation-heading_median	23.022401458322467
deviation-heading_min	23.022401458322467
distance-from-start_max	0.15457318474600304
distance-from-start_mean	0.15457318474600304
distance-from-start_median	0.15457318474600304
distance-from-start_min	0.15457318474600304
driven_any_max	5.610679736356324
driven_any_mean	5.610679736356324
driven_any_median	5.610679736356324
driven_any_min	5.610679736356324
driven_lanedir_consec_max	1.7679702264311512
driven_lanedir_consec_mean	1.7679702264311512
driven_lanedir_consec_min	1.7679702264311512
driven_lanedir_max	1.7679702264311512
driven_lanedir_mean	1.7679702264311512
driven_lanedir_median	1.7679702264311512
driven_lanedir_min	1.7679702264311512
in-drivable-lane_max	31.09999999999936
in-drivable-lane_mean	31.09999999999936
in-drivable-lane_min	31.09999999999936
per-episodes	details {"zigzag-000-ego0": {"driven_any": 5.610679736356324, "survival_time": 59.99999999999873, "driven_lanedir": 1.7679702264311512, "in-drivable-lane": 31.09999999999936, "deviation-heading": 23.022401458322467, "distance-from-start": 0.15457318474600304, "deviation-center-line": 1.3713332743622555, "driven_lanedir_consec": 1.7679702264311512}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107003

sim-3of4

success

yes

2021-11-03 09:03:30+00:00

2021-11-03 09:04:48+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

106996

sim-0of4

success

yes

2021-11-03 09:00:38+00:00

2021-11-03 09:05:18+00:00

0:04:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.022340468033597
survival_time_median	59.99999999999873
deviation-center-line_median	1.8767345044516768
in-drivable-lane_median	30.699999999999346

other stats

deviation-center-line_max	1.8767345044516768
deviation-center-line_mean	1.8767345044516768
deviation-center-line_min	1.8767345044516768
deviation-heading_max	23.430496452234575
deviation-heading_mean	23.430496452234575
deviation-heading_median	23.430496452234575
deviation-heading_min	23.430496452234575
distance-from-start_max	0.2991847538445801
distance-from-start_mean	0.2991847538445801
distance-from-start_median	0.2991847538445801
distance-from-start_min	0.2991847538445801
driven_any_max	6.208864243910385
driven_any_mean	6.208864243910385
driven_any_median	6.208864243910385
driven_any_min	6.208864243910385
driven_lanedir_consec_max	2.022340468033597
driven_lanedir_consec_mean	2.022340468033597
driven_lanedir_consec_min	2.022340468033597
driven_lanedir_max	2.022340468033597
driven_lanedir_mean	2.022340468033597
driven_lanedir_median	2.022340468033597
driven_lanedir_min	2.022340468033597
in-drivable-lane_max	30.699999999999346
in-drivable-lane_mean	30.699999999999346
in-drivable-lane_min	30.699999999999346
per-episodes	details {"loop2-000-ego0": {"driven_any": 6.208864243910385, "survival_time": 59.99999999999873, "driven_lanedir": 2.022340468033597, "in-drivable-lane": 30.699999999999346, "deviation-heading": 23.430496452234575, "distance-from-start": 0.2991847538445801, "deviation-center-line": 1.8767345044516768, "driven_lanedir_consec": 2.022340468033597}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

106993

sim-2of4

success

yes

2021-11-03 09:00:34+00:00

2021-11-03 09:04:08+00:00

0:03:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6096891641757387
survival_time_median	35.600000000000115
deviation-center-line_median	1.190424945534129
in-drivable-lane_median	15.500000000000004

other stats

deviation-center-line_max	1.190424945534129
deviation-center-line_mean	1.190424945534129
deviation-center-line_min	1.190424945534129
deviation-heading_max	15.26019099863466
deviation-heading_mean	15.26019099863466
deviation-heading_median	15.26019099863466
deviation-heading_min	15.26019099863466
distance-from-start_max	0.3917614936381868
distance-from-start_mean	0.3917614936381868
distance-from-start_median	0.3917614936381868
distance-from-start_min	0.3917614936381868
driven_any_max	4.604217352928546
driven_any_mean	4.604217352928546
driven_any_median	4.604217352928546
driven_any_min	4.604217352928546
driven_lanedir_consec_max	1.6096891641757387
driven_lanedir_consec_mean	1.6096891641757387
driven_lanedir_consec_min	1.6096891641757387
driven_lanedir_max	1.6096891641757387
driven_lanedir_mean	1.6096891641757387
driven_lanedir_median	1.6096891641757387
driven_lanedir_min	1.6096891641757387
in-drivable-lane_max	15.500000000000004
in-drivable-lane_mean	15.500000000000004
in-drivable-lane_min	15.500000000000004
per-episodes	details {"loop-000-ego0": {"driven_any": 4.604217352928546, "survival_time": 35.600000000000115, "driven_lanedir": 1.6096891641757387, "in-drivable-lane": 15.500000000000004, "deviation-heading": 15.26019099863466, "distance-from-start": 0.3917614936381868, "deviation-center-line": 1.190424945534129, "driven_lanedir_consec": 1.6096891641757387}}
simulation-passed	1
survival_time_max	35.600000000000115
survival_time_mean	35.600000000000115
survival_time_min	35.600000000000115

No reset possible

106990

sim-0of4

host-error

yes

2021-11-03 08:59:50+00:00

2021-11-03 09:00:08+00:00

0:00:18

Error while running [...]

Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

106988

sim-1of4

success

yes

2021-11-03 08:59:47+00:00

2021-11-03 09:05:30+00:00

0:05:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9507336685481835
survival_time_median	59.44999999999876
deviation-center-line_median	2.358810618495708
in-drivable-lane_median	37.29999999999898

other stats

deviation-center-line_max	2.358810618495708
deviation-center-line_mean	2.358810618495708
deviation-center-line_min	2.358810618495708
deviation-heading_max	17.56702288505792
deviation-heading_mean	17.56702288505792
deviation-heading_median	17.56702288505792
deviation-heading_min	17.56702288505792
distance-from-start_max	0.5834452415410037
distance-from-start_mean	0.5834452415410037
distance-from-start_median	0.5834452415410037
distance-from-start_min	0.5834452415410037
driven_any_max	8.073197709871938
driven_any_mean	8.073197709871938
driven_any_median	8.073197709871938
driven_any_min	8.073197709871938
driven_lanedir_consec_max	1.9507336685481835
driven_lanedir_consec_mean	1.9507336685481835
driven_lanedir_consec_min	1.9507336685481835
driven_lanedir_max	1.9507336685481835
driven_lanedir_mean	1.9507336685481835
driven_lanedir_median	1.9507336685481835
driven_lanedir_min	1.9507336685481835
in-drivable-lane_max	37.29999999999898
in-drivable-lane_mean	37.29999999999898
in-drivable-lane_min	37.29999999999898
per-episodes	details {"autolab-000-ego0": {"driven_any": 8.073197709871938, "survival_time": 59.44999999999876, "driven_lanedir": 1.9507336685481835, "in-drivable-lane": 37.29999999999898, "deviation-heading": 17.56702288505792, "distance-from-start": 0.5834452415410037, "deviation-center-line": 2.358810618495708, "driven_lanedir_consec": 1.9507336685481835}}
simulation-passed	1
survival_time_max	59.44999999999876
survival_time_mean	59.44999999999876
survival_time_min	59.44999999999876

No reset possible

106982

sim-2of4

success

yes

2021-11-03 08:58:10+00:00

2021-11-03 08:59:58+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

106975

sim-2of4

success

yes

2021-11-03 08:56:34+00:00

2021-11-03 08:57:38+00:00

0:01:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible