Submission 17604

Submission

17604

Competing

yes

Challenge

aido-LFP-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 08:53:29+00:00

Last status update

2021-12-04 20:47:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 105572 sim-1of4: 105538 sim-2of4: 105544 sim-3of4: 105568

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

105572

Click the images to see detailed statistics about the episode.

loop2-000

105568

Click the images to see detailed statistics about the episode.

loop-000

105544

Click the images to see detailed statistics about the episode.

autolab-000

105538

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

105572

sim-0of4

success

yes

2021-11-03 03:33:30+00:00

2021-11-03 03:35:08+00:00

0:01:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.950000000000047
in-drivable-lane_median	3.050000000000015
driven_lanedir_consec_median	1.1434531497771732
deviation-center-line_median	0.6480955880853644

other stats

deviation-center-line_max	0.6480955880853644
deviation-center-line_mean	0.6480955880853644
deviation-center-line_min	0.6480955880853644
deviation-heading_max	3.3190908057477073
deviation-heading_mean	3.3190908057477073
deviation-heading_median	3.3190908057477073
deviation-heading_min	3.3190908057477073
distance-from-start_max	0.9535184033366252
distance-from-start_mean	0.9535184033366252
distance-from-start_median	0.9535184033366252
distance-from-start_min	0.9535184033366252
driven_any_max	1.574595896347979
driven_any_mean	1.574595896347979
driven_any_median	1.574595896347979
driven_any_min	1.574595896347979
driven_lanedir_consec_max	1.1434531497771732
driven_lanedir_consec_mean	1.1434531497771732
driven_lanedir_consec_min	1.1434531497771732
driven_lanedir_max	1.1434531497771732
driven_lanedir_mean	1.1434531497771732
driven_lanedir_median	1.1434531497771732
driven_lanedir_min	1.1434531497771732
in-drivable-lane_max	3.050000000000015
in-drivable-lane_mean	3.050000000000015
in-drivable-lane_min	3.050000000000015
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.574595896347979, "survival_time": 12.950000000000047, "driven_lanedir": 1.1434531497771732, "in-drivable-lane": 3.050000000000015, "deviation-heading": 3.3190908057477073, "distance-from-start": 0.9535184033366252, "deviation-center-line": 0.6480955880853644, "driven_lanedir_consec": 1.1434531497771732}}
simulation-passed	1
survival_time_max	12.950000000000047
survival_time_mean	12.950000000000047
survival_time_min	12.950000000000047

No reset possible

105568

sim-3of4

success

yes

2021-11-03 03:32:24+00:00

2021-11-03 03:33:41+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.149999999999983
in-drivable-lane_median	0.9999999999999964
driven_lanedir_consec_median	0.6282912323055285
deviation-center-line_median	0.352171634965138

other stats

deviation-center-line_max	0.352171634965138
deviation-center-line_mean	0.352171634965138
deviation-center-line_min	0.352171634965138
deviation-heading_max	1.828109722024705
deviation-heading_mean	1.828109722024705
deviation-heading_median	1.828109722024705
deviation-heading_min	1.828109722024705
distance-from-start_max	0.6199706291294681
distance-from-start_mean	0.6199706291294681
distance-from-start_median	0.6199706291294681
distance-from-start_min	0.6199706291294681
driven_any_max	0.8045737419577668
driven_any_mean	0.8045737419577668
driven_any_median	0.8045737419577668
driven_any_min	0.8045737419577668
driven_lanedir_consec_max	0.6282912323055285
driven_lanedir_consec_mean	0.6282912323055285
driven_lanedir_consec_min	0.6282912323055285
driven_lanedir_max	0.6282912323055285
driven_lanedir_mean	0.6282912323055285
driven_lanedir_median	0.6282912323055285
driven_lanedir_min	0.6282912323055285
in-drivable-lane_max	0.9999999999999964
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0.9999999999999964
per-episodes	details {"loop-000-ego0": {"driven_any": 0.8045737419577668, "survival_time": 7.149999999999983, "driven_lanedir": 0.6282912323055285, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 1.828109722024705, "distance-from-start": 0.6199706291294681, "deviation-center-line": 0.352171634965138, "driven_lanedir_consec": 0.6282912323055285}}
simulation-passed	1
survival_time_max	7.149999999999983
survival_time_mean	7.149999999999983
survival_time_min	7.149999999999983

No reset possible

105564

sim-0of4

success

yes

2021-11-03 03:31:16+00:00

2021-11-03 03:32:45+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105559

sim-0of4

success

yes

2021-11-03 03:29:15+00:00

2021-11-03 03:31:01+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105558

sim-3of4

success

yes

2021-11-03 03:29:13+00:00

2021-11-03 03:30:40+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105554

sim-3of4

success

yes

2021-11-03 03:27:35+00:00

2021-11-03 03:28:56+00:00

0:01:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105553

sim-0of4

success

yes

2021-11-03 03:27:07+00:00

2021-11-03 03:28:34+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105546

sim-3of4

success

yes

2021-11-03 03:25:35+00:00

2021-11-03 03:27:03+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105545

sim-0of4

success

yes

2021-11-03 03:25:03+00:00

2021-11-03 03:26:31+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105544

sim-2of4

success

yes

2021-11-03 03:25:02+00:00

2021-11-03 03:26:52+00:00

0:01:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.30000000000004
in-drivable-lane_median	0.9000000000000128
driven_lanedir_consec_median	1.2230751374428015
deviation-center-line_median	0.9172478894722608

other stats

deviation-center-line_max	0.9172478894722608
deviation-center-line_mean	0.9172478894722608
deviation-center-line_min	0.9172478894722608
deviation-heading_max	4.146178365595217
deviation-heading_mean	4.146178365595217
deviation-heading_median	4.146178365595217
deviation-heading_min	4.146178365595217
distance-from-start_max	1.1588482491929208
distance-from-start_mean	1.1588482491929208
distance-from-start_median	1.1588482491929208
distance-from-start_min	1.1588482491929208
driven_any_max	1.4816934945625453
driven_any_mean	1.4816934945625453
driven_any_median	1.4816934945625453
driven_any_min	1.4816934945625453
driven_lanedir_consec_max	1.2230751374428015
driven_lanedir_consec_mean	1.2230751374428015
driven_lanedir_consec_min	1.2230751374428015
driven_lanedir_max	1.2230751374428015
driven_lanedir_mean	1.2230751374428015
driven_lanedir_median	1.2230751374428015
driven_lanedir_min	1.2230751374428015
in-drivable-lane_max	0.9000000000000128
in-drivable-lane_mean	0.9000000000000128
in-drivable-lane_min	0.9000000000000128
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.4816934945625453, "survival_time": 12.30000000000004, "driven_lanedir": 1.2230751374428015, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 4.146178365595217, "distance-from-start": 1.1588482491929208, "deviation-center-line": 0.9172478894722608, "driven_lanedir_consec": 1.2230751374428015}}
simulation-passed	1
survival_time_max	12.30000000000004
survival_time_mean	12.30000000000004
survival_time_min	12.30000000000004

No reset possible

105538

sim-1of4

success

yes

2021-11-03 03:23:28+00:00

2021-11-03 03:27:56+00:00

0:04:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	45.34999999999956
in-drivable-lane_median	8.349999999999817
driven_lanedir_consec_median	3.3215675905431876
deviation-center-line_median	3.105809455162569

other stats

deviation-center-line_max	3.105809455162569
deviation-center-line_mean	3.105809455162569
deviation-center-line_min	3.105809455162569
deviation-heading_max	10.847368288780224
deviation-heading_mean	10.847368288780224
deviation-heading_median	10.847368288780224
deviation-heading_min	10.847368288780224
distance-from-start_max	3.0559183958975273
distance-from-start_mean	3.0559183958975273
distance-from-start_median	3.0559183958975273
distance-from-start_min	3.0559183958975273
driven_any_max	5.87637605600171
driven_any_mean	5.87637605600171
driven_any_median	5.87637605600171
driven_any_min	5.87637605600171
driven_lanedir_consec_max	3.3215675905431876
driven_lanedir_consec_mean	3.3215675905431876
driven_lanedir_consec_min	3.3215675905431876
driven_lanedir_max	4.422326835503182
driven_lanedir_mean	4.422326835503182
driven_lanedir_median	4.422326835503182
driven_lanedir_min	4.422326835503182
in-drivable-lane_max	8.349999999999817
in-drivable-lane_mean	8.349999999999817
in-drivable-lane_min	8.349999999999817
per-episodes	details {"zigzag-000-ego0": {"driven_any": 5.87637605600171, "survival_time": 45.34999999999956, "driven_lanedir": 4.422326835503182, "in-drivable-lane": 8.349999999999817, "deviation-heading": 10.847368288780224, "distance-from-start": 3.0559183958975273, "deviation-center-line": 3.105809455162569, "driven_lanedir_consec": 3.3215675905431876}}
simulation-passed	1
survival_time_max	45.34999999999956
survival_time_mean	45.34999999999956
survival_time_min	45.34999999999956

No reset possible

105537

sim-2of4

success

yes

2021-11-03 03:23:01+00:00

2021-11-03 03:24:48+00:00

0:01:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible