Submission 13634

Submission

13634

Competing

yes

Challenge

aido-LFV-sim-validation

User

Raphael Jean

Date submitted

2021-01-31 22:18:19+00:00

Last status update

2021-12-04 20:47:22+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104886 sim-1of4: 104874 sim-2of4: 104873 sim-3of4: 104876

User label

mobile-segmentation

Admin priority

Blessing

n/a

User priority

104886

Click the images to see detailed statistics about the episode.

loop2-000

104876

Click the images to see detailed statistics about the episode.

zigzag-000

104874

Click the images to see detailed statistics about the episode.

autolab-000

104873

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104886

sim-0of4

success

yes

2021-11-02 22:25:38+00:00

2021-11-02 22:32:25+00:00

0:06:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.199999999999978
driven_lanedir_consec_median	25.908713257039732
deviation-center-line_median	2.54121003964547

other stats

deviation-center-line_max	2.54121003964547
deviation-center-line_mean	2.54121003964547
deviation-center-line_min	2.54121003964547
deviation-heading_max	8.552331482820975
deviation-heading_mean	8.552331482820975
deviation-heading_median	8.552331482820975
deviation-heading_min	8.552331482820975
distance-from-start_max	1.1299942978361457
distance-from-start_mean	1.1299942978361457
distance-from-start_median	1.1299942978361457
distance-from-start_min	1.1299942978361457
driven_any_max	26.83116950259357
driven_any_mean	26.83116950259357
driven_any_median	26.83116950259357
driven_any_min	26.83116950259357
driven_lanedir_consec_max	25.908713257039732
driven_lanedir_consec_mean	25.908713257039732
driven_lanedir_consec_min	25.908713257039732
driven_lanedir_max	25.908713257039732
driven_lanedir_mean	25.908713257039732
driven_lanedir_median	25.908713257039732
driven_lanedir_min	25.908713257039732
in-drivable-lane_max	1.199999999999978
in-drivable-lane_mean	1.199999999999978
in-drivable-lane_min	1.199999999999978
per-episodes	details {"loop2-000-ego0": {"driven_any": 26.83116950259357, "survival_time": 59.99999999999873, "driven_lanedir": 25.908713257039732, "in-drivable-lane": 1.199999999999978, "deviation-heading": 8.552331482820975, "distance-from-start": 1.1299942978361457, "deviation-center-line": 2.54121003964547, "driven_lanedir_consec": 25.908713257039732}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104881

sim-0of4

success

yes

2021-11-02 22:22:46+00:00

2021-11-02 22:25:30+00:00

0:02:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104877

sim-0of4

timeout

yes

2021-11-02 22:19:22+00:00

2021-11-02 22:20:19+00:00

0:00:57

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104876

sim-3of4

success

yes

2021-11-02 22:17:53+00:00

2021-11-02 22:22:39+00:00

0:04:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	16.150000000000095
in-drivable-lane_median	1.050000000000015
driven_lanedir_consec_median	6.338448748127439
deviation-center-line_median	0.905429235411676

other stats

deviation-center-line_max	0.905429235411676
deviation-center-line_mean	0.905429235411676
deviation-center-line_min	0.905429235411676
deviation-heading_max	3.486096803468504
deviation-heading_mean	3.486096803468504
deviation-heading_median	3.486096803468504
deviation-heading_min	3.486096803468504
distance-from-start_max	4.300511675067764
distance-from-start_mean	4.300511675067764
distance-from-start_median	4.300511675067764
distance-from-start_min	4.300511675067764
driven_any_max	6.696209851092002
driven_any_mean	6.696209851092002
driven_any_median	6.696209851092002
driven_any_min	6.696209851092002
driven_lanedir_consec_max	6.338448748127439
driven_lanedir_consec_mean	6.338448748127439
driven_lanedir_consec_min	6.338448748127439
driven_lanedir_max	6.338448748127439
driven_lanedir_mean	6.338448748127439
driven_lanedir_median	6.338448748127439
driven_lanedir_min	6.338448748127439
in-drivable-lane_max	1.050000000000015
in-drivable-lane_mean	1.050000000000015
in-drivable-lane_min	1.050000000000015
per-episodes	details {"zigzag-000-ego0": {"driven_any": 6.696209851092002, "survival_time": 16.150000000000095, "driven_lanedir": 6.338448748127439, "in-drivable-lane": 1.050000000000015, "deviation-heading": 3.486096803468504, "distance-from-start": 4.300511675067764, "deviation-center-line": 0.905429235411676, "driven_lanedir_consec": 6.338448748127439}}
simulation-passed	1
survival_time_max	16.150000000000095
survival_time_mean	16.150000000000095
survival_time_min	16.150000000000095

No reset possible

104874

sim-1of4

success

yes

2021-11-02 22:17:30+00:00

2021-11-02 22:22:09+00:00

0:04:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	17.15000000000011
in-drivable-lane_median	2.6500000000000306
driven_lanedir_consec_median	5.9839605289431335
deviation-center-line_median	0.8801643797486141

other stats

deviation-center-line_max	0.8801643797486141
deviation-center-line_mean	0.8801643797486141
deviation-center-line_min	0.8801643797486141
deviation-heading_max	4.179552795770043
deviation-heading_mean	4.179552795770043
deviation-heading_median	4.179552795770043
deviation-heading_min	4.179552795770043
distance-from-start_max	2.8398501851662212
distance-from-start_mean	2.8398501851662212
distance-from-start_median	2.8398501851662212
distance-from-start_min	2.8398501851662212
driven_any_max	7.144186520737583
driven_any_mean	7.144186520737583
driven_any_median	7.144186520737583
driven_any_min	7.144186520737583
driven_lanedir_consec_max	5.9839605289431335
driven_lanedir_consec_mean	5.9839605289431335
driven_lanedir_consec_min	5.9839605289431335
driven_lanedir_max	5.9839605289431335
driven_lanedir_mean	5.9839605289431335
driven_lanedir_median	5.9839605289431335
driven_lanedir_min	5.9839605289431335
in-drivable-lane_max	2.6500000000000306
in-drivable-lane_mean	2.6500000000000306
in-drivable-lane_min	2.6500000000000306
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.144186520737583, "survival_time": 17.15000000000011, "driven_lanedir": 5.9839605289431335, "in-drivable-lane": 2.6500000000000306, "deviation-heading": 4.179552795770043, "distance-from-start": 2.8398501851662212, "deviation-center-line": 0.8801643797486141, "driven_lanedir_consec": 5.9839605289431335}}
simulation-passed	1
survival_time_max	17.15000000000011
survival_time_mean	17.15000000000011
survival_time_min	17.15000000000011

No reset possible

104873

sim-2of4

success

yes

2021-11-02 22:17:28+00:00

2021-11-02 22:19:38+00:00

0:02:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	4.499999999999992
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.4997724945603697
deviation-center-line_median	0.16305964066329717

other stats

deviation-center-line_max	0.16305964066329717
deviation-center-line_mean	0.16305964066329717
deviation-center-line_min	0.16305964066329717
deviation-heading_max	1.0572073243650753
deviation-heading_mean	1.0572073243650753
deviation-heading_median	1.0572073243650753
deviation-heading_min	1.0572073243650753
distance-from-start_max	1.3046480884112197
distance-from-start_mean	1.3046480884112197
distance-from-start_median	1.3046480884112197
distance-from-start_min	1.3046480884112197
driven_any_max	1.539129390153188
driven_any_mean	1.539129390153188
driven_any_median	1.539129390153188
driven_any_min	1.539129390153188
driven_lanedir_consec_max	1.4997724945603697
driven_lanedir_consec_mean	1.4997724945603697
driven_lanedir_consec_min	1.4997724945603697
driven_lanedir_max	1.4997724945603697
driven_lanedir_mean	1.4997724945603697
driven_lanedir_median	1.4997724945603697
driven_lanedir_min	1.4997724945603697
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 1.539129390153188, "survival_time": 4.499999999999992, "driven_lanedir": 1.4997724945603697, "in-drivable-lane": 0.0, "deviation-heading": 1.0572073243650753, "distance-from-start": 1.3046480884112197, "deviation-center-line": 0.16305964066329717, "driven_lanedir_consec": 1.4997724945603697}}
simulation-passed	1
survival_time_max	4.499999999999992
survival_time_mean	4.499999999999992
survival_time_min	4.499999999999992

No reset possible

104869

sim-1of4

timeout

yes

2021-11-02 22:13:45+00:00

2021-11-02 22:13:55+00:00

0:00:10

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104867

sim-3of4

success

yes

2021-11-02 22:11:19+00:00

2021-11-02 22:15:47+00:00

0:04:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104866

sim-2of4

success

yes

2021-11-02 22:11:19+00:00

2021-11-02 22:13:30+00:00

0:02:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104865

sim-2of4

success

yes

2021-11-02 22:09:45+00:00

2021-11-02 22:11:48+00:00

0:02:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104860

sim-1of4

success

yes

2021-11-02 22:07:09+00:00

2021-11-02 22:12:06+00:00

0:04:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62326

354

success

yes

2021-03-23 06:27:07+00:00

2021-03-23 08:00:37+00:00

1:33:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible