Submission 18705

Submission

18705

Competing

yes

Challenge

aido-LF-full-sim-validation

User

Joakim Aarskog

Date submitted

2022-05-15 16:00:14+00:00

Last status update

2022-06-02 22:44:26+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 130100 sim-1of4: 130099 sim-2of4: 130093 sim-3of4: 130102

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

130102

Click the images to see detailed statistics about the episode.

loop2-000

130100

Click the images to see detailed statistics about the episode.

zigzag-000

130099

Click the images to see detailed statistics about the episode.

loop-000

130093

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

130102

sim-3of4

success

yes

2022-06-02 22:37:35+00:00

2022-06-02 22:41:57+00:00

0:04:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.399999999999982
in-drivable-lane_median	2.3499999999999917
driven_lanedir_consec_median	2.1793855589961835
deviation-center-line_median	0.25838781826874413

other stats

deviation-center-line_max	0.25838781826874413
deviation-center-line_mean	0.25838781826874413
deviation-center-line_min	0.25838781826874413
deviation-heading_max	1.2251105907871749
deviation-heading_mean	1.2251105907871749
deviation-heading_median	1.2251105907871749
deviation-heading_min	1.2251105907871749
distance-from-start_max	2.2205638521818027
distance-from-start_mean	2.2205638521818027
distance-from-start_median	2.2205638521818027
distance-from-start_min	2.2205638521818027
driven_any_max	3.0318746386450104
driven_any_mean	3.0318746386450104
driven_any_median	3.0318746386450104
driven_any_min	3.0318746386450104
driven_lanedir_consec_max	2.1793855589961835
driven_lanedir_consec_mean	2.1793855589961835
driven_lanedir_consec_min	2.1793855589961835
driven_lanedir_max	2.1793855589961835
driven_lanedir_mean	2.1793855589961835
driven_lanedir_median	2.1793855589961835
driven_lanedir_min	2.1793855589961835
in-drivable-lane_max	2.3499999999999917
in-drivable-lane_mean	2.3499999999999917
in-drivable-lane_min	2.3499999999999917
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.0318746386450104, "survival_time": 7.399999999999982, "driven_lanedir": 2.1793855589961835, "in-drivable-lane": 2.3499999999999917, "deviation-heading": 1.2251105907871749, "distance-from-start": 2.2205638521818027, "deviation-center-line": 0.25838781826874413, "driven_lanedir_consec": 2.1793855589961835}}
simulation-passed	1
survival_time_max	7.399999999999982
survival_time_mean	7.399999999999982
survival_time_min	7.399999999999982

No reset possible

130101

sim-3of4

success

yes

2022-06-02 22:32:34+00:00

2022-06-02 22:37:12+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

130100

sim-0of4

success

yes

2022-06-02 22:28:31+00:00

2022-06-02 22:32:19+00:00

0:03:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.499999999999999
in-drivable-lane_median	1.1999999999999986
driven_lanedir_consec_median	0.2515847406057292
deviation-center-line_median	0.09684610722717577

other stats

deviation-center-line_max	0.09684610722717577
deviation-center-line_mean	0.09684610722717577
deviation-center-line_min	0.09684610722717577
deviation-heading_max	0.6091252639789421
deviation-heading_mean	0.6091252639789421
deviation-heading_median	0.6091252639789421
deviation-heading_min	0.6091252639789421
distance-from-start_max	0.4871907179473835
distance-from-start_mean	0.4871907179473835
distance-from-start_median	0.4871907179473835
distance-from-start_min	0.4871907179473835
driven_any_max	0.4920045631104592
driven_any_mean	0.4920045631104592
driven_any_median	0.4920045631104592
driven_any_min	0.4920045631104592
driven_lanedir_consec_max	0.2515847406057292
driven_lanedir_consec_mean	0.2515847406057292
driven_lanedir_consec_min	0.2515847406057292
driven_lanedir_max	0.2515847406057292
driven_lanedir_mean	0.2515847406057292
driven_lanedir_median	0.2515847406057292
driven_lanedir_min	0.2515847406057292
in-drivable-lane_max	1.1999999999999986
in-drivable-lane_mean	1.1999999999999986
in-drivable-lane_min	1.1999999999999986
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.4920045631104592, "survival_time": 2.499999999999999, "driven_lanedir": 0.2515847406057292, "in-drivable-lane": 1.1999999999999986, "deviation-heading": 0.6091252639789421, "distance-from-start": 0.4871907179473835, "deviation-center-line": 0.09684610722717577, "driven_lanedir_consec": 0.2515847406057292}}
simulation-passed	1
survival_time_max	2.499999999999999
survival_time_mean	2.499999999999999
survival_time_min	2.499999999999999

No reset possible

130099

sim-1of4

success

yes

2022-06-02 22:22:31+00:00

2022-06-02 22:27:53+00:00

0:05:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.750000000000046
in-drivable-lane_median	5.000000000000036
driven_lanedir_consec_median	3.2460836799668726
deviation-center-line_median	0.5506605190444556

other stats

deviation-center-line_max	0.5506605190444556
deviation-center-line_mean	0.5506605190444556
deviation-center-line_min	0.5506605190444556
deviation-heading_max	2.5963283238701247
deviation-heading_mean	2.5963283238701247
deviation-heading_median	2.5963283238701247
deviation-heading_min	2.5963283238701247
distance-from-start_max	3.2029442175617
distance-from-start_mean	3.2029442175617
distance-from-start_median	3.2029442175617
distance-from-start_min	3.2029442175617
driven_any_max	5.35136719839803
driven_any_mean	5.35136719839803
driven_any_median	5.35136719839803
driven_any_min	5.35136719839803
driven_lanedir_consec_max	3.2460836799668726
driven_lanedir_consec_mean	3.2460836799668726
driven_lanedir_consec_min	3.2460836799668726
driven_lanedir_max	3.2460836799668726
driven_lanedir_mean	3.2460836799668726
driven_lanedir_median	3.2460836799668726
driven_lanedir_min	3.2460836799668726
in-drivable-lane_max	5.000000000000036
in-drivable-lane_mean	5.000000000000036
in-drivable-lane_min	5.000000000000036
per-episodes	details {"loop-000-ego0": {"driven_any": 5.35136719839803, "survival_time": 12.750000000000046, "driven_lanedir": 3.2460836799668726, "in-drivable-lane": 5.000000000000036, "deviation-heading": 2.5963283238701247, "distance-from-start": 3.2029442175617, "deviation-center-line": 0.5506605190444556, "driven_lanedir_consec": 3.2460836799668726}}
simulation-passed	1
survival_time_max	12.750000000000046
survival_time_mean	12.750000000000046
survival_time_min	12.750000000000046

No reset possible

130093

sim-2of4

success

yes

2022-06-02 22:11:03+00:00

2022-06-02 22:16:11+00:00

0:05:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.199999999999996
in-drivable-lane_median	2.650000000000005
driven_lanedir_consec_median	2.7545657901440728
deviation-center-line_median	0.4046616957392982

other stats

deviation-center-line_max	0.4046616957392982
deviation-center-line_mean	0.4046616957392982
deviation-center-line_min	0.4046616957392982
deviation-heading_max	1.792097019803331
deviation-heading_mean	1.792097019803331
deviation-heading_median	1.792097019803331
deviation-heading_min	1.792097019803331
distance-from-start_max	2.088390544070356
distance-from-start_mean	2.088390544070356
distance-from-start_median	2.088390544070356
distance-from-start_min	2.088390544070356
driven_any_max	3.6327546669806985
driven_any_mean	3.6327546669806985
driven_any_median	3.6327546669806985
driven_any_min	3.6327546669806985
driven_lanedir_consec_max	2.7545657901440728
driven_lanedir_consec_mean	2.7545657901440728
driven_lanedir_consec_min	2.7545657901440728
driven_lanedir_max	2.7545657901440728
driven_lanedir_mean	2.7545657901440728
driven_lanedir_median	2.7545657901440728
driven_lanedir_min	2.7545657901440728
in-drivable-lane_max	2.650000000000005
in-drivable-lane_mean	2.650000000000005
in-drivable-lane_min	2.650000000000005
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.6327546669806985, "survival_time": 9.199999999999996, "driven_lanedir": 2.7545657901440728, "in-drivable-lane": 2.650000000000005, "deviation-heading": 1.792097019803331, "distance-from-start": 2.088390544070356, "deviation-center-line": 0.4046616957392982, "driven_lanedir_consec": 2.7545657901440728}}
simulation-passed	1
survival_time_max	9.199999999999996
survival_time_mean	9.199999999999996
survival_time_min	9.199999999999996

No reset possible

130092

sim-2of4

success

yes

2022-06-02 22:06:14+00:00

2022-06-02 22:10:32+00:00

0:04:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

130084

sim-2of4

timeout

yes

2022-05-26 18:58:21+00:00

No reset possible