Submission 17603

Submission

17603

Competing

yes

Challenge

aido-LFV-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 08:53:29+00:00

Last status update

2021-12-04 20:47:22+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 105570 sim-1of4: 105556 sim-2of4: 105561 sim-3of4: 105573

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

105573

Click the images to see detailed statistics about the episode.

loop-000

105570

Click the images to see detailed statistics about the episode.

loop2-000

105561

Click the images to see detailed statistics about the episode.

autolab-000

105556

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

105573

sim-3of4

success

yes

2021-11-03 03:33:53+00:00

2021-11-03 03:38:28+00:00

0:04:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	28.850000000000275
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.6605210049623778
deviation-center-line_median	0.9064417284907615

other stats

deviation-center-line_max	0.9064417284907615
deviation-center-line_mean	0.9064417284907615
deviation-center-line_min	0.9064417284907615
deviation-heading_max	2.343411904824809
deviation-heading_mean	2.343411904824809
deviation-heading_median	2.343411904824809
deviation-heading_min	2.343411904824809
distance-from-start_max	2.8035337093942156
distance-from-start_mean	2.8035337093942156
distance-from-start_median	2.8035337093942156
distance-from-start_min	2.8035337093942156
driven_any_max	3.685787415899725
driven_any_mean	3.685787415899725
driven_any_median	3.685787415899725
driven_any_min	3.685787415899725
driven_lanedir_consec_max	3.6605210049623778
driven_lanedir_consec_mean	3.6605210049623778
driven_lanedir_consec_min	3.6605210049623778
driven_lanedir_max	3.6605210049623778
driven_lanedir_mean	3.6605210049623778
driven_lanedir_median	3.6605210049623778
driven_lanedir_min	3.6605210049623778
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 3.685787415899725, "survival_time": 28.850000000000275, "driven_lanedir": 3.6605210049623778, "in-drivable-lane": 0.0, "deviation-heading": 2.343411904824809, "distance-from-start": 2.8035337093942156, "deviation-center-line": 0.9064417284907615, "driven_lanedir_consec": 3.6605210049623778}}
simulation-passed	1
survival_time_max	28.850000000000275
survival_time_mean	28.850000000000275
survival_time_min	28.850000000000275

No reset possible

105570

sim-0of4

success

yes

2021-11-03 03:32:56+00:00

2021-11-03 03:34:42+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.79999999999998
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.855175887719656
deviation-center-line_median	0.6303155599421255

other stats

deviation-center-line_max	0.6303155599421255
deviation-center-line_mean	0.6303155599421255
deviation-center-line_min	0.6303155599421255
deviation-heading_max	1.8296387547671484
deviation-heading_mean	1.8296387547671484
deviation-heading_median	1.8296387547671484
deviation-heading_min	1.8296387547671484
distance-from-start_max	0.6784783094123761
distance-from-start_mean	0.6784783094123761
distance-from-start_median	0.6784783094123761
distance-from-start_min	0.6784783094123761
driven_any_max	0.8908848189246968
driven_any_mean	0.8908848189246968
driven_any_median	0.8908848189246968
driven_any_min	0.8908848189246968
driven_lanedir_consec_max	0.855175887719656
driven_lanedir_consec_mean	0.855175887719656
driven_lanedir_consec_min	0.855175887719656
driven_lanedir_max	0.855175887719656
driven_lanedir_mean	0.855175887719656
driven_lanedir_median	0.855175887719656
driven_lanedir_min	0.855175887719656
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.8908848189246968, "survival_time": 7.79999999999998, "driven_lanedir": 0.855175887719656, "in-drivable-lane": 0.0, "deviation-heading": 1.8296387547671484, "distance-from-start": 0.6784783094123761, "deviation-center-line": 0.6303155599421255, "driven_lanedir_consec": 0.855175887719656}}
simulation-passed	1
survival_time_max	7.79999999999998
survival_time_mean	7.79999999999998
survival_time_min	7.79999999999998

No reset possible

105561

sim-2of4

success

yes

2021-11-03 03:29:44+00:00

2021-11-03 03:41:04+00:00

0:11:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	5.299999999999812
driven_lanedir_consec_median	4.934658183659174
deviation-center-line_median	2.9731736110228506

other stats

deviation-center-line_max	2.9731736110228506
deviation-center-line_mean	2.9731736110228506
deviation-center-line_min	2.9731736110228506
deviation-heading_max	14.4800846680467
deviation-heading_mean	14.4800846680467
deviation-heading_median	14.4800846680467
deviation-heading_min	14.4800846680467
distance-from-start_max	2.664807052731225
distance-from-start_mean	2.664807052731225
distance-from-start_median	2.664807052731225
distance-from-start_min	2.664807052731225
driven_any_max	7.913958910199103
driven_any_mean	7.913958910199103
driven_any_median	7.913958910199103
driven_any_min	7.913958910199103
driven_lanedir_consec_max	4.934658183659174
driven_lanedir_consec_mean	4.934658183659174
driven_lanedir_consec_min	4.934658183659174
driven_lanedir_max	6.61321692244162
driven_lanedir_mean	6.61321692244162
driven_lanedir_median	6.61321692244162
driven_lanedir_min	6.61321692244162
in-drivable-lane_max	5.299999999999812
in-drivable-lane_mean	5.299999999999812
in-drivable-lane_min	5.299999999999812
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.913958910199103, "survival_time": 59.99999999999873, "driven_lanedir": 6.61321692244162, "in-drivable-lane": 5.299999999999812, "deviation-heading": 14.4800846680467, "distance-from-start": 2.664807052731225, "deviation-center-line": 2.9731736110228506, "driven_lanedir_consec": 4.934658183659174}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105560

sim-0of4

success

yes

2021-11-03 03:29:16+00:00

2021-11-03 03:31:58+00:00

0:02:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105556

sim-1of4

success

yes

2021-11-03 03:28:05+00:00

2021-11-03 03:32:35+00:00

0:04:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	17.050000000000107
in-drivable-lane_median	1.7000000000000195
driven_lanedir_consec_median	1.0059150009906248
deviation-center-line_median	0.6030073172520661

other stats

deviation-center-line_max	0.6030073172520661
deviation-center-line_mean	0.6030073172520661
deviation-center-line_min	0.6030073172520661
deviation-heading_max	4.727403538893187
deviation-heading_mean	4.727403538893187
deviation-heading_median	4.727403538893187
deviation-heading_min	4.727403538893187
distance-from-start_max	0.7488768901168233
distance-from-start_mean	0.7488768901168233
distance-from-start_median	0.7488768901168233
distance-from-start_min	0.7488768901168233
driven_any_max	2.118875749873129
driven_any_mean	2.118875749873129
driven_any_median	2.118875749873129
driven_any_min	2.118875749873129
driven_lanedir_consec_max	1.0059150009906248
driven_lanedir_consec_mean	1.0059150009906248
driven_lanedir_consec_min	1.0059150009906248
driven_lanedir_max	1.7781903721333414
driven_lanedir_mean	1.7781903721333414
driven_lanedir_median	1.7781903721333414
driven_lanedir_min	1.7781903721333414
in-drivable-lane_max	1.7000000000000195
in-drivable-lane_mean	1.7000000000000195
in-drivable-lane_min	1.7000000000000195
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.118875749873129, "survival_time": 17.050000000000107, "driven_lanedir": 1.7781903721333414, "in-drivable-lane": 1.7000000000000195, "deviation-heading": 4.727403538893187, "distance-from-start": 0.7488768901168233, "deviation-center-line": 0.6030073172520661, "driven_lanedir_consec": 1.0059150009906248}}
simulation-passed	1
survival_time_max	17.050000000000107
survival_time_mean	17.050000000000107
survival_time_min	17.050000000000107

No reset possible

105552

sim-0of4

success

yes

2021-11-03 03:27:07+00:00

2021-11-03 03:28:53+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105549

sim-2of4

success

yes

2021-11-03 03:26:42+00:00

2021-11-03 03:29:10+00:00

0:02:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible