Submission 15152

Submission

15152

Competing

yes

Challenge

aido-LF-sim-validation

User

Mattia Calderone

Date submitted

2021-04-30 14:20:26+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 111970 sim-1of4: 111966 sim-2of4: 111976 sim-3of4: 111965

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

111976

Click the images to see detailed statistics about the episode.

autolab-000

111970

Click the images to see detailed statistics about the episode.

loop2-000

111966

Click the images to see detailed statistics about the episode.

zigzag-000

111965

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

111976

sim-2of4

success

yes

2021-11-05 16:53:07+00:00

2021-11-05 16:55:52+00:00

0:02:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8749307976159656
survival_time_median	28.750000000000274
deviation-center-line_median	0.21757637448707
in-drivable-lane_median	21.350000000000293

other stats

deviation-center-line_max	0.21757637448707
deviation-center-line_mean	0.21757637448707
deviation-center-line_min	0.21757637448707
deviation-heading_max	1.7582411172227583
deviation-heading_mean	1.7582411172227583
deviation-heading_median	1.7582411172227583
deviation-heading_min	1.7582411172227583
distance-from-start_max	1.4362309081426212
distance-from-start_mean	1.4362309081426212
distance-from-start_median	1.4362309081426212
distance-from-start_min	1.4362309081426212
driven_any_max	3.665784243454852
driven_any_mean	3.665784243454852
driven_any_median	3.665784243454852
driven_any_min	3.665784243454852
driven_lanedir_consec_max	0.8749307976159656
driven_lanedir_consec_mean	0.8749307976159656
driven_lanedir_consec_min	0.8749307976159656
driven_lanedir_max	0.8749307976159656
driven_lanedir_mean	0.8749307976159656
driven_lanedir_median	0.8749307976159656
driven_lanedir_min	0.8749307976159656
in-drivable-lane_max	21.350000000000293
in-drivable-lane_mean	21.350000000000293
in-drivable-lane_min	21.350000000000293
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.665784243454852, "survival_time": 28.750000000000274, "driven_lanedir": 0.8749307976159656, "in-drivable-lane": 21.350000000000293, "deviation-heading": 1.7582411172227583, "distance-from-start": 1.4362309081426212, "deviation-center-line": 0.21757637448707, "driven_lanedir_consec": 0.8749307976159656}}
simulation-passed	1
survival_time_max	28.750000000000274
survival_time_mean	28.750000000000274
survival_time_min	28.750000000000274

No reset possible

111971

sim-2of4

success

yes

2021-11-05 16:47:05+00:00

2021-11-05 16:52:27+00:00

0:05:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

111970

sim-0of4

success

yes

2021-11-05 16:46:46+00:00

2021-11-05 16:48:57+00:00

0:02:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3389729862143278
survival_time_median	15.900000000000093
deviation-center-line_median	0.374802080482778
in-drivable-lane_median	10.300000000000104

other stats

deviation-center-line_max	0.374802080482778
deviation-center-line_mean	0.374802080482778
deviation-center-line_min	0.374802080482778
deviation-heading_max	2.75920326736158
deviation-heading_mean	2.75920326736158
deviation-heading_median	2.75920326736158
deviation-heading_min	2.75920326736158
distance-from-start_max	0.5355670352183239
distance-from-start_mean	0.5355670352183239
distance-from-start_median	0.5355670352183239
distance-from-start_min	0.5355670352183239
driven_any_max	1.966220847792864
driven_any_mean	1.966220847792864
driven_any_median	1.966220847792864
driven_any_min	1.966220847792864
driven_lanedir_consec_max	0.3389729862143278
driven_lanedir_consec_mean	0.3389729862143278
driven_lanedir_consec_min	0.3389729862143278
driven_lanedir_max	0.5904350118866353
driven_lanedir_mean	0.5904350118866353
driven_lanedir_median	0.5904350118866353
driven_lanedir_min	0.5904350118866353
in-drivable-lane_max	10.300000000000104
in-drivable-lane_mean	10.300000000000104
in-drivable-lane_min	10.300000000000104
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.966220847792864, "survival_time": 15.900000000000093, "driven_lanedir": 0.5904350118866353, "in-drivable-lane": 10.300000000000104, "deviation-heading": 2.75920326736158, "distance-from-start": 0.5355670352183239, "deviation-center-line": 0.374802080482778, "driven_lanedir_consec": 0.3389729862143278}}
simulation-passed	1
survival_time_max	15.900000000000093
survival_time_mean	15.900000000000093
survival_time_min	15.900000000000093

No reset possible

111967

sim-0of4

success

yes

2021-11-05 16:44:04+00:00

2021-11-05 16:46:39+00:00

0:02:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

111966

sim-1of4

success

yes

2021-11-05 16:42:58+00:00

2021-11-05 16:48:30+00:00

0:05:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.537664197053984
survival_time_median	59.99999999999873
deviation-center-line_median	4.511603616980321
in-drivable-lane_median	11.349999999999795

other stats

deviation-center-line_max	4.511603616980321
deviation-center-line_mean	4.511603616980321
deviation-center-line_min	4.511603616980321
deviation-heading_max	12.92823925040031
deviation-heading_mean	12.92823925040031
deviation-heading_median	12.92823925040031
deviation-heading_min	12.92823925040031
distance-from-start_max	4.374075907688138
distance-from-start_mean	4.374075907688138
distance-from-start_median	4.374075907688138
distance-from-start_min	4.374075907688138
driven_any_max	7.914343463477343
driven_any_mean	7.914343463477343
driven_any_median	7.914343463477343
driven_any_min	7.914343463477343
driven_lanedir_consec_max	5.537664197053984
driven_lanedir_consec_mean	5.537664197053984
driven_lanedir_consec_min	5.537664197053984
driven_lanedir_max	5.964154760232043
driven_lanedir_mean	5.964154760232043
driven_lanedir_median	5.964154760232043
driven_lanedir_min	5.964154760232043
in-drivable-lane_max	11.349999999999795
in-drivable-lane_mean	11.349999999999795
in-drivable-lane_min	11.349999999999795
per-episodes	details {"zigzag-000-ego0": {"driven_any": 7.914343463477343, "survival_time": 59.99999999999873, "driven_lanedir": 5.964154760232043, "in-drivable-lane": 11.349999999999795, "deviation-heading": 12.92823925040031, "distance-from-start": 4.374075907688138, "deviation-center-line": 4.511603616980321, "driven_lanedir_consec": 5.537664197053984}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

111965

sim-3of4

success

yes

2021-11-05 16:42:32+00:00

2021-11-05 16:46:52+00:00

0:04:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.711845111473135
survival_time_median	59.99999999999873
deviation-center-line_median	2.569149424464828
in-drivable-lane_median	5.09999999999971

other stats

deviation-center-line_max	2.569149424464828
deviation-center-line_mean	2.569149424464828
deviation-center-line_min	2.569149424464828
deviation-heading_max	9.09803596358841
deviation-heading_mean	9.09803596358841
deviation-heading_median	9.09803596358841
deviation-heading_min	9.09803596358841
distance-from-start_max	2.4840053658446495
distance-from-start_mean	2.4840053658446495
distance-from-start_median	2.4840053658446495
distance-from-start_min	2.4840053658446495
driven_any_max	7.914390861404529
driven_any_mean	7.914390861404529
driven_any_median	7.914390861404529
driven_any_min	7.914390861404529
driven_lanedir_consec_max	6.711845111473135
driven_lanedir_consec_mean	6.711845111473135
driven_lanedir_consec_min	6.711845111473135
driven_lanedir_max	6.957422625941213
driven_lanedir_mean	6.957422625941213
driven_lanedir_median	6.957422625941213
driven_lanedir_min	6.957422625941213
in-drivable-lane_max	5.09999999999971
in-drivable-lane_mean	5.09999999999971
in-drivable-lane_min	5.09999999999971
per-episodes	details {"loop-000-ego0": {"driven_any": 7.914390861404529, "survival_time": 59.99999999999873, "driven_lanedir": 6.957422625941213, "in-drivable-lane": 5.09999999999971, "deviation-heading": 9.09803596358841, "distance-from-start": 2.4840053658446495, "deviation-center-line": 2.569149424464828, "driven_lanedir_consec": 6.711845111473135}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

111964

sim-0of4

success

yes

2021-11-05 16:42:28+00:00

2021-11-05 16:43:45+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible