Submission 13983

Submission

13983

Competing

yes

Challenge

aido-LF-sim-validation

User

Liam Paull 🇨🇦

Date submitted

2021-04-04 19:50:26+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 114807 sim-1of4: 114782 sim-2of4: 114779 sim-3of4: 114784

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

114807

Click the images to see detailed statistics about the episode.

loop2-000

114784

Click the images to see detailed statistics about the episode.

loop-000

114782

Click the images to see detailed statistics about the episode.

zigzag-000

114779

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

114807

sim-0of4

success

yes

2021-11-06 12:26:12+00:00

2021-11-06 12:28:42+00:00

0:02:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3320755845686594
survival_time_median	32.90000000000027
deviation-center-line_median	0.7458842348291002
in-drivable-lane_median	24.350000000000215

other stats

deviation-center-line_max	0.7458842348291002
deviation-center-line_mean	0.7458842348291002
deviation-center-line_min	0.7458842348291002
deviation-heading_max	6.702758649906453
deviation-heading_mean	6.702758649906453
deviation-heading_median	6.702758649906453
deviation-heading_min	6.702758649906453
distance-from-start_max	1.908600000000561
distance-from-start_mean	1.908600000000561
distance-from-start_median	1.908600000000561
distance-from-start_min	1.908600000000561
driven_any_max	1.9086000000004644
driven_any_mean	1.9086000000004644
driven_any_median	1.9086000000004644
driven_any_min	1.9086000000004644
driven_lanedir_consec_max	0.3320755845686594
driven_lanedir_consec_mean	0.3320755845686594
driven_lanedir_consec_min	0.3320755845686594
driven_lanedir_max	0.3320755845686594
driven_lanedir_mean	0.3320755845686594
driven_lanedir_median	0.3320755845686594
driven_lanedir_min	0.3320755845686594
in-drivable-lane_max	24.350000000000215
in-drivable-lane_mean	24.350000000000215
in-drivable-lane_min	24.350000000000215
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.9086000000004644, "survival_time": 32.90000000000027, "driven_lanedir": 0.3320755845686594, "in-drivable-lane": 24.350000000000215, "deviation-heading": 6.702758649906453, "distance-from-start": 1.908600000000561, "deviation-center-line": 0.7458842348291002, "driven_lanedir_consec": 0.3320755845686594}}
simulation-passed	1
survival_time_max	32.90000000000027
survival_time_mean	32.90000000000027
survival_time_min	32.90000000000027

No reset possible

114792

sim-0of4

success

yes

2021-11-06 12:23:08+00:00

2021-11-06 12:25:31+00:00

0:02:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114784

sim-3of4

success

yes

2021-11-06 12:22:02+00:00

2021-11-06 12:23:28+00:00

0:01:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2015216993817159
survival_time_median	14.850000000000076
deviation-center-line_median	0.34809418019049376
in-drivable-lane_median	10.550000000000082

other stats

deviation-center-line_max	0.34809418019049376
deviation-center-line_mean	0.34809418019049376
deviation-center-line_min	0.34809418019049376
deviation-heading_max	2.3111864484133617
deviation-heading_mean	2.3111864484133617
deviation-heading_median	2.3111864484133617
deviation-heading_min	2.3111864484133617
distance-from-start_max	0.8256000000000894
distance-from-start_mean	0.8256000000000894
distance-from-start_median	0.8256000000000894
distance-from-start_min	0.8256000000000894
driven_any_max	0.8256000000001047
driven_any_mean	0.8256000000001047
driven_any_median	0.8256000000001047
driven_any_min	0.8256000000001047
driven_lanedir_consec_max	0.2015216993817159
driven_lanedir_consec_mean	0.2015216993817159
driven_lanedir_consec_min	0.2015216993817159
driven_lanedir_max	0.2015216993817159
driven_lanedir_mean	0.2015216993817159
driven_lanedir_median	0.2015216993817159
driven_lanedir_min	0.2015216993817159
in-drivable-lane_max	10.550000000000082
in-drivable-lane_mean	10.550000000000082
in-drivable-lane_min	10.550000000000082
per-episodes	details {"loop-000-ego0": {"driven_any": 0.8256000000001047, "survival_time": 14.850000000000076, "driven_lanedir": 0.2015216993817159, "in-drivable-lane": 10.550000000000082, "deviation-heading": 2.3111864484133617, "distance-from-start": 0.8256000000000894, "deviation-center-line": 0.34809418019049376, "driven_lanedir_consec": 0.2015216993817159}}
simulation-passed	1
survival_time_max	14.850000000000076
survival_time_mean	14.850000000000076
survival_time_min	14.850000000000076

No reset possible

114782

sim-1of4

success

yes

2021-11-06 12:21:27+00:00

2021-11-06 12:23:12+00:00

0:01:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.13991928144539578
survival_time_median	18.00000000000012
deviation-center-line_median	0.2574139970765134
in-drivable-lane_median	14.550000000000123

other stats

deviation-center-line_max	0.2574139970765134
deviation-center-line_mean	0.2574139970765134
deviation-center-line_min	0.2574139970765134
deviation-heading_max	2.3527101648793383
deviation-heading_mean	2.3527101648793383
deviation-heading_median	2.3527101648793383
deviation-heading_min	2.3527101648793383
distance-from-start_max	1.0145999999997628
distance-from-start_mean	1.0145999999997628
distance-from-start_median	1.0145999999997628
distance-from-start_min	1.0145999999997628
driven_any_max	1.0145999999997255
driven_any_mean	1.0145999999997255
driven_any_median	1.0145999999997255
driven_any_min	1.0145999999997255
driven_lanedir_consec_max	0.13991928144539578
driven_lanedir_consec_mean	0.13991928144539578
driven_lanedir_consec_min	0.13991928144539578
driven_lanedir_max	0.13991928144539578
driven_lanedir_mean	0.13991928144539578
driven_lanedir_median	0.13991928144539578
driven_lanedir_min	0.13991928144539578
in-drivable-lane_max	14.550000000000123
in-drivable-lane_mean	14.550000000000123
in-drivable-lane_min	14.550000000000123
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.0145999999997255, "survival_time": 18.00000000000012, "driven_lanedir": 0.13991928144539578, "in-drivable-lane": 14.550000000000123, "deviation-heading": 2.3527101648793383, "distance-from-start": 1.0145999999997628, "deviation-center-line": 0.2574139970765134, "driven_lanedir_consec": 0.13991928144539578}}
simulation-passed	1
survival_time_max	18.00000000000012
survival_time_mean	18.00000000000012
survival_time_min	18.00000000000012

No reset possible

114779

sim-2of4

success

yes

2021-11-06 12:20:24+00:00

2021-11-06 12:22:26+00:00

0:02:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.20153874631017477
survival_time_median	25.950000000000234
deviation-center-line_median	0.34809402621793606
in-drivable-lane_median	21.65000000000024

other stats

deviation-center-line_max	0.34809402621793606
deviation-center-line_mean	0.34809402621793606
deviation-center-line_min	0.34809402621793606
deviation-heading_max	2.3111864484133617
deviation-heading_mean	2.3111864484133617
deviation-heading_median	2.3111864484133617
deviation-heading_min	2.3111864484133617
distance-from-start_max	1.491599999998776
distance-from-start_mean	1.491599999998776
distance-from-start_median	1.491599999998776
distance-from-start_min	1.491599999998776
driven_any_max	1.4915999999988068
driven_any_mean	1.4915999999988068
driven_any_median	1.4915999999988068
driven_any_min	1.4915999999988068
driven_lanedir_consec_max	0.20153874631017477
driven_lanedir_consec_mean	0.20153874631017477
driven_lanedir_consec_min	0.20153874631017477
driven_lanedir_max	0.20153874631017477
driven_lanedir_mean	0.20153874631017477
driven_lanedir_median	0.20153874631017477
driven_lanedir_min	0.20153874631017477
in-drivable-lane_max	21.65000000000024
in-drivable-lane_mean	21.65000000000024
in-drivable-lane_min	21.65000000000024
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.4915999999988068, "survival_time": 25.950000000000234, "driven_lanedir": 0.20153874631017477, "in-drivable-lane": 21.65000000000024, "deviation-heading": 2.3111864484133617, "distance-from-start": 1.491599999998776, "deviation-center-line": 0.34809402621793606, "driven_lanedir_consec": 0.20153874631017477}}
simulation-passed	1
survival_time_max	25.950000000000234
survival_time_mean	25.950000000000234
survival_time_min	25.950000000000234

No reset possible

114774

sim-3of4

success

yes

2021-11-06 12:19:59+00:00

2021-11-06 12:21:34+00:00

0:01:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114772

sim-1of4

success

yes

2021-11-06 12:19:26+00:00

2021-11-06 12:21:05+00:00

0:01:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62975

347

success

yes

2021-04-04 19:54:34+00:00

2021-04-04 20:17:58+00:00

0:23:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible