Submission 18704

Submission

18704

Competing

yes

Challenge

aido-LF-full-sim-validation

User

Joakim Aarskog

Date submitted

2022-05-15 14:15:44+00:00

Last status update

2022-06-02 23:17:43+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 130103 sim-1of4: 130108 sim-2of4: 130105 sim-3of4: 130107

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

130108

Click the images to see detailed statistics about the episode.

loop-000

130107

Click the images to see detailed statistics about the episode.

loop2-000

130105

Click the images to see detailed statistics about the episode.

autolab-000

130103

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

130108

sim-1of4

success

yes

2022-06-02 23:08:10+00:00

2022-06-02 23:14:06+00:00

0:05:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.100000000000051
in-drivable-lane_median	9.050000000000052
driven_lanedir_consec_median	1.624867982795681
deviation-center-line_median	0.2566223912129241

other stats

deviation-center-line_max	0.2566223912129241
deviation-center-line_mean	0.2566223912129241
deviation-center-line_min	0.2566223912129241
deviation-heading_max	1.264114407601428
deviation-heading_mean	1.264114407601428
deviation-heading_median	1.264114407601428
deviation-heading_min	1.264114407601428
distance-from-start_max	2.593743128129699
distance-from-start_mean	2.593743128129699
distance-from-start_median	2.593743128129699
distance-from-start_min	2.593743128129699
driven_any_max	4.758064424663004
driven_any_mean	4.758064424663004
driven_any_median	4.758064424663004
driven_any_min	4.758064424663004
driven_lanedir_consec_max	1.624867982795681
driven_lanedir_consec_mean	1.624867982795681
driven_lanedir_consec_min	1.624867982795681
driven_lanedir_max	1.624867982795681
driven_lanedir_mean	1.624867982795681
driven_lanedir_median	1.624867982795681
driven_lanedir_min	1.624867982795681
in-drivable-lane_max	9.050000000000052
in-drivable-lane_mean	9.050000000000052
in-drivable-lane_min	9.050000000000052
per-episodes	details {"loop-000-ego0": {"driven_any": 4.758064424663004, "survival_time": 13.100000000000051, "driven_lanedir": 1.624867982795681, "in-drivable-lane": 9.050000000000052, "deviation-heading": 1.264114407601428, "distance-from-start": 2.593743128129699, "deviation-center-line": 0.2566223912129241, "driven_lanedir_consec": 1.624867982795681}}
simulation-passed	1
survival_time_max	13.100000000000051
survival_time_mean	13.100000000000051
survival_time_min	13.100000000000051

No reset possible

130107

sim-3of4

success

yes

2022-06-02 23:03:56+00:00

2022-06-02 23:07:25+00:00

0:03:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	4.549999999999992
in-drivable-lane_median	1.4499999999999948
driven_lanedir_consec_median	1.1263931549495028
deviation-center-line_median	0.18951852004564057

other stats

deviation-center-line_max	0.18951852004564057
deviation-center-line_mean	0.18951852004564057
deviation-center-line_min	0.18951852004564057
deviation-heading_max	0.8332112466687285
deviation-heading_mean	0.8332112466687285
deviation-heading_median	0.8332112466687285
deviation-heading_min	0.8332112466687285
distance-from-start_max	1.3729055491594329
distance-from-start_mean	1.3729055491594329
distance-from-start_median	1.3729055491594329
distance-from-start_min	1.3729055491594329
driven_any_max	1.5325155634741363
driven_any_mean	1.5325155634741363
driven_any_median	1.5325155634741363
driven_any_min	1.5325155634741363
driven_lanedir_consec_max	1.1263931549495028
driven_lanedir_consec_mean	1.1263931549495028
driven_lanedir_consec_min	1.1263931549495028
driven_lanedir_max	1.1263931549495028
driven_lanedir_mean	1.1263931549495028
driven_lanedir_median	1.1263931549495028
driven_lanedir_min	1.1263931549495028
in-drivable-lane_max	1.4499999999999948
in-drivable-lane_mean	1.4499999999999948
in-drivable-lane_min	1.4499999999999948
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.5325155634741363, "survival_time": 4.549999999999992, "driven_lanedir": 1.1263931549495028, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 0.8332112466687285, "distance-from-start": 1.3729055491594329, "deviation-center-line": 0.18951852004564057, "driven_lanedir_consec": 1.1263931549495028}}
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	4.549999999999992
survival_time_min	4.549999999999992

No reset possible

130106

sim-3of4

success

yes

2022-06-02 22:58:37+00:00

2022-06-02 23:03:11+00:00

0:04:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

130105

sim-2of4

success

yes

2022-06-02 22:52:28+00:00

2022-06-02 22:58:28+00:00

0:06:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	15.350000000000083
in-drivable-lane_median	12.200000000000086
driven_lanedir_consec_median	0.9165100485577888
deviation-center-line_median	0.21704981418405936

other stats

deviation-center-line_max	0.21704981418405936
deviation-center-line_mean	0.21704981418405936
deviation-center-line_min	0.21704981418405936
deviation-heading_max	1.5731252156610211
deviation-heading_mean	1.5731252156610211
deviation-heading_median	1.5731252156610211
deviation-heading_min	1.5731252156610211
distance-from-start_max	3.6666416731568527
distance-from-start_mean	3.6666416731568527
distance-from-start_median	3.6666416731568527
distance-from-start_min	3.6666416731568527
driven_any_max	5.881799615631414
driven_any_mean	5.881799615631414
driven_any_median	5.881799615631414
driven_any_min	5.881799615631414
driven_lanedir_consec_max	0.9165100485577888
driven_lanedir_consec_mean	0.9165100485577888
driven_lanedir_consec_min	0.9165100485577888
driven_lanedir_max	0.9165100485577888
driven_lanedir_mean	0.9165100485577888
driven_lanedir_median	0.9165100485577888
driven_lanedir_min	0.9165100485577888
in-drivable-lane_max	12.200000000000086
in-drivable-lane_mean	12.200000000000086
in-drivable-lane_min	12.200000000000086
per-episodes	details {"autolab-000-ego0": {"driven_any": 5.881799615631414, "survival_time": 15.350000000000083, "driven_lanedir": 0.9165100485577888, "in-drivable-lane": 12.200000000000086, "deviation-heading": 1.5731252156610211, "distance-from-start": 3.6666416731568527, "deviation-center-line": 0.21704981418405936, "driven_lanedir_consec": 0.9165100485577888}}
simulation-passed	1
survival_time_max	15.350000000000083
survival_time_mean	15.350000000000083
survival_time_min	15.350000000000083

No reset possible

130104

sim-2of4

success

yes

2022-06-02 22:46:59+00:00

2022-06-02 22:52:20+00:00

0:05:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

130103

sim-0of4

success

yes

2022-06-02 22:42:12+00:00

2022-06-02 22:46:31+00:00

0:04:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	5.599999999999988
in-drivable-lane_median	2.549999999999991
driven_lanedir_consec_median	0.7934588900279985
deviation-center-line_median	0.17847918033572974

other stats

deviation-center-line_max	0.17847918033572974
deviation-center-line_mean	0.17847918033572974
deviation-center-line_min	0.17847918033572974
deviation-heading_max	0.995819299362146
deviation-heading_mean	0.995819299362146
deviation-heading_median	0.995819299362146
deviation-heading_min	0.995819299362146
distance-from-start_max	1.217345210223146
distance-from-start_mean	1.217345210223146
distance-from-start_median	1.217345210223146
distance-from-start_min	1.217345210223146
driven_any_max	1.3424239487102645
driven_any_mean	1.3424239487102645
driven_any_median	1.3424239487102645
driven_any_min	1.3424239487102645
driven_lanedir_consec_max	0.7934588900279985
driven_lanedir_consec_mean	0.7934588900279985
driven_lanedir_consec_min	0.7934588900279985
driven_lanedir_max	0.7934588900279985
driven_lanedir_mean	0.7934588900279985
driven_lanedir_median	0.7934588900279985
driven_lanedir_min	0.7934588900279985
in-drivable-lane_max	2.549999999999991
in-drivable-lane_mean	2.549999999999991
in-drivable-lane_min	2.549999999999991
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.3424239487102645, "survival_time": 5.599999999999988, "driven_lanedir": 0.7934588900279985, "in-drivable-lane": 2.549999999999991, "deviation-heading": 0.995819299362146, "distance-from-start": 1.217345210223146, "deviation-center-line": 0.17847918033572974, "driven_lanedir_consec": 0.7934588900279985}}
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	5.599999999999988
survival_time_min	5.599999999999988

No reset possible