Submission 18341

Submission

18341

Competing

yes

Challenge

aido-LFI-sim-validation

User

Bence Haromi

Date submitted

2021-12-07 12:32:12+00:00

Last status update

2021-12-07 13:50:24+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 120870 sim-1of4: 120899 sim-2of4: 120842 sim-3of4: 120900

User label

005-0.8

Admin priority

Blessing

n/a

User priority

120899

Click the images to see detailed statistics about the episode.

udem1-000

120870

Click the images to see detailed statistics about the episode.

udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

120900

sim-3of4

success

yes

2021-12-07 13:46:01+00:00

2021-12-07 13:47:13+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

120899

sim-1of4

success

yes

2021-12-07 13:44:19+00:00

2021-12-07 13:47:05+00:00

0:02:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.900000000000048
in-drivable-lane_median	0.6500000000000092
driven_lanedir_consec_median	3.8396529481834256
deviation-center-line_median	0.9907722867608164

other stats

deviation-center-line_max	0.9907722867608164
deviation-center-line_mean	0.9907722867608164
deviation-center-line_min	0.9907722867608164
deviation-heading_max	4.902942017315086
deviation-heading_mean	4.902942017315086
deviation-heading_median	4.902942017315086
deviation-heading_min	4.902942017315086
distance-from-start_max	2.3084751540544124
distance-from-start_mean	2.3084751540544124
distance-from-start_median	2.3084751540544124
distance-from-start_min	2.3084751540544124
driven_any_max	4.583255764657249
driven_any_mean	4.583255764657249
driven_any_median	4.583255764657249
driven_any_min	4.583255764657249
driven_lanedir_consec_max	3.8396529481834256
driven_lanedir_consec_mean	3.8396529481834256
driven_lanedir_consec_min	3.8396529481834256
driven_lanedir_max	4.005398048586582
driven_lanedir_mean	4.005398048586582
driven_lanedir_median	4.005398048586582
driven_lanedir_min	4.005398048586582
in-drivable-lane_max	0.6500000000000092
in-drivable-lane_mean	0.6500000000000092
in-drivable-lane_min	0.6500000000000092
per-episodes	details {"udem1-000-ego0": {"driven_any": 4.583255764657249, "survival_time": 12.900000000000048, "driven_lanedir": 4.005398048586582, "in-drivable-lane": 0.6500000000000092, "deviation-heading": 4.902942017315086, "distance-from-start": 2.3084751540544124, "deviation-center-line": 0.9907722867608164, "driven_lanedir_consec": 3.8396529481834256}}
simulation-passed	1
survival_time_max	12.900000000000048
survival_time_mean	12.900000000000048
survival_time_min	12.900000000000048

No reset possible

120898

sim-3of4

success

yes

2021-12-07 13:44:18+00:00

2021-12-07 13:45:31+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120896

sim-3of4

success

yes

2021-12-07 13:42:43+00:00

2021-12-07 13:43:54+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120893

sim-1of4

success

yes

2021-12-07 13:41:21+00:00

2021-12-07 13:44:03+00:00

0:02:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120892

sim-3of4

success

yes

2021-12-07 13:41:17+00:00

2021-12-07 13:42:27+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120889

sim-1of4

timeout

yes

2021-12-07 13:40:51+00:00

2021-12-07 13:41:01+00:00

0:00:10

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120888

sim-3of4

success

yes

2021-12-07 13:39:50+00:00

2021-12-07 13:41:01+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120884

sim-3of4

success

yes

2021-12-07 13:38:04+00:00

2021-12-07 13:39:15+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120881

sim-3of4

success

yes

2021-12-07 13:36:36+00:00

2021-12-07 13:37:48+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120880

sim-1of4

success

yes

2021-12-07 13:36:35+00:00

2021-12-07 13:39:20+00:00

0:02:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

120870

sim-0of4

success

yes

2021-12-07 13:32:42+00:00

2021-12-07 13:38:08+00:00

0:05:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.00000000000005
in-drivable-lane_median	0.5500000000000078
driven_lanedir_consec_median	3.8900897740062943
deviation-center-line_median	1.047472716634443

other stats

deviation-center-line_max	1.047472716634443
deviation-center-line_mean	1.047472716634443
deviation-center-line_min	1.047472716634443
deviation-heading_max	5.154112466759069
deviation-heading_mean	5.154112466759069
deviation-heading_median	5.154112466759069
deviation-heading_min	5.154112466759069
distance-from-start_max	2.3004775258965844
distance-from-start_mean	2.3004775258965844
distance-from-start_median	2.3004775258965844
distance-from-start_min	2.3004775258965844
driven_any_max	4.606732105628304
driven_any_mean	4.606732105628304
driven_any_median	4.606732105628304
driven_any_min	4.606732105628304
driven_lanedir_consec_max	3.8900897740062943
driven_lanedir_consec_mean	3.8900897740062943
driven_lanedir_consec_min	3.8900897740062943
driven_lanedir_max	4.0472300507138845
driven_lanedir_mean	4.0472300507138845
driven_lanedir_median	4.0472300507138845
driven_lanedir_min	4.0472300507138845
in-drivable-lane_max	0.5500000000000078
in-drivable-lane_mean	0.5500000000000078
in-drivable-lane_min	0.5500000000000078
per-episodes	details {"udem1-000-ego0": {"driven_any": 4.606732105628304, "survival_time": 13.00000000000005, "driven_lanedir": 4.0472300507138845, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 5.154112466759069, "distance-from-start": 2.3004775258965844, "deviation-center-line": 1.047472716634443, "driven_lanedir_consec": 3.8900897740062943}}
simulation-passed	1
survival_time_max	13.00000000000005
survival_time_mean	13.00000000000005
survival_time_min	13.00000000000005

No reset possible

120842

sim-2of4

success

yes

2021-12-07 13:21:24+00:00

2021-12-07 13:22:37+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible