Submission 13637

Submission

13637

Competing

yes

Challenge

aido-LFVI_multi-sim-validation

User

Raphael Jean

Date submitted

2021-01-31 22:18:20+00:00

Last status update

2021-12-04 20:47:44+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104856 sim-1of4: 104894 sim-2of4: 104861 sim-3of4: 104896

User label

mobile-segmentation

Admin priority

Blessing

n/a

User priority

104894

Click the images to see detailed statistics about the episode.

4way-000

104856

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104896

sim-3of4

success

yes

2021-11-02 22:30:03+00:00

2021-11-02 22:31:15+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

104894

sim-1of4

success

yes

2021-11-02 22:29:30+00:00

2021-11-02 22:33:03+00:00

0:03:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	5.349999999999989
in-drivable-lane_median	0.9749999999999964
driven_lanedir_consec_median	1.0145378137304215
deviation-center-line_median	0.33707202315893514

other stats

deviation-center-line_max	0.6483181953289276
deviation-center-line_mean	0.3576731979096809
deviation-center-line_min	0.10823054999192566
deviation-heading_max	1.1254387391116698
deviation-heading_mean	0.9358589963304024
deviation-heading_median	0.9678746393479044
deviation-heading_min	0.6822479675141305
distance-from-start_max	1.6057929908455528
distance-from-start_mean	1.2510953007601937
distance-from-start_median	1.2057147090459095
distance-from-start_min	0.987158794103402
driven_any_max	1.937917444328892
driven_any_mean	1.469929267818153
driven_any_median	1.4655340428403516
driven_any_min	1.010731541263017
driven_lanedir_consec_max	1.5872458144222448
driven_lanedir_consec_mean	1.0803518362793876
driven_lanedir_consec_min	0.7050859032344629
driven_lanedir_max	1.888144666826664
driven_lanedir_mean	1.2411381729126956
driven_lanedir_median	1.1200744708364665
driven_lanedir_min	0.8362590831511851
in-drivable-lane_max	2.6999999999999904
in-drivable-lane_mean	1.162499999999996
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 1.8850465898239896, "survival_time": 5.349999999999989, "driven_lanedir": 1.295709232484239, "in-drivable-lane": 1.8999999999999932, "deviation-heading": 0.8700776985592218, "distance-from-start": 1.6057929908455528, "deviation-center-line": 0.10823054999192566, "driven_lanedir_consec": 1.295709232484239}, "4way-000-ego1": {"driven_any": 1.0460214958567138, "survival_time": 5.349999999999989, "driven_lanedir": 0.944439709188694, "in-drivable-lane": 2.6999999999999904, "deviation-heading": 0.6822479675141305, "distance-from-start": 0.987158794103402, "deviation-center-line": 0.1911311112336549, "driven_lanedir_consec": 0.733366394976604}, "4way-000-ego2": {"driven_any": 1.937917444328892, "survival_time": 5.349999999999989, "driven_lanedir": 1.888144666826664, "in-drivable-lane": 0.0, "deviation-heading": 1.065671580136587, "distance-from-start": 1.4112263604471482, "deviation-center-line": 0.48301293508421533, "driven_lanedir_consec": 1.5872458144222448}, "4way-000-ego3": {"driven_any": 1.010731541263017, "survival_time": 5.349999999999989, "driven_lanedir": 0.8362590831511851, "in-drivable-lane": 0.04999999999999982, "deviation-heading": 1.1254387391116698, "distance-from-start": 1.0002030576446712, "deviation-center-line": 0.6483181953289276, "driven_lanedir_consec": 0.7050859032344629}}
simulation-passed	1
survival_time_max	5.349999999999989
survival_time_mean	5.349999999999989
survival_time_min	5.349999999999989

No reset possible

104893

sim-3of4

success

yes

2021-11-02 22:28:22+00:00

2021-11-02 22:29:30+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104890

sim-3of4

success

yes

2021-11-02 22:26:45+00:00

2021-11-02 22:27:55+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104888

sim-1of4

success

yes

2021-11-02 22:25:41+00:00

2021-11-02 22:28:55+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104885

sim-3of4

success

yes

2021-11-02 22:25:05+00:00

2021-11-02 22:26:12+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104882

sim-3of4

success

yes

2021-11-02 22:23:34+00:00

2021-11-02 22:24:44+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104880

sim-1of4

success

yes

2021-11-02 22:21:58+00:00

2021-11-02 22:25:13+00:00

0:03:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104878

sim-3of4

success

yes

2021-11-02 22:19:22+00:00

2021-11-02 22:22:22+00:00

0:03:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104875

sim-1of4

success

yes

2021-11-02 22:17:45+00:00

2021-11-02 22:21:00+00:00

0:03:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104872

sim-3of4

success

yes

2021-11-02 22:17:27+00:00

2021-11-02 22:18:36+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104871

sim-3of4

timeout

yes

2021-11-02 22:14:17+00:00

2021-11-02 22:14:27+00:00

0:00:10

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104870

sim-1of4

success

yes

2021-11-02 22:14:02+00:00

2021-11-02 22:17:16+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104868

sim-3of4

success

yes

2021-11-02 22:11:54+00:00

2021-11-02 22:13:04+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104864

sim-3of4

success

yes

2021-11-02 22:09:43+00:00

2021-11-02 22:11:05+00:00

0:01:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104863

sim-1of4

timeout

yes

2021-11-02 22:09:08+00:00

2021-11-02 22:09:18+00:00

0:00:10

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104862

sim-1of4

success

yes

2021-11-02 22:08:35+00:00

2021-11-02 22:12:38+00:00

0:04:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104861

sim-2of4

success

yes

2021-11-02 22:08:16+00:00

2021-11-02 22:09:31+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

104859

sim-2of4

success

yes

2021-11-02 22:06:43+00:00

2021-11-02 22:07:55+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104858

sim-3of4

success

yes

2021-11-02 22:06:41+00:00

2021-11-02 22:07:50+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104857

sim-2of4

success

yes

2021-11-02 22:04:55+00:00

2021-11-02 22:06:05+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104856

sim-0of4

success

yes

2021-11-02 22:03:22+00:00

2021-11-02 22:08:23+00:00

0:05:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.550000000000043
in-drivable-lane_median	0.6999999999999982
driven_lanedir_consec_median	0.7037464582389903
deviation-center-line_median	1.5041174749956825

other stats

deviation-center-line_max	1.644438324951205
deviation-center-line_mean	1.3212122877994932
deviation-center-line_min	0.6321758762554034
deviation-heading_max	14.564868662132817
deviation-heading_mean	7.95844681832123
deviation-heading_median	7.951386500411211
deviation-heading_min	1.366145610329682
distance-from-start_max	3.4526215628421757
distance-from-start_mean	1.651874574286553
distance-from-start_median	1.088845915025075
distance-from-start_min	0.9771849042538864
driven_any_max	5.132011522014099
driven_any_mean	2.110162766575158
driven_any_median	1.153041601432658
driven_any_min	1.0025563414212155
driven_lanedir_consec_max	4.293008292626892
driven_lanedir_consec_mean	1.5894209822358063
driven_lanedir_consec_min	0.657182719838354
driven_lanedir_max	4.29305171243689
driven_lanedir_mean	1.614633962943412
driven_lanedir_median	0.7381518079514795
driven_lanedir_min	0.6891805234338002
in-drivable-lane_max	2.250000000000032
in-drivable-lane_mean	0.9625000000000068
in-drivable-lane_min	0.1999999999999993
per-episodes	details {"udem-000-ego0": {"driven_any": 5.132011522014099, "survival_time": 12.550000000000043, "driven_lanedir": 4.29305171243689, "in-drivable-lane": 2.250000000000032, "deviation-heading": 2.248039967650166, "distance-from-start": 3.4526215628421757, "deviation-center-line": 0.6321758762554034, "driven_lanedir_consec": 4.293008292626892}, "udem-000-ego1": {"driven_any": 1.303169591453934, "survival_time": 12.550000000000043, "driven_lanedir": 0.6891805234338002, "in-drivable-lane": 1.0499999999999976, "deviation-heading": 1.366145610329682, "distance-from-start": 1.188111904600963, "deviation-center-line": 1.644438324951205, "driven_lanedir_consec": 0.6891805234338002}, "udem-000-ego2": {"driven_any": 1.0025563414212155, "survival_time": 12.550000000000043, "driven_lanedir": 0.7491199120506384, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 13.654733033172256, "distance-from-start": 0.9771849042538864, "deviation-center-line": 1.374292826582619, "driven_lanedir_consec": 0.7183123930441804}, "udem-000-ego3": {"driven_any": 1.002913611411382, "survival_time": 12.550000000000043, "driven_lanedir": 0.7271837038523206, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 14.564868662132817, "distance-from-start": 0.9895799254491876, "deviation-center-line": 1.6339421234087452, "driven_lanedir_consec": 0.657182719838354}}
simulation-passed	1
survival_time_max	12.550000000000043
survival_time_mean	12.550000000000043
survival_time_min	12.550000000000043

No reset possible