Evaluator 5577

baseline-duckietown

sim-1of4

timeout

yes

2022-06-03 03:11:00+00:00

No reset possible

130110

18702

baseline-duckietown

sim-3of4

host-error

yes

2022-06-02 23:20:16+00:00

2022-06-03 03:10:25+00:00

3:50:09

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 856, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1058, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get "https://registry-1.docker.io/v2/": read tcp 172.29.7.108:44218->35.170.144.174:443: read: connection reset by peer")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

130109

18702

baseline-duckietown

sim-2of4

success

yes

2022-06-02 23:14:28+00:00

2022-06-02 23:19:40+00:00

0:05:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.84999999999998
in-drivable-lane_median	4.949999999999982
driven_lanedir_consec_median	0.8894209326703845
deviation-center-line_median	0.1836844557915258

other stats

deviation-center-line_max	0.1836844557915258
deviation-center-line_mean	0.1836844557915258
deviation-center-line_min	0.1836844557915258
deviation-heading_max	1.460441425913939
deviation-heading_mean	1.460441425913939
deviation-heading_median	1.460441425913939
deviation-heading_min	1.460441425913939
distance-from-start_max	2.073997242248557
distance-from-start_mean	2.073997242248557
distance-from-start_median	2.073997242248557
distance-from-start_min	2.073997242248557
driven_any_max	2.644451425910487
driven_any_mean	2.644451425910487
driven_any_median	2.644451425910487
driven_any_min	2.644451425910487
driven_lanedir_consec_max	0.8894209326703845
driven_lanedir_consec_mean	0.8894209326703845
driven_lanedir_consec_min	0.8894209326703845
driven_lanedir_max	0.8894209326703845
driven_lanedir_mean	0.8894209326703845
driven_lanedir_median	0.8894209326703845
driven_lanedir_min	0.8894209326703845
in-drivable-lane_max	4.949999999999982
in-drivable-lane_mean	4.949999999999982
in-drivable-lane_min	4.949999999999982
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.644451425910487, "survival_time": 7.84999999999998, "driven_lanedir": 0.8894209326703845, "in-drivable-lane": 4.949999999999982, "deviation-heading": 1.460441425913939, "distance-from-start": 2.073997242248557, "deviation-center-line": 0.1836844557915258, "driven_lanedir_consec": 0.8894209326703845}}
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	7.84999999999998
survival_time_min	7.84999999999998

No reset possible

130108

baseline-duckietown

sim-1of4

success

yes

2022-06-02 23:08:10+00:00

2022-06-02 23:14:06+00:00

0:05:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.100000000000051
in-drivable-lane_median	9.050000000000052
driven_lanedir_consec_median	1.624867982795681
deviation-center-line_median	0.2566223912129241

other stats

deviation-center-line_max	0.2566223912129241
deviation-center-line_mean	0.2566223912129241
deviation-center-line_min	0.2566223912129241
deviation-heading_max	1.264114407601428
deviation-heading_mean	1.264114407601428
deviation-heading_median	1.264114407601428
deviation-heading_min	1.264114407601428
distance-from-start_max	2.593743128129699
distance-from-start_mean	2.593743128129699
distance-from-start_median	2.593743128129699
distance-from-start_min	2.593743128129699
driven_any_max	4.758064424663004
driven_any_mean	4.758064424663004
driven_any_median	4.758064424663004
driven_any_min	4.758064424663004
driven_lanedir_consec_max	1.624867982795681
driven_lanedir_consec_mean	1.624867982795681
driven_lanedir_consec_min	1.624867982795681
driven_lanedir_max	1.624867982795681
driven_lanedir_mean	1.624867982795681
driven_lanedir_median	1.624867982795681
driven_lanedir_min	1.624867982795681
in-drivable-lane_max	9.050000000000052
in-drivable-lane_mean	9.050000000000052
in-drivable-lane_min	9.050000000000052
per-episodes	details {"loop-000-ego0": {"driven_any": 4.758064424663004, "survival_time": 13.100000000000051, "driven_lanedir": 1.624867982795681, "in-drivable-lane": 9.050000000000052, "deviation-heading": 1.264114407601428, "distance-from-start": 2.593743128129699, "deviation-center-line": 0.2566223912129241, "driven_lanedir_consec": 1.624867982795681}}
simulation-passed	1
survival_time_max	13.100000000000051
survival_time_mean	13.100000000000051
survival_time_min	13.100000000000051

No reset possible

130107

baseline-duckietown

sim-3of4

success

yes

2022-06-02 23:03:56+00:00

2022-06-02 23:07:25+00:00

0:03:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	4.549999999999992
in-drivable-lane_median	1.4499999999999948
driven_lanedir_consec_median	1.1263931549495028
deviation-center-line_median	0.18951852004564057

other stats

deviation-center-line_max	0.18951852004564057
deviation-center-line_mean	0.18951852004564057
deviation-center-line_min	0.18951852004564057
deviation-heading_max	0.8332112466687285
deviation-heading_mean	0.8332112466687285
deviation-heading_median	0.8332112466687285
deviation-heading_min	0.8332112466687285
distance-from-start_max	1.3729055491594329
distance-from-start_mean	1.3729055491594329
distance-from-start_median	1.3729055491594329
distance-from-start_min	1.3729055491594329
driven_any_max	1.5325155634741363
driven_any_mean	1.5325155634741363
driven_any_median	1.5325155634741363
driven_any_min	1.5325155634741363
driven_lanedir_consec_max	1.1263931549495028
driven_lanedir_consec_mean	1.1263931549495028
driven_lanedir_consec_min	1.1263931549495028
driven_lanedir_max	1.1263931549495028
driven_lanedir_mean	1.1263931549495028
driven_lanedir_median	1.1263931549495028
driven_lanedir_min	1.1263931549495028
in-drivable-lane_max	1.4499999999999948
in-drivable-lane_mean	1.4499999999999948
in-drivable-lane_min	1.4499999999999948
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.5325155634741363, "survival_time": 4.549999999999992, "driven_lanedir": 1.1263931549495028, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 0.8332112466687285, "distance-from-start": 1.3729055491594329, "deviation-center-line": 0.18951852004564057, "driven_lanedir_consec": 1.1263931549495028}}
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	4.549999999999992
survival_time_min	4.549999999999992

No reset possible

130106

baseline-duckietown

sim-3of4

success

yes

2022-06-02 22:58:37+00:00

2022-06-02 23:03:11+00:00

0:04:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	4.6499999999999915
in-drivable-lane_median	1.399999999999995
driven_lanedir_consec_median	1.158758600412952
deviation-center-line_median	0.23441726114809405

other stats

deviation-center-line_max	0.23441726114809405
deviation-center-line_mean	0.23441726114809405
deviation-center-line_min	0.23441726114809405
deviation-heading_max	0.7908721022695246
deviation-heading_mean	0.7908721022695246
deviation-heading_median	0.7908721022695246
deviation-heading_min	0.7908721022695246
distance-from-start_max	1.3530927841551483
distance-from-start_mean	1.3530927841551483
distance-from-start_median	1.3530927841551483
distance-from-start_min	1.3530927841551483
driven_any_max	1.5383446023940488
driven_any_mean	1.5383446023940488
driven_any_median	1.5383446023940488
driven_any_min	1.5383446023940488
driven_lanedir_consec_max	1.158758600412952
driven_lanedir_consec_mean	1.158758600412952
driven_lanedir_consec_min	1.158758600412952
driven_lanedir_max	1.158758600412952
driven_lanedir_mean	1.158758600412952
driven_lanedir_median	1.158758600412952
driven_lanedir_min	1.158758600412952
in-drivable-lane_max	1.399999999999995
in-drivable-lane_mean	1.399999999999995
in-drivable-lane_min	1.399999999999995
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.5383446023940488, "survival_time": 4.6499999999999915, "driven_lanedir": 1.158758600412952, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.7908721022695246, "distance-from-start": 1.3530927841551483, "deviation-center-line": 0.23441726114809405, "driven_lanedir_consec": 1.158758600412952}}
simulation-passed	1
survival_time_max	4.6499999999999915
survival_time_mean	4.6499999999999915
survival_time_min	4.6499999999999915

No reset possible

130105

baseline-duckietown

sim-2of4

success

yes

2022-06-02 22:52:28+00:00

2022-06-02 22:58:28+00:00

0:06:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	15.350000000000083
in-drivable-lane_median	12.200000000000086
driven_lanedir_consec_median	0.9165100485577888
deviation-center-line_median	0.21704981418405936

other stats

deviation-center-line_max	0.21704981418405936
deviation-center-line_mean	0.21704981418405936
deviation-center-line_min	0.21704981418405936
deviation-heading_max	1.5731252156610211
deviation-heading_mean	1.5731252156610211
deviation-heading_median	1.5731252156610211
deviation-heading_min	1.5731252156610211
distance-from-start_max	3.6666416731568527
distance-from-start_mean	3.6666416731568527
distance-from-start_median	3.6666416731568527
distance-from-start_min	3.6666416731568527
driven_any_max	5.881799615631414
driven_any_mean	5.881799615631414
driven_any_median	5.881799615631414
driven_any_min	5.881799615631414
driven_lanedir_consec_max	0.9165100485577888
driven_lanedir_consec_mean	0.9165100485577888
driven_lanedir_consec_min	0.9165100485577888
driven_lanedir_max	0.9165100485577888
driven_lanedir_mean	0.9165100485577888
driven_lanedir_median	0.9165100485577888
driven_lanedir_min	0.9165100485577888
in-drivable-lane_max	12.200000000000086
in-drivable-lane_mean	12.200000000000086
in-drivable-lane_min	12.200000000000086
per-episodes	details {"autolab-000-ego0": {"driven_any": 5.881799615631414, "survival_time": 15.350000000000083, "driven_lanedir": 0.9165100485577888, "in-drivable-lane": 12.200000000000086, "deviation-heading": 1.5731252156610211, "distance-from-start": 3.6666416731568527, "deviation-center-line": 0.21704981418405936, "driven_lanedir_consec": 0.9165100485577888}}
simulation-passed	1
survival_time_max	15.350000000000083
survival_time_mean	15.350000000000083
survival_time_min	15.350000000000083

No reset possible

130104

baseline-duckietown

sim-2of4

success

yes

2022-06-02 22:46:59+00:00

2022-06-02 22:52:20+00:00

0:05:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	10.600000000000016
in-drivable-lane_median	7.950000000000017
driven_lanedir_consec_median	0.6501195723900308
deviation-center-line_median	0.1803412453419894

other stats

deviation-center-line_max	0.1803412453419894
deviation-center-line_mean	0.1803412453419894
deviation-center-line_min	0.1803412453419894
deviation-heading_max	1.552785135697365
deviation-heading_mean	1.552785135697365
deviation-heading_median	1.552785135697365
deviation-heading_min	1.552785135697365
distance-from-start_max	3.093124141669197
distance-from-start_mean	3.093124141669197
distance-from-start_median	3.093124141669197
distance-from-start_min	3.093124141669197
driven_any_max	3.532580668437338
driven_any_mean	3.532580668437338
driven_any_median	3.532580668437338
driven_any_min	3.532580668437338
driven_lanedir_consec_max	0.6501195723900308
driven_lanedir_consec_mean	0.6501195723900308
driven_lanedir_consec_min	0.6501195723900308
driven_lanedir_max	0.6501195723900308
driven_lanedir_mean	0.6501195723900308
driven_lanedir_median	0.6501195723900308
driven_lanedir_min	0.6501195723900308
in-drivable-lane_max	7.950000000000017
in-drivable-lane_mean	7.950000000000017
in-drivable-lane_min	7.950000000000017
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.532580668437338, "survival_time": 10.600000000000016, "driven_lanedir": 0.6501195723900308, "in-drivable-lane": 7.950000000000017, "deviation-heading": 1.552785135697365, "distance-from-start": 3.093124141669197, "deviation-center-line": 0.1803412453419894, "driven_lanedir_consec": 0.6501195723900308}}
simulation-passed	1
survival_time_max	10.600000000000016
survival_time_mean	10.600000000000016
survival_time_min	10.600000000000016

No reset possible

130103

baseline-duckietown

sim-0of4

success

yes

2022-06-02 22:42:12+00:00

2022-06-02 22:46:31+00:00

0:04:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	5.599999999999988
in-drivable-lane_median	2.549999999999991
driven_lanedir_consec_median	0.7934588900279985
deviation-center-line_median	0.17847918033572974

other stats

deviation-center-line_max	0.17847918033572974
deviation-center-line_mean	0.17847918033572974
deviation-center-line_min	0.17847918033572974
deviation-heading_max	0.995819299362146
deviation-heading_mean	0.995819299362146
deviation-heading_median	0.995819299362146
deviation-heading_min	0.995819299362146
distance-from-start_max	1.217345210223146
distance-from-start_mean	1.217345210223146
distance-from-start_median	1.217345210223146
distance-from-start_min	1.217345210223146
driven_any_max	1.3424239487102645
driven_any_mean	1.3424239487102645
driven_any_median	1.3424239487102645
driven_any_min	1.3424239487102645
driven_lanedir_consec_max	0.7934588900279985
driven_lanedir_consec_mean	0.7934588900279985
driven_lanedir_consec_min	0.7934588900279985
driven_lanedir_max	0.7934588900279985
driven_lanedir_mean	0.7934588900279985
driven_lanedir_median	0.7934588900279985
driven_lanedir_min	0.7934588900279985
in-drivable-lane_max	2.549999999999991
in-drivable-lane_mean	2.549999999999991
in-drivable-lane_min	2.549999999999991
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.3424239487102645, "survival_time": 5.599999999999988, "driven_lanedir": 0.7934588900279985, "in-drivable-lane": 2.549999999999991, "deviation-heading": 0.995819299362146, "distance-from-start": 1.217345210223146, "deviation-center-line": 0.17847918033572974, "driven_lanedir_consec": 0.7934588900279985}}
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	5.599999999999988
survival_time_min	5.599999999999988

No reset possible

130102

baseline-duckietown

sim-3of4

success

yes

2022-06-02 22:37:35+00:00

2022-06-02 22:41:57+00:00

0:04:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.399999999999982
in-drivable-lane_median	2.3499999999999917
driven_lanedir_consec_median	2.1793855589961835
deviation-center-line_median	0.25838781826874413

other stats

deviation-center-line_max	0.25838781826874413
deviation-center-line_mean	0.25838781826874413
deviation-center-line_min	0.25838781826874413
deviation-heading_max	1.2251105907871749
deviation-heading_mean	1.2251105907871749
deviation-heading_median	1.2251105907871749
deviation-heading_min	1.2251105907871749
distance-from-start_max	2.2205638521818027
distance-from-start_mean	2.2205638521818027
distance-from-start_median	2.2205638521818027
distance-from-start_min	2.2205638521818027
driven_any_max	3.0318746386450104
driven_any_mean	3.0318746386450104
driven_any_median	3.0318746386450104
driven_any_min	3.0318746386450104
driven_lanedir_consec_max	2.1793855589961835
driven_lanedir_consec_mean	2.1793855589961835
driven_lanedir_consec_min	2.1793855589961835
driven_lanedir_max	2.1793855589961835
driven_lanedir_mean	2.1793855589961835
driven_lanedir_median	2.1793855589961835
driven_lanedir_min	2.1793855589961835
in-drivable-lane_max	2.3499999999999917
in-drivable-lane_mean	2.3499999999999917
in-drivable-lane_min	2.3499999999999917
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.0318746386450104, "survival_time": 7.399999999999982, "driven_lanedir": 2.1793855589961835, "in-drivable-lane": 2.3499999999999917, "deviation-heading": 1.2251105907871749, "distance-from-start": 2.2205638521818027, "deviation-center-line": 0.25838781826874413, "driven_lanedir_consec": 2.1793855589961835}}
simulation-passed	1
survival_time_max	7.399999999999982
survival_time_mean	7.399999999999982
survival_time_min	7.399999999999982

No reset possible

130101

baseline-duckietown

sim-3of4

success

yes

2022-06-02 22:32:34+00:00

2022-06-02 22:37:12+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.449999999999981
in-drivable-lane_median	2.249999999999992
driven_lanedir_consec_median	2.2210049091356976
deviation-center-line_median	0.2714929042695111

other stats

deviation-center-line_max	0.2714929042695111
deviation-center-line_mean	0.2714929042695111
deviation-center-line_min	0.2714929042695111
deviation-heading_max	1.188491641250566
deviation-heading_mean	1.188491641250566
deviation-heading_median	1.188491641250566
deviation-heading_min	1.188491641250566
distance-from-start_max	2.2033754165934174
distance-from-start_mean	2.2033754165934174
distance-from-start_median	2.2033754165934174
distance-from-start_min	2.2033754165934174
driven_any_max	3.04079769578231
driven_any_mean	3.04079769578231
driven_any_median	3.04079769578231
driven_any_min	3.04079769578231
driven_lanedir_consec_max	2.2210049091356976
driven_lanedir_consec_mean	2.2210049091356976
driven_lanedir_consec_min	2.2210049091356976
driven_lanedir_max	2.2210049091356976
driven_lanedir_mean	2.2210049091356976
driven_lanedir_median	2.2210049091356976
driven_lanedir_min	2.2210049091356976
in-drivable-lane_max	2.249999999999992
in-drivable-lane_mean	2.249999999999992
in-drivable-lane_min	2.249999999999992
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.04079769578231, "survival_time": 7.449999999999981, "driven_lanedir": 2.2210049091356976, "in-drivable-lane": 2.249999999999992, "deviation-heading": 1.188491641250566, "distance-from-start": 2.2033754165934174, "deviation-center-line": 0.2714929042695111, "driven_lanedir_consec": 2.2210049091356976}}
simulation-passed	1
survival_time_max	7.449999999999981
survival_time_mean	7.449999999999981
survival_time_min	7.449999999999981

No reset possible

130100

baseline-duckietown

sim-0of4

success

yes

2022-06-02 22:28:31+00:00

2022-06-02 22:32:19+00:00

0:03:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.499999999999999
in-drivable-lane_median	1.1999999999999986
driven_lanedir_consec_median	0.2515847406057292
deviation-center-line_median	0.09684610722717577

other stats

deviation-center-line_max	0.09684610722717577
deviation-center-line_mean	0.09684610722717577
deviation-center-line_min	0.09684610722717577
deviation-heading_max	0.6091252639789421
deviation-heading_mean	0.6091252639789421
deviation-heading_median	0.6091252639789421
deviation-heading_min	0.6091252639789421
distance-from-start_max	0.4871907179473835
distance-from-start_mean	0.4871907179473835
distance-from-start_median	0.4871907179473835
distance-from-start_min	0.4871907179473835
driven_any_max	0.4920045631104592
driven_any_mean	0.4920045631104592
driven_any_median	0.4920045631104592
driven_any_min	0.4920045631104592
driven_lanedir_consec_max	0.2515847406057292
driven_lanedir_consec_mean	0.2515847406057292
driven_lanedir_consec_min	0.2515847406057292
driven_lanedir_max	0.2515847406057292
driven_lanedir_mean	0.2515847406057292
driven_lanedir_median	0.2515847406057292
driven_lanedir_min	0.2515847406057292
in-drivable-lane_max	1.1999999999999986
in-drivable-lane_mean	1.1999999999999986
in-drivable-lane_min	1.1999999999999986
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.4920045631104592, "survival_time": 2.499999999999999, "driven_lanedir": 0.2515847406057292, "in-drivable-lane": 1.1999999999999986, "deviation-heading": 0.6091252639789421, "distance-from-start": 0.4871907179473835, "deviation-center-line": 0.09684610722717577, "driven_lanedir_consec": 0.2515847406057292}}
simulation-passed	1
survival_time_max	2.499999999999999
survival_time_mean	2.499999999999999
survival_time_min	2.499999999999999

No reset possible

130099

baseline-duckietown

sim-1of4

success

yes

2022-06-02 22:22:31+00:00

2022-06-02 22:27:53+00:00

0:05:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.750000000000046
in-drivable-lane_median	5.000000000000036
driven_lanedir_consec_median	3.2460836799668726
deviation-center-line_median	0.5506605190444556

other stats

deviation-center-line_max	0.5506605190444556
deviation-center-line_mean	0.5506605190444556
deviation-center-line_min	0.5506605190444556
deviation-heading_max	2.5963283238701247
deviation-heading_mean	2.5963283238701247
deviation-heading_median	2.5963283238701247
deviation-heading_min	2.5963283238701247
distance-from-start_max	3.2029442175617
distance-from-start_mean	3.2029442175617
distance-from-start_median	3.2029442175617
distance-from-start_min	3.2029442175617
driven_any_max	5.35136719839803
driven_any_mean	5.35136719839803
driven_any_median	5.35136719839803
driven_any_min	5.35136719839803
driven_lanedir_consec_max	3.2460836799668726
driven_lanedir_consec_mean	3.2460836799668726
driven_lanedir_consec_min	3.2460836799668726
driven_lanedir_max	3.2460836799668726
driven_lanedir_mean	3.2460836799668726
driven_lanedir_median	3.2460836799668726
driven_lanedir_min	3.2460836799668726
in-drivable-lane_max	5.000000000000036
in-drivable-lane_mean	5.000000000000036
in-drivable-lane_min	5.000000000000036
per-episodes	details {"loop-000-ego0": {"driven_any": 5.35136719839803, "survival_time": 12.750000000000046, "driven_lanedir": 3.2460836799668726, "in-drivable-lane": 5.000000000000036, "deviation-heading": 2.5963283238701247, "distance-from-start": 3.2029442175617, "deviation-center-line": 0.5506605190444556, "driven_lanedir_consec": 3.2460836799668726}}
simulation-passed	1
survival_time_max	12.750000000000046
survival_time_mean	12.750000000000046
survival_time_min	12.750000000000046

No reset possible

130098

collision-check-exercise

step1

success

yes

2022-06-02 22:21:34+00:00

2022-06-02 22:22:16+00:00

0:00:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.07
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130097

collision-check-exercise

step1

success

yes

2022-06-02 22:20:24+00:00

2022-06-02 22:21:00+00:00

0:00:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.07
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130096

collision-check-exercise

step1

success

yes

2022-06-02 22:19:10+00:00

2022-06-02 22:19:53+00:00

0:00:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.07
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130095

collision-check-exercise

step1

success

yes

2022-06-02 22:18:05+00:00

2022-06-02 22:18:48+00:00

0:00:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.07
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130094

collision-check-exercise

step1

success

yes

2022-06-02 22:16:25+00:00

2022-06-02 22:17:31+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.07
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130093

baseline-duckietown

sim-2of4

success

yes

2022-06-02 22:11:03+00:00

2022-06-02 22:16:11+00:00

0:05:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.199999999999996
in-drivable-lane_median	2.650000000000005
driven_lanedir_consec_median	2.7545657901440728
deviation-center-line_median	0.4046616957392982

other stats

deviation-center-line_max	0.4046616957392982
deviation-center-line_mean	0.4046616957392982
deviation-center-line_min	0.4046616957392982
deviation-heading_max	1.792097019803331
deviation-heading_mean	1.792097019803331
deviation-heading_median	1.792097019803331
deviation-heading_min	1.792097019803331
distance-from-start_max	2.088390544070356
distance-from-start_mean	2.088390544070356
distance-from-start_median	2.088390544070356
distance-from-start_min	2.088390544070356
driven_any_max	3.6327546669806985
driven_any_mean	3.6327546669806985
driven_any_median	3.6327546669806985
driven_any_min	3.6327546669806985
driven_lanedir_consec_max	2.7545657901440728
driven_lanedir_consec_mean	2.7545657901440728
driven_lanedir_consec_min	2.7545657901440728
driven_lanedir_max	2.7545657901440728
driven_lanedir_mean	2.7545657901440728
driven_lanedir_median	2.7545657901440728
driven_lanedir_min	2.7545657901440728
in-drivable-lane_max	2.650000000000005
in-drivable-lane_mean	2.650000000000005
in-drivable-lane_min	2.650000000000005
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.6327546669806985, "survival_time": 9.199999999999996, "driven_lanedir": 2.7545657901440728, "in-drivable-lane": 2.650000000000005, "deviation-heading": 1.792097019803331, "distance-from-start": 2.088390544070356, "deviation-center-line": 0.4046616957392982, "driven_lanedir_consec": 2.7545657901440728}}
simulation-passed	1
survival_time_max	9.199999999999996
survival_time_mean	9.199999999999996
survival_time_min	9.199999999999996

No reset possible

130092

baseline-duckietown

sim-2of4

success

yes

2022-06-02 22:06:14+00:00

2022-06-02 22:10:32+00:00

0:04:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.6
in-drivable-lane_median	7.550000000000001
driven_lanedir_consec_median	0.6647012845651064
deviation-center-line_median	0.1176291461366648

other stats

deviation-center-line_max	0.1176291461366648
deviation-center-line_mean	0.1176291461366648
deviation-center-line_min	0.1176291461366648
deviation-heading_max	0.7688821086538364
deviation-heading_mean	0.7688821086538364
deviation-heading_median	0.7688821086538364
deviation-heading_min	0.7688821086538364
distance-from-start_max	3.1438914618966916
distance-from-start_mean	3.1438914618966916
distance-from-start_median	3.1438914618966916
distance-from-start_min	3.1438914618966916
driven_any_max	3.538778376171007
driven_any_mean	3.538778376171007
driven_any_median	3.538778376171007
driven_any_min	3.538778376171007
driven_lanedir_consec_max	0.6647012845651064
driven_lanedir_consec_mean	0.6647012845651064
driven_lanedir_consec_min	0.6647012845651064
driven_lanedir_max	0.6647012845651064
driven_lanedir_mean	0.6647012845651064
driven_lanedir_median	0.6647012845651064
driven_lanedir_min	0.6647012845651064
in-drivable-lane_max	7.550000000000001
in-drivable-lane_mean	7.550000000000001
in-drivable-lane_min	7.550000000000001
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.538778376171007, "survival_time": 9.6, "driven_lanedir": 0.6647012845651064, "in-drivable-lane": 7.550000000000001, "deviation-heading": 0.7688821086538364, "distance-from-start": 3.1438914618966916, "deviation-center-line": 0.1176291461366648, "driven_lanedir_consec": 0.6647012845651064}}
simulation-passed	1
survival_time_max	9.6
survival_time_mean	9.6
survival_time_min	9.6

No reset possible

130091

collision-check-exercise

step1

success

yes

2022-06-02 22:05:18+00:00

2022-06-02 22:05:59+00:00

0:00:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.05
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130090

collision-check-exercise

step1

success

yes

2022-06-02 22:04:11+00:00

2022-06-02 22:04:56+00:00

0:00:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.05
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130089

collision-check-exercise

step1

success

yes

2022-06-02 22:03:03+00:00

2022-06-02 22:03:42+00:00

0:00:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.05
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130088

collision-check-exercise

step1

success

yes

2022-06-02 22:02:06+00:00

2022-06-02 22:02:47+00:00

0:00:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.05
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130087

collision-check-exercise

step1

success

yes

2022-06-02 22:00:58+00:00

2022-06-02 22:01:44+00:00

0:00:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.05
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

130084

baseline-duckietown

sim-2of4

timeout

yes

2022-05-26 18:58:21+00:00

No reset possible

130083

template-random

sanity-check

success

yes

2022-05-26 18:56:15+00:00

2022-05-26 18:57:53+00:00

0:01:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.007457570166591001

other stats

deviation-center-line_max	0.007457570166591001
deviation-center-line_mean	0.007457570166591001
deviation-center-line_min	0.007457570166591001
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	8.413744284337043e-16
driven_any_mean	8.413744284337043e-16
driven_any_median	8.413744284337043e-16
driven_any_min	8.413744284337043e-16
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

130082

template-random

sanity-check

success

yes

2022-05-26 18:54:50+00:00

2022-05-26 18:56:01+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.007457570166591001

other stats

deviation-center-line_max	0.007457570166591001
deviation-center-line_mean	0.007457570166591001
deviation-center-line_min	0.007457570166591001
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	8.413744284337043e-16
driven_any_mean	8.413744284337043e-16
driven_any_median	8.413744284337043e-16
driven_any_min	8.413744284337043e-16
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

130081

template-random

sanity-check

success

yes

2022-05-26 18:53:34+00:00

2022-05-26 18:54:35+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.007457570166591001

other stats

deviation-center-line_max	0.007457570166591001
deviation-center-line_mean	0.007457570166591001
deviation-center-line_min	0.007457570166591001
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	8.413744284337043e-16
driven_any_mean	8.413744284337043e-16
driven_any_median	8.413744284337043e-16
driven_any_min	8.413744284337043e-16
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

130080

template-random

sanity-check

success

yes

2022-05-26 18:51:53+00:00

2022-05-26 18:53:04+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.007457570166591001

other stats

deviation-center-line_max	0.007457570166591001
deviation-center-line_mean	0.007457570166591001
deviation-center-line_min	0.007457570166591001
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	8.413744284337043e-16
driven_any_mean	8.413744284337043e-16
driven_any_median	8.413744284337043e-16
driven_any_min	8.413744284337043e-16
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

130079

template-random

sanity-check

success

yes

2022-05-26 18:50:11+00:00

2022-05-26 18:51:45+00:00

0:01:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.007457570166591001

other stats

deviation-center-line_max	0.007457570166591001
deviation-center-line_mean	0.007457570166591001
deviation-center-line_min	0.007457570166591001
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	8.413744284337043e-16
driven_any_mean	8.413744284337043e-16
driven_any_median	8.413744284337043e-16
driven_any_min	8.413744284337043e-16
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

130078

18711

template-random

sanity-check

success

yes

2022-05-26 18:48:50+00:00

2022-05-26 18:49:52+00:00

0:01:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.007457570166591001

other stats

deviation-center-line_max	0.007457570166591001
deviation-center-line_mean	0.007457570166591001
deviation-center-line_min	0.007457570166591001
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	8.413744284337043e-16
driven_any_mean	8.413744284337043e-16
driven_any_median	8.413744284337043e-16
driven_any_min	8.413744284337043e-16
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

130077

18711

template-random

sanity-check

success

yes