Duckietown Challenges Home Challenges Submissions

Evaluator 363

ID363
evaluators-MacBook-puro.local-13934
ownerYun Chen 🇨🇦
machines-MacBook-puro.local
processs-MacBook-puro.local-13934
versionDC:3.1.57;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success6 10822
# timeout
# failed
# error5 10828
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
109561282Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyess-MacBook-puro.local-139340:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.05985247177248
deviation-center-line_median0.32463013910329175
in-drivable-lane_median8.23333333333332


other stats
deviation-center-line_max1.2229848197846576
deviation-center-line_mean0.5013585011463242
deviation-center-line_min0.18421462158296809
deviation-heading_max6.639256027638261
deviation-heading_mean6.130316773672168
deviation-heading_median6.587348625790274
deviation-heading_min4.253182461720226
driven_any_max3.317636741607105
driven_any_mean3.31763674160709
driven_any_median3.317636741607098
driven_any_min3.3176367416070653
driven_lanedir_max-0.8727849850798894
driven_lanedir_mean-1.0237415377242507
driven_lanedir_min-1.0652501105207834
in-drivable-lane_max10.466666666666663
in-drivable-lane_mean8.686666666666657
in-drivable-lane_min8.233333333333318
per-episodes
details{"ep000": {"driven_any": 3.317636741607105, "driven_lanedir": -0.8727849850798894, "in-drivable-lane": 10.466666666666663, "deviation-heading": 4.253182461720226, "deviation-center-line": 1.2229848197846576}, "ep001": {"driven_any": 3.3176367416070653, "driven_lanedir": -1.0585760658647092, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.639256027638261, "deviation-center-line": 0.4939995088117161}, "ep002": {"driven_any": 3.317636741607098, "driven_lanedir": -1.0622440553833916, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.60795448532735, "deviation-center-line": 0.28096341644898776}, "ep003": {"driven_any": 3.317636741607083, "driven_lanedir": -1.05985247177248, "in-drivable-lane": 8.266666666666653, "deviation-heading": 6.563842267884727, "deviation-center-line": 0.18421462158296809}, "ep004": {"driven_any": 3.3176367416071, "driven_lanedir": -1.0652501105207834, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587348625790274, "deviation-center-line": 0.32463013910329175}}
No reset possible
109341281Yun Chen 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyess-MacBook-puro.local-139340:06:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.1277084947325524
deviation-center-line_median0.21813380591001513
in-drivable-lane_median4.899999999999988


other stats
deviation-center-line_max0.380914912819748
deviation-center-line_mean0.2305222638710954
deviation-center-line_min0.08042209529634169
deviation-heading_max6.695251918755404
deviation-heading_mean2.968397790615076
deviation-heading_median2.3803439804106667
deviation-heading_min0.7340334522927733
driven_any_max1.147514414161098
driven_any_mean0.6321277046803103
driven_any_median0.6292780798715786
driven_any_min0.1451745708877611
driven_lanedir_max-0.03062263736441606
driven_lanedir_mean-0.16399291768892374
driven_lanedir_min-0.38661333766655104
in-drivable-lane_max13.69999999999998
in-drivable-lane_mean5.933333333333326
in-drivable-lane_min1.0333333333333348
per-episodes
details{"ep000": {"driven_any": 1.147514414161098, "driven_lanedir": -0.1277084947325524, "in-drivable-lane": 13.69999999999998, "deviation-heading": 2.3803439804106667, "deviation-center-line": 0.380914912819748}, "ep001": {"driven_any": 0.24250416908067615, "driven_lanedir": -0.0847419274714194, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 1.408962372196319, "deviation-center-line": 0.1930310368565834}, "ep002": {"driven_any": 0.9961672894004376, "driven_lanedir": -0.38661333766655104, "in-drivable-lane": 8.099999999999996, "deviation-heading": 6.695251918755404, "deviation-center-line": 0.2801094684727889}, "ep003": {"driven_any": 0.6292780798715786, "driven_lanedir": -0.1902781912096798, "in-drivable-lane": 4.899999999999988, "deviation-heading": 3.6233972294202177, "deviation-center-line": 0.21813380591001513}, "ep004": {"driven_any": 0.1451745708877611, "driven_lanedir": -0.03062263736441606, "in-drivable-lane": 1.0333333333333348, "deviation-heading": 0.7340334522927733, "deviation-center-line": 0.08042209529634169}}
No reset possible
109251281Yun Chen 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyess-MacBook-puro.local-139340:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.566666666666643


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1789177468200214, "good_angle": 52.8257833360501, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.466666666666653}, "ep001": {"nsteps": 113, "reward": -10.744224535152975, "good_angle": 3.067664796680797, "survival_time": 3.766666666666663, "traveled_tiles": 1, "valid_direction": 2.899999999999997}, "ep002": {"nsteps": 500, "reward": -1.1421123770271078, "good_angle": 13.471365841535407, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.83333333333332}, "ep003": {"nsteps": 287, "reward": -5.003585959356343, "good_angle": 7.97969443692576, "survival_time": 9.566666666666643, "traveled_tiles": 1, "valid_direction": 7.433333333333315}, "ep004": {"nsteps": 59, "reward": -18.741837305537725, "good_angle": 1.642058174013297, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 1.4666666666666688}}
good_angle_max52.8257833360501
good_angle_mean15.79731331704107
good_angle_median7.97969443692576
good_angle_min1.642058174013297
reward_max-1.1421123770271078
reward_mean-7.3621355847788355
reward_median-5.003585959356343
reward_min-18.741837305537725
survival_time_max16.666666666666654
survival_time_mean9.726666666666656
survival_time_min1.9666666666666697
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.466666666666653
valid_direction_mean7.8199999999999905
valid_direction_median7.433333333333315
valid_direction_min1.4666666666666688
No reset possible
109171281Yun Chen 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnos-MacBook-puro.local-139340:07:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
108881280Yun Chen 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationsuccessnos-MacBook-puro.local-139340:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
108641279Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrornos-MacBook-puro.local-139340:15:37
Timeout: Waited 824 [...]
Timeout:

Waited 824.366234064 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108501277Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrornos-MacBook-puro.local-139340:15:02
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 581, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python2.7/dist-packages/docker/models/containers.py", line 843, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/container.py", line 730, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/client.py", line 198, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 537, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 524, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 637, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108451276Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrornos-MacBook-puro.local-139340:10:58
Timeout: Waited 603 [...]
Timeout:

Waited 603.595606804 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108341275Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrornos-MacBook-puro.local-139340:12:31
Timeout: Waited 641 [...]
Timeout:

Waited 641.634567976 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108281274Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrornos-MacBook-puro.local-139340:11:33
Timeout: Waited 618 [...]
Timeout:

Waited 618.397711039 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108221273Guohao LiSolution templateaido1_luck-v3step1successyess-MacBook-puro.local-139340:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score130.29768585122106


No reset possible