Duckietown Challenges Home Challenges Submissions

Evaluator 1437

ID1437
evaluatorp-13294
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processp-13294
versiond-c:4.0.30;d-c-r:4.0.47;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success3 23891
# timeout
# failed
# error3 23706
# aborted3 23771
# host-error5 23704
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
239863785Andrés Calderón 🇨🇴challenge-aido_LF-template-randomaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyesp-132940:16:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.15008728504180907
agent_compute-ego_mean0.13757120045003898
agent_compute-ego_median0.13715566529168022
agent_compute-ego_min0.13076439343000712
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.09426686498853896, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.053337534268697105, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13344525849377667, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07427440307758472, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.033071407565364135, "sim_compute_performance-ego": 0.054890588477805806, "sim_compute_robot_state-ego": 0.058930277824401855, "sim_compute_robot_state-npc0": 0.06197424288149233, "sim_compute_robot_state-npc1": 0.05973030902721264, "sim_compute_robot_state-npc2": 0.05751697222391764, "sim_compute_robot_state-npc3": 0.05738608042399088}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.10774447441101076, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.052450637817382816, "in-drivable-lane": 0, "agent_compute-ego": 0.13094550132751465, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.07541735649108887, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03264870643615723, "sim_compute_performance-ego": 0.05834684371948242, "sim_compute_robot_state-ego": 0.058035116195678714, "sim_compute_robot_state-npc0": 0.0667491054534912, "sim_compute_robot_state-npc1": 0.06115119934082031, "sim_compute_robot_state-npc2": 0.05922738075256348, "sim_compute_robot_state-npc3": 0.058640270233154296}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.10169401921724018, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05350263181485628, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13076439343000712, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.07410097749609697, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03219915691174959, "sim_compute_performance-ego": 0.058027292552747224, "sim_compute_robot_state-ego": 0.05817777545828568, "sim_compute_robot_state-npc0": 0.06212988025263736, "sim_compute_robot_state-npc1": 0.05848643026853863, "sim_compute_robot_state-npc2": 0.05753808899929649, "sim_compute_robot_state-npc3": 0.057970053271243445}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1142513329469705, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.052860296225246, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1353491710711129, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0752510662320294, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.033560635168341145, "sim_compute_performance-ego": 0.05867041817194299, "sim_compute_robot_state-ego": 0.06120972090129611, "sim_compute_robot_state-npc0": 0.06043929389760464, "sim_compute_robot_state-npc1": 0.05878373037410688, "sim_compute_robot_state-npc2": 0.05788153636304638, "sim_compute_robot_state-npc3": 0.05940869186497942}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.10947621720177789, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05699185814176287, "in-drivable-lane": 0, "agent_compute-ego": 0.134866578238351, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07776275702885219, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.033605405262538364, "sim_compute_performance-ego": 0.06174225466591971, "sim_compute_robot_state-ego": 0.06109808172498431, "sim_compute_robot_state-npc0": 0.06348076888493129, "sim_compute_robot_state-npc1": 0.060115814208984375, "sim_compute_robot_state-npc2": 0.061351699488503594, "sim_compute_robot_state-npc3": 0.061001360416412354}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.1106466982099745, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05398934417300754, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.13369432202091924, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.07931250996059841, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.035115445101702655, "sim_compute_performance-ego": 0.05915865633222792, "sim_compute_robot_state-ego": 0.06122806778660527, "sim_compute_robot_state-npc0": 0.06243805090586344, "sim_compute_robot_state-npc1": 0.06061090363396539, "sim_compute_robot_state-npc2": 0.06077297087068911, "sim_compute_robot_state-npc3": 0.05997528411723949}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.09547595624570492, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.05372861579612449, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.13304731139430293, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.07517498952371103, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.032903154691060386, "sim_compute_performance-ego": 0.0582788520389133, "sim_compute_robot_state-ego": 0.06048919977965178, "sim_compute_robot_state-npc0": 0.06241465056384051, "sim_compute_robot_state-npc1": 0.06077208783891466, "sim_compute_robot_state-npc2": 0.056405963721098726, "sim_compute_robot_state-npc3": 0.05723730723063151}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.11644183264838324, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.054038349787394205, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.13715566529168022, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.07697245279947916, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03195892969767253, "sim_compute_performance-ego": 0.05978107452392578, "sim_compute_robot_state-ego": 0.06286737124125162, "sim_compute_robot_state-npc0": 0.0661587185329861, "sim_compute_robot_state-npc1": 0.062334103054470485, "sim_compute_robot_state-npc2": 0.05958366923862034, "sim_compute_robot_state-npc3": 0.06023678249782986}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.09113710341246233, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.05690399978471839, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.13893835959227188, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.07582252958546513, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03306844441787056, "sim_compute_performance-ego": 0.06100299047387164, "sim_compute_robot_state-ego": 0.06237873305445132, "sim_compute_robot_state-npc0": 0.0659676686577175, "sim_compute_robot_state-npc1": 0.06158764465995457, "sim_compute_robot_state-npc2": 0.06005905503812044, "sim_compute_robot_state-npc3": 0.059443795162698494}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.10804539680480955, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.053205561637878415, "in-drivable-lane": 0, "agent_compute-ego": 0.13878681182861327, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.07694258213043213, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.032962222099304196, "sim_compute_performance-ego": 0.05837446689605713, "sim_compute_robot_state-ego": 0.060523853302001954, "sim_compute_robot_state-npc0": 0.06602247714996339, "sim_compute_robot_state-npc1": 0.06042535305023193, "sim_compute_robot_state-npc2": 0.05999852657318115, "sim_compute_robot_state-npc3": 0.0595871639251709}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.11463112831115722, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.05665819644927979, "in-drivable-lane": 0, "agent_compute-ego": 0.13802446126937867, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.07538124322891235, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.0344562292098999, "sim_compute_performance-ego": 0.06151994466781616, "sim_compute_robot_state-ego": 0.0633087396621704, "sim_compute_robot_state-npc0": 0.06742225885391236, "sim_compute_robot_state-npc1": 0.06132043600082397, "sim_compute_robot_state-npc2": 0.06137517690658569, "sim_compute_robot_state-npc3": 0.06056829690933228}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.09169515810514751, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0551261776372006, "in-drivable-lane": 0, "agent_compute-ego": 0.13866395699350456, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.07271058935868113, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.033080113561529866, "sim_compute_performance-ego": 0.06160321988557514, "sim_compute_robot_state-ego": 0.06077393732572857, "sim_compute_robot_state-npc0": 0.06959650391026546, "sim_compute_robot_state-npc1": 0.05933914686504163, "sim_compute_robot_state-npc2": 0.05912741861845318, "sim_compute_robot_state-npc3": 0.06076440058256451}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.09509547233581545, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.057601847648620606, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15008728504180907, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.07843399524688721, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.03397441864013672, "sim_compute_performance-ego": 0.06020873069763184, "sim_compute_robot_state-ego": 0.06161864280700684, "sim_compute_robot_state-npc0": 0.07020679473876953, "sim_compute_robot_state-npc1": 0.06453270435333253, "sim_compute_robot_state-npc2": 0.06166038990020752, "sim_compute_robot_state-npc3": 0.062216782569885255}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.13069857250560413, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.05644907734610818, "in-drivable-lane": 0, "agent_compute-ego": 0.1434846357865767, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.07789229262958873, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.034120158715681595, "sim_compute_performance-ego": 0.06289127739993008, "sim_compute_robot_state-ego": 0.06367633559487083, "sim_compute_robot_state-npc0": 0.07381285320628773, "sim_compute_robot_state-npc1": 0.06366229057312012, "sim_compute_robot_state-npc2": 0.06314324248920787, "sim_compute_robot_state-npc3": 0.06162354079159824}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.11192777205486688, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.05847251171968421, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.1463142949707654, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.0780584666193748, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.03398135730198452, "sim_compute_performance-ego": 0.06110513940149424, "sim_compute_robot_state-ego": 0.06245101228052256, "sim_compute_robot_state-npc0": 0.0687815218555684, "sim_compute_robot_state-npc1": 0.06286634717668806, "sim_compute_robot_state-npc2": 0.0615922431556546, "sim_compute_robot_state-npc3": 0.06278620447431292}}
set_robot_commands_max0.07931250996059841
set_robot_commands_mean0.07623388076058549
set_robot_commands_median0.07582252958546513
set_robot_commands_min0.07271058935868113
sim_compute_performance-ego_max0.06289127739993008
sim_compute_performance-ego_mean0.05970678332702275
sim_compute_performance-ego_median0.05978107452392578
sim_compute_performance-ego_min0.054890588477805806
sim_compute_robot_state-ego_max0.06367633559487083
sim_compute_robot_state-ego_mean0.06111779099592718
sim_compute_robot_state-ego_median0.06120972090129611
sim_compute_robot_state-ego_min0.058035116195678714
sim_compute_robot_state-npc0_max0.07381285320628773
sim_compute_robot_state-npc0_mean0.06583965264968876
sim_compute_robot_state-npc0_median0.06602247714996339
sim_compute_robot_state-npc0_min0.06043929389760464
sim_compute_robot_state-npc1_max0.06453270435333253
sim_compute_robot_state-npc1_mean0.06104790002841373
sim_compute_robot_state-npc1_median0.06077208783891466
sim_compute_robot_state-npc1_min0.05848643026853863
sim_compute_robot_state-npc2_max0.06314324248920787
sim_compute_robot_state-npc2_mean0.059815622289276414
sim_compute_robot_state-npc2_median0.05999852657318115
sim_compute_robot_state-npc2_min0.056405963721098726
sim_compute_robot_state-npc3_max0.06278620447431292
sim_compute_robot_state-npc3_mean0.05992306763140293
sim_compute_robot_state-npc3_median0.05997528411723949
sim_compute_robot_state-npc3_min0.05723730723063151
sim_compute_sim_state_max0.035115445101702655
sim_compute_sim_state_mean0.033380385652066226
sim_compute_sim_state_median0.033080113561529866
sim_compute_sim_state_min0.03195892969767253
sim_physics_max0.13069857250560413
sim_physics_mean0.10621519995996426
sim_physics_median0.10804539680480955
sim_physics_min0.09113710341246233
sim_render-ego_max0.05847251171968421
sim_render-ego_mean0.05502110934986411
sim_render-ego_median0.054038349787394205
sim_render-ego_min0.052450637817382816
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
239793765Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.2aido2-LF-real-validationeval0-videos-watchtowerserroryesp-132943:00:48
Waited 10803 seconds [...]
Waited 10803 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239753631Nicky Eichmannaido2-LFVI-real-validationeval1-videos-autobotshost-erroryesp-132940:01:33
Could not access IPF [...]
Could not access IPFS data:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1184, in download_artefacts
    try_to_get_hash(client, sha256hex)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 81, in new_function
    return function(*args, **kwargs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1133, in try_to_get_hash
    res = client.file_ls(qm)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfsapi-0.4.4-py3.7.egg/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfsapi-0.4.4-py3.7.egg/ipfsapi/client/__init__.py", line 242, in file_ls
    return self._client.request('/file/ls', args, decoder='json', **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 282, in _request
    timeout=timeout)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 245, in _do_request
    return requests.request(*args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/requests_wrapper.py", line 240, in request
    return session.request(method=method, url=url, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/requests_wrapper.py", line 219, in request
    return super(Session, self).request(method, url, *args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 1321, in getresponse
    response.begin()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 257, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 72, in handler
    _raise_exception(timeout_exception, exception_message)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 45, in _raise_exception
    raise exception()
timeout_decorator.timeout_decorator.TimeoutError: 'Timed Out'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1188, in download_artefacts
    raise IPFSException(msg)
duckietown_challenges_runner.runner.IPFSException: Could not get IPFS hash Qmf7ToVmu2GwQgVHhELsKnT3hkc7N9ya1mkKgijnay8PNh
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239473769Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.3aido2-LFV-real-validationeval0-videos-watchtowerserroryesp-132943:00:28
Waited 10801 seconds [...]
Waited 10801 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238993761Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-real-validationeval0-videos-watchtowerssuccessyesp-132942:59:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238913764Anastasiya Nikolskaya 🇷🇺FINALaido2-LF-real-validationeval0-videos-autobotssuccessyesp-132940:10:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238903776Anastasiya Nikolskaya 🇷🇺Offset-based Oneaido2-LFVI-real-validationeval0-videos-autobotshost-erroryesp-132940:01:05
Could not access IPF [...]
Could not access IPFS data:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1184, in download_artefacts
    try_to_get_hash(client, sha256hex)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 81, in new_function
    return function(*args, **kwargs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1133, in try_to_get_hash
    res = client.file_ls(qm)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfsapi-0.4.4-py3.7.egg/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfsapi-0.4.4-py3.7.egg/ipfsapi/client/__init__.py", line 242, in file_ls
    return self._client.request('/file/ls', args, decoder='json', **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 282, in _request
    timeout=timeout)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 245, in _do_request
    return requests.request(*args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/requests_wrapper.py", line 240, in request
    return session.request(method=method, url=url, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/requests_wrapper.py", line 219, in request
    return super(Session, self).request(method, url, *args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 1321, in getresponse
    response.begin()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 257, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 72, in handler
    _raise_exception(timeout_exception, exception_message)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 45, in _raise_exception
    raise exception()
timeout_decorator.timeout_decorator.TimeoutError: 'Timed Out'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1188, in download_artefacts
    raise IPFSException(msg)
duckietown_challenges_runner.runner.IPFSException: Could not get IPFS hash QmbHynWudunEo9xfRMCJgfWHZnqq9mZZVeFdtRh9CG2x5C
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238063766Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.2aido2-LFV-real-validationeval0-videos-autobotsabortedyesp-132943:00:55
Waited 10801 seconds [...]
Waited 10801 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237923754Anastasiya Nikolskaya 🇷🇺robotariumaido2-LF-real-validationeval0-videos-autobotsabortedyesp-132940:58:48
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 820, in run_one
    time.sleep(5)
KeyboardInterrupt
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237713764Anastasiya Nikolskaya 🇷🇺FINALaido2-LF-real-validationeval0-videos-autobotsabortedyesp-132943:00:50
Waited 10803 seconds [...]
Waited 10803 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237603608Riza Velioglu 🇩🇪aido2-LFV-real-validationeval1-videos-watchtowershost-erroryesp-132941:21:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1363, in upload
    copy_to_cache(realfile, sha256hex)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner_cache.py", line 36, in copy_to_cache
    os.makedirs(cache_dir_by_value)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/os.py", line 211, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/os.py", line 211, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/os.py", line 221, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/cache'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237093645jiang pengRobotarium test - THaido2-LF-real-validationeval0-videos-watchtowershost-erroryesp-132942:12:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1363, in upload
    copy_to_cache(realfile, sha256hex)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner_cache.py", line 41, in copy_to_cache
    shutil.copy(fn, have)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237063732jiang pengSecond test -RGB- TH-jpaido2-LF-sim-validationstep1-simulationerroryesp-132940:01:14
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237043728jiang pengSecond test -RGB- TH-jpaido2-LFVI-real-validationeval0-videos-autobotshost-erroryesp-132940:01:07
Could not access IPF [...]
Could not access IPFS data:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1184, in download_artefacts
    try_to_get_hash(client, sha256hex)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 81, in new_function
    return function(*args, **kwargs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1133, in try_to_get_hash
    res = client.file_ls(qm)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfsapi-0.4.4-py3.7.egg/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfsapi-0.4.4-py3.7.egg/ipfsapi/client/__init__.py", line 242, in file_ls
    return self._client.request('/file/ls', args, decoder='json', **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 282, in _request
    timeout=timeout)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/http.py", line 245, in _do_request
    return requests.request(*args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/requests_wrapper.py", line 240, in request
    return session.request(method=method, url=url, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/ipfshttpclient-0.4.11-py3.7.egg/ipfshttpclient/requests_wrapper.py", line 219, in request
    return super(Session, self).request(method, url, *args, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 1321, in getresponse
    response.begin()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/http/client.py", line 257, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/linuxbrew/.linuxbrew/opt/python/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 72, in handler
    _raise_exception(timeout_exception, exception_message)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 45, in _raise_exception
    raise exception()
timeout_decorator.timeout_decorator.TimeoutError: 'Timed Out'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1188, in download_artefacts
    raise IPFSException(msg)
duckietown_challenges_runner.runner.IPFSException: Could not get IPFS hash QmWJCcYt7VBeQ8Ypr4RxeT1S1xxzjsd22aww5hHrpbWa88
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible