Duckietown Challenges Home Challenges Submissions

Evaluator 2288

ID2288
evaluatorreg03-c4a430e5e868-1
ownerI don't have one 😀
machinearchimede
processreg03-c4a430e5e868-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success5 42046
# timeout
# failed4 42235
# error1 42023
# aborted
# host-error25 42084
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4245711458Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-testingLFt-simhost-errornoreg03-c4a430e5e868-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4245511457Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4242511448Cliff Chandler 🇺🇸template-randomaido5-LF-sim-validationLFv-simsuccessnoreg03-c4a430e5e868-10:15:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.644037326580434
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.03312486012776693
agent_compute-ego_mean0.025923932717642543
agent_compute-ego_median0.024836605490325472
agent_compute-ego_min0.02089765976215231
complete-iteration_max0.3970058494144016
complete-iteration_mean0.3599781442330297
complete-iteration_median0.3570348842669342
complete-iteration_min0.32883695898384885
deviation-center-line_max0.1558386830383756
deviation-center-line_mean0.10879855071843546
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876907
driven_any_mean1.8510551780477624
driven_any_median1.9986666350865232
driven_any_min0.5174263274303109
driven_lanedir_consec_max0.8904446665936316
driven_lanedir_consec_mean0.6302364342579729
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936316
driven_lanedir_mean0.6302364342579729
driven_lanedir_median0.644037326580434
driven_lanedir_min0.3424264172773923
get_duckie_state_max4.186468609308792e-06
get_duckie_state_mean3.3640527307092147e-06
get_duckie_state_median3.13460017197309e-06
get_duckie_state_min3.0005419695818862e-06
get_robot_state_max0.0271933290693495
get_robot_state_mean0.023995864932377983
get_robot_state_median0.023526927049673088
get_robot_state_min0.02173627656081627
get_state_dump_max0.02478988965352376
get_state_dump_mean0.02054700597316027
get_state_dump_median0.020246750309213836
get_state_dump_min0.016904633620689655
get_ui_image_max0.07669794647781937
get_ui_image_mean0.06763585273947349
get_ui_image_median0.06647007872692096
get_ui_image_min0.0609053070262327
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.0609053070262327, "step_physics": 0.15282401796114647, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.017233828366813014, "sim_render-ego": 0.008816440226668018, "get_robot_state": 0.022247080075538765, "get_duckie_state": 4.186468609308792e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.02461059214705128, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.34007243786827995, "set_robot_commands": 0.006719710463184422, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.04096841812133789, "sim_compute_performance-ego": 0.005573640435428942}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303109, "get_ui_image": 0.06969266102231782, "step_physics": 0.1455709852021316, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.016904633620689655, "sim_render-ego": 0.007952706567172346, "get_robot_state": 0.02173627656081627, "get_duckie_state": 3.009006894867996e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.02089765976215231, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.32883695898384885, "set_robot_commands": 0.006209414580772663, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.034533591106020174, "sim_compute_performance-ego": 0.005160594808644262}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.835401090377117, "get_ui_image": 0.07669794647781937, "step_physics": 0.1540116963563142, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921869, "get_state_dump": 0.02478988965352376, "sim_render-ego": 0.013822974099053278, "get_robot_state": 0.0271933290693495, "get_duckie_state": 3.0005419695818862e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.03312486012776693, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.3970058494144016, "set_robot_commands": 0.011133096836231373, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921869, "sim_compute_sim_state": 0.04602647180910464, "sim_compute_performance-ego": 0.010021340405499492}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876907, "get_ui_image": 0.06324749643152411, "step_physics": 0.15298941641142874, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936316, "get_state_dump": 0.023259672251614655, "sim_render-ego": 0.012646364443229906, "get_robot_state": 0.02480677402380741, "get_duckie_state": 3.260193449078184e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.02506261883359967, "deviation-heading": 0.976837469261332, "complete-iteration": 0.3739973306655884, "set_robot_commands": 0.01005526925578262, "deviation-center-line": 0.1558386830383756, "driven_lanedir_consec": 0.8904446665936316, "sim_compute_sim_state": 0.05546644420334787, "sim_compute_performance-ego": 0.006282430706602155}}
set_robot_commands_max0.011133096836231373
set_robot_commands_mean0.00852937278399277
set_robot_commands_median0.00838748985948352
set_robot_commands_min0.006209414580772663
sim_compute_performance-ego_max0.010021340405499492
sim_compute_performance-ego_mean0.006759501589043713
sim_compute_performance-ego_median0.005928035571015549
sim_compute_performance-ego_min0.005160594808644262
sim_compute_sim_state_max0.05546644420334787
sim_compute_sim_state_mean0.04424873130995264
sim_compute_sim_state_median0.04349744496522126
sim_compute_sim_state_min0.034533591106020174
sim_render-ego_max0.013822974099053278
sim_render-ego_mean0.010809621334030886
sim_render-ego_median0.010731402334948962
sim_render-ego_min0.007952706567172346
simulation-passed1
step_physics_max0.1540116963563142
step_physics_mean0.15134902898275523
step_physics_median0.15290671718628762
step_physics_min0.1455709852021316
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible
4240611444Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailednoreg03-c4a430e5e868-10:01:04
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4240211443Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4239811442Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4238511441Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4238311441Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4237111440Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4233711424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4233411423Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sanity-sim-validationsanity-checkhost-erroryesreg03-c4a430e5e868-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4232811414Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFP-sim-testingLFP-simsuccessnoreg03-c4a430e5e868-10:25:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1219534185604285
survival_time_median14.950000000000076
deviation-center-line_median0.5551314891819351
in-drivable-lane_median0.5500000000000078


other stats
agent_compute-ego_max0.19467746416727705
agent_compute-ego_mean0.0954582169826088
agent_compute-ego_median0.06422161181767783
agent_compute-ego_min0.058712180127802584
complete-iteration_max0.8061027789115905
complete-iteration_mean0.5087487881904615
complete-iteration_median0.420292344793831
complete-iteration_min0.3883076842625936
deviation-center-line_max0.6381077323606118
deviation-center-line_mean0.5215814819870154
deviation-center-line_min0.33795521722357924
deviation-heading_max2.699690417820893
deviation-heading_mean1.9625696404755824
deviation-heading_median1.8334462560708973
deviation-heading_min1.4836956319396426
driven_any_max3.5733060127186045
driven_any_mean3.252303675655469
driven_any_median3.5732704583489943
driven_any_min2.2893677732052833
driven_lanedir_consec_max3.523349574546978
driven_lanedir_consec_mean3.004476160939467
driven_lanedir_consec_min2.2506482320900325
driven_lanedir_max3.523349574546978
driven_lanedir_mean3.004476160939467
driven_lanedir_median3.1219534185604285
driven_lanedir_min2.2506482320900325
get_duckie_state_max0.10436115980148317
get_duckie_state_mean0.06324092983175389
get_duckie_state_median0.0509591809908549
get_duckie_state_min0.046684197543822616
get_robot_state_max0.045309151808420815
get_robot_state_mean0.028939080531244835
get_robot_state_median0.02435502290725708
get_robot_state_min0.021737124502044364
get_state_dump_max0.05876320521036784
get_state_dump_mean0.03530736695040543
get_state_dump_median0.028198986053466796
get_state_dump_min0.02606829048432026
get_ui_image_max0.10142947991689046
get_ui_image_mean0.06797938761637383
get_ui_image_median0.05751247043462143
get_ui_image_min0.055463129679361976
in-drivable-lane_max1.6500000000000234
in-drivable-lane_mean0.6875000000000098
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5732917080206352, "get_ui_image": 0.10142947991689046, "step_physics": 0.16150966962178548, "survival_time": 14.950000000000076, "driven_lanedir": 3.2105297722034365, "get_state_dump": 0.05876320521036784, "sim_render-ego": 0.02691988468170166, "get_robot_state": 0.045309151808420815, "get_duckie_state": 0.10436115980148317, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.19467746416727705, "deviation-heading": 2.1036962467853044, "complete-iteration": 0.8061027789115905, "set_robot_commands": 0.022778460184733073, "deviation-center-line": 0.4786888478904044, "driven_lanedir_consec": 3.2105297722034365, "sim_compute_sim_state": 0.06968719641367595, "sim_compute_performance-ego": 0.020447710355122883}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5733060127186045, "get_ui_image": 0.05701488256454468, "step_physics": 0.13214085737864176, "survival_time": 14.950000000000076, "driven_lanedir": 3.523349574546978, "get_state_dump": 0.02922854502995809, "sim_render-ego": 0.009642739295959471, "get_robot_state": 0.026323317686716717, "get_duckie_state": 0.05521870772043864, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06905130942662557, "deviation-heading": 1.56319626535649, "complete-iteration": 0.4298378300666809, "set_robot_commands": 0.009625815550486246, "deviation-center-line": 0.6381077323606118, "driven_lanedir_consec": 3.523349574546978, "sim_compute_sim_state": 0.033549943765004475, "sim_compute_performance-ego": 0.00780430793762207}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.573249208677353, "get_ui_image": 0.055463129679361976, "step_physics": 0.1213828182220459, "survival_time": 14.950000000000076, "driven_lanedir": 3.03337706491742, "get_state_dump": 0.027169427076975505, "sim_render-ego": 0.00898437738418579, "get_robot_state": 0.022386728127797444, "get_duckie_state": 0.04669965426127116, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.059391914208730065, "deviation-heading": 2.699690417820893, "complete-iteration": 0.3883076842625936, "set_robot_commands": 0.0070001538594563805, "deviation-center-line": 0.6315741304734659, "driven_lanedir_consec": 3.03337706491742, "sim_compute_sim_state": 0.03357626994450887, "sim_compute_performance-ego": 0.006020821730295817}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.2893677732052833, "get_ui_image": 0.058010058304698194, "step_physics": 0.13891918757527144, "survival_time": 9.700000000000005, "driven_lanedir": 2.2506482320900325, "get_state_dump": 0.02606829048432026, "sim_render-ego": 0.008919549971511684, "get_robot_state": 0.021737124502044364, "get_duckie_state": 0.046684197543822616, "in-drivable-lane": 0.0, "agent_compute-ego": 0.058712180127802584, "deviation-heading": 1.4836956319396426, "complete-iteration": 0.410746859520981, "set_robot_commands": 0.006977625728882465, "deviation-center-line": 0.33795521722357924, "driven_lanedir_consec": 2.2506482320900325, "sim_compute_sim_state": 0.03868467537398191, "sim_compute_performance-ego": 0.005808944554673028}}
set_robot_commands_max0.022778460184733073
set_robot_commands_mean0.01159551383088954
set_robot_commands_median0.008312984704971313
set_robot_commands_min0.006977625728882465
sim_compute_performance-ego_max0.020447710355122883
sim_compute_performance-ego_mean0.010020446144428447
sim_compute_performance-ego_median0.006912564833958943
sim_compute_performance-ego_min0.005808944554673028
sim_compute_sim_state_max0.06968719641367595
sim_compute_sim_state_mean0.0438745213742928
sim_compute_sim_state_median0.03613047265924539
sim_compute_sim_state_min0.033549943765004475
sim_render-ego_max0.02691988468170166
sim_render-ego_mean0.013616637833339652
sim_render-ego_median0.009313558340072633
sim_render-ego_min0.008919549971511684
simulation-passed1
step_physics_max0.16150966962178548
step_physics_mean0.13848813319943615
step_physics_median0.1355300224769566
step_physics_min0.1213828182220459
survival_time_max14.950000000000076
survival_time_mean13.63750000000006
survival_time_min9.700000000000005
No reset possible
4232311415Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornoreg03-c4a430e5e868-10:00:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4232211415Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornoreg03-c4a430e5e868-10:00:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4231511417Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-testingLFt-simhost-errornoreg03-c4a430e5e868-10:00:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4231011417Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-testingLFt-simhost-errornoreg03-c4a430e5e868-10:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4230611418Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simhost-errornoreg03-c4a430e5e868-10:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4227811411Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sanity-sim-validationsanity-checkhost-erroryesreg03-c4a430e5e868-10:00:27
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4227111412Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4225511407Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg03-c4a430e5e868-10:05:59
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4225011406Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg03-c4a430e5e868-10:01:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4223511403Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg03-c4a430e5e868-10:02:05
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4218711391Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4217311387Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4217211387Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4216811388Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4214411381Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4214211380Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4211911379Martin Cote 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4211811379Martin Cote 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4209711375Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simsuccessnoreg03-c4a430e5e868-10:19:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.290310358420486
survival_time_median14.950000000000076
deviation-center-line_median0.6931341262040256
in-drivable-lane_median2.4250000000000345


other stats
agent_compute-ego_max0.1880343341827393
agent_compute-ego_mean0.17267393092314404
agent_compute-ego_median0.1846420919895172
agent_compute-ego_min0.1333772055308024
complete-iteration_max0.558185916741689
complete-iteration_mean0.5314359724521637
complete-iteration_median0.5336433239777882
complete-iteration_min0.5002713251113892
deviation-center-line_max1.0292836206861289
deviation-center-line_mean0.6323683480490473
deviation-center-line_min0.11392151910200952
deviation-heading_max2.4442336156824993
deviation-heading_mean2.062942065247515
deviation-heading_median2.060260060113084
deviation-heading_min1.6870145250813935
driven_any_max1.9399438445122827
driven_any_mean1.938253120630164
driven_any_median1.9397497764627432
driven_any_min1.9335690850828864
driven_lanedir_consec_max1.788485326617624
driven_lanedir_consec_mean1.1183047032158964
driven_lanedir_consec_min0.1041127694049898
driven_lanedir_max1.788485326617624
driven_lanedir_mean1.2440286268510925
driven_lanedir_median1.5417582056908783
driven_lanedir_min0.1041127694049898
get_duckie_state_max3.2607714335123696e-06
get_duckie_state_mean2.963542938232422e-06
get_duckie_state_median2.920230229695638e-06
get_duckie_state_min2.7529398600260417e-06
get_robot_state_max0.02649373213450114
get_robot_state_mean0.02462199568748474
get_robot_state_median0.024344759384791057
get_robot_state_min0.02330473184585571
get_state_dump_max0.022773280143737792
get_state_dump_mean0.020973148544629415
get_state_dump_median0.02125849008560181
get_state_dump_min0.018602333863576254
get_ui_image_max0.07311911424001058
get_ui_image_mean0.07050830165545145
get_ui_image_median0.07142988046010335
get_ui_image_min0.06605433146158854
in-drivable-lane_max13.000000000000082
in-drivable-lane_mean4.6625000000000405
in-drivable-lane_min0.8000000000000114
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9335690850828864, "get_ui_image": 0.0729385773340861, "step_physics": 0.17754300594329833, "survival_time": 14.950000000000076, "driven_lanedir": 1.5380745193716563, "get_state_dump": 0.02118699312210083, "sim_render-ego": 0.01158386786778768, "get_robot_state": 0.02649373213450114, "get_duckie_state": 2.884864807128906e-06, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.1333772055308024, "deviation-heading": 2.0603551839781824, "complete-iteration": 0.5002713251113892, "set_robot_commands": 0.00829919417699178, "deviation-center-line": 1.0292836206861289, "driven_lanedir_consec": 1.155508454913892, "sim_compute_sim_state": 0.042616768678029375, "sim_compute_performance-ego": 0.006047685941060384}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9396841809062089, "get_ui_image": 0.06605433146158854, "step_physics": 0.1577259874343872, "survival_time": 14.950000000000076, "driven_lanedir": 1.5454418920101, "get_state_dump": 0.022773280143737792, "sim_render-ego": 0.01007941722869873, "get_robot_state": 0.024849780400594077, "get_duckie_state": 2.9555956522623698e-06, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.18357585350672403, "deviation-heading": 2.4442336156824993, "complete-iteration": 0.5174633590380351, "set_robot_commands": 0.00772484302520752, "deviation-center-line": 0.8368373096490813, "driven_lanedir_consec": 1.42511226192708, "sim_compute_sim_state": 0.03837931553522746, "sim_compute_performance-ego": 0.006108850638071696}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939815372019278, "get_ui_image": 0.07311911424001058, "step_physics": 0.18081036806106568, "survival_time": 14.950000000000076, "driven_lanedir": 0.1041127694049898, "get_state_dump": 0.021329987049102783, "sim_render-ego": 0.011101529598236085, "get_robot_state": 0.02330473184585571, "get_duckie_state": 3.2607714335123696e-06, "in-drivable-lane": 13.000000000000082, "agent_compute-ego": 0.1880343341827393, "deviation-heading": 1.6870145250813935, "complete-iteration": 0.558185916741689, "set_robot_commands": 0.011005419890085856, "deviation-center-line": 0.11392151910200952, "driven_lanedir_consec": 0.1041127694049898, "sim_compute_sim_state": 0.042877306938171385, "sim_compute_performance-ego": 0.006411876678466797}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399438445122827, "get_ui_image": 0.06992118358612061, "step_physics": 0.17938191175460816, "survival_time": 14.950000000000076, "driven_lanedir": 1.788485326617624, "get_state_dump": 0.018602333863576254, "sim_render-ego": 0.010002107620239255, "get_robot_state": 0.023839738368988037, "get_duckie_state": 2.7529398600260417e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.1857083304723104, "deviation-heading": 2.060164936247985, "complete-iteration": 0.5498232889175415, "set_robot_commands": 0.009378912448883055, "deviation-center-line": 0.5494309427589698, "driven_lanedir_consec": 1.788485326617624, "sim_compute_sim_state": 0.04687094132105509, "sim_compute_performance-ego": 0.005925507545471192}}
set_robot_commands_max0.011005419890085856
set_robot_commands_mean0.009102092385292054
set_robot_commands_median0.008839053312937419
set_robot_commands_min0.00772484302520752
sim_compute_performance-ego_max0.006411876678466797
sim_compute_performance-ego_mean0.006123480200767518
sim_compute_performance-ego_median0.00607826828956604
sim_compute_performance-ego_min0.005925507545471192
sim_compute_sim_state_max0.04687094132105509
sim_compute_sim_state_mean0.042686083118120825
sim_compute_sim_state_median0.04274703780810038
sim_compute_sim_state_min0.03837931553522746
sim_render-ego_max0.01158386786778768
sim_render-ego_mean0.010691730578740438
sim_render-ego_median0.010590473413467407
sim_render-ego_min0.010002107620239255
simulation-passed1
step_physics_max0.18081036806106568
step_physics_mean0.17386531829833984
step_physics_median0.17846245884895323
step_physics_min0.1577259874343872
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4208411372Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simhost-errornoreg03-c4a430e5e868-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4206411366Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg03-c4a430e5e868-10:14:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02750179449717204
agent_compute-ego_mean0.026652188301086423
agent_compute-ego_median0.026966399749120077
agent_compute-ego_min0.02517415920893351
complete-iteration_max0.3151031955083211
complete-iteration_mean0.29935584088166556
complete-iteration_median0.29868037859598795
complete-iteration_min0.28495941082636517
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max4.318555196126302e-06
get_duckie_state_mean3.541707992553711e-06
get_duckie_state_median3.3183892567952473e-06
get_duckie_state_min3.211498260498047e-06
get_robot_state_max0.02653175671895345
get_robot_state_mean0.02463163415590922
get_robot_state_median0.024641687075297035
get_robot_state_min0.02271140575408935
get_state_dump_max0.02231751283009847
get_state_dump_mean0.020446447134017946
get_state_dump_median0.02036367893218994
get_state_dump_min0.018740917841593423
get_ui_image_max0.054754100640614825
get_ui_image_mean0.05267594734827678
get_ui_image_median0.05223462144533793
get_ui_image_min0.05148044586181641
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.05148044586181641, "step_physics": 0.1139210836092631, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.018740917841593423, "sim_render-ego": 0.009414645036061604, "get_robot_state": 0.02271140575408935, "get_duckie_state": 4.318555196126302e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02517415920893351, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.28495941082636517, "set_robot_commands": 0.0070610857009887696, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.030012630621592203, "sim_compute_performance-ego": 0.006210910479227702}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.052796212832132976, "step_physics": 0.11019346475601197, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02231751283009847, "sim_render-ego": 0.010403593381245932, "get_robot_state": 0.02653175671895345, "get_duckie_state": 3.4117698669433595e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02725195646286011, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.29672593196233116, "set_robot_commands": 0.008465943336486816, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03168402353922526, "sim_compute_performance-ego": 0.006865597565968831}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.054754100640614825, "step_physics": 0.11580974022547404, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.019887057145436603, "sim_render-ego": 0.01133628527323405, "get_robot_state": 0.024587694803873697, "get_duckie_state": 3.2250086466471356e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02750179449717204, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.3006348252296448, "set_robot_commands": 0.007652087211608887, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.03217517296473185, "sim_compute_performance-ego": 0.006723821957906087}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.05167303005854289, "step_physics": 0.13061699151992798, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02084030071894328, "sim_render-ego": 0.009920567671457926, "get_robot_state": 0.024695679346720376, "get_duckie_state": 3.211498260498047e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026680843035380045, "deviation-heading": 0.486072248607516, "complete-iteration": 0.3151031955083211, "set_robot_commands": 0.00828256607055664, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.035808258056640625, "sim_compute_performance-ego": 0.006368900140126546}}
set_robot_commands_max0.008465943336486816
set_robot_commands_mean0.00786542057991028
set_robot_commands_median0.007967326641082764
set_robot_commands_min0.0070610857009887696
sim_compute_performance-ego_max0.006865597565968831
sim_compute_performance-ego_mean0.006542307535807292
sim_compute_performance-ego_median0.006546361049016317
sim_compute_performance-ego_min0.006210910479227702
sim_compute_sim_state_max0.035808258056640625
sim_compute_sim_state_mean0.03242002129554748
sim_compute_sim_state_median0.03192959825197855
sim_compute_sim_state_min0.030012630621592203
sim_render-ego_max0.01133628527323405
sim_render-ego_mean0.010268772840499875
sim_render-ego_median0.010162080526351928
sim_render-ego_min0.009414645036061604
simulation-passed1
step_physics_max0.13061699151992798
step_physics_mean0.11763532002766929
step_physics_median0.11486541191736856
step_physics_min0.11019346475601197
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4204611362Liam Paull 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoreg03-c4a430e5e868-10:13:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.267926035280778
survival_time_median14.950000000000076
deviation-center-line_median0.6667370640030905
in-drivable-lane_median4.250000000000031


other stats
agent_compute-ego_max0.07083770751953125
agent_compute-ego_mean0.062429206989429616
agent_compute-ego_median0.06128972971880878
agent_compute-ego_min0.05629966100056966
complete-iteration_max0.4242330034573873
complete-iteration_mean0.34802569395966
complete-iteration_median0.32813158088260225
complete-iteration_min0.31160661061604816
deviation-center-line_max0.7986761720545036
deviation-center-line_mean0.5973674478807994
deviation-center-line_min0.2573194914625132
deviation-heading_max1.3008329040427835
deviation-heading_mean1.1266911783262443
deviation-heading_median1.100650328981697
deviation-heading_min1.0046311512987995
driven_any_max1.9399752793895355
driven_any_mean1.7988985629757586
driven_any_median1.9333165633836131
driven_any_min1.3889858457462725
driven_lanedir_consec_max1.7811007749782894
driven_lanedir_consec_mean1.220518794759383
driven_lanedir_consec_min0.565122333497687
driven_lanedir_max1.7811007749782894
driven_lanedir_mean1.220518794759383
driven_lanedir_median1.267926035280778
driven_lanedir_min0.565122333497687
get_duckie_state_max1.00588357007062e-05
get_duckie_state_mean5.6912391274063674e-06
get_duckie_state_median4.309415817260742e-06
get_duckie_state_min4.087289174397787e-06
get_robot_state_max0.03041765371958415
get_robot_state_mean0.02648233373959859
get_robot_state_median0.025383245944976807
get_robot_state_min0.024745189348856608
get_state_dump_max0.02166919469833374
get_state_dump_mean0.02083728419409858
get_state_dump_median0.020730699433220756
get_state_dump_min0.020218543211619058
get_ui_image_max0.06259395519892375
get_ui_image_mean0.05372013746588318
get_ui_image_median0.05146649358449158
get_ui_image_min0.04935360749562581
in-drivable-lane_max7.350000000000081
in-drivable-lane_mean4.23750000000004
in-drivable-lane_min1.1000000000000156
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9266635993018504, "get_ui_image": 0.04935360749562581, "step_physics": 0.10384090105692544, "survival_time": 14.950000000000076, "driven_lanedir": 0.9301073223500804, "get_state_dump": 0.020474437872568765, "sim_render-ego": 0.010186238288879396, "get_robot_state": 0.024745189348856608, "get_duckie_state": 4.087289174397787e-06, "in-drivable-lane": 7.350000000000081, "agent_compute-ego": 0.05629966100056966, "deviation-heading": 1.3008329040427835, "complete-iteration": 0.31160661061604816, "set_robot_commands": 0.007907764911651611, "deviation-center-line": 0.6445759445932155, "driven_lanedir_consec": 0.9301073223500804, "sim_compute_sim_state": 0.03162786245346069, "sim_compute_performance-ego": 0.0069351712862650555}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399752793895355, "get_ui_image": 0.05045087337493896, "step_physics": 0.10382319927215576, "survival_time": 14.950000000000076, "driven_lanedir": 1.6057447482114755, "get_state_dump": 0.020218543211619058, "sim_render-ego": 0.010179444948832194, "get_robot_state": 0.02498237689336141, "get_duckie_state": 4.220008850097656e-06, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.06295750061670939, "deviation-heading": 1.0515292982604405, "complete-iteration": 0.3185870273907979, "set_robot_commands": 0.007940028508504232, "deviation-center-line": 0.7986761720545036, "driven_lanedir_consec": 1.6057447482114755, "sim_compute_sim_state": 0.03088009357452393, "sim_compute_performance-ego": 0.006924184958140055}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.3889858457462725, "get_ui_image": 0.05248211379404421, "step_physics": 0.11272803280088636, "survival_time": 10.800000000000018, "driven_lanedir": 0.565122333497687, "get_state_dump": 0.020986960993872747, "sim_render-ego": 0.010686329117527716, "get_robot_state": 0.025784114996592205, "get_duckie_state": 1.00588357007062e-05, "in-drivable-lane": 6.050000000000027, "agent_compute-ego": 0.05962195882090816, "deviation-heading": 1.0046311512987995, "complete-iteration": 0.3376761343744066, "set_robot_commands": 0.008624532708415279, "deviation-center-line": 0.2573194914625132, "driven_lanedir_consec": 0.565122333497687, "sim_compute_sim_state": 0.03867083677539119, "sim_compute_performance-ego": 0.007853265161867495}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399695274653757, "get_ui_image": 0.06259395519892375, "step_physics": 0.15382322708765667, "survival_time": 14.950000000000076, "driven_lanedir": 1.7811007749782894, "get_state_dump": 0.02166919469833374, "sim_render-ego": 0.011311203638712564, "get_robot_state": 0.03041765371958415, "get_duckie_state": 4.398822784423828e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.07083770751953125, "deviation-heading": 1.1497713597029535, "complete-iteration": 0.4242330034573873, "set_robot_commands": 0.009336880048116048, "deviation-center-line": 0.6888981834129654, "driven_lanedir_consec": 1.7811007749782894, "sim_compute_sim_state": 0.054014194011688235, "sim_compute_performance-ego": 0.010012933413187665}}
set_robot_commands_max0.009336880048116048
set_robot_commands_mean0.008452301544171793
set_robot_commands_median0.008282280608459754
set_robot_commands_min0.007907764911651611
sim_compute_performance-ego_max0.010012933413187665
sim_compute_performance-ego_mean0.007931388704865067
sim_compute_performance-ego_median0.007394218224066275
sim_compute_performance-ego_min0.006924184958140055
sim_compute_sim_state_max0.054014194011688235
sim_compute_sim_state_mean0.03879824670376601
sim_compute_sim_state_median0.03514934961442594
sim_compute_sim_state_min0.03088009357452393
sim_render-ego_max0.011311203638712564
sim_render-ego_mean0.010590803998487969
sim_render-ego_median0.010436283703203555
sim_render-ego_min0.010179444948832194
simulation-passed1
step_physics_max0.15382322708765667
step_physics_mean0.11855384005440608
step_physics_median0.1082844669289059
step_physics_min0.10382319927215576
survival_time_max14.950000000000076
survival_time_mean13.912500000000062
survival_time_min10.800000000000018
No reset possible
4202311352Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido5-LF-sim-validationLFv-simerrornoreg03-c4a430e5e868-11:01:04
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible