Duckietown Challenges Home Challenges Submissions

Evaluator 2287

ID2287
evaluatorreg01-6a3e86e05a2e-1
ownerI don't have one 😀
machinearchimede
processreg01-6a3e86e05a2e-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success5 42057
# timeout
# failed5 42022
# error2 42024
# aborted
# host-error20 42122
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4242211447Diego Charrez 🇵🇪template-randomaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4241611446Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4240711442Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-6a3e86e05a2e-10:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0602181169115967
survival_time_median13.65000000000006
deviation-center-line_median0.3273201349849182
in-drivable-lane_median3.9250000000000496


other stats
agent_compute-ego_max0.07918238543305803
agent_compute-ego_mean0.0664962730652173
agent_compute-ego_median0.07467545276388116
agent_compute-ego_min0.037451801300048826
complete-iteration_max0.3581779939442994
complete-iteration_mean0.33357661839235164
complete-iteration_median0.33916002948349766
complete-iteration_min0.2978084206581116
deviation-center-line_max0.46116414367893654
deviation-center-line_mean0.3353316072428612
deviation-center-line_min0.2255220153226718
deviation-heading_max1.9448372544754056
deviation-heading_mean1.3602690085472529
deviation-heading_median1.3272319027166437
deviation-heading_min0.8417749742803187
driven_any_max3.639291235120514
driven_any_mean3.1230737782614386
driven_any_median3.0752118851775556
driven_any_min2.70258010757013
driven_lanedir_consec_max3.110432141670814
driven_lanedir_consec_mean1.9817967005027413
driven_lanedir_consec_min0.6963184265169586
driven_lanedir_max3.110432141670814
driven_lanedir_mean1.9817967005027413
driven_lanedir_median2.0602181169115967
driven_lanedir_min0.6963184265169586
get_duckie_state_max4.181495079627404e-06
get_duckie_state_mean4.013371562935329e-06
get_duckie_state_median4.031825867632478e-06
get_duckie_state_min3.808339436848958e-06
get_robot_state_max0.02647541119502141
get_robot_state_mean0.024867011264222447
get_robot_state_median0.024609424612208608
get_robot_state_min0.02377378463745117
get_state_dump_max0.022243881032534454
get_state_dump_mean0.020401803966914236
get_state_dump_median0.019955363999083868
get_state_dump_min0.019452606836954753
get_ui_image_max0.05237032810846965
get_ui_image_mean0.051407314216044615
get_ui_image_median0.05153019617765378
get_ui_image_min0.05019853640040126
in-drivable-lane_max11.100000000000064
in-drivable-lane_mean5.312500000000049
in-drivable-lane_min2.3000000000000327
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.639291235120514, "get_ui_image": 0.0509733788172404, "step_physics": 0.10643129269282024, "survival_time": 14.950000000000076, "driven_lanedir": 3.110432141670814, "get_state_dump": 0.020238142808278403, "sim_render-ego": 0.010024936993916827, "get_robot_state": 0.02460668166478475, "get_duckie_state": 3.9656956990559895e-06, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.037451801300048826, "deviation-heading": 1.6630027367582216, "complete-iteration": 0.2978084206581116, "set_robot_commands": 0.0074258510271708175, "deviation-center-line": 0.46116414367893654, "driven_lanedir_consec": 3.110432141670814, "sim_compute_sim_state": 0.03348782142003377, "sim_compute_performance-ego": 0.006936887900034587}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.70258010757013, "get_ui_image": 0.05019853640040126, "step_physics": 0.1047628461767774, "survival_time": 10.90000000000002, "driven_lanedir": 2.046143775705869, "get_state_dump": 0.01967258518988933, "sim_render-ego": 0.010025712328219631, "get_robot_state": 0.024612167559632463, "get_duckie_state": 4.097956036208966e-06, "in-drivable-lane": 3.2000000000000393, "agent_compute-ego": 0.07466520081966295, "deviation-heading": 0.9914610686750652, "complete-iteration": 0.3303490702165376, "set_robot_commands": 0.007730046543506308, "deviation-center-line": 0.298973452191055, "driven_lanedir_consec": 2.046143775705869, "sim_compute_sim_state": 0.031557787448988045, "sim_compute_performance-ego": 0.006892272091786796}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.255760111033806, "get_ui_image": 0.05237032810846965, "step_physics": 0.11881032625834148, "survival_time": 14.950000000000076, "driven_lanedir": 0.6963184265169586, "get_state_dump": 0.019452606836954753, "sim_render-ego": 0.01026269276936849, "get_robot_state": 0.02377378463745117, "get_duckie_state": 3.808339436848958e-06, "in-drivable-lane": 11.100000000000064, "agent_compute-ego": 0.07468570470809936, "deviation-heading": 1.9448372544754056, "complete-iteration": 0.3479709887504578, "set_robot_commands": 0.007306850751241048, "deviation-center-line": 0.2255220153226718, "driven_lanedir_consec": 0.6963184265169586, "sim_compute_sim_state": 0.032892308235168456, "sim_compute_performance-ego": 0.00818521499633789}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8946636593213046, "get_ui_image": 0.052087013538067155, "step_physics": 0.11390703699366768, "survival_time": 12.35000000000004, "driven_lanedir": 2.074292458117324, "get_state_dump": 0.022243881032534454, "sim_render-ego": 0.010388912942245422, "get_robot_state": 0.02647541119502141, "get_duckie_state": 4.181495079627404e-06, "in-drivable-lane": 4.65000000000006, "agent_compute-ego": 0.07918238543305803, "deviation-heading": 0.8417749742803187, "complete-iteration": 0.3581779939442994, "set_robot_commands": 0.008159434747116768, "deviation-center-line": 0.35566681777878145, "driven_lanedir_consec": 2.074292458117324, "sim_compute_sim_state": 0.03858960977932702, "sim_compute_performance-ego": 0.0068958500618876714}}
set_robot_commands_max0.008159434747116768
set_robot_commands_mean0.007655545767258735
set_robot_commands_median0.007577948785338563
set_robot_commands_min0.007306850751241048
sim_compute_performance-ego_max0.00818521499633789
sim_compute_performance-ego_mean0.007227556262511736
sim_compute_performance-ego_median0.006916368980961129
sim_compute_performance-ego_min0.006892272091786796
sim_compute_sim_state_max0.03858960977932702
sim_compute_sim_state_mean0.034131881720879324
sim_compute_sim_state_median0.03319006482760112
sim_compute_sim_state_min0.031557787448988045
sim_render-ego_max0.010388912942245422
sim_render-ego_mean0.010175563758437593
sim_render-ego_median0.01014420254879406
sim_render-ego_min0.010024936993916827
simulation-passed1
step_physics_max0.11881032625834148
step_physics_mean0.1109778755304017
step_physics_median0.11016916484324396
step_physics_min0.1047628461767774
survival_time_max14.950000000000076
survival_time_mean13.287500000000056
survival_time_min10.90000000000002
No reset possible
4237811441Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4236311440Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4233911424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4231311415Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornoreg01-6a3e86e05a2e-10:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4230811415Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornoreg01-6a3e86e05a2e-10:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4230211418Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simhost-errornoreg01-6a3e86e05a2e-10:00:20
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4230011418Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simhost-errornoreg01-6a3e86e05a2e-10:00:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4229311417Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-testingLFt-simhost-errornoreg01-6a3e86e05a2e-10:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4229011417Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-testingLFt-simhost-errornoreg01-6a3e86e05a2e-10:00:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4227911411Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sanity-sim-validationsanity-checkhost-erroryesreg01-6a3e86e05a2e-10:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4227211412Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4226611410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg01-6a3e86e05a2e-10:02:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4225611408Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg01-6a3e86e05a2e-10:02:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4225111406Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg01-6a3e86e05a2e-10:03:07
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4223311403Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg01-6a3e86e05a2e-10:02:40
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4222011399Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido5-LF-sim-validationLFv-simerrornoreg01-6a3e86e05a2e-11:01:15
Waited 3604 seconds [...]
Waited 3604 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4220811397Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simsuccessnoreg01-6a3e86e05a2e-10:16:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.426018328125322
survival_time_median14.950000000000076
deviation-center-line_median0.5672417409179057
in-drivable-lane_median3.025000000000043


other stats
agent_compute-ego_max0.1328661060333252
agent_compute-ego_mean0.07513738711675008
agent_compute-ego_median0.0701426096757253
agent_compute-ego_min0.02739822308222453
complete-iteration_max0.4104053052266438
complete-iteration_mean0.3587348061800003
complete-iteration_median0.3565253897507985
complete-iteration_min0.31148313999176025
deviation-center-line_max1.0107670645941516
deviation-center-line_mean0.5529384521885061
deviation-center-line_min0.06650326232406167
deviation-heading_max3.563911167231381
deviation-heading_mean2.0332718235297103
deviation-heading_median1.5510016686509664
deviation-heading_min1.4671727895855284
driven_any_max1.939925072532891
driven_any_mean1.938249612536675
driven_any_median1.9398208970781592
driven_any_min1.9334315834574909
driven_lanedir_consec_max1.679743197464037
driven_lanedir_consec_mean1.1572241389365363
driven_lanedir_consec_min0.0971167020314644
driven_lanedir_max1.679743197464037
driven_lanedir_mean1.163605936313048
driven_lanedir_median1.438781922878345
driven_lanedir_min0.0971167020314644
get_duckie_state_max4.281997680664063e-06
get_duckie_state_mean4.090269406636556e-06
get_duckie_state_median4.057884216308594e-06
get_duckie_state_min3.963311513264974e-06
get_robot_state_max0.024575042724609374
get_robot_state_mean0.02445320248603821
get_robot_state_median0.024501153230667115
get_robot_state_min0.02423546075820923
get_state_dump_max0.02026200612386068
get_state_dump_mean0.019791678786277772
get_state_dump_median0.01968340317408244
get_state_dump_min0.01953790267308553
get_ui_image_max0.053382476965586345
get_ui_image_mean0.05279799064000448
get_ui_image_median0.05322936018308004
get_ui_image_min0.051350765228271485
in-drivable-lane_max13.10000000000008
in-drivable-lane_mean5.225000000000048
in-drivable-lane_min1.7500000000000249
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9334315834574909, "get_ui_image": 0.05313024202982584, "step_physics": 0.12952221393585206, "survival_time": 14.950000000000076, "driven_lanedir": 1.2678194809097882, "get_state_dump": 0.02026200612386068, "sim_render-ego": 0.009806653658548992, "get_robot_state": 0.02446244955062866, "get_duckie_state": 4.11828358968099e-06, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.028157997131347656, "deviation-heading": 3.563911167231381, "complete-iteration": 0.31148313999176025, "set_robot_commands": 0.007484474182128906, "deviation-center-line": 0.7507333253753706, "driven_lanedir_consec": 1.2422922914037429, "sim_compute_sim_state": 0.03201477766036987, "sim_compute_performance-ego": 0.006419634819030762}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399099271723783, "get_ui_image": 0.053382476965586345, "step_physics": 0.134767062664032, "survival_time": 14.950000000000076, "driven_lanedir": 1.6097443648469014, "get_state_dump": 0.01953790267308553, "sim_render-ego": 0.01066673199335734, "get_robot_state": 0.024539856910705565, "get_duckie_state": 3.963311513264974e-06, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.02739822308222453, "deviation-heading": 1.4671727895855284, "complete-iteration": 0.31958542664845785, "set_robot_commands": 0.010200289090474449, "deviation-center-line": 1.0107670645941516, "driven_lanedir_consec": 1.6097443648469014, "sim_compute_sim_state": 0.03240173896153768, "sim_compute_performance-ego": 0.006473848819732666}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9397318669839407, "get_ui_image": 0.05332847833633423, "step_physics": 0.12656362215677897, "survival_time": 14.950000000000076, "driven_lanedir": 0.0971167020314644, "get_state_dump": 0.01971408287684123, "sim_render-ego": 0.011033189296722413, "get_robot_state": 0.024575042724609374, "get_duckie_state": 3.997484842936198e-06, "in-drivable-lane": 13.10000000000008, "agent_compute-ego": 0.11212722222010296, "deviation-heading": 1.566378384505677, "complete-iteration": 0.3934653528531392, "set_robot_commands": 0.007029679616292318, "deviation-center-line": 0.06650326232406167, "driven_lanedir_consec": 0.0971167020314644, "sim_compute_sim_state": 0.03243539571762085, "sim_compute_performance-ego": 0.006436831156412761}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939925072532891, "get_ui_image": 0.051350765228271485, "step_physics": 0.12264669100443522, "survival_time": 14.950000000000076, "driven_lanedir": 1.679743197464037, "get_state_dump": 0.01965272347132365, "sim_render-ego": 0.010673896471659342, "get_robot_state": 0.02423546075820923, "get_duckie_state": 4.281997680664063e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.1328661060333252, "deviation-heading": 1.5356249527962562, "complete-iteration": 0.4104053052266438, "set_robot_commands": 0.006599171161651611, "deviation-center-line": 0.3837501564604407, "driven_lanedir_consec": 1.679743197464037, "sim_compute_sim_state": 0.03558735529581706, "sim_compute_performance-ego": 0.006569323539733887}}
set_robot_commands_max0.010200289090474449
set_robot_commands_mean0.00782840351263682
set_robot_commands_median0.007257076899210612
set_robot_commands_min0.006599171161651611
sim_compute_performance-ego_max0.006569323539733887
sim_compute_performance-ego_mean0.0064749095837275195
sim_compute_performance-ego_median0.006455339988072713
sim_compute_performance-ego_min0.006419634819030762
sim_compute_sim_state_max0.03558735529581706
sim_compute_sim_state_mean0.03310981690883637
sim_compute_sim_state_median0.03241856733957926
sim_compute_sim_state_min0.03201477766036987
sim_render-ego_max0.011033189296722413
sim_render-ego_mean0.01054511785507202
sim_render-ego_median0.010670314232508344
sim_render-ego_min0.009806653658548992
simulation-passed1
step_physics_max0.134767062664032
step_physics_mean0.12837489744027455
step_physics_median0.1280429180463155
step_physics_min0.12264669100443522
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4220611396Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoreg01-6a3e86e05a2e-10:14:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9718337229538364
survival_time_median14.950000000000076
deviation-center-line_median0.5158475869051617
in-drivable-lane_median5.700000000000056


other stats
agent_compute-ego_max0.15367897351582846
agent_compute-ego_mean0.0889169184366862
agent_compute-ego_median0.08758442521095276
agent_compute-ego_min0.026819849809010823
complete-iteration_max0.46867762962977094
complete-iteration_mean0.39468616326649986
complete-iteration_median0.3882862826188406
complete-iteration_min0.33349445819854734
deviation-center-line_max0.6615410758319261
deviation-center-line_mean0.4859017021636771
deviation-center-line_min0.25037055901245886
deviation-heading_max5.965517679881405
deviation-heading_mean2.8610512424688572
deviation-heading_median1.925462106856035
deviation-heading_min1.627763076281954
driven_any_max1.939947406483088
driven_any_mean1.9381147653564463
driven_any_median1.939685943165548
driven_any_min1.933139768611603
driven_lanedir_consec_max1.79946900661154
driven_lanedir_consec_mean0.9762327848617732
driven_lanedir_consec_min0.16179468692788002
driven_lanedir_max1.79946900661154
driven_lanedir_mean0.9811770050953932
driven_lanedir_median0.9817221634210764
driven_lanedir_min0.16179468692788002
get_duckie_state_max5.049705505371094e-06
get_duckie_state_mean4.848837852478027e-06
get_duckie_state_median4.875262578328451e-06
get_duckie_state_min4.595120747884115e-06
get_robot_state_max0.025675098101298015
get_robot_state_mean0.02483317454655965
get_robot_state_median0.025247405370076494
get_robot_state_min0.023162789344787597
get_state_dump_max0.02552304983139038
get_state_dump_mean0.020855117042859396
get_state_dump_median0.019393718640009563
get_state_dump_min0.01910998106002808
get_ui_image_max0.05972540140151977
get_ui_image_mean0.057454821864763896
get_ui_image_median0.05849514206250509
get_ui_image_min0.05310360193252563
in-drivable-lane_max12.65000000000008
in-drivable-lane_mean6.20000000000005
in-drivable-lane_min0.7500000000000107
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933139768611603, "get_ui_image": 0.05733893632888794, "step_physics": 0.1481638995806376, "survival_time": 14.950000000000076, "driven_lanedir": 0.886231610583283, "get_state_dump": 0.01939555565516154, "sim_render-ego": 0.009442514578501385, "get_robot_state": 0.023162789344787597, "get_duckie_state": 4.595120747884115e-06, "in-drivable-lane": 5.450000000000032, "agent_compute-ego": 0.026819849809010823, "deviation-heading": 5.965517679881405, "complete-iteration": 0.33349445819854734, "set_robot_commands": 0.007241278489430745, "deviation-center-line": 0.6615410758319261, "driven_lanedir_consec": 0.8664547296488028, "sim_compute_sim_state": 0.035716968377431234, "sim_compute_performance-ego": 0.006008915106455485}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9397275333087365, "get_ui_image": 0.05972540140151977, "step_physics": 0.1414360809326172, "survival_time": 14.950000000000076, "driven_lanedir": 1.0772127162588698, "get_state_dump": 0.01910998106002808, "sim_render-ego": 0.010836018721262611, "get_robot_state": 0.025675098101298015, "get_duckie_state": 4.726250966389974e-06, "in-drivable-lane": 5.950000000000081, "agent_compute-ego": 0.03224873224894206, "deviation-heading": 2.0116158277654965, "complete-iteration": 0.3420615522066752, "set_robot_commands": 0.007136203447977702, "deviation-center-line": 0.6467769403837996, "driven_lanedir_consec": 1.0772127162588698, "sim_compute_sim_state": 0.03758273760477702, "sim_compute_performance-ego": 0.008112467130025228}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9396443530223593, "get_ui_image": 0.05965134779612223, "step_physics": 0.13992157061894736, "survival_time": 14.950000000000076, "driven_lanedir": 0.16179468692788002, "get_state_dump": 0.02552304983139038, "sim_render-ego": 0.011175078550974528, "get_robot_state": 0.02548834403355916, "get_duckie_state": 5.049705505371094e-06, "in-drivable-lane": 12.65000000000008, "agent_compute-ego": 0.15367897351582846, "deviation-heading": 1.627763076281954, "complete-iteration": 0.46867762962977094, "set_robot_commands": 0.008456785678863526, "deviation-center-line": 0.25037055901245886, "driven_lanedir_consec": 0.16179468692788002, "sim_compute_sim_state": 0.037809109687805174, "sim_compute_performance-ego": 0.006764857769012451}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939947406483088, "get_ui_image": 0.05310360193252563, "step_physics": 0.13088381846745809, "survival_time": 14.950000000000076, "driven_lanedir": 1.79946900661154, "get_state_dump": 0.019391881624857586, "sim_render-ego": 0.009883039792378744, "get_robot_state": 0.02500646670659383, "get_duckie_state": 5.024274190266927e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.14292011817296346, "deviation-heading": 1.8393083859465733, "complete-iteration": 0.43451101303100587, "set_robot_commands": 0.006957965691884359, "deviation-center-line": 0.38491823342652376, "driven_lanedir_consec": 1.79946900661154, "sim_compute_sim_state": 0.03968884865442912, "sim_compute_performance-ego": 0.0064628696441650394}}
set_robot_commands_max0.008456785678863526
set_robot_commands_mean0.007448058327039083
set_robot_commands_median0.0071887409687042235
set_robot_commands_min0.006957965691884359
sim_compute_performance-ego_max0.008112467130025228
sim_compute_performance-ego_mean0.006837277412414551
sim_compute_performance-ego_median0.006613863706588745
sim_compute_performance-ego_min0.006008915106455485
sim_compute_sim_state_max0.03968884865442912
sim_compute_sim_state_mean0.03769941608111064
sim_compute_sim_state_median0.037695923646291096
sim_compute_sim_state_min0.035716968377431234
sim_render-ego_max0.011175078550974528
sim_render-ego_mean0.010334162910779316
sim_render-ego_median0.01035952925682068
sim_render-ego_min0.009442514578501385
simulation-passed1
step_physics_max0.1481638995806376
step_physics_mean0.14010134239991506
step_physics_median0.14067882577578228
step_physics_min0.13088381846745809
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4213711380Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4213611380Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4213311381Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4213011381Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4212411379Martin Cote 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4212311379Martin Cote 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4212211379Martin Cote 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg01-6a3e86e05a2e-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4209611376Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simsuccessnoreg01-6a3e86e05a2e-10:19:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3395448462976602
survival_time_median14.950000000000076
deviation-center-line_median0.6238426355234261
in-drivable-lane_median2.1500000000000306


other stats
agent_compute-ego_max0.19882699092229209
agent_compute-ego_mean0.17262783606847126
agent_compute-ego_median0.18219839215278624
agent_compute-ego_min0.1272875690460205
complete-iteration_max0.589661066532135
complete-iteration_mean0.5536616124709447
complete-iteration_median0.5546837294101715
complete-iteration_min0.5156179245313008
deviation-center-line_max1.0489322274582191
deviation-center-line_mean0.6026648803573611
deviation-center-line_min0.11404202292437292
deviation-heading_max4.475674548737469
deviation-heading_mean2.546848953362197
deviation-heading_median2.063307108551624
deviation-heading_min1.5851070476080698
driven_any_max1.9399684710051217
driven_any_mean1.9382106218281436
driven_any_median1.9396883891116048
driven_any_min1.933497238084244
driven_lanedir_consec_max1.7569260334383567
driven_lanedir_consec_mean1.1405827073161214
driven_lanedir_consec_min0.12631510323080886
driven_lanedir_max1.7569260334383567
driven_lanedir_mean1.2178396320311993
driven_lanedir_median1.4940586957278157
driven_lanedir_min0.12631510323080886
get_duckie_state_max3.360112508138021e-06
get_duckie_state_mean3.3104419708251957e-06
get_duckie_state_median3.350575764973958e-06
get_duckie_state_min3.1805038452148437e-06
get_robot_state_max0.02598976771036784
get_robot_state_mean0.024207501808802285
get_robot_state_median0.024259425401687625
get_robot_state_min0.022321388721466065
get_state_dump_max0.022562216917673746
get_state_dump_mean0.02123843312263489
get_state_dump_median0.02178800622622172
get_state_dump_min0.018815503120422364
get_ui_image_max0.08218840440114339
get_ui_image_mean0.07651885986328125
get_ui_image_median0.07570422569910684
get_ui_image_min0.0724785836537679
in-drivable-lane_max12.95000000000008
in-drivable-lane_mean4.60000000000004
in-drivable-lane_min1.1500000000000163
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933497238084244, "get_ui_image": 0.08218840440114339, "step_physics": 0.18353734413782757, "survival_time": 14.950000000000076, "driven_lanedir": 1.507222194571435, "get_state_dump": 0.021597069104512538, "sim_render-ego": 0.011616516908009846, "get_robot_state": 0.02598976771036784, "get_duckie_state": 3.344217936197917e-06, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.1272875690460205, "deviation-heading": 4.475674548737469, "complete-iteration": 0.5156179245313008, "set_robot_commands": 0.009127792517344156, "deviation-center-line": 0.7911479167313853, "driven_lanedir_consec": 1.368129421050973, "sim_compute_sim_state": 0.045455909570058184, "sim_compute_performance-ego": 0.00864588975906372}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9396306426337129, "get_ui_image": 0.07420751094818115, "step_physics": 0.18237897078196208, "survival_time": 14.950000000000076, "driven_lanedir": 1.4808951968841964, "get_state_dump": 0.021978943347930907, "sim_render-ego": 0.00993343432744344, "get_robot_state": 0.02364388863245646, "get_duckie_state": 3.35693359375e-06, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.17726785580317178, "deviation-heading": 2.5283187843438624, "complete-iteration": 0.5469445220629374, "set_robot_commands": 0.008581293423970541, "deviation-center-line": 1.0489322274582191, "driven_lanedir_consec": 1.3109602715443476, "sim_compute_sim_state": 0.04250911156336466, "sim_compute_performance-ego": 0.006274082660675049}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9397461355894965, "get_ui_image": 0.07720094045003255, "step_physics": 0.1951186482111613, "survival_time": 14.950000000000076, "driven_lanedir": 0.12631510323080886, "get_state_dump": 0.022562216917673746, "sim_render-ego": 0.01398261308670044, "get_robot_state": 0.024874962170918783, "get_duckie_state": 3.360112508138021e-06, "in-drivable-lane": 12.95000000000008, "agent_compute-ego": 0.19882699092229209, "deviation-heading": 1.5851070476080698, "complete-iteration": 0.589661066532135, "set_robot_commands": 0.007883047262827556, "deviation-center-line": 0.11404202292437292, "driven_lanedir_consec": 0.12631510323080886, "sim_compute_sim_state": 0.041652436256408694, "sim_compute_performance-ego": 0.007386264006296794}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399684710051217, "get_ui_image": 0.0724785836537679, "step_physics": 0.18907042344411215, "survival_time": 14.950000000000076, "driven_lanedir": 1.7569260334383567, "get_state_dump": 0.018815503120422364, "sim_render-ego": 0.00956758419672648, "get_robot_state": 0.022321388721466065, "get_duckie_state": 3.1805038452148437e-06, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.1871289285024007, "deviation-heading": 1.598295432759386, "complete-iteration": 0.5624229367574056, "set_robot_commands": 0.008520519733428955, "deviation-center-line": 0.4565373543154669, "driven_lanedir_consec": 1.7569260334383567, "sim_compute_sim_state": 0.04860431512196859, "sim_compute_performance-ego": 0.005747203826904297}}
set_robot_commands_max0.009127792517344156
set_robot_commands_mean0.008528163234392802
set_robot_commands_median0.008550906578699748
set_robot_commands_min0.007883047262827556
sim_compute_performance-ego_max0.00864588975906372
sim_compute_performance-ego_mean0.007013360063234965
sim_compute_performance-ego_median0.006830173333485921
sim_compute_performance-ego_min0.005747203826904297
sim_compute_sim_state_max0.04860431512196859
sim_compute_sim_state_mean0.04455544312795003
sim_compute_sim_state_median0.04398251056671142
sim_compute_sim_state_min0.041652436256408694
sim_render-ego_max0.01398261308670044
sim_render-ego_mean0.01127503712972005
sim_render-ego_median0.010774975617726643
sim_render-ego_min0.00956758419672648
simulation-passed1
step_physics_max0.1951186482111613
step_physics_mean0.18752634664376577
step_physics_median0.18630388379096985
step_physics_min0.18237897078196208
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4205711364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-6a3e86e05a2e-10:13:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.030301090876261393
agent_compute-ego_mean0.02607775012652079
agent_compute-ego_median0.02495613972345988
agent_compute-ego_min0.02409763018290202
complete-iteration_max0.3204909412066142
complete-iteration_mean0.3158168399333954
complete-iteration_median0.3164383725325266
complete-iteration_min0.30989967346191405
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max3.900527954101562e-06
get_duckie_state_mean3.7801265716552735e-06
get_duckie_state_median3.828605016072591e-06
get_duckie_state_min3.562768300374349e-06
get_robot_state_max0.023387718995412192
get_robot_state_mean0.021989009380340575
get_robot_state_median0.02168902675310771
get_robot_state_min0.0211902650197347
get_state_dump_max0.01868853410085042
get_state_dump_mean0.01804085075855255
get_state_dump_median0.017982412974039713
get_state_dump_min0.017510042985280354
get_ui_image_max0.06218909978866577
get_ui_image_mean0.05895004868507385
get_ui_image_median0.05881100336710613
get_ui_image_min0.05598908821741739
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.05944589376449585, "step_physics": 0.1297144341468811, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01868853410085042, "sim_render-ego": 0.00916826089223226, "get_robot_state": 0.0211902650197347, "get_duckie_state": 3.562768300374349e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024919630686442058, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.30989967346191405, "set_robot_commands": 0.006585903167724609, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03404916763305664, "sim_compute_performance-ego": 0.005936078230539958}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.06218909978866577, "step_physics": 0.13197016557057695, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.017625002861022948, "sim_render-ego": 0.009729803403218587, "get_robot_state": 0.021889461676279705, "get_duckie_state": 3.8695335388183595e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0249926487604777, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.3139916968345642, "set_robot_commands": 0.006701176961263021, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.032434742450714114, "sim_compute_performance-ego": 0.006259388128916423}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.05817611296971639, "step_physics": 0.12956560134887696, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.01833982308705648, "sim_render-ego": 0.00996768315633138, "get_robot_state": 0.023387718995412192, "get_duckie_state": 3.787676493326823e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030301090876261393, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.3204909412066142, "set_robot_commands": 0.0069761554400126135, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.0358282216389974, "sim_compute_performance-ego": 0.007742776075998942}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.05598908821741739, "step_physics": 0.14122801621754963, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.017510042985280354, "sim_render-ego": 0.009019835789998373, "get_robot_state": 0.02148859182993571, "get_duckie_state": 3.900527954101562e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02409763018290202, "deviation-heading": 0.486072248607516, "complete-iteration": 0.3188850482304891, "set_robot_commands": 0.006705244382222493, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.03647716999053955, "sim_compute_performance-ego": 0.006164015928904216}}
set_robot_commands_max0.0069761554400126135
set_robot_commands_mean0.006742119987805684
set_robot_commands_median0.006703210671742757
set_robot_commands_min0.006585903167724609
sim_compute_performance-ego_max0.007742776075998942
sim_compute_performance-ego_mean0.006525564591089885
sim_compute_performance-ego_median0.00621170202891032
sim_compute_performance-ego_min0.005936078230539958
sim_compute_sim_state_max0.03647716999053955
sim_compute_sim_state_mean0.034697325428326924
sim_compute_sim_state_median0.034938694636027015
sim_compute_sim_state_min0.032434742450714114
sim_render-ego_max0.00996768315633138
sim_render-ego_mean0.009471395810445147
sim_render-ego_median0.009449032147725423
sim_render-ego_min0.009019835789998373
simulation-passed1
step_physics_max0.14122801621754963
step_physics_mean0.13311955432097117
step_physics_median0.13084229985872903
step_physics_min0.12956560134887696
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4202411351Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoreg01-6a3e86e05a2e-11:00:41
Waited 3601 seconds [...]
Waited 3601 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4202211354Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg01-6a3e86e05a2e-10:01:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible