Duckietown Challenges Home Challenges Submissions

Submission 11411

Submission11411
Competingyes
Challengeaido5-LF-sanity-sim-validation
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssanity-check: 42287
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

42287

Click the images to see detailed statistics about the episode.

udem1-sc0-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
42287sanity-checksuccessyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04696803281794803
survival_time_median0.49999999999999994
deviation-center-line_median0.007831575060469616
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.21336288885636764
agent_compute-ego_mean0.21336288885636764
agent_compute-ego_median0.21336288885636764
agent_compute-ego_min0.21336288885636764
complete-iteration_max0.4281805645335805
complete-iteration_mean0.4281805645335805
complete-iteration_median0.4281805645335805
complete-iteration_min0.4281805645335805
deviation-center-line_max0.007831575060469616
deviation-center-line_mean0.007831575060469616
deviation-center-line_min0.007831575060469616
deviation-heading_max0.048979333655011496
deviation-heading_mean0.048979333655011496
deviation-heading_median0.048979333655011496
deviation-heading_min0.048979333655011496
driven_any_max0.04714117300529868
driven_any_mean0.04714117300529868
driven_any_median0.04714117300529868
driven_any_min0.04714117300529868
driven_lanedir_consec_max0.04696803281794803
driven_lanedir_consec_mean0.04696803281794803
driven_lanedir_consec_min0.04696803281794803
driven_lanedir_max0.04696803281794803
driven_lanedir_mean0.04696803281794803
driven_lanedir_median0.04696803281794803
driven_lanedir_min0.04696803281794803
get_duckie_state_max0.004006385803222656
get_duckie_state_mean0.004006385803222656
get_duckie_state_median0.004006385803222656
get_duckie_state_min0.004006385803222656
get_robot_state_max0.014431628313931553
get_robot_state_mean0.014431628313931553
get_robot_state_median0.014431628313931553
get_robot_state_min0.014431628313931553
get_state_dump_max0.015084006569602272
get_state_dump_mean0.015084006569602272
get_state_dump_median0.015084006569602272
get_state_dump_min0.015084006569602272
get_ui_image_max0.0401416691866788
get_ui_image_mean0.0401416691866788
get_ui_image_median0.0401416691866788
get_ui_image_min0.0401416691866788
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.04714117300529868, "get_ui_image": 0.0401416691866788, "step_physics": 0.10175074230540884, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04696803281794803, "get_state_dump": 0.015084006569602272, "sim_render-ego": 0.006194027987393466, "get_robot_state": 0.014431628313931553, "get_duckie_state": 0.004006385803222656, "in-drivable-lane": 0.0, "agent_compute-ego": 0.21336288885636764, "deviation-heading": 0.048979333655011496, "complete-iteration": 0.4281805645335805, "set_robot_commands": 0.00490570068359375, "deviation-center-line": 0.007831575060469616, "driven_lanedir_consec": 0.04696803281794803, "sim_compute_sim_state": 0.02401224049654874, "sim_compute_performance-ego": 0.00414508039301092}}
set_robot_commands_max0.00490570068359375
set_robot_commands_mean0.00490570068359375
set_robot_commands_median0.00490570068359375
set_robot_commands_min0.00490570068359375
sim_compute_performance-ego_max0.00414508039301092
sim_compute_performance-ego_mean0.00414508039301092
sim_compute_performance-ego_median0.00414508039301092
sim_compute_performance-ego_min0.00414508039301092
sim_compute_sim_state_max0.02401224049654874
sim_compute_sim_state_mean0.02401224049654874
sim_compute_sim_state_median0.02401224049654874
sim_compute_sim_state_min0.02401224049654874
sim_render-ego_max0.006194027987393466
sim_render-ego_mean0.006194027987393466
sim_render-ego_median0.006194027987393466
sim_render-ego_min0.006194027987393466
simulation-passed1
step_physics_max0.10175074230540884
step_physics_mean0.10175074230540884
step_physics_median0.10175074230540884
step_physics_min0.10175074230540884
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
42286sanity-checksuccessyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42285sanity-checkhost-erroryes0:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42284sanity-checksuccessyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42283sanity-checksuccessyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42282sanity-checksuccessyes0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42281sanity-checkhost-erroryes0:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42280sanity-checkhost-erroryes0:00:27
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42279sanity-checkhost-erroryes0:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42278sanity-checkhost-erroryes0:00:27
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42277sanity-checkhost-erroryes0:00:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42275sanity-checksuccessyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42274sanity-checksuccessyes0:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible