Duckietown Challenges Home Challenges Submissions

Submission 11423

Submission11423
Competingyes
Challengeaido5-LF-sanity-sim-validation
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssanity-check: 42335
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

42335

Click the images to see detailed statistics about the episode.

udem1-sc0-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
42335sanity-checksuccessyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03789214051512469
survival_time_median0.49999999999999994
deviation-center-line_median0.008499263050673618
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01859833977439187
agent_compute-ego_mean0.01859833977439187
agent_compute-ego_median0.01859833977439187
agent_compute-ego_min0.01859833977439187
complete-iteration_max0.2362149195237593
complete-iteration_mean0.2362149195237593
complete-iteration_median0.2362149195237593
complete-iteration_min0.2362149195237593
deviation-center-line_max0.008499263050673618
deviation-center-line_mean0.008499263050673618
deviation-center-line_min0.008499263050673618
deviation-heading_max0.09372531535197506
deviation-heading_mean0.09372531535197506
deviation-heading_median0.09372531535197506
deviation-heading_min0.09372531535197506
driven_any_max0.03976613265187649
driven_any_mean0.03976613265187649
driven_any_median0.03976613265187649
driven_any_min0.03976613265187649
driven_lanedir_consec_max0.03789214051512469
driven_lanedir_consec_mean0.03789214051512469
driven_lanedir_consec_min0.03789214051512469
driven_lanedir_max0.03789214051512469
driven_lanedir_mean0.03789214051512469
driven_lanedir_median0.03789214051512469
driven_lanedir_min0.03789214051512469
get_duckie_state_max0.003950834274291992
get_duckie_state_mean0.003950834274291992
get_duckie_state_median0.003950834274291992
get_duckie_state_min0.003950834274291992
get_robot_state_max0.01321909644386985
get_robot_state_mean0.01321909644386985
get_robot_state_median0.01321909644386985
get_robot_state_min0.01321909644386985
get_state_dump_max0.014208316802978516
get_state_dump_mean0.014208316802978516
get_state_dump_median0.014208316802978516
get_state_dump_min0.014208316802978516
get_ui_image_max0.03925095904957165
get_ui_image_mean0.03925095904957165
get_ui_image_median0.03925095904957165
get_ui_image_min0.03925095904957165
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.03976613265187649, "get_ui_image": 0.03925095904957165, "step_physics": 0.10922897945750844, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03789214051512469, "get_state_dump": 0.014208316802978516, "sim_render-ego": 0.005839217792857777, "get_robot_state": 0.01321909644386985, "get_duckie_state": 0.003950834274291992, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01859833977439187, "deviation-heading": 0.09372531535197506, "complete-iteration": 0.2362149195237593, "set_robot_commands": 0.004610386761752042, "deviation-center-line": 0.008499263050673618, "driven_lanedir_consec": 0.03789214051512469, "sim_compute_sim_state": 0.023227713324806908, "sim_compute_performance-ego": 0.0039528933438387785}}
set_robot_commands_max0.004610386761752042
set_robot_commands_mean0.004610386761752042
set_robot_commands_median0.004610386761752042
set_robot_commands_min0.004610386761752042
sim_compute_performance-ego_max0.0039528933438387785
sim_compute_performance-ego_mean0.0039528933438387785
sim_compute_performance-ego_median0.0039528933438387785
sim_compute_performance-ego_min0.0039528933438387785
sim_compute_sim_state_max0.023227713324806908
sim_compute_sim_state_mean0.023227713324806908
sim_compute_sim_state_median0.023227713324806908
sim_compute_sim_state_min0.023227713324806908
sim_render-ego_max0.005839217792857777
sim_render-ego_mean0.005839217792857777
sim_render-ego_median0.005839217792857777
sim_render-ego_min0.005839217792857777
simulation-passed1
step_physics_max0.10922897945750844
step_physics_mean0.10922897945750844
step_physics_median0.10922897945750844
step_physics_min0.10922897945750844
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
42334sanity-checkhost-erroryes0:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42333sanity-checksuccessyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible