Duckietown Challenges Home Challenges Submissions

Submission 11413

Submission11413
Competingyes
Challengeaido5-LFP-sim-validation
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFP-sim: 59950
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

59950

Click the images to see detailed statistics about the episode.

LFP-norm-loop-000

LFP-norm-small_loop-000

LFP-norm-techtrack-000

LFP-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59950LFP-simsuccessyes0:11:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.025
in-drivable-lane_median0.5250000000000075
driven_lanedir_consec_median1.5425060846496597
deviation-center-line_median0.3402907324174555


other stats
agent_compute-ego0_max0.04778334177457369
agent_compute-ego0_mean0.04469642320885032
agent_compute-ego0_median0.0458099797168703
agent_compute-ego0_min0.03938239162708698
complete-iteration_max0.30353711935190053
complete-iteration_mean0.24575842889637897
complete-iteration_median0.25195125518833916
complete-iteration_min0.17559408585693714
deviation-center-line_max3.9835052701742866
deviation-center-line_mean1.2336037220577882
deviation-center-line_min0.2703281532219555
deviation-heading_max15.44160972654172
deviation-heading_mean4.828005877068277
deviation-heading_median1.509696620487722
deviation-heading_min0.851020540755943
driven_any_max14.5898100863319
driven_any_mean4.633620364467578
driven_any_median1.7082199312507167
driven_any_min0.5282315090369815
driven_lanedir_consec_max11.088425839240465
driven_lanedir_consec_mean3.6663712255447503
driven_lanedir_consec_min0.4920468936392186
driven_lanedir_max11.088425839240465
driven_lanedir_mean3.6663712255447503
driven_lanedir_median1.5425060846496597
driven_lanedir_min0.4920468936392186
get_duckie_state_max0.024163384850208577
get_duckie_state_mean0.01718917804096482
get_duckie_state_median0.02033737471271119
get_duckie_state_min0.003918577888228316
get_robot_state_max0.0036551768963153544
get_robot_state_mean0.003510992524328247
get_robot_state_median0.0035746648459131503
get_robot_state_min0.003239463509171333
get_state_dump_max0.008298091017282926
get_state_dump_mean0.007098878389081326
get_state_dump_median0.007752280091760948
get_state_dump_min0.004592862355520485
get_ui_image_max0.036761148159320536
get_ui_image_mean0.03089807772883713
get_ui_image_median0.031984141349393785
get_ui_image_min0.022862880057240405
in-drivable-lane_max11.099999999999756
in-drivable-lane_mean3.037499999999943
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.276806063496427, "get_ui_image": 0.03039608781154339, "step_physics": 0.1127454535319255, "survival_time": 10.350000000000012, "driven_lanedir": 1.9665277864594513, "get_state_dump": 0.008298091017282926, "get_robot_state": 0.003628430458215567, "sim_render-ego0": 0.003657750212229215, "get_duckie_state": 0.024163384850208577, "in-drivable-lane": 1.050000000000015, "deviation-heading": 1.747008755262681, "agent_compute-ego0": 0.045045899657102734, "complete-iteration": 0.24026036721009475, "set_robot_commands": 0.002969099925114558, "deviation-center-line": 0.3724996356547582, "driven_lanedir_consec": 1.9665277864594513, "sim_compute_sim_state": 0.00739960830945235, "sim_compute_performance-ego0": 0.00184897046822768}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5282315090369815, "get_ui_image": 0.036761148159320536, "step_physics": 0.16876092690687913, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4920468936392186, "get_state_dump": 0.008085100467388447, "get_robot_state": 0.0036551768963153544, "sim_render-ego0": 0.003831771703866812, "get_duckie_state": 0.021036269114567685, "in-drivable-lane": 0.0, "deviation-heading": 1.2723844857127633, "agent_compute-ego0": 0.04778334177457369, "complete-iteration": 0.30353711935190053, "set_robot_commands": 0.002369077389056866, "deviation-center-line": 0.2703281532219555, "driven_lanedir_consec": 0.4920468936392186, "sim_compute_sim_state": 0.00913998897259052, "sim_compute_performance-ego0": 0.001999422220083383}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1396337990050067, "get_ui_image": 0.03357219488724418, "step_physics": 0.1325100442637568, "survival_time": 5.699999999999988, "driven_lanedir": 1.118484382839868, "get_state_dump": 0.007419459716133449, "get_robot_state": 0.0035208992336107337, "sim_render-ego0": 0.0037605264912480897, "get_duckie_state": 0.019638480310854703, "in-drivable-lane": 0.0, "deviation-heading": 0.851020540755943, "agent_compute-ego0": 0.046574059776637866, "complete-iteration": 0.2636421431665835, "set_robot_commands": 0.002198747966600501, "deviation-center-line": 0.3080818291801528, "driven_lanedir_consec": 1.118484382839868, "sim_compute_sim_state": 0.012498324850331182, "sim_compute_performance-ego0": 0.001849991342295771}, "LFP-norm-small_loop-000-ego0": {"driven_any": 14.5898100863319, "get_ui_image": 0.022862880057240405, "step_physics": 0.08910185768641997, "survival_time": 59.99999999999873, "driven_lanedir": 11.088425839240465, "get_state_dump": 0.004592862355520485, "get_robot_state": 0.003239463509171333, "sim_render-ego0": 0.003387085504079242, "get_duckie_state": 0.003918577888228316, "in-drivable-lane": 11.099999999999756, "deviation-heading": 15.44160972654172, "agent_compute-ego0": 0.03938239162708698, "complete-iteration": 0.17559408585693714, "set_robot_commands": 0.0019099333204893544, "deviation-center-line": 3.9835052701742866, "driven_lanedir_consec": 11.088425839240465, "sim_compute_sim_state": 0.005445211158009194, "sim_compute_performance-ego0": 0.0016695958787852976}}
set_robot_commands_max0.002969099925114558
set_robot_commands_mean0.00236171465031532
set_robot_commands_median0.0022839126778286837
set_robot_commands_min0.0019099333204893544
sim_compute_performance-ego0_max0.001999422220083383
sim_compute_performance-ego0_mean0.0018419949773480328
sim_compute_performance-ego0_median0.0018494809052617255
sim_compute_performance-ego0_min0.0016695958787852976
sim_compute_sim_state_max0.012498324850331182
sim_compute_sim_state_mean0.008620783322595811
sim_compute_sim_state_median0.008269798641021436
sim_compute_sim_state_min0.005445211158009194
sim_render-ego0_max0.003831771703866812
sim_render-ego0_mean0.0036592834778558393
sim_render-ego0_median0.003709138351738652
sim_render-ego0_min0.003387085504079242
simulation-passed1
step_physics_max0.16876092690687913
step_physics_mean0.12577957059724534
step_physics_median0.12262774889784114
step_physics_min0.08910185768641997
survival_time_max59.99999999999873
survival_time_mean19.81249999999968
survival_time_min3.1999999999999966
No reset possible
59935LFP-simhost-erroryes0:02:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55161LFP-simsuccessno0:13:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55144LFP-simsuccessno0:12:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55140LFP-simsuccessno0:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55129LFP-simsuccessno0:11:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55124LFP-simsuccessno0:12:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55119LFP-simsuccessno0:13:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55108LFP-simsuccessno0:13:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55096LFP-simsuccessno0:13:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55018LFP-simhost-errorno0:03:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55005LFP-simsuccessno0:14:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54989LFP-simsuccessno0:13:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54969LFP-simsuccessno0:15:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42296LFP-simsuccessno0:10:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42294LFP-simsuccessno0:08:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42291LFP-simsuccessno0:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42289LFP-simhost-errorno0:00:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible