Duckietown Challenges Home Challenges Submissions

Submission 12741

Submission12741
Competingyes
Challengeaido5-LFP-sim-validation
UserThomas Wiggers 🇳🇱
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFP-sim: 59949
Next
User labelppo_v1
Admin priority50
Blessingn/a
User priority50

59949

Click the images to see detailed statistics about the episode.

LFP-norm-loop-000

LFP-norm-small_loop-000

LFP-norm-techtrack-000

LFP-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59949LFP-simsuccessyes0:21:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median36.374999999999545
in-drivable-lane_median16.274999999999714
driven_lanedir_consec_median2.055129501338393
deviation-center-line_median1.299324744636262


other stats
agent_compute-ego0_max0.023506080579457793
agent_compute-ego0_mean0.020623610788426297
agent_compute-ego0_median0.019806208519390103
agent_compute-ego0_min0.01937594553546719
complete-iteration_max0.19468738319417536
complete-iteration_mean0.1762991207682158
complete-iteration_median0.1872862645060997
complete-iteration_min0.13593657086648847
deviation-center-line_max2.248349247268523
deviation-center-line_mean1.3101559916681234
deviation-center-line_min0.3936252301314458
deviation-heading_max15.47692974907237
deviation-heading_mean8.07157674919009
deviation-heading_median7.286292370224595
deviation-heading_min2.236792507238798
driven_any_max6.33720795137238
driven_any_mean3.983631906076276
driven_any_median3.930932224260968
driven_any_min1.7354552244107868
driven_lanedir_consec_max2.6199140706800117
driven_lanedir_consec_mean2.0735244990699564
driven_lanedir_consec_min1.5639249229230288
driven_lanedir_max2.638144464610038
driven_lanedir_mean2.113489838312255
driven_lanedir_median2.1259449828579764
driven_lanedir_min1.5639249229230288
get_duckie_state_max0.02430674918862276
get_duckie_state_mean0.01659267935320468
get_duckie_state_median0.019144721662118978
get_duckie_state_min0.003774524899958011
get_robot_state_max0.0034153260463892026
get_robot_state_mean0.003284026357957527
get_robot_state_median0.003271875818256449
get_robot_state_min0.003177027748928008
get_state_dump_max0.007937174896861231
get_state_dump_mean0.006652782922802853
get_state_dump_median0.007019359927713147
get_state_dump_min0.004635236938923888
get_ui_image_max0.03346027442557329
get_ui_image_mean0.028969739750275173
get_ui_image_median0.02974470222644425
get_ui_image_min0.022929280122638913
in-drivable-lane_max29.349999999999195
in-drivable-lane_mean15.91249999999966
in-drivable-lane_min1.7500000000000249
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.4361336856453364, "get_ui_image": 0.02837679760400639, "step_physics": 0.08508333009342815, "survival_time": 17.15000000000011, "driven_lanedir": 1.8638023324811583, "get_state_dump": 0.007937174896861231, "get_robot_state": 0.0034153260463892026, "sim_render-ego0": 0.003481137891148412, "get_duckie_state": 0.02430674918862276, "in-drivable-lane": 6.3000000000000895, "deviation-heading": 2.236792507238798, "agent_compute-ego0": 0.02004582868065945, "complete-iteration": 0.18312914149705753, "set_robot_commands": 0.001890840918518776, "deviation-center-line": 0.4584180899310169, "driven_lanedir_consec": 1.862307875025896, "sim_compute_sim_state": 0.006780017947041711, "sim_compute_performance-ego0": 0.0017204859922098558}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.33720795137238, "get_ui_image": 0.03346027442557329, "step_physics": 0.09092908536861778, "survival_time": 59.99999999999873, "driven_lanedir": 2.638144464610038, "get_state_dump": 0.007026717625093103, "get_robot_state": 0.003284881553681665, "sim_render-ego0": 0.0035271142344986965, "get_duckie_state": 0.019133949359191844, "in-drivable-lane": 29.349999999999195, "deviation-heading": 12.27857696764576, "agent_compute-ego0": 0.019566588358120755, "complete-iteration": 0.1914433875151419, "set_robot_commands": 0.0018721418912762112, "deviation-center-line": 2.248349247268523, "driven_lanedir_consec": 2.6199140706800117, "sim_compute_sim_state": 0.010824779586728468, "sim_compute_performance-ego0": 0.0017326501485807116}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.425730762876601, "get_ui_image": 0.031112606848882108, "step_physics": 0.09134065151643024, "survival_time": 55.59999999999898, "driven_lanedir": 2.3880876332347944, "get_state_dump": 0.00701200223033319, "get_robot_state": 0.003258870082831233, "sim_render-ego0": 0.0034745497844932537, "get_duckie_state": 0.019155493965046105, "in-drivable-lane": 26.24999999999934, "deviation-heading": 15.47692974907237, "agent_compute-ego0": 0.023506080579457793, "complete-iteration": 0.19468738319417536, "set_robot_commands": 0.0018184326408365664, "deviation-center-line": 2.1402313993415074, "driven_lanedir_consec": 2.247951127650889, "sim_compute_sim_state": 0.012227055411668693, "sim_compute_performance-ego0": 0.0016968772953304212}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.7354552244107868, "get_ui_image": 0.022929280122638913, "step_physics": 0.07001551199425315, "survival_time": 15.300000000000082, "driven_lanedir": 1.5639249229230288, "get_state_dump": 0.004635236938923888, "get_robot_state": 0.003177027748928008, "sim_render-ego0": 0.0032948826345636324, "get_duckie_state": 0.003774524899958011, "in-drivable-lane": 1.7500000000000249, "deviation-heading": 2.2940077728034303, "agent_compute-ego0": 0.01937594553546719, "complete-iteration": 0.13593657086648847, "set_robot_commands": 0.0017832148735220346, "deviation-center-line": 0.3936252301314458, "driven_lanedir_consec": 1.5639249229230288, "sim_compute_sim_state": 0.005261453821138761, "sim_compute_performance-ego0": 0.0016095762532386407}}
set_robot_commands_max0.001890840918518776
set_robot_commands_mean0.001841157581038397
set_robot_commands_median0.0018452872660563889
set_robot_commands_min0.0017832148735220346
sim_compute_performance-ego0_max0.0017326501485807116
sim_compute_performance-ego0_mean0.0016898974223399073
sim_compute_performance-ego0_median0.0017086816437701384
sim_compute_performance-ego0_min0.0016095762532386407
sim_compute_sim_state_max0.012227055411668693
sim_compute_sim_state_mean0.008773326691644408
sim_compute_sim_state_median0.00880239876688509
sim_compute_sim_state_min0.005261453821138761
sim_render-ego0_max0.0035271142344986965
sim_render-ego0_mean0.003444421136175999
sim_render-ego0_median0.003477843837820833
sim_render-ego0_min0.0032948826345636324
simulation-passed1
step_physics_max0.09134065151643024
step_physics_mean0.08434214474318233
step_physics_median0.08800620773102297
step_physics_min0.07001551199425315
survival_time_max59.99999999999873
survival_time_mean37.01249999999948
survival_time_min15.300000000000082
No reset possible
59926LFP-simhost-erroryes0:02:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58787LFP-simsuccessno0:29:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58775LFP-simsuccessno0:43:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58768LFP-simsuccessno0:32:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible