Duckietown Challenges Home Challenges Submissions

Submission 12566

Submission12566
Competingyes
Challengeaido5-LFP-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFP-sim: 59945
Next
User labelstraight
Admin priority50
Blessingn/a
User priority50

59945

Click the images to see detailed statistics about the episode.

LFP-norm-loop-000

LFP-norm-small_loop-000

LFP-norm-techtrack-000

LFP-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59945LFP-simsuccessyes0:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.150000000000013
in-drivable-lane_median7.300000000000006
driven_lanedir_consec_median0.396189716606664
deviation-center-line_median0.34364037251843715


other stats
agent_compute-ego0_max0.010332966482402473
agent_compute-ego0_mean0.009841835782725829
agent_compute-ego0_median0.01005667660684396
agent_compute-ego0_min0.008921023434812918
complete-iteration_max0.2174382588721269
complete-iteration_mean0.1926835590217177
complete-iteration_median0.20364203718180748
complete-iteration_min0.14601190285112872
deviation-center-line_max0.3752537773781193
deviation-center-line_mean0.30893750402467646
deviation-center-line_min0.17321549368371217
deviation-heading_max2.4579513197432807
deviation-heading_mean1.707777454638749
deviation-heading_median1.8301948297055497
deviation-heading_min0.7127688394006165
driven_any_max3.631434578774691
driven_any_mean1.9291437101652016
driven_any_median1.5056919599307212
driven_any_min1.0737563420246723
driven_lanedir_consec_max0.8767965189721969
driven_lanedir_consec_mean0.4753127734307908
driven_lanedir_consec_min0.2320751415376383
driven_lanedir_max0.8767965189721969
driven_lanedir_mean0.4753127734307908
driven_lanedir_median0.396189716606664
driven_lanedir_min0.2320751415376383
get_duckie_state_max0.024665895676770747
get_duckie_state_mean0.017585317605786074
get_duckie_state_median0.02092370350633324
get_duckie_state_min0.003827967733707068
get_robot_state_max0.0037089705945976287
get_robot_state_mean0.003519202852045324
get_robot_state_median0.003575164053521501
get_robot_state_min0.0032175127065406654
get_state_dump_max0.00837830834041368
get_state_dump_mean0.007006794134300018
get_state_dump_median0.007506065330600872
get_state_dump_min0.004636737535584648
get_ui_image_max0.035336123891623626
get_ui_image_mean0.030484940476502354
get_ui_image_median0.03177107480246179
get_ui_image_min0.023061488409462216
in-drivable-lane_max17.000000000000206
in-drivable-lane_mean8.95000000000005
in-drivable-lane_min4.199999999999985
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.0737563420246723, "get_ui_image": 0.030911038253481023, "step_physics": 0.12290712855509577, "survival_time": 7.499999999999981, "driven_lanedir": 0.2320751415376383, "get_state_dump": 0.00837830834041368, "get_robot_state": 0.0036436769346527703, "sim_render-ego0": 0.003921707734366916, "get_duckie_state": 0.024665895676770747, "in-drivable-lane": 5.649999999999981, "deviation-heading": 0.7127688394006165, "agent_compute-ego0": 0.010332966482402473, "complete-iteration": 0.2174382588721269, "set_robot_commands": 0.002146562993131726, "deviation-center-line": 0.17321549368371217, "driven_lanedir_consec": 0.2320751415376383, "sim_compute_sim_state": 0.008550662868070286, "sim_compute_performance-ego0": 0.0018926156277688131}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.8747843281625909, "get_ui_image": 0.035336123891623626, "step_physics": 0.1135295394912781, "survival_time": 12.40000000000004, "driven_lanedir": 0.40973817312126504, "get_state_dump": 0.007685031278066367, "get_robot_state": 0.0037089705945976287, "sim_render-ego0": 0.003862994741723241, "get_duckie_state": 0.021321727568844717, "in-drivable-lane": 8.950000000000031, "deviation-heading": 2.0468157303902648, "agent_compute-ego0": 0.0101504574817826, "complete-iteration": 0.20939217226572304, "set_robot_commands": 0.0021353284996676156, "deviation-center-line": 0.3364716145626944, "driven_lanedir_consec": 0.40973817312126504, "sim_compute_sim_state": 0.009560311175733206, "sim_compute_performance-ego0": 0.002011899488518037}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.631434578774691, "get_ui_image": 0.032631111351442546, "step_physics": 0.10504207105347604, "survival_time": 23.050000000000193, "driven_lanedir": 0.8767965189721969, "get_state_dump": 0.007327099383135379, "get_robot_state": 0.003506651172390232, "sim_render-ego0": 0.003822362784183387, "get_duckie_state": 0.02052567944382176, "in-drivable-lane": 17.000000000000206, "deviation-heading": 1.6135739290208342, "agent_compute-ego0": 0.009962895731905322, "complete-iteration": 0.19789190209789193, "set_robot_commands": 0.002022590988126152, "deviation-center-line": 0.3752537773781193, "driven_lanedir_consec": 0.8767965189721969, "sim_compute_sim_state": 0.0110596903474816, "sim_compute_performance-ego0": 0.001910014586015181}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.1365995916988514, "get_ui_image": 0.023061488409462216, "step_physics": 0.09018509792831708, "survival_time": 7.89999999999998, "driven_lanedir": 0.382641260092063, "get_state_dump": 0.004636737535584648, "get_robot_state": 0.0032175127065406654, "sim_render-ego0": 0.003358293629292422, "get_duckie_state": 0.003827967733707068, "in-drivable-lane": 4.199999999999985, "deviation-heading": 2.4579513197432807, "agent_compute-ego0": 0.008921023434812918, "complete-iteration": 0.14601190285112872, "set_robot_commands": 0.00177810327062067, "deviation-center-line": 0.35080913047417994, "driven_lanedir_consec": 0.382641260092063, "sim_compute_sim_state": 0.005307593435611365, "sim_compute_performance-ego0": 0.0016461978168607508}}
set_robot_commands_max0.002146562993131726
set_robot_commands_mean0.002020646437886541
set_robot_commands_median0.002078959743896884
set_robot_commands_min0.00177810327062067
sim_compute_performance-ego0_max0.002011899488518037
sim_compute_performance-ego0_mean0.0018651818797906956
sim_compute_performance-ego0_median0.0019013151068919972
sim_compute_performance-ego0_min0.0016461978168607508
sim_compute_sim_state_max0.0110596903474816
sim_compute_sim_state_mean0.008619564456724113
sim_compute_sim_state_median0.009055487021901744
sim_compute_sim_state_min0.005307593435611365
sim_render-ego0_max0.003921707734366916
sim_render-ego0_mean0.003741339722391491
sim_render-ego0_median0.003842678762953314
sim_render-ego0_min0.003358293629292422
simulation-passed1
step_physics_max0.12290712855509577
step_physics_mean0.10791595925704175
step_physics_median0.10928580527237708
step_physics_min0.09018509792831708
survival_time_max23.050000000000193
survival_time_mean12.712500000000048
survival_time_min7.499999999999981
No reset possible
59929LFP-simhost-erroryes0:01:54
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53457LFP-simsuccessno0:09:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53370LFP-simabortedno0:49:08
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53363LFP-simabortedno0:49:26
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53341LFP-simabortedno0:05:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible