Duckietown Challenges Home Challenges Submissions

Submission 9782

Submission9782
Competingyes
Challengeaido5-LF-sim-validation
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53958
Next
User labeljbr_sim2real
Admin priority60
Blessingn/a
User priority60

53958

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53958LFv-simsuccessyes0:22:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8094109977884565
survival_time_median9.074999999999996
deviation-center-line_median0.4100566928065677
in-drivable-lane_median4.350000000000005


other stats
agent_compute-ego0_max0.5094323569330675
agent_compute-ego0_mean0.4931180090533713
agent_compute-ego0_median0.49823567661501855
agent_compute-ego0_min0.4665683260503805
complete-iteration_max0.7619105413042265
complete-iteration_mean0.7174034928130639
complete-iteration_median0.7149306558176749
complete-iteration_min0.6778421183126792
deviation-center-line_max2.085843994556087
deviation-center-line_mean0.768397389686206
deviation-center-line_min0.16763217857560153
deviation-heading_max10.715939935152658
deviation-heading_mean3.7952132702878103
deviation-heading_median1.7056456725763844
deviation-heading_min1.0536218008458134
driven_any_max16.110754473891923
driven_any_mean5.9381451885515855
driven_any_median2.993548340267222
driven_any_min1.6547295997799754
driven_lanedir_consec_max6.968093017582005
driven_lanedir_consec_mean2.82146423291507
driven_lanedir_consec_min0.698941918501363
driven_lanedir_max6.968093017582005
driven_lanedir_mean2.82146423291507
driven_lanedir_median1.8094109977884565
driven_lanedir_min0.698941918501363
get_duckie_state_max1.5723294225232355e-06
get_duckie_state_mean1.384411347518783e-06
get_duckie_state_median1.3603704974416813e-06
get_duckie_state_min1.2445749726685338e-06
get_robot_state_max0.004073406087941137
get_robot_state_mean0.00387005549163992
get_robot_state_median0.0038554112875578313
get_robot_state_min0.0036959933035028807
get_state_dump_max0.004988105132662016
get_state_dump_mean0.00481597525786748
get_state_dump_median0.004846497471832644
get_state_dump_min0.004582800955142615
get_ui_image_max0.03678783877142545
get_ui_image_mean0.03324546978079625
get_ui_image_median0.034272259776973825
get_ui_image_min0.027649520797811883
in-drivable-lane_max23.79999999999938
in-drivable-lane_mean8.774999999999846
in-drivable-lane_min2.599999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.5290036421360136, "get_ui_image": 0.031763386957853745, "step_physics": 0.15290322928752714, "survival_time": 10.25000000000001, "driven_lanedir": 1.9332865247138091, "get_state_dump": 0.004952604330859138, "get_robot_state": 0.003862987444238755, "sim_render-ego0": 0.004007020042937936, "get_duckie_state": 1.393475578826608e-06, "in-drivable-lane": 5.35000000000002, "deviation-heading": 1.1554471909350217, "agent_compute-ego0": 0.507933064571862, "complete-iteration": 0.7208462421176502, "set_robot_commands": 0.002489148991779216, "deviation-center-line": 0.45119847948851266, "driven_lanedir_consec": 1.9332865247138091, "sim_compute_sim_state": 0.010771550021125276, "sim_compute_performance-ego0": 0.002068305478512662}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.45809303839843, "get_ui_image": 0.036781132596093905, "step_physics": 0.1785632124486959, "survival_time": 7.89999999999998, "driven_lanedir": 1.685535470863104, "get_state_dump": 0.004582800955142615, "get_robot_state": 0.0036959933035028807, "sim_render-ego0": 0.003848020385646221, "get_duckie_state": 1.2445749726685338e-06, "in-drivable-lane": 2.599999999999993, "deviation-heading": 2.2558441542177476, "agent_compute-ego0": 0.4665683260503805, "complete-iteration": 0.7090150695176994, "set_robot_commands": 0.002322583828332289, "deviation-center-line": 0.36891490612462274, "driven_lanedir_consec": 1.685535470863104, "sim_compute_sim_state": 0.010472551081915322, "sim_compute_performance-ego0": 0.0020936360149263586}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.6547295997799754, "get_ui_image": 0.03678783877142545, "step_physics": 0.18855621691407828, "survival_time": 5.749999999999988, "driven_lanedir": 0.698941918501363, "get_state_dump": 0.004988105132662016, "get_robot_state": 0.004073406087941137, "sim_render-ego0": 0.004088816971614443, "get_duckie_state": 1.5723294225232355e-06, "in-drivable-lane": 3.34999999999999, "deviation-heading": 1.0536218008458134, "agent_compute-ego0": 0.5094323569330675, "complete-iteration": 0.7619105413042265, "set_robot_commands": 0.002480671323578933, "deviation-center-line": 0.16763217857560153, "driven_lanedir_consec": 0.698941918501363, "sim_compute_sim_state": 0.00915230759258928, "sim_compute_performance-ego0": 0.002247666490489039}, "LF-norm-small_loop-000-ego0": {"driven_any": 16.110754473891923, "get_ui_image": 0.027649520797811883, "step_physics": 0.13793988825178044, "survival_time": 46.24999999999951, "driven_lanedir": 6.968093017582005, "get_state_dump": 0.004740390612806151, "get_robot_state": 0.003847835130876908, "sim_render-ego0": 0.003950204756553436, "get_duckie_state": 1.3272654160567545e-06, "in-drivable-lane": 23.79999999999938, "deviation-heading": 10.715939935152658, "agent_compute-ego0": 0.48853828865817506, "complete-iteration": 0.6778421183126792, "set_robot_commands": 0.002399078455651038, "deviation-center-line": 2.085843994556087, "driven_lanedir_consec": 6.968093017582005, "sim_compute_sim_state": 0.00657465751433733, "sim_compute_performance-ego0": 0.002112677751298085}}
set_robot_commands_max0.002489148991779216
set_robot_commands_mean0.0024228706498353693
set_robot_commands_median0.0024398748896149857
set_robot_commands_min0.002322583828332289
sim_compute_performance-ego0_max0.002247666490489039
sim_compute_performance-ego0_mean0.002130571433806536
sim_compute_performance-ego0_median0.0021031568831122215
sim_compute_performance-ego0_min0.002068305478512662
sim_compute_sim_state_max0.010771550021125276
sim_compute_sim_state_mean0.009242766552491802
sim_compute_sim_state_median0.0098124293372523
sim_compute_sim_state_min0.00657465751433733
sim_render-ego0_max0.004088816971614443
sim_render-ego0_mean0.003973515539188009
sim_render-ego0_median0.003978612399745686
sim_render-ego0_min0.003848020385646221
simulation-passed1
step_physics_max0.18855621691407828
step_physics_mean0.16449063672552044
step_physics_median0.16573322086811154
step_physics_min0.13793988825178044
survival_time_max46.24999999999951
survival_time_mean17.537499999999874
survival_time_min5.749999999999988
No reset possible
53936LFv-simhost-erroryes0:02:57
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53919LFv-simhost-erroryes0:03:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible