Duckietown Challenges Home Challenges Submissions

Submission 11775

Submission11775
Competingyes
Challengeaido5-LF-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53780
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

53780

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53780LFv-simsuccessyes0:28:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.704895178305396
survival_time_median50.67499999999926
deviation-center-line_median1.5787990514614938
in-drivable-lane_median13.899999999999444


other stats
agent_compute-ego0_max0.013109714455074736
agent_compute-ego0_mean0.012755962695349806
agent_compute-ego0_median0.01303971390885406
agent_compute-ego0_min0.011834708508616364
complete-iteration_max0.24613679477713885
complete-iteration_mean0.21271148538199208
complete-iteration_median0.20687424909500848
complete-iteration_min0.1909606485608125
deviation-center-line_max3.565165738298228
deviation-center-line_mean1.711285915388815
deviation-center-line_min0.12237982033404415
deviation-heading_max14.13470120403198
deviation-heading_mean7.495214001566635
deviation-heading_median7.52205808366578
deviation-heading_min0.8020386349029999
driven_any_max11.731286532485685
driven_any_mean8.337513726403172
driven_any_median9.962021199860342
driven_any_min1.694725973406324
driven_lanedir_consec_max9.333171035264687
driven_lanedir_consec_mean4.8516149517581475
driven_lanedir_consec_min0.6634984151571057
driven_lanedir_max9.333171035264687
driven_lanedir_mean4.860798708099724
driven_lanedir_median4.723262690988551
driven_lanedir_min0.6634984151571057
get_duckie_state_max1.836279647534932e-06
get_duckie_state_mean1.7089379441276994e-06
get_duckie_state_median1.7291378407251268e-06
get_duckie_state_min1.541196447525612e-06
get_robot_state_max0.0042134934001498755
get_robot_state_mean0.004084858002377232
get_robot_state_median0.004087957007002005
get_robot_state_min0.003950024595355043
get_state_dump_max0.005497146977318658
get_state_dump_mean0.005315675972383929
get_state_dump_median0.005359434507467297
get_state_dump_min0.005046687897282465
get_ui_image_max0.03831279883277505
get_ui_image_mean0.03270241274020253
get_ui_image_median0.031917421047054854
get_ui_image_min0.028662010033925375
in-drivable-lane_max38.9999999999993
in-drivable-lane_mean18.212499999999547
in-drivable-lane_min6.0499999999999945
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.926808889340785, "get_ui_image": 0.028960395829774627, "step_physics": 0.1231150233706232, "survival_time": 45.39999999999956, "driven_lanedir": 6.260369135831893, "get_state_dump": 0.005046687897282465, "get_robot_state": 0.003950024595355043, "sim_render-ego0": 0.003967669406215219, "get_duckie_state": 1.541196447525612e-06, "in-drivable-lane": 16.449999999999395, "deviation-heading": 8.054382225087389, "agent_compute-ego0": 0.011834708508616364, "complete-iteration": 0.1909606485608125, "set_robot_commands": 0.002339185005498536, "deviation-center-line": 1.8161493297639932, "driven_lanedir_consec": 6.223634110465582, "sim_compute_sim_state": 0.009461471349886149, "sim_compute_performance-ego0": 0.002194162773745026}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.731286532485685, "get_ui_image": 0.03831279883277505, "step_physics": 0.16114984960182818, "survival_time": 59.99999999999873, "driven_lanedir": 9.333171035264687, "get_state_dump": 0.0054709893479930865, "get_robot_state": 0.004138849061494266, "sim_render-ego0": 0.0042198055689777565, "get_duckie_state": 1.836279647534932e-06, "in-drivable-lane": 11.349999999999492, "deviation-heading": 14.13470120403198, "agent_compute-ego0": 0.013055574089958706, "complete-iteration": 0.24613679477713885, "set_robot_commands": 0.0024287390966995074, "deviation-center-line": 3.565165738298228, "driven_lanedir_consec": 9.333171035264687, "sim_compute_sim_state": 0.014916222657291816, "sim_compute_performance-ego0": 0.0023397369051257537}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.9972335103799, "get_ui_image": 0.034874446264335085, "step_physics": 0.13752006952251708, "survival_time": 55.94999999999896, "driven_lanedir": 3.1861562461452086, "get_state_dump": 0.005247879666941507, "get_robot_state": 0.004037064952509744, "sim_render-ego0": 0.004108177764075143, "get_duckie_state": 1.666162695203509e-06, "in-drivable-lane": 38.9999999999993, "deviation-heading": 6.989733942244172, "agent_compute-ego0": 0.013023853727749416, "complete-iteration": 0.2181054745401655, "set_robot_commands": 0.002389516574995858, "deviation-center-line": 1.341448773158994, "driven_lanedir_consec": 3.1861562461452086, "sim_compute_sim_state": 0.014537738263607025, "sim_compute_performance-ego0": 0.0022614517382213047}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.694725973406324, "get_ui_image": 0.028662010033925375, "step_physics": 0.129136500093672, "survival_time": 8.949999999999992, "driven_lanedir": 0.6634984151571057, "get_state_dump": 0.005497146977318658, "get_robot_state": 0.0042134934001498755, "sim_render-ego0": 0.0042775988578796385, "get_duckie_state": 1.7921129862467448e-06, "in-drivable-lane": 6.0499999999999945, "deviation-heading": 0.8020386349029999, "agent_compute-ego0": 0.013109714455074736, "complete-iteration": 0.19564302364985148, "set_robot_commands": 0.0025352014435662163, "deviation-center-line": 0.12237982033404415, "driven_lanedir_consec": 0.6634984151571057, "sim_compute_sim_state": 0.005825771225823296, "sim_compute_performance-ego0": 0.0022811055183410644}}
set_robot_commands_max0.0025352014435662163
set_robot_commands_mean0.002423160530190029
set_robot_commands_median0.002409127835847683
set_robot_commands_min0.002339185005498536
sim_compute_performance-ego0_max0.0023397369051257537
sim_compute_performance-ego0_mean0.0022691142338582874
sim_compute_performance-ego0_median0.0022712786282811847
sim_compute_performance-ego0_min0.002194162773745026
sim_compute_sim_state_max0.014916222657291816
sim_compute_sim_state_mean0.011185300874152072
sim_compute_sim_state_median0.011999604806746588
sim_compute_sim_state_min0.005825771225823296
sim_render-ego0_max0.0042775988578796385
sim_render-ego0_mean0.00414331289928694
sim_render-ego0_median0.004163991666526449
sim_render-ego0_min0.003967669406215219
simulation-passed1
step_physics_max0.16114984960182818
step_physics_mean0.1377303606471601
step_physics_median0.13332828480809455
step_physics_min0.1231150233706232
survival_time_max59.99999999999873
survival_time_mean42.57499999999931
survival_time_min8.949999999999992
No reset possible
53777LFv-simsuccessyes0:26:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53776LFv-simsuccessyes0:21:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53763LFv-simhost-erroryes0:01:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible