Duckietown Challenges Home Challenges Submissions

Submission 11395

Submission11395
Competingyes
Challengeaido5-LF-sim-validation
UserCharlie Gauthier 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 54679
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

54679

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
54679LFv-simsuccessyes0:12:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4953415167970959
survival_time_median3.8749999999999942
deviation-center-line_median0.10019431734994318
in-drivable-lane_median2.5999999999999948


other stats
agent_compute-ego0_max0.014946320769590304
agent_compute-ego0_mean0.013352537901220485
agent_compute-ego0_median0.012999680780703272
agent_compute-ego0_min0.01246446927388509
complete-iteration_max0.2466458838160445
complete-iteration_mean0.20512366565241705
complete-iteration_median0.19755439670953423
complete-iteration_min0.17873998537455518
deviation-center-line_max1.3347053459531408
deviation-center-line_mean0.39649251993821305
deviation-center-line_min0.050876099099825205
deviation-heading_max7.092505358170257
deviation-heading_mean2.1832773338209277
deviation-heading_median0.6958540662065884
deviation-heading_min0.24889584470027704
driven_any_max32.21451956876099
driven_any_mean9.164620243328644
driven_any_median1.53081754802698
driven_any_min1.3823263084996291
driven_lanedir_consec_max9.151844330275928
driven_lanedir_consec_mean2.6196278682405016
driven_lanedir_consec_min0.3359841090918858
driven_lanedir_max10.09337842757754
driven_lanedir_mean2.85860808999487
driven_lanedir_median0.5025349116550267
driven_lanedir_min0.3359841090918858
get_duckie_state_max1.445400228508307e-06
get_duckie_state_mean1.2927363919177495e-06
get_duckie_state_median1.3042853130557673e-06
get_duckie_state_min1.1169747130511558e-06
get_robot_state_max0.003680916253374975
get_robot_state_mean0.003590768693627593
get_robot_state_median0.003594336567855463
get_robot_state_min0.0034934853854244703
get_state_dump_max0.004948711395263672
get_state_dump_mean0.0047348230961743775
get_state_dump_median0.004759319409704144
get_state_dump_min0.004471942170025551
get_ui_image_max0.03518976525562566
get_ui_image_mean0.02927750835770463
get_ui_image_median0.02844872886129396
get_ui_image_min0.025022810452604943
in-drivable-lane_max39.1499999999992
in-drivable-lane_mean11.612499999999796
in-drivable-lane_min2.0999999999999934
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 32.21451956876099, "get_ui_image": 0.027370114608370792, "step_physics": 0.12381740335024564, "survival_time": 59.99999999999873, "driven_lanedir": 10.09337842757754, "get_state_dump": 0.004794028676816764, "get_robot_state": 0.003680916253374975, "sim_render-ego0": 0.003786533500233062, "get_duckie_state": 1.445400228508307e-06, "in-drivable-lane": 39.1499999999992, "deviation-heading": 7.092505358170257, "agent_compute-ego0": 0.014946320769590304, "complete-iteration": 0.19062347237414665, "set_robot_commands": 0.002311115360180603, "deviation-center-line": 1.3347053459531408, "driven_lanedir_consec": 9.151844330275928, "sim_compute_sim_state": 0.007780155273996523, "sim_compute_performance-ego0": 0.002043580730987726}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6253119880518745, "get_ui_image": 0.03518976525562566, "step_physics": 0.1730414570831671, "survival_time": 4.049999999999994, "driven_lanedir": 0.6188196930254084, "get_state_dump": 0.0047246101425915225, "get_robot_state": 0.0035765839786064332, "sim_render-ego0": 0.003687500953674317, "get_duckie_state": 1.3083946414110138e-06, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 1.1348402688492234, "agent_compute-ego0": 0.013315346182846442, "complete-iteration": 0.2466458838160445, "set_robot_commands": 0.002340540653321801, "deviation-center-line": 0.14647640362993186, "driven_lanedir_consec": 0.6044329033095468, "sim_compute_sim_state": 0.008849716768032166, "sim_compute_performance-ego0": 0.0018385794104599372}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.436323108002086, "get_ui_image": 0.029527343114217123, "step_physics": 0.13896303176879882, "survival_time": 3.699999999999995, "driven_lanedir": 0.38625013028464505, "get_state_dump": 0.004948711395263672, "get_robot_state": 0.003612089157104493, "sim_render-ego0": 0.003580465316772461, "get_duckie_state": 1.3001759847005208e-06, "in-drivable-lane": 2.5999999999999943, "deviation-heading": 0.25686786356395347, "agent_compute-ego0": 0.01246446927388509, "complete-iteration": 0.20448532104492187, "set_robot_commands": 0.0022316805521647135, "deviation-center-line": 0.050876099099825205, "driven_lanedir_consec": 0.38625013028464505, "sim_compute_sim_state": 0.007103430430094401, "sim_compute_performance-ego0": 0.0019622421264648437}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3823263084996291, "get_ui_image": 0.025022810452604943, "step_physics": 0.12064593132228069, "survival_time": 3.599999999999995, "driven_lanedir": 0.3359841090918858, "get_state_dump": 0.004471942170025551, "get_robot_state": 0.0034934853854244703, "sim_render-ego0": 0.003499452381917875, "get_duckie_state": 1.1169747130511558e-06, "in-drivable-lane": 2.599999999999995, "deviation-heading": 0.24889584470027704, "agent_compute-ego0": 0.012684015378560103, "complete-iteration": 0.17873998537455518, "set_robot_commands": 0.0021307631714703287, "deviation-center-line": 0.053912231069954485, "driven_lanedir_consec": 0.3359841090918858, "sim_compute_sim_state": 0.004801126375590286, "sim_compute_performance-ego0": 0.0019101312715713293}}
set_robot_commands_max0.002340540653321801
set_robot_commands_mean0.0022535249342843615
set_robot_commands_median0.002271397956172658
set_robot_commands_min0.0021307631714703287
sim_compute_performance-ego0_max0.002043580730987726
sim_compute_performance-ego0_mean0.001938633384870959
sim_compute_performance-ego0_median0.0019361866990180864
sim_compute_performance-ego0_min0.0018385794104599372
sim_compute_sim_state_max0.008849716768032166
sim_compute_sim_state_mean0.007133607211928343
sim_compute_sim_state_median0.007441792852045462
sim_compute_sim_state_min0.004801126375590286
sim_render-ego0_max0.003786533500233062
sim_render-ego0_mean0.003638488038149429
sim_render-ego0_median0.003633983135223389
sim_render-ego0_min0.003499452381917875
simulation-passed1
step_physics_max0.1730414570831671
step_physics_mean0.13911695588112305
step_physics_median0.13139021755952224
step_physics_min0.12064593132228069
survival_time_max59.99999999999873
survival_time_mean17.83749999999968
survival_time_min3.599999999999995
No reset possible
54675LFv-simsuccessyes0:11:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54671LFv-simsuccessyes0:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54664LFv-simsuccessyes0:12:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54652LFv-simhost-erroryes0:02:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible