Duckietown Challenges Home Challenges Submissions

Submission 11417

Submission11417
Competingyes
Challengeaido5-LF-sim-testing
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFt-sim: 55036
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
55036LFt-simsuccessyes0:35:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.841738068163073
survival_time_median59.99999999999873
deviation-center-line_median2.750243082788165
in-drivable-lane_median1.474999999999998


other stats
agent_compute-ego0_max0.044507315117155485
agent_compute-ego0_mean0.04100089486095927
agent_compute-ego0_median0.040506427135197545
agent_compute-ego0_min0.038483410056286506
complete-iteration_max0.22434156780735243
complete-iteration_mean0.20006933825696935
complete-iteration_median0.20274533846296933
complete-iteration_min0.17044510829458626
deviation-center-line_max3.141656150136964
deviation-center-line_mean2.8046209081313633
deviation-center-line_min2.5763413168121603
deviation-heading_max16.01389255831746
deviation-heading_mean10.91089079528525
deviation-heading_median9.912508108794055
deviation-heading_min7.804654405235421
driven_any_max14.590320637943917
driven_any_mean14.590179304369176
driven_any_median14.590201634950937
driven_any_min14.58999330963091
driven_lanedir_consec_max14.376451629386544
driven_lanedir_consec_mean12.868591481147524
driven_lanedir_consec_min9.414438158877408
driven_lanedir_max14.376451629386544
driven_lanedir_mean12.912619142021784
driven_lanedir_median13.841738068163073
driven_lanedir_min9.590548802374446
get_duckie_state_max1.315173261072316e-06
get_duckie_state_mean1.2549234369613048e-06
get_duckie_state_median1.2580004461004177e-06
get_duckie_state_min1.1885195945720688e-06
get_robot_state_max0.003654352532735375
get_robot_state_mean0.003468597510970701
get_robot_state_median0.003454421283204192
get_robot_state_min0.003311194944739044
get_state_dump_max0.004522724215136678
get_state_dump_mean0.004365807865978181
get_state_dump_median0.004334946953188271
get_state_dump_min0.0042706133423995015
get_ui_image_max0.03217076401627133
get_ui_image_mean0.02868518980218409
get_ui_image_median0.029334858990430236
get_ui_image_min0.023900277211604568
in-drivable-lane_max16.349999999999522
in-drivable-lane_mean4.824999999999879
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.590320637943917, "get_ui_image": 0.026524412542656, "step_physics": 0.09265005737419033, "survival_time": 59.99999999999873, "driven_lanedir": 14.30401875520247, "get_state_dump": 0.004363202532562586, "get_robot_state": 0.003501938741272633, "sim_render-ego0": 0.003639496931128458, "get_duckie_state": 1.315173261072316e-06, "in-drivable-lane": 0.19999999999998863, "deviation-heading": 7.804654405235421, "agent_compute-ego0": 0.04088143067594174, "complete-iteration": 0.1840205383141968, "set_robot_commands": 0.002195493863286027, "deviation-center-line": 2.5763413168121603, "driven_lanedir_consec": 14.30401875520247, "sim_compute_sim_state": 0.00825106412743053, "sim_compute_performance-ego0": 0.0019249288763829215}, "LF-norm-zigzag-000-ego0": {"driven_any": 14.58999330963091, "get_ui_image": 0.03217076401627133, "step_physics": 0.12457530484608469, "survival_time": 59.99999999999873, "driven_lanedir": 9.590548802374446, "get_state_dump": 0.0042706133423995015, "get_robot_state": 0.003311194944739044, "sim_render-ego0": 0.0034809015275635985, "get_duckie_state": 1.2089668165932683e-06, "in-drivable-lane": 16.349999999999522, "deviation-heading": 16.01389255831746, "agent_compute-ego0": 0.040131423594453354, "complete-iteration": 0.22434156780735243, "set_robot_commands": 0.0020533064620679464, "deviation-center-line": 3.141656150136964, "driven_lanedir_consec": 9.414438158877408, "sim_compute_sim_state": 0.01245064759234604, "sim_compute_performance-ego0": 0.0018112532403645768}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.590208219073103, "get_ui_image": 0.03214530543820447, "step_physics": 0.11582931491556414, "survival_time": 59.99999999999873, "driven_lanedir": 13.379457381123672, "get_state_dump": 0.004522724215136678, "get_robot_state": 0.003654352532735375, "sim_render-ego0": 0.003712491330060236, "get_duckie_state": 1.3070340756075666e-06, "in-drivable-lane": 2.750000000000007, "deviation-heading": 11.218922590272136, "agent_compute-ego0": 0.044507315117155485, "complete-iteration": 0.2214701386117419, "set_robot_commands": 0.002249686148244078, "deviation-center-line": 2.7816451911429674, "driven_lanedir_consec": 13.379457381123672, "sim_compute_sim_state": 0.012813044626647289, "sim_compute_performance-ego0": 0.0019430089850509095}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.590195050828765, "get_ui_image": 0.023900277211604568, "step_physics": 0.08722734768920695, "survival_time": 59.99999999999873, "driven_lanedir": 14.376451629386544, "get_state_dump": 0.004306691373813956, "get_robot_state": 0.003406903825135751, "sim_render-ego0": 0.0034633667443217486, "get_duckie_state": 1.1885195945720688e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.60609362731598, "agent_compute-ego0": 0.038483410056286506, "complete-iteration": 0.17044510829458626, "set_robot_commands": 0.002067407303110547, "deviation-center-line": 2.718840974433362, "driven_lanedir_consec": 14.376451629386544, "sim_compute_sim_state": 0.005687621114255983, "sim_compute_performance-ego0": 0.001816255067607743}}
set_robot_commands_max0.002249686148244078
set_robot_commands_mean0.0021414734441771496
set_robot_commands_median0.002131450583198287
set_robot_commands_min0.0020533064620679464
sim_compute_performance-ego0_max0.0019430089850509095
sim_compute_performance-ego0_mean0.001873861542351538
sim_compute_performance-ego0_median0.0018705919719953323
sim_compute_performance-ego0_min0.0018112532403645768
sim_compute_sim_state_max0.012813044626647289
sim_compute_sim_state_mean0.00980059436516996
sim_compute_sim_state_median0.010350855859888285
sim_compute_sim_state_min0.005687621114255983
sim_render-ego0_max0.003712491330060236
sim_render-ego0_mean0.0035740641332685104
sim_render-ego0_median0.0035601992293460283
sim_render-ego0_min0.0034633667443217486
simulation-passed1
step_physics_max0.12457530484608469
step_physics_mean0.10507050620626152
step_physics_median0.10423968614487723
step_physics_min0.08722734768920695
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
55012LFt-simsuccessyes0:34:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54998LFt-simsuccessyes0:34:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54973LFt-simsuccessyes0:35:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42324LFt-simsuccessno0:24:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42315LFt-simhost-errorno0:00:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42314LFt-simsuccessno0:31:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42310LFt-simhost-errorno0:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42309LFt-simhost-errorno0:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42307LFt-simsuccessno0:31:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42303LFt-simhost-errorno0:00:20
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42299LFt-simhost-errorno0:00:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42295LFt-simhost-errorno0:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42293LFt-simhost-errorno0:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42292LFt-simsuccessno0:31:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42290LFt-simhost-errorno0:00:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42288LFt-simsuccessno0:24:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible