Duckietown Challenges Home Challenges Submissions

Submission 11709

Submission11709
Competingyes
Challengeaido5-LF-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53982
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

53982

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53982LFv-simsuccessyes0:38:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.152574285072888
survival_time_median59.99999999999873
deviation-center-line_median3.209831100169093
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01251786952213284
agent_compute-ego0_mean0.01227313830989485
agent_compute-ego0_median0.012242413579573938
agent_compute-ego0_min0.012089856558298688
complete-iteration_max0.23163148068468536
complete-iteration_mean0.2123368391387171
complete-iteration_median0.2167906128893685
complete-iteration_min0.184134650091446
deviation-center-line_max3.485113599732615
deviation-center-line_mean3.2562383512543285
deviation-center-line_min3.1201776049465115
deviation-heading_max15.17633343624431
deviation-heading_mean14.71762537720706
deviation-heading_median14.72251396168093
deviation-heading_min14.249140149222068
driven_any_max11.84577773656118
driven_any_mean11.366083142825824
driven_any_median11.671743446161248
driven_any_min10.275067942419618
driven_lanedir_consec_max11.30964662560534
driven_lanedir_consec_mean9.775610001211
driven_lanedir_consec_min5.4876448090928935
driven_lanedir_max11.30964662560534
driven_lanedir_mean10.179713248076746
driven_lanedir_median11.152574285072888
driven_lanedir_min7.104057796555873
get_duckie_state_max2.133856208794917e-06
get_duckie_state_mean2.031123806892286e-06
get_duckie_state_median2.025366822051367e-06
get_duckie_state_min1.9399053746714977e-06
get_robot_state_max0.00394412877656935
get_robot_state_mean0.003835613433764837
get_robot_state_median0.0038508866649186184
get_robot_state_min0.0036965516286527585
get_state_dump_max0.0048402989536002715
get_state_dump_mean0.004796383184358341
get_state_dump_median0.004822594240047254
get_state_dump_min0.004700045303738584
get_ui_image_max0.03639537726314141
get_ui_image_mean0.0324649670836729
get_ui_image_median0.03298779738932029
get_ui_image_min0.027488896292909595
in-drivable-lane_max18.300000000000136
in-drivable-lane_mean4.575000000000034
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.84577773656118, "get_ui_image": 0.03065891249987803, "step_physics": 0.1319818117537169, "survival_time": 59.99999999999873, "driven_lanedir": 11.30964662560534, "get_state_dump": 0.0048402989536002715, "get_robot_state": 0.003913707677569616, "sim_render-ego0": 0.0040108161008328225, "get_duckie_state": 2.133856208794917e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.17633343624431, "agent_compute-ego0": 0.012217900834413094, "complete-iteration": 0.20228631113292175, "set_robot_commands": 0.0024229360559798597, "deviation-center-line": 3.2978902454996963, "driven_lanedir_consec": 11.30964662560534, "sim_compute_sim_state": 0.00995576471015873, "sim_compute_performance-ego0": 0.0021936450770852173}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.520821052303615, "get_ui_image": 0.03639537726314141, "step_physics": 0.15209132765453126, "survival_time": 59.99999999999873, "driven_lanedir": 11.00413932267178, "get_state_dump": 0.004700045303738584, "get_robot_state": 0.0036965516286527585, "sim_render-ego0": 0.003841001723430039, "get_duckie_state": 1.972660633249148e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.8577103475529, "agent_compute-ego0": 0.012089856558298688, "complete-iteration": 0.23129491464581517, "set_robot_commands": 0.00223262542292637, "deviation-center-line": 3.485113599732615, "driven_lanedir_consec": 11.00413932267178, "sim_compute_sim_state": 0.014095135473589615, "sim_compute_performance-ego0": 0.0020676056213124803}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.822665840018878, "get_ui_image": 0.03531668227876255, "step_physics": 0.15323420607180122, "survival_time": 59.99999999999873, "driven_lanedir": 11.301009247473996, "get_state_dump": 0.0048095368028778914, "get_robot_state": 0.00394412877656935, "sim_render-ego0": 0.004001942403509059, "get_duckie_state": 1.9399053746714977e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.587317575808958, "agent_compute-ego0": 0.01251786952213284, "complete-iteration": 0.23163148068468536, "set_robot_commands": 0.00242214496685603, "deviation-center-line": 3.1201776049465115, "driven_lanedir_consec": 11.301009247473996, "sim_compute_sim_state": 0.013057160635574177, "sim_compute_performance-ego0": 0.002240404896096921}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.275067942419618, "get_ui_image": 0.027488896292909595, "step_physics": 0.120961639108904, "survival_time": 59.99999999999873, "driven_lanedir": 7.104057796555873, "get_state_dump": 0.004835651677216618, "get_robot_state": 0.003788065652267621, "sim_render-ego0": 0.003870146359928839, "get_duckie_state": 2.078073010853586e-06, "in-drivable-lane": 18.300000000000136, "deviation-heading": 14.249140149222068, "agent_compute-ego0": 0.01226692632473478, "complete-iteration": 0.184134650091446, "set_robot_commands": 0.0022721020605641538, "deviation-center-line": 3.121771954838489, "driven_lanedir_consec": 5.4876448090928935, "sim_compute_sim_state": 0.006539291982150495, "sim_compute_performance-ego0": 0.002026621646229969}}
set_robot_commands_max0.0024229360559798597
set_robot_commands_mean0.0023374521265816036
set_robot_commands_median0.002347123513710092
set_robot_commands_min0.00223262542292637
sim_compute_performance-ego0_max0.002240404896096921
sim_compute_performance-ego0_mean0.0021320693101811467
sim_compute_performance-ego0_median0.002130625349198849
sim_compute_performance-ego0_min0.002026621646229969
sim_compute_sim_state_max0.014095135473589615
sim_compute_sim_state_mean0.010911838200368252
sim_compute_sim_state_median0.011506462672866452
sim_compute_sim_state_min0.006539291982150495
sim_render-ego0_max0.0040108161008328225
sim_render-ego0_mean0.003930976646925191
sim_render-ego0_median0.0039360443817189495
sim_render-ego0_min0.003841001723430039
simulation-passed1
step_physics_max0.15323420607180122
step_physics_mean0.13956724614723834
step_physics_median0.1420365697041241
step_physics_min0.120961639108904
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
53979LFv-simsuccessyes0:32:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53922LFv-simhost-erroryes0:03:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible