Duckietown Challenges Home Challenges Submissions

Submission 11732

Submission11732
Competingyes
Challengeaido5-LF-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53967
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

53967

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53967LFv-simsuccessyes0:36:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.177284702373883
survival_time_median59.99999999999873
deviation-center-line_median2.423576015080782
in-drivable-lane_median28.02499999999893


other stats
agent_compute-ego0_max0.01326625611164687
agent_compute-ego0_mean0.013077029230989684
agent_compute-ego0_median0.013095942464696676
agent_compute-ego0_min0.01284997588291851
complete-iteration_max0.22538718097315144
complete-iteration_mean0.1992202093956572
complete-iteration_median0.19815761461345285
complete-iteration_min0.1751784273825716
deviation-center-line_max2.7503570083139097
deviation-center-line_mean2.3989775084685268
deviation-center-line_min1.998400995398633
deviation-heading_max10.533396185636208
deviation-heading_mean9.534668160030956
deviation-heading_median9.313411655274615
deviation-heading_min8.978453143938385
driven_any_max12.88012073440684
driven_any_mean12.215125694997234
driven_any_median12.126117338402516
driven_any_min11.728147368777067
driven_lanedir_consec_max8.041075166132796
driven_lanedir_consec_mean6.467409272377144
driven_lanedir_consec_min5.4739925186280125
driven_lanedir_max8.754707044731628
driven_lanedir_mean6.645817242026852
driven_lanedir_median6.177284702373883
driven_lanedir_min5.4739925186280125
get_duckie_state_max2.440763055831566e-06
get_duckie_state_mean2.157578956673882e-06
get_duckie_state_median2.1007039167799618e-06
get_duckie_state_min1.988144937304037e-06
get_robot_state_max0.004121173331382173
get_robot_state_mean0.0038131283383683098
get_robot_state_median0.003770039440888747
get_robot_state_min0.003591261140313574
get_state_dump_max0.005277578280827684
get_state_dump_mean0.004947317629233685
get_state_dump_median0.004903576753220888
get_state_dump_min0.004704538729665282
get_ui_image_max0.035835488650522856
get_ui_image_mean0.03137848250177083
get_ui_image_median0.031359656962824306
get_ui_image_min0.02695912743091186
in-drivable-lane_max30.999999999998636
in-drivable-lane_mean26.94999999999888
in-drivable-lane_min20.749999999999034
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.493700469099364, "get_ui_image": 0.028502827778545445, "step_physics": 0.11536567534733376, "survival_time": 59.99999999999873, "driven_lanedir": 8.754707044731628, "get_state_dump": 0.005277578280827684, "get_robot_state": 0.003591261140313574, "sim_render-ego0": 0.0036949279604109, "get_duckie_state": 1.988144937304037e-06, "in-drivable-lane": 20.749999999999034, "deviation-heading": 9.234979196069125, "agent_compute-ego0": 0.01326625611164687, "complete-iteration": 0.1827543921315799, "set_robot_commands": 0.002420581052146486, "deviation-center-line": 2.7503570083139097, "driven_lanedir_consec": 8.041075166132796, "sim_compute_sim_state": 0.008550314780178913, "sim_compute_performance-ego0": 0.002005660265907459}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.728147368777067, "get_ui_image": 0.035835488650522856, "step_physics": 0.14569435607980033, "survival_time": 59.99999999999873, "driven_lanedir": 5.4739925186280125, "get_state_dump": 0.004705564068517121, "get_robot_state": 0.0038118751519526377, "sim_render-ego0": 0.003922956968525069, "get_duckie_state": 2.0387667005604052e-06, "in-drivable-lane": 30.999999999998636, "deviation-heading": 10.533396185636208, "agent_compute-ego0": 0.012973913840707594, "complete-iteration": 0.22538718097315144, "set_robot_commands": 0.002313741537851656, "deviation-center-line": 2.51950402718843, "driven_lanedir_consec": 5.4739925186280125, "sim_compute_sim_state": 0.013899388460195828, "sim_compute_performance-ego0": 0.0021436847715353984}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.88012073440684, "get_ui_image": 0.03421648614710316, "step_physics": 0.13449345440987642, "survival_time": 59.99999999999873, "driven_lanedir": 6.39246162691318, "get_state_dump": 0.005101589437924654, "get_robot_state": 0.004121173331382173, "sim_render-ego0": 0.004207188640407083, "get_duckie_state": 2.440763055831566e-06, "in-drivable-lane": 28.64999999999932, "deviation-heading": 9.391844114480108, "agent_compute-ego0": 0.01321797108868576, "complete-iteration": 0.21356083709532572, "set_robot_commands": 0.002467140964822507, "deviation-center-line": 1.998400995398633, "driven_lanedir_consec": 6.39246162691318, "sim_compute_sim_state": 0.01330465659015284, "sim_compute_performance-ego0": 0.0023312006862236997}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.758534207705669, "get_ui_image": 0.02695912743091186, "step_physics": 0.11257762615130804, "survival_time": 59.99999999999873, "driven_lanedir": 5.962107777834586, "get_state_dump": 0.004704538729665282, "get_robot_state": 0.003728203729824857, "sim_render-ego0": 0.00382096106364864, "get_duckie_state": 2.1626411329995188e-06, "in-drivable-lane": 27.399999999998535, "deviation-heading": 8.978453143938385, "agent_compute-ego0": 0.01284997588291851, "complete-iteration": 0.1751784273825716, "set_robot_commands": 0.0022258804203767165, "deviation-center-line": 2.327648002973134, "driven_lanedir_consec": 5.962107777834586, "sim_compute_sim_state": 0.006221429195928137, "sim_compute_performance-ego0": 0.002004995631933411}}
set_robot_commands_max0.002467140964822507
set_robot_commands_mean0.0023568359937993413
set_robot_commands_median0.0023671612949990707
set_robot_commands_min0.0022258804203767165
sim_compute_performance-ego0_max0.0023312006862236997
sim_compute_performance-ego0_mean0.002121385338899992
sim_compute_performance-ego0_median0.0020746725187214287
sim_compute_performance-ego0_min0.002004995631933411
sim_compute_sim_state_max0.013899388460195828
sim_compute_sim_state_mean0.010493947256613928
sim_compute_sim_state_median0.010927485685165876
sim_compute_sim_state_min0.006221429195928137
sim_render-ego0_max0.004207188640407083
sim_render-ego0_mean0.003911508658247923
sim_render-ego0_median0.0038719590160868544
sim_render-ego0_min0.0036949279604109
simulation-passed1
step_physics_max0.14569435607980033
step_physics_mean0.12703277799707963
step_physics_median0.12492956487860508
step_physics_min0.11257762615130804
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
53939LFv-simhost-erroryes0:02:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53921LFv-simsuccessyes0:25:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible