Duckietown Challenges Home Challenges Submissions

Submission 12667

Submission12667
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53514
Next
User labeltemplate-tensorflow
Admin priority50
Blessingn/a
User priority50

53514

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53514LFVIv-simsuccessyes0:10:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3721517665539752
survival_time_median5.424999999999988
deviation-center-line_median0.09548428682411264
in-drivable-lane_median3.62499999999999


other stats
agent_compute-ego0_max0.03285019771725524
agent_compute-ego0_mean0.02363023262278047
agent_compute-ego0_median0.02363023262278047
agent_compute-ego0_min0.014410267528305706
agent_compute-ego1_max0.032014596695993464
agent_compute-ego1_mean0.02260902219827958
agent_compute-ego1_median0.02260902219827958
agent_compute-ego1_min0.013203447700565698
agent_compute-ego2_max0.03265450982486501
agent_compute-ego2_mean0.022568831196857375
agent_compute-ego2_median0.022568831196857375
agent_compute-ego2_min0.012483152568849742
agent_compute-ego3_max0.03222562518774295
agent_compute-ego3_mean0.022496738015496592
agent_compute-ego3_median0.022496738015496592
agent_compute-ego3_min0.01276785084325024
complete-iteration_max1.2176630426855648
complete-iteration_mean1.1744221821389886
complete-iteration_median1.1744221821389886
complete-iteration_min1.1311813215924125
deviation-center-line_max0.6258409130040247
deviation-center-line_mean0.22433979719424776
deviation-center-line_min0.05756082847674367
deviation-heading_max5.270201864598124
deviation-heading_mean1.7315069097414828
deviation-heading_median0.7512152569353552
deviation-heading_min0.34358688111894314
driven_any_max2.1839742128085904
driven_any_mean1.1668923509082014
driven_any_median1.1479286131534017
driven_any_min0.4606387027326224
driven_lanedir_consec_max0.730850681995064
driven_lanedir_consec_mean0.4050792857218991
driven_lanedir_consec_min0.22014418177313175
driven_lanedir_max0.730850681995064
driven_lanedir_mean0.4050796016579647
driven_lanedir_median0.3721517665539752
driven_lanedir_min0.22014418177313175
get_duckie_state_max1.276240629308364e-06
get_duckie_state_mean1.243336707758148e-06
get_duckie_state_median1.243336707758148e-06
get_duckie_state_min1.2104327862079326e-06
get_robot_state_max0.01408553824705236
get_robot_state_mean0.014069970286989284
get_robot_state_median0.014069970286989284
get_robot_state_min0.014054402326926207
get_state_dump_max0.009497390073888442
get_state_dump_mean0.009464201884032374
get_state_dump_median0.009464201884032374
get_state_dump_min0.009431013694176309
get_ui_image_max0.05553125112484663
get_ui_image_mean0.0538073448214236
get_ui_image_median0.0538073448214236
get_ui_image_min0.05208343851800058
in-drivable-lane_max4.749999999999988
in-drivable-lane_mean2.9499999999999913
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 0.5630315041845138, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.5242244189001424, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.270201864598124, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.6095654258201965, "driven_lanedir_consec": 0.5242218914116172, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.232581973984518, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.730850681995064, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 0.8949418333547714, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.1755020443632793, "driven_lanedir_consec": 0.730850681995064, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.063275252322285, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.22014418177313175, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 4.749999999999988, "deviation-heading": 0.4874511691212228, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.06782155010157959, "driven_lanedir_consec": 0.22014418177313175, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.1839742128085904, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.3240172326356263, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 4.149999999999989, "deviation-heading": 1.0468198240301587, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.11043863735377496, "driven_lanedir_consec": 0.3240172326356263, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.2518433490362342, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.43965205373223615, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 3.549999999999989, "deviation-heading": 0.4009304626878723, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.06745904213993315, "driven_lanedir_consec": 0.43965205373223615, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.746074895348089, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.2989175009036211, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 3.9499999999999895, "deviation-heading": 0.34358688111894314, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.05756082847674367, "driven_lanedir_consec": 0.2989175009036211, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.4606387027326224, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.42028630047232407, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.800634562504832, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.6258409130040247, "driven_lanedir_consec": 0.42028630047232407, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.8337189168487602, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.282544442851572, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 3.6999999999999895, "deviation-heading": 0.6074886805159389, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.08052993629445032, "driven_lanedir_consec": 0.282544442851572, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}}
set_robot_commands_max0.0022225192948883655
set_robot_commands_mean0.0021802745553463052
set_robot_commands_median0.0021802745553463052
set_robot_commands_min0.002138029815804245
sim_compute_performance-ego0_max0.0020007783291386624
sim_compute_performance-ego0_mean0.0019768630217642806
sim_compute_performance-ego0_median0.0019768630217642806
sim_compute_performance-ego0_min0.0019529477143898988
sim_compute_performance-ego1_max0.001963729532355936
sim_compute_performance-ego1_mean0.0019555849427251495
sim_compute_performance-ego1_median0.0019555849427251495
sim_compute_performance-ego1_min0.0019474403530943627
sim_compute_performance-ego2_max0.0019789957532695694
sim_compute_performance-ego2_mean0.0019661490194398355
sim_compute_performance-ego2_median0.0019661490194398355
sim_compute_performance-ego2_min0.001953302285610101
sim_compute_performance-ego3_max0.00195921168607824
sim_compute_performance-ego3_mean0.0019503362577964816
sim_compute_performance-ego3_median0.0019503362577964816
sim_compute_performance-ego3_min0.0019414608295147235
sim_compute_sim_state_max0.027434379446740244
sim_compute_sim_state_mean0.02658502659406897
sim_compute_sim_state_median0.02658502659406897
sim_compute_sim_state_min0.025735673741397697
sim_render-ego0_max0.003933185186141577
sim_render-ego0_mean0.003855528065521792
sim_render-ego0_median0.003855528065521792
sim_render-ego0_min0.0037778709449020086
sim_render-ego1_max0.003789033645238632
sim_render-ego1_mean0.003766226552730232
sim_render-ego1_median0.003766226552730232
sim_render-ego1_min0.003743419460221833
sim_render-ego2_max0.0037763399236342486
sim_render-ego2_mean0.0036915232632974094
sim_render-ego2_median0.0036915232632974094
sim_render-ego2_min0.0036067066029605702
sim_render-ego3_max0.003712275448967429
sim_render-ego3_mean0.003674592907072732
sim_render-ego3_median0.003674592907072732
sim_render-ego3_min0.0036369103651780342
simulation-passed1
step_physics_max0.9527349214927824
step_physics_mean0.947232144900217
step_physics_median0.947232144900217
step_physics_min0.9417293683076516
survival_time_max5.799999999999987
survival_time_mean5.424999999999988
survival_time_min5.04999999999999
No reset possible
53509LFVIv-simhost-erroryes0:03:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible