Duckietown Challenges Home Challenges Submissions

Submission 12903

Submission12903
Competingyes
Challengeaido5-LF-sim-validation
UserLANG CHENG 🇭🇰
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 59847
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

59847

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59847LFv-simsuccessyes0:19:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.367191189384364
survival_time_median25.449999999999815
deviation-center-line_median0.2512982820416291
in-drivable-lane_median16.374999999999904


other stats
agent_compute-ego0_max0.012493874715722126
agent_compute-ego0_mean0.012248055703618891
agent_compute-ego0_median0.01219992907004449
agent_compute-ego0_min0.012098489958664466
complete-iteration_max0.2956006267796392
complete-iteration_mean0.25208277025752773
complete-iteration_median0.2533170776320208
complete-iteration_min0.20609629898643017
deviation-center-line_max1.3830715714669604
deviation-center-line_mean0.4858278197742272
deviation-center-line_min0.05764314354669032
deviation-heading_max13.389317867371624
deviation-heading_mean4.296392694594517
deviation-heading_median1.6695911553746707
deviation-heading_min0.4570706002571001
driven_any_max11.005520706956696
driven_any_mean5.428030706452855
driven_any_median5.22965108379707
driven_any_min0.24729995126058835
driven_lanedir_consec_max1.5534264455295554
driven_lanedir_consec_mean0.5895376430189142
driven_lanedir_consec_min0.07034174777737334
driven_lanedir_max2.247870981853152
driven_lanedir_mean0.7631487770998133
driven_lanedir_median0.367191189384364
driven_lanedir_min0.07034174777737334
get_duckie_state_max1.1962617465995134e-06
get_duckie_state_mean1.134982524056928e-06
get_duckie_state_median1.1325149062257377e-06
get_duckie_state_min1.0786385371767242e-06
get_robot_state_max0.003570369447980608
get_robot_state_mean0.0035523080269830023
get_robot_state_median0.003553332551152374
get_robot_state_min0.0035321975576466528
get_state_dump_max0.004495226818582286
get_state_dump_mean0.004427619322428423
get_state_dump_median0.004415894210132986
get_state_dump_min0.004383462050865436
get_ui_image_max0.035077991692916206
get_ui_image_mean0.03000924690264937
get_ui_image_median0.02991838841837615
get_ui_image_min0.02512221908092896
in-drivable-lane_max55.74999999999873
in-drivable-lane_mean22.412499999999635
in-drivable-lane_min1.1499999999999997
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.174680932073446, "get_ui_image": 0.02791336931501116, "step_physics": 0.17453480175563268, "survival_time": 43.699999999999655, "driven_lanedir": 2.247870981853152, "get_state_dump": 0.004416459764753069, "get_robot_state": 0.003570369447980608, "sim_render-ego0": 0.0037558108738490513, "get_duckie_state": 1.1454990931919642e-06, "in-drivable-lane": 26.849999999999827, "deviation-heading": 13.389317867371624, "agent_compute-ego0": 0.012248623984200614, "complete-iteration": 0.23929101725987023, "set_robot_commands": 0.002183499200003488, "deviation-center-line": 1.3830715714669604, "driven_lanedir_consec": 1.5534264455295554, "sim_compute_sim_state": 0.008652976717267717, "sim_compute_performance-ego0": 0.001940105983189174}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.24729995126058835, "get_ui_image": 0.035077991692916206, "step_physics": 0.22331419198409372, "survival_time": 2.25, "driven_lanedir": 0.07034174777737334, "get_state_dump": 0.004495226818582286, "get_robot_state": 0.0035482956015545387, "sim_render-ego0": 0.003747058951336404, "get_duckie_state": 1.119530719259511e-06, "in-drivable-lane": 1.1499999999999997, "deviation-heading": 0.9360279164311684, "agent_compute-ego0": 0.012493874715722126, "complete-iteration": 0.2956006267796392, "set_robot_commands": 0.0022038325019504714, "deviation-center-line": 0.05764314354669032, "driven_lanedir_consec": 0.07034174777737334, "sim_compute_sim_state": 0.008760581845822542, "sim_compute_performance-ego0": 0.0018856162610261335}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.2846212355206934, "get_ui_image": 0.031923407521741144, "step_physics": 0.1987844960442905, "survival_time": 7.199999999999982, "driven_lanedir": 0.1860533372735047, "get_state_dump": 0.004383462050865436, "get_robot_state": 0.0035321975576466528, "sim_render-ego0": 0.003607804199744915, "get_duckie_state": 1.0786385371767242e-06, "in-drivable-lane": 5.899999999999982, "deviation-heading": 0.4570706002571001, "agent_compute-ego0": 0.012098489958664466, "complete-iteration": 0.2673431380041714, "set_robot_commands": 0.0020936374006600214, "deviation-center-line": 0.07833895975969091, "driven_lanedir_consec": 0.1860533372735047, "sim_compute_sim_state": 0.008979256399746598, "sim_compute_performance-ego0": 0.0018647325449976427}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.005520706956696, "get_ui_image": 0.02512221908092896, "step_physics": 0.14698098998184905, "survival_time": 59.99999999999873, "driven_lanedir": 0.5483290414952233, "get_state_dump": 0.004415328655512902, "get_robot_state": 0.003558369500750209, "sim_render-ego0": 0.003625010967651672, "get_duckie_state": 1.1962617465995134e-06, "in-drivable-lane": 55.74999999999873, "deviation-heading": 2.403154394318173, "agent_compute-ego0": 0.012151234155888363, "complete-iteration": 0.20609629898643017, "set_robot_commands": 0.002105676760582205, "deviation-center-line": 0.4242576043235673, "driven_lanedir_consec": 0.5483290414952233, "sim_compute_sim_state": 0.006194556384757595, "sim_compute_performance-ego0": 0.0018698095183487637}}
set_robot_commands_max0.0022038325019504714
set_robot_commands_mean0.0021466614657990467
set_robot_commands_median0.0021445879802928468
set_robot_commands_min0.0020936374006600214
sim_compute_performance-ego0_max0.001940105983189174
sim_compute_performance-ego0_mean0.0018900660768904284
sim_compute_performance-ego0_median0.0018777128896874488
sim_compute_performance-ego0_min0.0018647325449976427
sim_compute_sim_state_max0.008979256399746598
sim_compute_sim_state_mean0.008146842836898613
sim_compute_sim_state_median0.008706779281545129
sim_compute_sim_state_min0.006194556384757595
sim_render-ego0_max0.0037558108738490513
sim_render-ego0_mean0.003683921248145511
sim_render-ego0_median0.0036860349594940384
sim_render-ego0_min0.003607804199744915
simulation-passed1
step_physics_max0.22331419198409372
step_physics_mean0.18590361994146648
step_physics_median0.18665964889996156
step_physics_min0.14698098998184905
survival_time_max59.99999999999873
survival_time_mean28.28749999999959
survival_time_min2.25
No reset possible
59846LFv-simhost-erroryes0:02:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible