Duckietown Challenges Home Challenges Submissions

Submission 13580

Submission13580
Competingyes
Challengeaido-LF-sim-validation
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105481 sim-1of4: 105525 sim-2of4: 105486 sim-3of4: 105494
Next
User label202-1
Admin priority50
Blessingn/a
User priority50

105525

Click the images to see detailed statistics about the episode.

autolab-000

105494

Click the images to see detailed statistics about the episode.

zigzag-000

105486

Click the images to see detailed statistics about the episode.

loop-000

105481

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
105525sim-1of4successyes0:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.03288036056119
survival_time_median59.99999999999873
deviation-center-line_median4.094298576695392
in-drivable-lane_median3.049999999999951


other stats
deviation-center-line_max4.094298576695392
deviation-center-line_mean4.094298576695392
deviation-center-line_min4.094298576695392
deviation-heading_max8.623503344397447
deviation-heading_mean8.623503344397447
deviation-heading_median8.623503344397447
deviation-heading_min8.623503344397447
distance-from-start_max3.217503978696621
distance-from-start_mean3.217503978696621
distance-from-start_median3.217503978696621
distance-from-start_min3.217503978696621
driven_any_max29.63289492962705
driven_any_mean29.63289492962705
driven_any_median29.63289492962705
driven_any_min29.63289492962705
driven_lanedir_consec_max28.03288036056119
driven_lanedir_consec_mean28.03288036056119
driven_lanedir_consec_min28.03288036056119
driven_lanedir_max28.03288036056119
driven_lanedir_mean28.03288036056119
driven_lanedir_median28.03288036056119
driven_lanedir_min28.03288036056119
in-drivable-lane_max3.049999999999951
in-drivable-lane_mean3.049999999999951
in-drivable-lane_min3.049999999999951
per-episodes
details{"autolab-000-ego0": {"driven_any": 29.63289492962705, "survival_time": 59.99999999999873, "driven_lanedir": 28.03288036056119, "in-drivable-lane": 3.049999999999951, "deviation-heading": 8.623503344397447, "distance-from-start": 3.217503978696621, "deviation-center-line": 4.094298576695392, "driven_lanedir_consec": 28.03288036056119}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105502sim-1of4host-erroryes0:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105501sim-1of4host-erroryes0:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105494sim-3of4successyes0:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median26.32601665961187
survival_time_median59.99999999999873
deviation-center-line_median4.618020348709959
in-drivable-lane_median4.249999999999897


other stats
deviation-center-line_max4.618020348709959
deviation-center-line_mean4.618020348709959
deviation-center-line_min4.618020348709959
deviation-heading_max9.371844183384402
deviation-heading_mean9.371844183384402
deviation-heading_median9.371844183384402
deviation-heading_min9.371844183384402
distance-from-start_max4.404181011344676
distance-from-start_mean4.404181011344676
distance-from-start_median4.404181011344676
distance-from-start_min4.404181011344676
driven_any_max28.43790177354407
driven_any_mean28.43790177354407
driven_any_median28.43790177354407
driven_any_min28.43790177354407
driven_lanedir_consec_max26.32601665961187
driven_lanedir_consec_mean26.32601665961187
driven_lanedir_consec_min26.32601665961187
driven_lanedir_max26.32601665961187
driven_lanedir_mean26.32601665961187
driven_lanedir_median26.32601665961187
driven_lanedir_min26.32601665961187
in-drivable-lane_max4.249999999999897
in-drivable-lane_mean4.249999999999897
in-drivable-lane_min4.249999999999897
per-episodes
details{"zigzag-000-ego0": {"driven_any": 28.43790177354407, "survival_time": 59.99999999999873, "driven_lanedir": 26.32601665961187, "in-drivable-lane": 4.249999999999897, "deviation-heading": 9.371844183384402, "distance-from-start": 4.404181011344676, "deviation-center-line": 4.618020348709959, "driven_lanedir_consec": 26.32601665961187}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105489sim-1of4successyes0:05:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105486sim-2of4successyes0:04:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.85103951719593
survival_time_median59.99999999999873
deviation-center-line_median4.332374570106843
in-drivable-lane_median1.6999999999999815


other stats
deviation-center-line_max4.332374570106843
deviation-center-line_mean4.332374570106843
deviation-center-line_min4.332374570106843
deviation-heading_max7.539740050618482
deviation-heading_mean7.539740050618482
deviation-heading_median7.539740050618482
deviation-heading_min7.539740050618482
distance-from-start_max2.5707607570804982
distance-from-start_mean2.5707607570804982
distance-from-start_median2.5707607570804982
distance-from-start_min2.5707607570804982
driven_any_max29.84018861636128
driven_any_mean29.84018861636128
driven_any_median29.84018861636128
driven_any_min29.84018861636128
driven_lanedir_consec_max28.85103951719593
driven_lanedir_consec_mean28.85103951719593
driven_lanedir_consec_min28.85103951719593
driven_lanedir_max28.85103951719593
driven_lanedir_mean28.85103951719593
driven_lanedir_median28.85103951719593
driven_lanedir_min28.85103951719593
in-drivable-lane_max1.6999999999999815
in-drivable-lane_mean1.6999999999999815
in-drivable-lane_min1.6999999999999815
per-episodes
details{"loop-000-ego0": {"driven_any": 29.84018861636128, "survival_time": 59.99999999999873, "driven_lanedir": 28.85103951719593, "in-drivable-lane": 1.6999999999999815, "deviation-heading": 7.539740050618482, "distance-from-start": 2.5707607570804982, "deviation-center-line": 4.332374570106843, "driven_lanedir_consec": 28.85103951719593}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105481sim-0of4successyes0:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median26.90119379290897
survival_time_median59.99999999999873
deviation-center-line_median3.8675878355488664
in-drivable-lane_median0.0


other stats
deviation-center-line_max3.8675878355488664
deviation-center-line_mean3.8675878355488664
deviation-center-line_min3.8675878355488664
deviation-heading_max10.065664593188066
deviation-heading_mean10.065664593188066
deviation-heading_median10.065664593188066
deviation-heading_min10.065664593188066
distance-from-start_max1.12888032185216
distance-from-start_mean1.12888032185216
distance-from-start_median1.12888032185216
distance-from-start_min1.12888032185216
driven_any_max27.47247301505451
driven_any_mean27.47247301505451
driven_any_median27.47247301505451
driven_any_min27.47247301505451
driven_lanedir_consec_max26.90119379290897
driven_lanedir_consec_mean26.90119379290897
driven_lanedir_consec_min26.90119379290897
driven_lanedir_max26.90119379290897
driven_lanedir_mean26.90119379290897
driven_lanedir_median26.90119379290897
driven_lanedir_min26.90119379290897
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 27.47247301505451, "survival_time": 59.99999999999873, "driven_lanedir": 26.90119379290897, "in-drivable-lane": 0.0, "deviation-heading": 10.065664593188066, "distance-from-start": 1.12888032185216, "deviation-center-line": 3.8675878355488664, "driven_lanedir_consec": 26.90119379290897}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
62267347successyes1:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible