Duckietown Challenges Home Challenges Submissions

Submission 13578

Submission13578
Competingyes
Challengeaido-LFV_multi-sim-validation
UserMárton Tim 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105498 sim-1of4: 105499 sim-2of4: 105495 sim-3of4: 105533
Next
User label3626
Admin priority50
Blessingn/a
User priority50

105533

Click the images to see detailed statistics about the episode.

zigzag-000

challenge-solution-output

105499

Click the images to see detailed statistics about the episode.

autolab-000

challenge-solution-output

105498

Click the images to see detailed statistics about the episode.

loop2-000

challenge-solution-output

105495

Click the images to see detailed statistics about the episode.

loop-000

challenge-solution-output

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
105533sim-3of4successyes0:17:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.1749999999999328
driven_lanedir_consec_median15.7097815346452
deviation-center-line_median5.849744603000914


other stats
deviation-center-line_max9.137596083687525
deviation-center-line_mean6.240232726450769
deviation-center-line_min4.123845616113723
deviation-heading_max20.548488291265713
deviation-heading_mean13.374697745196398
deviation-heading_median15.091316655600451
deviation-heading_min2.767669378318979
distance-from-start_max3.843231876066566
distance-from-start_mean3.0620316786810493
distance-from-start_median3.5723961073684145
distance-from-start_min1.2601026239208022
driven_any_max28.67040502263789
driven_any_mean16.329983660680213
driven_any_median17.51251685399463
driven_any_min1.62449591209371
driven_lanedir_consec_max25.152999113062037
driven_lanedir_consec_mean14.521825266448843
driven_lanedir_consec_min1.5147388834429405
driven_lanedir_max25.152999113062037
driven_lanedir_mean14.521825266448843
driven_lanedir_median15.7097815346452
driven_lanedir_min1.5147388834429405
in-drivable-lane_max4.749999999999969
in-drivable-lane_mean2.2749999999999586
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 28.4540394811522, "survival_time": 59.99999999999873, "driven_lanedir": 25.051904385522995, "in-drivable-lane": 4.3499999999998655, "deviation-heading": 15.737309082184728, "distance-from-start": 3.843231876066566, "deviation-center-line": 4.2701801917132745, "driven_lanedir_consec": 25.051904385522995}, "zigzag-000-ego1": {"driven_any": 6.570994226837057, "survival_time": 59.99999999999873, "driven_lanedir": 6.367658683767406, "in-drivable-lane": 0.0, "deviation-heading": 20.548488291265713, "distance-from-start": 3.3157510312029723, "deviation-center-line": 7.429309014288555, "driven_lanedir_consec": 6.367658683767406}, "zigzag-000-ego2": {"driven_any": 28.67040502263789, "survival_time": 59.99999999999873, "driven_lanedir": 25.152999113062037, "in-drivable-lane": 4.749999999999969, "deviation-heading": 14.445324229016174, "distance-from-start": 3.8290411835338567, "deviation-center-line": 4.123845616113723, "driven_lanedir_consec": 25.152999113062037}, "zigzag-000-ego3": {"driven_any": 1.62449591209371, "survival_time": 59.99999999999873, "driven_lanedir": 1.5147388834429405, "in-drivable-lane": 0.0, "deviation-heading": 2.767669378318979, "distance-from-start": 1.2601026239208022, "deviation-center-line": 9.137596083687525, "driven_lanedir_consec": 1.5147388834429405}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105529sim-3of4host-erroryes0:01:21
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(0, experiment_idx=0, checkpoint_idx=0, logger=context)
              ||   File "/submission/model.py", line 42, in __init__
              ||     dummy_env = wrap_env(config["env_config"], extra_config={
              ||   File "/submission/duckietown_utils/env.py", line 46, in wrap_env
              ||     env = SegmentObsWrapper(env, model=extra_config['model'])
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 43, in __init__
              ||     self.model.cuda()
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(0, experiment_idx=0, checkpoint_idx=0, logger=context)
              ||   File "/submission/model.py", line 42, in __init__
              ||     dummy_env = wrap_env(config["env_config"], extra_config={
              ||   File "/submission/duckietown_utils/env.py", line 46, in wrap_env
              ||     env = SegmentObsWrapper(env, model=extra_config['model'])
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 43, in __init__
              ||     self.model.cuda()
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105526sim-3of4host-erroryes0:01:21
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(0, experiment_idx=0, checkpoint_idx=0, logger=context)
              ||   File "/submission/model.py", line 42, in __init__
              ||     dummy_env = wrap_env(config["env_config"], extra_config={
              ||   File "/submission/duckietown_utils/env.py", line 46, in wrap_env
              ||     env = SegmentObsWrapper(env, model=extra_config['model'])
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 43, in __init__
              ||     self.model.cuda()
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(0, experiment_idx=0, checkpoint_idx=0, logger=context)
              ||   File "/submission/model.py", line 42, in __init__
              ||     dummy_env = wrap_env(config["env_config"], extra_config={
              ||   File "/submission/duckietown_utils/env.py", line 46, in wrap_env
              ||     env = SegmentObsWrapper(env, model=extra_config['model'])
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 43, in __init__
              ||     self.model.cuda()
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105505sim-3of4host-erroryes0:01:09
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(0, experiment_idx=0, checkpoint_idx=0, logger=context)
              ||   File "/submission/model.py", line 42, in __init__
              ||     dummy_env = wrap_env(config["env_config"], extra_config={
              ||   File "/submission/duckietown_utils/env.py", line 46, in wrap_env
              ||     env = SegmentObsWrapper(env, model=extra_config['model'])
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 43, in __init__
              ||     self.model.cuda()
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(0, experiment_idx=0, checkpoint_idx=0, logger=context)
              ||   File "/submission/model.py", line 42, in __init__
              ||     dummy_env = wrap_env(config["env_config"], extra_config={
              ||   File "/submission/duckietown_utils/env.py", line 46, in wrap_env
              ||     env = SegmentObsWrapper(env, model=extra_config['model'])
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 43, in __init__
              ||     self.model.cuda()
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105499sim-1of4successyes0:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.25000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median2.785187775925856
deviation-center-line_median0.6725475789472162


other stats
deviation-center-line_max1.3190623729964177
deviation-center-line_mean0.7524573446365179
deviation-center-line_min0.3456718476552218
deviation-heading_max3.1253146376107788
deviation-heading_mean2.3131991051993595
deviation-heading_median2.0692994251518977
deviation-heading_min1.9888829328828657
distance-from-start_max2.7919223224704033
distance-from-start_mean2.0720661884778893
distance-from-start_median1.9458313625783643
distance-from-start_min1.6046797062844254
driven_any_max5.675177691072589
driven_any_mean3.45597788852455
driven_any_median2.837974981269711
driven_any_min2.4727839004861885
driven_lanedir_consec_max5.594358765462706
driven_lanedir_consec_mean3.2445771272526582
driven_lanedir_consec_min1.8135741916962151
driven_lanedir_max5.594358765462706
driven_lanedir_mean3.2445771272526582
driven_lanedir_median2.785187775925856
driven_lanedir_min1.8135741916962151
in-drivable-lane_max7.500000000000048
in-drivable-lane_mean1.875000000000012
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.477565646198937, "survival_time": 12.25000000000004, "driven_lanedir": 2.426221828905951, "in-drivable-lane": 0.0, "deviation-heading": 2.1019146706745513, "distance-from-start": 1.856427335146081, "deviation-center-line": 1.3190623729964177, "driven_lanedir_consec": 2.426221828905951}, "autolab-000-ego1": {"driven_any": 2.4727839004861885, "survival_time": 12.25000000000004, "driven_lanedir": 1.8135741916962151, "in-drivable-lane": 7.500000000000048, "deviation-heading": 1.9888829328828657, "distance-from-start": 2.035235390010648, "deviation-center-line": 0.3456718476552218, "driven_lanedir_consec": 1.8135741916962151}, "autolab-000-ego2": {"driven_any": 5.675177691072589, "survival_time": 12.25000000000004, "driven_lanedir": 5.594358765462706, "in-drivable-lane": 0.0, "deviation-heading": 2.0366841796292436, "distance-from-start": 2.7919223224704033, "deviation-center-line": 0.5836075257331482, "driven_lanedir_consec": 5.594358765462706}, "autolab-000-ego3": {"driven_any": 3.198384316340485, "survival_time": 12.25000000000004, "driven_lanedir": 3.1441537229457612, "in-drivable-lane": 0.0, "deviation-heading": 3.1253146376107788, "distance-from-start": 1.6046797062844254, "deviation-center-line": 0.761487632161284, "driven_lanedir_consec": 3.1441537229457612}}
simulation-passed1
survival_time_max12.25000000000004
survival_time_mean12.25000000000004
survival_time_min12.25000000000004
No reset possible
105498sim-0of4successyes0:09:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median29.489053694862584
deviation-center-line_median3.799063439111303


other stats
deviation-center-line_max3.810027047109866
deviation-center-line_mean3.799063439111303
deviation-center-line_min3.7880998311127407
deviation-heading_max10.748450938770524
deviation-heading_mean10.715375523284504
deviation-heading_median10.715375523284504
deviation-heading_min10.682300107798488
distance-from-start_max1.6208909044674764
distance-from-start_mean1.6114386587326144
distance-from-start_median1.6114386587326144
distance-from-start_min1.6019864129977524
driven_any_max30.125316473073195
driven_any_mean30.101125942504005
driven_any_median30.101125942504005
driven_any_min30.076935411934812
driven_lanedir_consec_max29.518442846195132
driven_lanedir_consec_mean29.489053694862584
driven_lanedir_consec_min29.45966454353003
driven_lanedir_max29.518442846195132
driven_lanedir_mean29.489053694862584
driven_lanedir_median29.489053694862584
driven_lanedir_min29.45966454353003
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 30.125316473073195, "survival_time": 59.99999999999873, "driven_lanedir": 29.518442846195132, "in-drivable-lane": 0.0, "deviation-heading": 10.682300107798488, "distance-from-start": 1.6019864129977524, "deviation-center-line": 3.7880998311127407, "driven_lanedir_consec": 29.518442846195132}, "loop2-000-ego1": {"driven_any": 30.076935411934812, "survival_time": 59.99999999999873, "driven_lanedir": 29.45966454353003, "in-drivable-lane": 0.0, "deviation-heading": 10.748450938770524, "distance-from-start": 1.6208909044674764, "deviation-center-line": 3.810027047109866, "driven_lanedir_consec": 29.45966454353003}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105495sim-2of4successyes0:17:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median30.3366725838766
deviation-center-line_median3.1141538558377144


other stats
deviation-center-line_max3.1482688948440383
deviation-center-line_mean3.004847325686942
deviation-center-line_min2.6428126962283014
deviation-heading_max9.373089350027598
deviation-heading_mean8.251074253994592
deviation-heading_median7.937263618476122
deviation-heading_min7.756680428998527
distance-from-start_max3.288625520258886
distance-from-start_mean2.7950186413554885
distance-from-start_median2.9200457187457536
distance-from-start_min2.0513576076715614
driven_any_max30.95822180021811
driven_any_mean30.62025827006281
driven_any_median30.825025043045905
driven_any_min29.8727611939413
driven_lanedir_consec_max30.579014649538912
driven_lanedir_consec_mean30.173450515316752
driven_lanedir_consec_min29.441442243974898
driven_lanedir_max30.579014649538912
driven_lanedir_mean30.173450515316752
driven_lanedir_median30.3366725838766
driven_lanedir_min29.441442243974898
in-drivable-lane_max0.4000000000000057
in-drivable-lane_mean0.10000000000000142
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 29.8727611939413, "survival_time": 59.99999999999873, "driven_lanedir": 29.441442243974898, "in-drivable-lane": 0.0, "deviation-heading": 9.373089350027598, "distance-from-start": 2.0513576076715614, "deviation-center-line": 2.6428126962283014, "driven_lanedir_consec": 29.441442243974898}, "loop-000-ego1": {"driven_any": 30.95572790735278, "survival_time": 59.99999999999873, "driven_lanedir": 30.379046168697055, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 7.756680428998527, "distance-from-start": 3.288625520258886, "deviation-center-line": 3.137204406941155, "driven_lanedir_consec": 30.379046168697055}, "loop-000-ego2": {"driven_any": 30.95822180021811, "survival_time": 59.99999999999873, "driven_lanedir": 30.579014649538912, "in-drivable-lane": 0.0, "deviation-heading": 7.814540517583159, "distance-from-start": 3.246392525479919, "deviation-center-line": 3.1482688948440383, "driven_lanedir_consec": 30.579014649538912}, "loop-000-ego3": {"driven_any": 30.694322178739032, "survival_time": 59.99999999999873, "driven_lanedir": 30.294298999056146, "in-drivable-lane": 0.0, "deviation-heading": 8.059986719369084, "distance-from-start": 2.5936989120115883, "deviation-center-line": 3.091103304734274, "driven_lanedir_consec": 30.294298999056146}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91393403successyes0:45:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91295402successyes1:25:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74324403successyes0:41:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74275402successyes0:56:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62347356failedyes0:02:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 90, in on_received_get_commands
              ||     pwm_left, pwm_right = self.compute_action(self.current_image)
              ||   File "solution.py", line 84, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/submission/model.py", line 71, in predict
              ||     observation = wrapper.observation(observation)
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 56, in observation
              ||     _, pred = torch.max(self.model.forward(obs_prep), 1)
              ||   File "/submission/duckietown_utils/wrappers/my_models/tiramisu.py", line 145, in forward
              ||     x = self.featureExtractor(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/tiramisu.py", line 102, in forward
              ||     out = self.denseBlocksUp[i](out)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/layers.py", line 38, in forward
              ||     out = layer(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/layers.py", line 15, in forward
              ||     return super().forward(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/batchnorm.py", line 131, in forward
              ||     return F.batch_norm(
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/functional.py", line 2056, in batch_norm
              ||     return torch.batch_norm(
              || RuntimeError: CUDA out of memory. Tried to allocate 14.00 MiB (GPU 0; 10.76 GiB total capacity; 280.34 MiB already allocated; 12.12 MiB free; 340.00 MiB reserved in total by PyTorch)
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible