Duckietown Challenges Home Challenges Submissions

Submission 18132

Submission18132
Competingyes
Challengeaido-LF-sim-testing
UserSampsa Ranta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 118982 sim-1of4: 118984 sim-2of4: 118983 sim-3of4: 118981
Next
User labelBug Reservoir
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
118984sim-1of4successyes0:10:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.507399992149622
survival_time_median59.99999999999873
deviation-center-line_median2.5876155309697597
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.5876155309697597
deviation-center-line_mean2.5876155309697597
deviation-center-line_min2.5876155309697597
deviation-heading_max10.599359114814886
deviation-heading_mean10.599359114814886
deviation-heading_median10.599359114814886
deviation-heading_min10.599359114814886
distance-from-start_max1.0411992421432783
distance-from-start_mean1.0411992421432783
distance-from-start_median1.0411992421432783
distance-from-start_min1.0411992421432783
driven_any_max29.211129642855244
driven_any_mean29.211129642855244
driven_any_median29.211129642855244
driven_any_min29.211129642855244
driven_lanedir_consec_max28.507399992149622
driven_lanedir_consec_mean28.507399992149622
driven_lanedir_consec_min28.507399992149622
driven_lanedir_max28.507399992149622
driven_lanedir_mean28.507399992149622
driven_lanedir_median28.507399992149622
driven_lanedir_min28.507399992149622
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 29.211129642855244, "survival_time": 59.99999999999873, "driven_lanedir": 28.507399992149622, "in-drivable-lane": 0.0, "deviation-heading": 10.599359114814886, "distance-from-start": 1.0411992421432783, "deviation-center-line": 2.5876155309697597, "driven_lanedir_consec": 28.507399992149622}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118983sim-2of4successyes0:10:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median31.09236897544927
survival_time_median59.99999999999873
deviation-center-line_median2.1446424786073304
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.1446424786073304
deviation-center-line_mean2.1446424786073304
deviation-center-line_min2.1446424786073304
deviation-heading_max6.620475942228943
deviation-heading_mean6.620475942228943
deviation-heading_median6.620475942228943
deviation-heading_min6.620475942228943
distance-from-start_max2.567254652869909
distance-from-start_mean2.567254652869909
distance-from-start_median2.567254652869909
distance-from-start_min2.567254652869909
driven_any_max31.374207493643485
driven_any_mean31.374207493643485
driven_any_median31.374207493643485
driven_any_min31.374207493643485
driven_lanedir_consec_max31.09236897544927
driven_lanedir_consec_mean31.09236897544927
driven_lanedir_consec_min31.09236897544927
driven_lanedir_max31.09236897544927
driven_lanedir_mean31.09236897544927
driven_lanedir_median31.09236897544927
driven_lanedir_min31.09236897544927
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 31.374207493643485, "survival_time": 59.99999999999873, "driven_lanedir": 31.09236897544927, "in-drivable-lane": 0.0, "deviation-heading": 6.620475942228943, "distance-from-start": 2.567254652869909, "deviation-center-line": 2.1446424786073304, "driven_lanedir_consec": 31.09236897544927}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118982sim-0of4successyes0:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.02132081857941
survival_time_median59.99999999999873
deviation-center-line_median2.616414743760292
in-drivable-lane_median0.7500000000000006


other stats
deviation-center-line_max2.616414743760292
deviation-center-line_mean2.616414743760292
deviation-center-line_min2.616414743760292
deviation-heading_max10.79689743450759
deviation-heading_mean10.79689743450759
deviation-heading_median10.79689743450759
deviation-heading_min10.79689743450759
distance-from-start_max3.303287935875339
distance-from-start_mean3.303287935875339
distance-from-start_median3.303287935875339
distance-from-start_min3.303287935875339
driven_any_max29.07831043428919
driven_any_mean29.07831043428919
driven_any_median29.07831043428919
driven_any_min29.07831043428919
driven_lanedir_consec_max28.02132081857941
driven_lanedir_consec_mean28.02132081857941
driven_lanedir_consec_min28.02132081857941
driven_lanedir_max28.02132081857941
driven_lanedir_mean28.02132081857941
driven_lanedir_median28.02132081857941
driven_lanedir_min28.02132081857941
in-drivable-lane_max0.7500000000000006
in-drivable-lane_mean0.7500000000000006
in-drivable-lane_min0.7500000000000006
per-episodes
details{"zigzag-000-ego0": {"driven_any": 29.07831043428919, "survival_time": 59.99999999999873, "driven_lanedir": 28.02132081857941, "in-drivable-lane": 0.7500000000000006, "deviation-heading": 10.79689743450759, "distance-from-start": 3.303287935875339, "deviation-center-line": 2.616414743760292, "driven_lanedir_consec": 28.02132081857941}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118981sim-3of4successyes0:10:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median30.00882067555715
survival_time_median59.99999999999873
deviation-center-line_median2.407018824881044
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.407018824881044
deviation-center-line_mean2.407018824881044
deviation-center-line_min2.407018824881044
deviation-heading_max8.398221905805356
deviation-heading_mean8.398221905805356
deviation-heading_median8.398221905805356
deviation-heading_min8.398221905805356
distance-from-start_max3.993142289144236
distance-from-start_mean3.993142289144236
distance-from-start_median3.993142289144236
distance-from-start_min3.993142289144236
driven_any_max30.47847767451986
driven_any_mean30.47847767451986
driven_any_median30.47847767451986
driven_any_min30.47847767451986
driven_lanedir_consec_max30.00882067555715
driven_lanedir_consec_mean30.00882067555715
driven_lanedir_consec_min30.00882067555715
driven_lanedir_max30.00882067555715
driven_lanedir_mean30.00882067555715
driven_lanedir_median30.00882067555715
driven_lanedir_min30.00882067555715
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 30.47847767451986, "survival_time": 59.99999999999873, "driven_lanedir": 30.00882067555715, "in-drivable-lane": 0.0, "deviation-heading": 8.398221905805356, "distance-from-start": 3.993142289144236, "deviation-center-line": 2.407018824881044, "driven_lanedir_consec": 30.00882067555715}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118980sim-3of4failedyes0:02:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 416, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 589, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/submission_ws/src/agent/src/solution.py", line 81, in on_received_get_commands
              ||     raise Exception(msg)
              || Exception: I have been waiting for commands from the ROS part since 60 s
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible