Duckietown Challenges Home Challenges Submissions

Submission 18047

Submission18047
Competingyes
Challengeaido-LF-sim-testing
UserSampsa Ranta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 118623 sim-1of4: 118622 sim-2of4: 118624 sim-3of4: 118625
Next
User labelQuack²: Oh Quack Là Là
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
118625sim-3of4successyes0:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median29.470222096257924
survival_time_median59.99999999999873
deviation-center-line_median1.2803519541103283
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.2803519541103283
deviation-center-line_mean1.2803519541103283
deviation-center-line_min1.2803519541103283
deviation-heading_max4.576036841942041
deviation-heading_mean4.576036841942041
deviation-heading_median4.576036841942041
deviation-heading_min4.576036841942041
distance-from-start_max2.545461298085882
distance-from-start_mean2.545461298085882
distance-from-start_median2.545461298085882
distance-from-start_min2.545461298085882
driven_any_max29.63861911478574
driven_any_mean29.63861911478574
driven_any_median29.63861911478574
driven_any_min29.63861911478574
driven_lanedir_consec_max29.470222096257924
driven_lanedir_consec_mean29.470222096257924
driven_lanedir_consec_min29.470222096257924
driven_lanedir_max29.470222096257924
driven_lanedir_mean29.470222096257924
driven_lanedir_median29.470222096257924
driven_lanedir_min29.470222096257924
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 29.63861911478574, "survival_time": 59.99999999999873, "driven_lanedir": 29.470222096257924, "in-drivable-lane": 0.0, "deviation-heading": 4.576036841942041, "distance-from-start": 2.545461298085882, "deviation-center-line": 1.2803519541103283, "driven_lanedir_consec": 29.470222096257924}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118624sim-2of4successyes0:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.794165750555937
survival_time_median59.99999999999873
deviation-center-line_median1.4998684851096424
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.4998684851096424
deviation-center-line_mean1.4998684851096424
deviation-center-line_min1.4998684851096424
deviation-heading_max6.242813260357718
deviation-heading_mean6.242813260357718
deviation-heading_median6.242813260357718
deviation-heading_min6.242813260357718
distance-from-start_max3.9656978766089663
distance-from-start_mean3.9656978766089663
distance-from-start_median3.9656978766089663
distance-from-start_min3.9656978766089663
driven_any_max29.074185927416167
driven_any_mean29.074185927416167
driven_any_median29.074185927416167
driven_any_min29.074185927416167
driven_lanedir_consec_max28.794165750555937
driven_lanedir_consec_mean28.794165750555937
driven_lanedir_consec_min28.794165750555937
driven_lanedir_max28.794165750555937
driven_lanedir_mean28.794165750555937
driven_lanedir_median28.794165750555937
driven_lanedir_min28.794165750555937
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 29.074185927416167, "survival_time": 59.99999999999873, "driven_lanedir": 28.794165750555937, "in-drivable-lane": 0.0, "deviation-heading": 6.242813260357718, "distance-from-start": 3.9656978766089663, "deviation-center-line": 1.4998684851096424, "driven_lanedir_consec": 28.794165750555937}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118623sim-0of4successyes0:06:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.563265235056456
survival_time_median59.99999999999873
deviation-center-line_median2.3823526670875017
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.3823526670875017
deviation-center-line_mean2.3823526670875017
deviation-center-line_min2.3823526670875017
deviation-heading_max11.122484118412642
deviation-heading_mean11.122484118412642
deviation-heading_median11.122484118412642
deviation-heading_min11.122484118412642
distance-from-start_max1.0562066991231462
distance-from-start_mean1.0562066991231462
distance-from-start_median1.0562066991231462
distance-from-start_min1.0562066991231462
driven_any_max28.19461809024989
driven_any_mean28.19461809024989
driven_any_median28.19461809024989
driven_any_min28.19461809024989
driven_lanedir_consec_max27.563265235056456
driven_lanedir_consec_mean27.563265235056456
driven_lanedir_consec_min27.563265235056456
driven_lanedir_max27.563265235056456
driven_lanedir_mean27.563265235056456
driven_lanedir_median27.563265235056456
driven_lanedir_min27.563265235056456
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 28.19461809024989, "survival_time": 59.99999999999873, "driven_lanedir": 27.563265235056456, "in-drivable-lane": 0.0, "deviation-heading": 11.122484118412642, "distance-from-start": 1.0562066991231462, "deviation-center-line": 2.3823526670875017, "driven_lanedir_consec": 27.563265235056456}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118622sim-1of4successyes0:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median25.694721471318367
survival_time_median59.99999999999873
deviation-center-line_median1.702273187673801
in-drivable-lane_median4.149999999999989


other stats
deviation-center-line_max1.702273187673801
deviation-center-line_mean1.702273187673801
deviation-center-line_min1.702273187673801
deviation-heading_max9.022192322146957
deviation-heading_mean9.022192322146957
deviation-heading_median9.022192322146957
deviation-heading_min9.022192322146957
distance-from-start_max3.2860974729275214
distance-from-start_mean3.2860974729275214
distance-from-start_median3.2860974729275214
distance-from-start_min3.2860974729275214
driven_any_max28.34793476490969
driven_any_mean28.34793476490969
driven_any_median28.34793476490969
driven_any_min28.34793476490969
driven_lanedir_consec_max25.694721471318367
driven_lanedir_consec_mean25.694721471318367
driven_lanedir_consec_min25.694721471318367
driven_lanedir_max25.694721471318367
driven_lanedir_mean25.694721471318367
driven_lanedir_median25.694721471318367
driven_lanedir_min25.694721471318367
in-drivable-lane_max4.149999999999989
in-drivable-lane_mean4.149999999999989
in-drivable-lane_min4.149999999999989
per-episodes
details{"zigzag-000-ego0": {"driven_any": 28.34793476490969, "survival_time": 59.99999999999873, "driven_lanedir": 25.694721471318367, "in-drivable-lane": 4.149999999999989, "deviation-heading": 9.022192322146957, "distance-from-start": 3.2860974729275214, "deviation-center-line": 1.702273187673801, "driven_lanedir_consec": 25.694721471318367}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
118621sim-3of4failedyes0:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 416, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 589, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/submission_ws/src/agent/src/solution.py", line 81, in on_received_get_commands
              ||     raise Exception(msg)
              || Exception: I have been waiting for commands from the ROS part since 60 s
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible